Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainties”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Defining Computational Emissivity Uncertainty Over Large Temperature Scales Due to Surface Evolution

There is a dearth in the literature on how to capture the uncertainty generated by material surface evolution in thermal modeling. This leads to inadequate or highly variable uncertainty representations for material properties, specifically emissivity when minimal information is available. Inaccurate understandings of prediction uncertainties may lead decision makers to incorrect conclusions, so best engineering practices should be developed for this domain. In order to mitigate the aforementioned issues, this study explores different strategies to better capture the thermal uncertainty response of engineered systems exposed to fire environments via defensible emissivity uncertainty characterizations that can be easily adapted to a variety of use cases. Here, two unique formulations (one physics-informed and one mathematically based) are presented. The formulations and methodologies presented herein are not exhaustive but more so are a starting point and give the reader a basis for how to customize their uncertainty definitions for differing fire scenarios and materials. Lastly, the impact of using this approach versus other commonly used strategies and the usefulness of adding rigor to material surface evolution uncertainty is demonstrated.

97 MATHEMATICS AND COMPUTING↗

Uncertainty in Annual Energy Resulting from Uncertain Irradiance Measurements

We report an analysis quantifying the contribution to uncertainty in annual energy projections from uncertainty in ground-measured irradiance. Uncertainty in measured irradiance is quantified for eight instruments by the difference from a well maintained, secondary standard pyranometer which is regarded as truthful. We construct a statistical model of irradiance uncertainty and apply the model to generate a sample of 100 annual time series of irradiance for each instrument. The sample is propagated through a common performance model for a reference photovoltaic system to quantify variation in annual energy. Although the measured irradiance varies from the reference by a few percent (standard deviation of 1-2%) the uncertainty in annual energy is on the order of a fraction of one percent. We propose a model for a factor that represents uncertainty in modeled annual energy that arises from uncertainty in ground-measured irradiance.

14 SOLAR ENERGY↗

Uncertainties in ab initio nuclear structure calculations with chiral interactions

We present theoretical ground state energies and their uncertainties for p -shell nuclei obtained from chiral effective field theory internucleon interactions as a function of chiral order, fitted to two- and three-body data only. We apply a Similary Renormalization Group transformation to improve the numerical convergence of the many-body calculations, and discuss both the numerical uncertainties arising from basis truncations and those from omitted induced many-body forces, as well as chiral truncation uncertainties. With complete Next-to-Next-to-Leading (N 2 LO) order two- and three-body interactions, we find significant overbinding for the ground states in the upper p -shell, but using higher-order two-body potentials, in combination with N 2 LO three-body forces, our predictions agree with experiment throughout the p -shell to within our combined estimated uncertainties. The uncertainties due to chiral order truncation are noticeably larger than the numerical uncertainties, but they are expected to become comparable to the numerical uncertainties at complete N 3 LO.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Wake steering optimization under uncertainty

Turbines in wind power plants experience significant power losses when wakes from upstream turbines affect the energy production of downstream turbines. A promising plant-level control strategy to reduce these losses is wake steering, where upstream turbines are yawed to direct wakes away from downstream turbines. However, there are significant uncertainties in many aspects of the wake steering problem. For example, infield sensors do not give perfect information, and inflow to the plant is complex and difficult to forecast with available information, even over short time periods. Here, we formulate and solve an optimization under uncertainty (OUU) problem for determining optimal plant-level wake steering strategies in the presence of independent uncertainties in the direction, speed, turbulence intensity, and shear of the incoming wind, as well as in turbine yaw positions. The OUU wake steering strategy is first examined for a two-turbine test case to explore the impacts of different types of inflow uncertainties, and it is then demonstrated for a more realistic 11-turbine wind power plant. Of the sources of uncertainty considered, we find that wake steering strategies are most sensitive to uncertainties in the wind speed and direction. When maximizing expected power production, the OUU strategy also tends to favor smaller yaw angles, which have been shown in previous work to reduce turbine loading. Ultimately, the plant-level wake steering strategy formulated using an OUU approach yields 0.48?% more expected annual energy production for the 11-turbine wind plant than a strategy that neglects uncertainty when considering stochastic inputs. Thus, not only does the present OUU strategy produce more power in realistic conditions, but it also reduces risk by prescribing strategies that call for less extreme yaw angles.

17 WIND ENERGY↗

Long-term uncertainty quantification in WRF-modeled offshore wind resource off the US Atlantic coast

Uncertainty quantification of long-term modeled wind speed is essential to ensure stakeholders can best leverage wind resource numerical data sets. Offshore, this need is even stronger given the limited availability of observations of wind speed at heights relevant for wind energy purposes and the resulting heavier relative weight of numerical data sets for wind energy planning and operational projects. In this analysis, we consider the National Renewable Energy Laboratory's 21-year updated numerical offshore data set for the US East Coast and provide a methodological framework to leverage both floating lidar and near-surface buoy observations in the region to quantify uncertainty in the modeled hub-height wind resource. We first show how using a numerical ensemble to quantify the uncertainty in modeled wind speed is insufficient to fully capture the model deviation from real-world observations. Next, we train and validate a random forest to vertically extrapolate near-surface wind speed to hub height using the available short-term lidar data sets in the region. We then apply this model to vertically extrapolate the long-term near-surface buoy wind speed observations to hub height so that they can be directly compared to the long-term numerical data set. We find that the mean 21-year uncertainty in 140 m hourly average wind speed is slightly lower than 3 m s -1 (roughly 30m% of the mean observed wind speed) across the considered region. Atmospheric stability is strictly connected to the modeled wind speed uncertainty, with stable conditions associated with an uncertainty which is, on average, about 20 % larger than the overall mean uncertainty.

17 WIND ENERGY↗

Remaining Useful Life Estimation in Prognosis: An Uncertainty Propagation Problem

The estimation of remaining useful life is significant in the context of prognostics and health monitoring, and the prediction of remaining useful life is essential for online operations and decision-making. However, it is challenging to accurately predict the remaining useful life in practical aerospace applications due to the presence of various uncertainties that affect prognostic calculations, and in turn, render the remaining useful life prediction uncertain. It is challenging to identify and characterize the various sources of uncertainty in prognosis, understand how each of these sources of uncertainty affect the uncertainty in the remaining useful life prediction, and thereby compute the overall uncertainty in the remaining useful life prediction. In order to achieve these goals, this paper proposes that the task of estimating the remaining useful life must be approached as an uncertainty propagation problem. In this context, uncertainty propagation methods which are available in the literature are reviewed, and their applicability to prognostics and health monitoring are discussed.

Uncertainty Quantification↗

Uncertainty Quantification of a Rotorcraft Conceptual Sizing Toolsuite

A computational framework to support the quantification of system uncertainties and sensitivities for rotorcraft applications is presented using the NASA Design and Analysis of Rotorcraft (NDARC) conceptual sizing tool. A 90 passenger conceptual tiltrotor configuration was used for case demonstration in the modeling of uncertainties in NDARCs emission module. A non-intrusive forward propagation uncertainty quantification approach was applied to ensemble simulations using a Monte Carlo methodology with stratified Latin hypercube sampling. An off-the-shelf software, DAKOTA, which supports trade studies and design space exploration, including optimization, surrogate modeling and uncertainty analysis was used to address the research goals. A toolsuite was further developed incorporating DAKOTA with automated design processes and methods using function wrappers to execute program routines including support for data post-processing. Uncertainties in rotorcraft emissions modeling using the Average Temperature Response metric for a set mission profile were studied. It was shown that for the current study, using the base-line best estimate modeling parameters for the Average Temperature Response metric, NDARC under-estimates the effects of emissions when compared with results from Monte Carlo simulations. A global sensitivity analysis was further undertaken to quantify the contribution of the various emission species on output sensitivity, hence uncertainty. The work demonstrates that the developed toolsuite is robust and will support the quantification of system uncertainties and sensitivities in future rotorcraft design efforts.

Rotorcraft↗

An Approach for Uncertainty Quantification and Management of Unmanned Aerial Vehicle Health

The increasing interest in low-altitude unmanned aerial vehicle (UAV) operations is bringing along safety concerns. Performance of small, low-cost UAVs drastically changes with type, size and controller of the vehicle. Their reliability is lower when compared to reliability of commercial aircrafts, and the availability of on-board sensors for health and state awareness is extremely limited due to their size and propulsion capabilities. Uncertainty plays a dominant role in such a scenario, where a variety of UAVs of different size, propulsion systems, dynamic performance and reliability enters the low-altitude airspace. Unexpected failures could have dangerous consequences for both equipment and humans within that same airspace. As a result, a number of research works and methodologies are being proposed in the area of UAV dynamic modeling, health and safety monitoring, but uncertainty quantification is rarely addressed. Thus, this paper pro- poses a perspective towards uncertainty quantification for autonomous systems, giving special emphasis to a UAV health monitoring application. A formal approach to classify uncertainty is presented; it is utilized to identify the uncertainty sources in UAVs health and operations, and then map uncertainty within a predictive process. To show the application of the methodology proposed here, the design of a model-based powertrain health monitoring algorithm for small-size UAVs is used as case study. The example illustrates how the uncertainty quantification approach can help the modeling strategy, as well as the assessment of diagnostic and prognostic performance.

Health Monitoring↗

Uncertainty Quantification of Inducer Natural Frequency using Conditional Assessment of Modeling and Modal Testing of Simpler Systems

The low pressure fuel pump inducer of the new Space Launch System RS25 core stage engine operates in a highly complex environment that substantially affects its modal characteristics. Some of the more important effects are fluid-added mass resulting from operation within a light liquid (Hydrogen), and the magnification of this effect due to tight tip clearance. Since higher order cavitation has been identified as a significant harmonic driver, knowledge of the natural frequency of potentially excitable modes is critical for safe operation, but this frequency cannot be measured during the severe operational environment. A comprehensive testing and analysis program has therefore been performed over the last four years to identify the nominal value and uncertainty of the frequency by modeling and testing four simpler structures which share some of the characteristics of the operational inducer. This testing was used to assess and adjust modeling techniques and excellent correlation was achieved. Identification of the uncertainty in the inducer frequency itself was still problematic, however. This difficulty led to an investigation of Bayesian uncertainty quantification techniques, and to the application of the relatively simple technique of Multi-Variate Normal conditional distributions to calculate the inducer natural frequency uncertainty. Assumptions on prior distributions of uncertainty of the fluid-added mass and tip clearance effect are initially applied to models of each of the simple structures and the inducer itself, and these uncertainties are propagated to generate natural frequencies using design of experiments. Simple response surfaces are then created from this data in order to calculate a Covariance Matrix relating all of these natural frequencies. Finally, the results from modal test of the simple structures are considered to be observations and used to calculate the conditional variance of the desired inducer frequencies. As this method is less rigorous than more complicated Bayesian methods reported in the literature, a conservative factor is applied to the result, but the resulting uncertainty is still significantly less than originally estimated and will greatly assist certification of the inducer for use in the engine.

Uncertainty Quantification↗

Uncertainty Quantification of Inducer Eigenvalues using Conditional Assessment of Models and Modal Test of Simpler Systems

The low pressure fuel pump inducer of the new Space Launch System RS25 core stage engine operates in a highly complex environment that substantially affects its modal characteristics. Some of the more important effects are fluid-added mass resulting from operation within a light liquid (Hydrogen), and the magnification of this effect due to tight tip clearance. Since higher order cavitation has been identified as a significant harmonic driver, knowledge of the natural frequency of potentially excitable modes is critical for safe operation, but this frequency cannot be measured during the severe operational environment. A comprehensive testing and analysis program has therefore been performed over the last four years to identify the nominal value and uncertainty of the frequency by modeling and testing four simpler structures which share some of the characteristics of the operational inducer. This testing was used to assess and adjust modeling techniques and excellent correlation was achieved. Identification of the uncertainty in the inducer frequency itself was still problematic, however. This difficulty led to an investigation of Bayesian uncertainty quantification techniques, and to the application of the relatively simple technique of Multi-Variate Normal conditional distributions to calculate the inducer natural frequency uncertainty. Assumptions on prior distributions of uncertainty of the fluid-added mass and tip clearance effect are initially applied to models of each of the simple structures and the inducer itself, and these uncertainties are propagated to generate natural frequencies using design of experiments. Simple response surfaces are then created from this data in order to calculate a Covariance Matrix relating all of these natural frequencies. Finally, the results from modal test of the simple structures are considered to be observations and used to calculate the conditional variance of the desired inducer frequencies. As this method is less rigorous than more complicated Bayesian methods reported in the literature, a conservative factor is applied to the result, but the resulting uncertainty is still significantly less than originally estimated and will greatly assist certification of the inducer for use in the engine.

Uncertainty Quantification↗

The effect of modeling dose uncertainty on low-boom community noise dose-response curves

In logistic dose-response modeling, failing to account for uncertainty in estimated doses can cause an artificial flattening or attenuation of the slope of the summary curve. In Lee et al. [J. Acoust. Soc. Am. 147(4), pp. 2222-2234 (2020)], data from two NASA low-amplitude sonic boom community noise survey tests were modeled using a Bayesian multilevel logistic regression (MLR) statistical model that assumed there was no uncertainty in the noise dose estimates. However, in these community tests, the noise dose uncertainty was estimated by Page et al. [NASA/CR-2014-218180 and NASA/CR-2020-220589/Volume I] using a leave-one-out method. In the current work, a term was added to extend the Bayesian MLR model to account for the estimated noise dose uncertainty quantified in the Page et al. analyses. This uncertainty term was included in two ways, either as classical or as Berkson uncertainty, and yield similar results. When the uncertainty is accounted for in the Bayesian MLR model, the dose-response curves become 5-10% steeper, but the difference in the noise dose that elicits a 5% highly annoyed response is small (less than 1 dB). This result is encouraging for future X-59 community tests whose survey area will be sparsely populated with noise monitors.

X-59↗

Effective Uncertainty Quantification for Multi-Angle Polarimetric Aerosol Remote Sensing Over Ocean

Multi-angle polarimetric (MAP) measurements can enable detailed characterization of aerosol microphysical and optical properties and improve atmospheric correction in ocean color remote sensing. Advanced retrieval algorithms have been developed to obtain multiple geophysical parameters in the atmosphere–ocean system. Theoretical pixel-wise retrieval uncertainties based on error propagation have been used to quantify retrieval performance and determine the quality of data products. However, standard error propagation techniques in high-dimensional retrievals may not always represent true retrieval errors well due to issues such as local minima and the nonlinear dependence of the forward model on the retrieved parameters near the solution. In this work, we analyze these theoretical uncertainty estimates and validate them using a flexible Monte Carlo approach. The Fast Multi-Angular Polarimetric Ocean coLor (FastMAPOL) retrieval algorithm, based on efficient neural network forward models, is used to conduct the retrievals and uncertainty quantification on both synthetic HARP2 (Hyper-Angular Rainbow Polarimeter 2) and AirHARP (airborne version of HARP2) datasets. In addition, for practical application of the uncertainty evaluation technique in operational data processing, we use the automatic differentiation method to calculate derivatives analytically based on the neural network models. Both the speed and accuracy associated with uncertainty quantification for MAP retrievals are addressed in this study. Pixel-wise retrieval uncertainties are further evaluated for the real AirHARP field campaign data. The uncertainty quantification methods and results can be used to evaluate the quality of data products, as well as guide MAP algorithm development for current and future satellite systems such as NASA’s Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) mission.

PACE↗

Uncertainty Improvement in the NASA Glenn Research Center 8- by 6-Foot Supersonic Wind Tunnel

Within the past decade, a measurement uncertainty analysis (MUA) team was assembled at the NASA Glenn Research Center to assist the wind tunnel characterization team with quantification of uncertainty estimates for variables of interest in wind tunnels and test cells across the center. The initial analysis performed by the team was conducted on the 8- by 6- Foot Supersonic Wind Tunnel using results from the 1996/97 full calibration test entry. These MUA results were published in 2016 which included recommendations for methods to improve the uncertainty estimates for various variables of interest, such as changes to regression models, tunnel operation philosophy, and instrumentation choices. The wind tunnel characterization team utilized the proposed methods in 2019 during a full characterization test entry. Following publication of the 2019 test section characterization results, the MUA team pursued an update to the uncertainty estimates for the facility, which validated previous recommendations and revealed significantly reduced systematic uncertainties across most variables of interest. Inclusion of within-test repeat points in the 2019 test entry allowed for higher fidelity estimates of random uncertainty to be generated, as well. This collaboration between the facility, wind tunnel characterization, and MUA teams serves as an example of the data quality benefits that can be achieved through rigorous analysis of the sources of uncertainty in a ground-test facility.

Uncertainty↗

Uncertainty Improvement in the NASA Glenn Research Center 8- by 6-Foot Supersonic Wind Tunnel

Within the past decade, a measurement uncertainty analysis (MUA) team was assembled at NASA Glenn Research Center to assist the wind tunnel characterization team with quantification of uncertainty estimates for variables of interest in wind tunnels and test cells across the center. The initial analysis performed by the team was conducted on the 8- by 6-Foot Supersonic Wind Tunnel using results from the 1996/97 full calibration test entry. These MUA results were published in 2016 which included recommendations for methods to improve the uncertainty estimates for various variables of interest, such as changes to regression models, tunnel operation philosophy, and instrumentation choices. The wind tunnel characterization team utilized the proposed methods in 2019 during a full characterization test entry. Following publication of the 2019 test section characterization results, the MUA team pursued an update to the uncertainty estimates for the facility, which validated previous recommendations and revealed significantly reduced systematic uncertainties across most variables of interest. Inclusion of within-test repeat points in the 2019 test entry allowed for higher fidelity estimates of random uncertainty to be generated, as well. This collaboration between the facility, wind tunnel characterization, and MUA teams serves as an example of the data quality benefits that can be achieved through rigorous analysis of the sources of uncertainty in a ground-test facility.

Uncertainty↗

Uncertainty Quantification for Empirical X-59 Sonic Boom Loudness Levels

Estimates of the total uncertainty for empirically determined loudness levels are documented when GRS (Ground Recording System) noise monitors are used to record X 59 sonic boom waveforms. The total uncertainty is characterized by combining nine different sources of uncertainty that may affect the apparent gain of the measurement chain. These uncertainty estimates are presented as expected measurement error relative to the true loudness level, and separate error estimates are provided for eight different noise metrics in which NASA has interest. The behavior of the Perceived Level (PL) metric is studied within the report body, while the total uncertainties for the seven other noise metrics are summarized in appendices for brevity. The effects of four sources of uncertainty are estimated simply from information found on hardware specification sheets provided by the manufacturer. However, mock acoustic recordings are created to estimate the effects of other sources because those effects are expected to induce spectral coloration, so they may vary with noise metric type and sound level. These sources are not well modeled by simple gain adjustments. Importantly, measurement error is computable when processing mock recordings since the true levels are knowable, which is not the case when processing data recorded in the field. Specifically, the true levels are knowable because the components of the mock recordings are separable – e.g., loudness levels of booms can be computed with or without superimposed background noise. Mock acoustic recordings also have the benefit of allowing analysis of sonic booms from vehicles that are not yet flying, like the X-59, since the mock recordings are created by combining vehicle-specific predicted waveforms with other audio sources. The estimates of total measurement error are documented as a function of the signal-to-noise ratio (SNR) of the loudness level, where the corrected SNR is computed while accounting for the effects of the method that is used to correct for background noise contamination when computing the noise metric values. The corrected SNR calculations used here can be applied to both mock recordings and in-field measurements, so the uncertainty of in-field recordings can be found using pre-computed lookup tables that identify the relationship between metric type, corrected SNR, and the expected measurement error.

Sonic Boom↗

An extended polynomial chaos expansion for PDF characterization and variation with aleatory and epistemic uncertainties

This paper presents an extended polynomial chaos formalism for epistemic uncertainties and a new framework for evaluating sensitivities and variations of output probability density functions (PDF) to uncertainty in probabilistic models of input variables. An ”extended” polynomial chaos expansion (PCE) approach is developed that accounts for both aleatory and epistemic uncertainties, modeled as random variables, thus allowing a unified treatment of both types of uncertainty. We explore in particular epistemic uncertainty associated with the choice of prior probabilistic models for input parameters. A PCE-based Kernel Density (KDE) construction provides a composite map from the PCE coefficients and germ to the PDF of quantities of interest (QoI). Here, the sensitivities of these PDF with respect to the input parameters are then evaluated. Input parameters of the probabilistic models are considered. By sampling over the epistemic random variable, a family of PDFs is generated and the failure probability is itself estimated as a random variable with its own PCE. Integrating epistemic uncertainties within the PCE framework results in a computationally efficient paradigm for propagation and sensitivity evaluation. Two typical illustrative examples are used to demonstrate the proposed approach.

Aleatory uncertainty↗

LandScan mosaic enables high-resolution gridded population estimates with explicit uncertainty

Gridded population datasets represent high-resolution distributions of human occupancy, enabling informed decision-making across a broad range of fields. These data products are valuable for assessing environmental risk, urban development, disaster preparedness and resource allocation—areas where accurate population estimates directly enhance policy effectiveness and optimize resource distribution. Despite the importance of gridded population datasets, traditional population modeling approaches often overlook inherent uncertainties in the estimation process. This limitation can create a false sense of certainty in population estimates, potentially leading to flawed decisions by those who rely on the data. To address this methodological gap, we introduce a probabilistic machine learning modeling framework, LandScan Mosaic, that explicitly incorporates uncertainty into the population modeling process. Our approach systematically quantifies uncertainty in three key modeling parameters of the LandScan HD gridded population dataset: building use types, floor counts, and occupancy rates. By employing Monte Carlo simulations, we propagate these uncertainties through the modeling process, yielding probability distributions of population counts in place of deterministic point estimates. We demonstrate the practical application of this framework in Iloilo City, Philippines, using structured decision-making techniques and our probabilistic estimates to identify and prioritize areas most affected by projected flooding, supporting targeted interventions that address both economic and social risks. In doing so, we propose a population-specific approach for incorporating confidence into structured decision making processes. Through a comparative analysis with conventional deterministic approaches and point estimate approaches, including LandScan HD and WorldPop, we evaluate how the incorporation of machine learning and uncertainty influences decision rankings. This research advances population distribution modeling by offering a robust, quantitative approach that explicitly accounts for uncertainty in the underlying data, along with guidance for how users can apply uncertainty in their decision-making.

Environmental sciences↗

Bootstrap estimation of the effect of instrument response function uncertainty on the reconstruction of fusion neutron sources

Neutron imagers are important diagnostics for the inertial confinement fusion implosions at the National Ignition Facility. They provide two- and three-dimensional reconstructions of the neutron source shape that are key indicators of the overall performance. To interpret the shape results properly, it is critical to estimate the uncertainty in those reconstructions. There are two main sources of uncertainties: limited neutron statistics, leading to random errors in the reconstructed images, and incomplete knowledge of the instrument response function (the pinhole-dependent point spread function). While the statistical errors dominate the uncertainty for lower yield deuterium-tritium (DT) shots, errors due to the instrument response function dominate the uncertainty for DT yields on the order of 10 16 neutrons or higher. In this work, a bootstrapping method estimates the uncertainty in a reconstructed image due to the incomplete knowledge of the instrument response function. The main reconstruction is created from the fixed collection of pinhole images that are best aligned with the neutron source. Additional reconstructions are then built using subsets of that collection of images. Variations in the shapes of these additional reconstructions originate solely from uncertainties in the instrument response function, allowing us to use them to provide an additional systematic uncertainty estimate.

47 OTHER INSTRUMENTATION↗