Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,351 records · Page 75

Uncertainty of Observation Impact Estimation in an Adjoint Model Investigated with an Observing System Simulation Experiment

Adjoint models are often used to estimate the impact of different observations on short-term forecast skill. A common difficulty with the evaluation of short term forecast quality is the choice of verification fields. The use of self-analysis fields for verification is typical but incestuous, and introduces uncertainty due to biases and errors in the analysis field. In this study, an observing system simulation experiment (OSSE) is used to explore the uncertainty in adjoint model estimations of observation impact. The availability of the true state for verification in the OSSE framework in the form of the Nature Run allows calculation of the observation impact without the uncertainties present in self-analysis verification. These impact estimates are compared to estimates calculated using self-analysis verification. The Global Earth Observing System version 5 (GEOS-5) forecast model with Gridpoint Statistical Interpolation (GSI) is used with the National Aeronautics and Space Administration Global Modeling and Assimilation Office (NASA/GMAO) OSSE capability. The adjoint model includes moist processes, with total wet energy selected as the norm for evaluation of observation impacts. The results show that there are measurable but small discrepancies in the adjoint model estimation of observation impact. In general, observations of temperature and winds tend to have overestimated impacts with self-analysis verification, while observations of humidity and moisture-affected observations tend to have underestimated impacts. The small magnitude of the differences in impact estimates supports the robustness of the adjoint method of estimating observation impacts.

N C Prive↗

Design Under Uncertainty for Conceptual Aircraft Design Leveraging Analytical Gradients

The purpose of this paper is to extend previously demonstrated methodologies for design under uncertainty, leveraging analytical gradients to higher fidelity analysis for use in conceptual aircraft design. Previous work developed methods to generate analytical derivatives through polynomial chaos expansion, eliminating the need to estimate derivatives via complex step or finite difference. In this research, the authors build upon the methods to include physics-based aircraft design codes for aircraft design under uncertainty. This extends the previous work’s case study, which employed analytical aerodynamics and Breguet range estimations for wing design, to a higher fidelity level. In addition, this work extends previous work on interface development between the Uncertainty Quantification with Polynomial Chaos Expansion (UQPCE) software and Model-Based Systems Analysis and Engineering (MBSA&E) frameworks. This paper will discuss the development work necessary to perform multidisciplinary design under uncertainty as well as demonstrate the mechanics of interfacing UQPCE and conceptual aircraft design tools such as NASA’s Aviary code. In a case study, a conceptual aircraft design under uncertainty was conducted and compared against a traditional deterministic design. When given information about the uncertainty space from UQPCE, the optimizer was able to shape the output distribution and produce a more robust design

UQ↗

Design Under Uncertainty for Conceptual Aircraft Design Leveraging Analytical Gradients

The purpose of this paper is to extend previously demonstrated methodologies for design under uncertainty, leveraging analytical gradients to higher fidelity analysis for use in conceptual aircraft design. Previous work developed methods to generate analytical derivatives through polynomial chaos expansion, eliminating the need to estimate derivatives via complex step or finite difference. In this research, the authors build upon the methods to include physics-based aircraft design codes for aircraft design under uncertainty. This extends the previous work’s case study, which employed analytical aerodynamics and Breguet range estimations for wing design, to a higher fidelity level. In addition, this work extends previous work on interface development between the Uncertainty Quantification with Polynomial Chaos Expansion (UQPCE) software and Model-Based Systems Analysis and Engineering (MBSA&E) frameworks. This paper will discuss the development work necessary to perform multidisciplinary design under uncertainty as well as demonstrate the mechanics of interfacing UQPCE and conceptual aircraft design tools such as NASA’s Aviary code. In a case study, a conceptual aircraft design under uncertainty was conducted and compared against a traditional deterministic design. When given information about the uncertainty space from UQPCE, the optimizer was able to shape the output distribution and produce a more robust design.

UQ↗

Latest Three-Flavor Neutrino Oscillation Results from NOvA

NOvA, is a two-detector, long-baseline neutrino oscillation experiment located at Fermilab, Batavia, IL, USA. It aims to constrain neutrino oscillation parameters by analyzing $\nu_\mu (\bar{\nu}_\mu)$ disappearance and $\nu_e (\bar{\nu}_e)$ appearance data. The experiment uses the Neutrinos at Main Injector (NuMI) beamline at Fermilab, which delivers a high-purity 900 KW beam of neutrinos and anti-neutrinos. The detectors are functionally identical finely granulated liquid tracking calorimeters, both situated 14.6 mrad off-axis to the beam direction. The NOvA Near Detector (ND), situated 100 meters underground and 1 kilometer from the beam source, detects the un-oscillated $\nu_\mu (\bar{\nu}_\mu)$ and beam $\nu_e (\bar{\nu}_e)$ events. The Far Detector (FD), located in Ash River, MN, USA, 809 kilometers from the ND, records the oscillated $\nu_e (\bar{\nu}_e)$ and the un-oscillated $\nu_\mu (\bar{\nu}_\mu)$ events. NOvA employs an extrapolation technique to predict the expected events at the Far Detector based on the Near Detector data, thereby providing a significant constraint on systematic uncertainties in the oscillation analyses. As NOvA accumulates more data, controlling these systematic uncertainties becomes increasingly important. This talk will detail the NOvA neutrino oscillation analysis framework and its approach to minimizing dominant systematic uncertainties using Near Detector data. The latest three flavor neutrino oscillation results based on a neutrino-beam exposure of $26.60 \times 10^{20}$ POT and an anti-neutrino beam exposure of $12.50\times 10^{20}$ POT and a novel low energy $\nu_e$ sample, will also be presented.

Choudhary, Brajesh↗

Description of data on the Nimbus 7 LIMS map archive tape: Temperature and geopotential height

The process by which the analysis of the Limb Infared Monitor of the Stratosphere (LIMS) experiment data were used to produce estimates of synoptic maps of temperature and geopotential height is described. In addition to a detailed description of the analysis procedure, several interesting features in the data are discussed and these features are used to demonstrate how the analysis procedure produced the final maps and how one can estimate the uncertainties in the maps. In addition, features in the analysis are noted that would influence how one might use, or interpret, the results. These include subjects such as smoothing and the interpretation of wave components. While some suggestions are made for an improved analysis of the data, it is shown that, in general, the maps are an excellent estimation of the synoptic fields.

Haggard, K. V.↗

Description of data on the Nimbus 7 LIMS map archive tape: Water vapor and nitrogen dioxide

Described is the process by which the analysis of the Limb Infrared Monitor of the Stratosphere (LIMS) experiment data were used to produce estimates of synoptic maps of water vapor and nitrogen dioxide. In addition to a detailed description of the analysis procedure, also discussed are several interesting features in the data which are used to demonstrate how the analysis procedure produced the final maps and how one can estimate the uncertainties in the maps. In addition, features in the analysis are noted that would influence how one might use, or interpret, the results. These include subjects such as smoothing and the interpretation of wave components.

Haggard, Kenneth V.↗

Parametric Robust Control and System Identification: Unified Approach

During the period of this support, a new control system design and analysis method has been studied. This approach deals with control systems containing uncertainties that are represented in terms of its transfer function parameters. Such a representation of the control system is common and many physical parameter variations fall into this type of uncertainty. Techniques developed here are capable of providing nonconservative analysis of such control systems with parameter variations. We have also developed techniques to deal with control systems when their state space representations are given rather than transfer functions. In this case, the plant parameters will appear as entries of state space matrices. Finally, a system modeling technique to construct such systems from the raw input - output frequency domain data has been developed.

Keel, L. H.↗

Interval prediction in structural dynamic analysis

Methods for assessing the predictive accuracy of structural dynamic models are examined with attention given to the effects of modal mass, stiffness, and damping uncertainties. The methods are based on a nondeterministic analysis called 'interval prediction' in which interval variables are used to describe parameters and responses that are unknown. Statistical databases for generic modeling uncertainties are derived from experimental data and incorporated analytically to evaluate responses. Covariance matrices of modal mass, stiffness, and damping parameters are propagated numerically in models of large space structures by means of three methods. The test data tend to fall within the predicted intervals of uncertainty determined by the statistical databases. The present findings demonstrate the suitability of using data from previously analyzed and tested space structures for assessing the predictive accuracy of an analytical model.

Hasselman, Timothy K.↗

The application of sensitivity analysis to models of large scale physiological systems

A survey of the literature of sensitivity analysis as it applies to biological systems is reported as well as a brief development of sensitivity theory. A simple population model and a more complex thermoregulatory model illustrate the investigatory techniques and interpretation of parameter sensitivity analysis. The role of sensitivity analysis in validating and verifying models, and in identifying relative parameter influence in estimating errors in model behavior due to uncertainty in input data is presented. This analysis is valuable to the simulationist and the experimentalist in allocating resources for data collection. A method for reducing highly complex, nonlinear models to simple linear algebraic models that could be useful for making rapid, first order calculations of system behavior is presented.

Leonard, J. I.↗

Uncertainty Quantification and Certification Prediction of Low-Boom Supersonic Aircraft Configurations

The primary objective of this work was to develop and demonstrate a process for accurate and efficient uncertainty quantification and certification prediction of low-boom, supersonic, transport aircraft. High-fidelity computational fluid dynamics models of multiple low-boom configurations were investigated including the Lockheed Martin SEEB-ALR body of revolution, the NASA 69 Delta Wing, and the Lockheed Martin 1021-01 configuration. A nonintrusive polynomial chaos surrogate modeling approach was used for reduced computational cost of propagating mixed, inherent (aleatory) and model-form (epistemic) uncertainty from both the computation fluid dynamics model and the near-field to ground level propagation model. A methodology has also been introduced to quantify the plausibility of a design to pass a certification under uncertainty. Results of this study include the analysis of each of the three configurations of interest under inviscid and fully turbulent flow assumptions. A comparison of the uncertainty outputs and sensitivity analyses between the configurations is also given. The results of this study illustrate the flexibility and robustness of the developed framework as a tool for uncertainty quantification and certification prediction of low-boom, supersonic aircraft.

West, Thomas K., IV↗

Coordination Sphere of Lanthanide Aqua Ions Resolved with Ab Initio Molecular Dynamics and X-ray Absorption Spectroscopy

To resolve the fleeting structures of lanthanide Ln 3+ aqua ions in solution, we (i) performed the first ab initio molecular dynamics (AIMD) simulations of the entire series of Ln 3+ aqua ions in explicit water solvent using pseudopotentials and basis sets recently optimized for lanthanides and (ii) measured the symmetry of the hydrating waters about Ln 3+ ions (Nd 3+ , Dy 3+ , Er 3+ , Lu 3+ ) for the first time with extended X-ray absorption fine structure (EXAFS). EXAFS spectra were measured experimentally and generated from AIMD trajectories to directly compare simulation, which concurrently considers the electronic structure and the atomic dynamics in solution, with experiment. In this study, we performed a comprehensive evaluation of EXAFS multiple-scattering analysis (up to 6.5 Å) to measure Ln–O distances and angular correlations (i.e., symmetry) and elucidate the molecular geometry of the first hydration shell. This evaluation, in combination with symmetry-dependent L 3 - and L 1 -edge spectral analysis, shows that the AIMD simulations remarkably reproduces the experimental EXAFS data. The error in the predicted Ln–O distances is less than 0.07 Å for the later lanthanides, while we observed excellent agreement with predicted distances within experimental uncertainty for the early lanthanides. Our analysis revealed a dynamic, symmetrically disordered first coordination shell, which does not conform to a single molecular geometry for most lanthanides. This work sheds critical light on the highly elusive coordination geometry of the Ln 3+ aqua ions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

STAT7 v2.0 User Guide

The STAT7 software was developed to perform steady-state, single-phase thermal hydraulics analysis of plate-fueled reactors based on statistical propagation of uncertainties. Application of the software includes non-power research and test reactor analysis, and it has been used for the conversion to low- enriched uranium fuel of U.S. High Performance Research Reactors such as the Massachusetts Institute of Technology Research Reactor. Since it can be necessary to repeat reactor safety analysis, such as during fuel reloading, STAT7 accommodates flexibility in analyzing many practical aspects of reactor fuel management. STAT7 uses a Monte Carlo approach to model uncertainty in common fuel fabrication parameters and other key reactor operating parameters required for reactor thermal hydraulics analysis. These safety calculations are ultimately intended to protect against high fuel plate temperatures due to critical heat flux, or onset of flow instability. STAT7 supports water properties based on the IAPWS-IF97 functions (The International Association for the Properties of Water and Steam Industrial Formulation 1997 for the Thermodynamic Properties of Water and Steam) in addition to fitted functions. STAT7 predicts axial profiles of fuel, cladding, and coolant temperature along a lateral stripe that runs the full length of the fuel plate from the bottom to the top. STAT7 can simultaneously analyze every axial node in each lateral stripe of all fuel plates and coolant channels in every fuel element of an entire reactor core. Power splits are calculated for each axial node of each plate to determine how much of the power goes out each face of the plate. In a single execution, STAT7 can be used to perform full core analysis by analyzing the margin to onset of nucleate boiling and onset of flow instability for each axial node of each stripe of each plate of each fuel element in the core.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A Mathematical Model and Algorithm for Routing Air Traffic Under Weather Uncertainty

A central challenge in managing today's commercial en route air traffic is the task of routing the aircraft in the presence of adverse weather. Such weather can make regions of the airspace unusable, so all affected flights must be re-routed. Today this task is carried out by conference and negotiation between human air traffic controllers (ATC) responsible for the involved sectors of the airspace. One can argue that, in so doing, ATC try to solve an optimization problem without giving it a precise quantitative formulation. Such a formulation gives the mathematical machinery for constructing and verifying algorithms that are aimed at solving the problem. This paper contributes one such formulation and a corresponding algorithm. The algorithm addresses weather uncertainty and has closed form, which allows transparent analysis of correctness, realism, and computational costs.

uncertainty↗

Component-level Performance and Mass Sensitivity Analysis of NEP MW-class Power System

Nuclear electric propulsion (NEP) is a promising option towards enabling missions to Mars and is an area of interest for NASA’s Space Nuclear Propulsion project. This project is currently investigating technology development opportunities for an NEP vehicle. Physics-based modeling can be used in the early stages of technology development to gain understanding of the effects of technology and performance assumptions on the system performance and mass. This information can then inform technology maturation planning for near term development. By using a Brayton power conversion model and vehicle mass model for megawatt class NEP applications, a sensitivity analysis is performed to assess the impact of individual components’ performance on the power conversion system performance and system mass. A Monte Carlo simulation is also used to determine the variability in system mass based on uncertainty within the modeling parameters. The sensitivity analysis shows a high sensitivity to power conversion inlet temperature, compressor inlet temperature, and recuperator performance. A Monte Carlo analysis suggests a range of -10% to +15% for a 90% confidence interval on system mass based on the uncertainties in the model inputs.

Nuclear electric propulsion↗

Bayesian Inference and the Effects of Varying Uncertainty Models in Charring Ablator Calibration and Uncertainty Quantification Problems

The Mars Science Laboratory (MSL) vehicle utilized a heat shield constructed from NASA’s Phenolic-Impregnated Carbon Ablator (PICA) material to protect the main structure from the high enthalpy environment encountered during hypersonic atmospheric entry. During the vehicle’s descent through Martian atmosphere, multiple thermocouples embedded within the heat shield captured in-depth material temperature data that allow for studies to be conducted on current material response reconstruction tools. In the present work, material temperature data obtained from thermocouples within the MISP-4 plug (MEDLI (Mars Science Laboratory Entry, Descent, and Landing Instrument) Integrated Sensor Plug) are utilized in the calibration of Theoretical Ablative Composite for Open Testing (TACOT) model parameters in conjunction with NASA’s Porous material Analysis Toolbox (PATO) through Bayesian inference where uncertainty due to parametric, modeling, and experimental sources is simultaneously quantified. Prior to the study, a sensitivity analysis is performed through computation of the robust Sobol indices in an effort to study the relationship between input space and model response and to reduce the dimensionality of the statistical inverse problem. The Bayesian inference methodology necessitates an a-priori choice to be made for the uncertainty model for which numerous possibilities are available. Across most works, however, only basic additive or multiplicative models are utilized with pre-defined magnitudes of uncertainty based on a-priori knowledge or to-be-calibrated multipliers of static covariance matrix structures. The present effort explores the effects of informed uncertainty models, ones with temporal dependence that are simultaneously calibrated through Bayesian inference, on calibrated results for parameters that make up the uncertain input space.

Sensitivity Analysis↗

Assimilation of Sea Ice Thickness Derived from Cryosat-2 Along-Track Freeboard Measurements into the Met Office's Forecast Ocean Assimilation Model (FOAM)

The feasibility of assimilating sea ice thickness (SIT) observations derived from CryoSat-2 along-track measurements of sea ice freeboard is successfully demonstrated using a 3D-Var assimilation scheme, NEMOVAR, within the Met Office's global, coupled ocean–sea-ice model, Forecast Ocean Assimilation Model (FOAM). The CryoSat-2 Arctic freeboard measurements are produced by the Centre for Polar Observation and Modelling (CPOM) and are converted to SIT within FOAM using modelled snow depth. This is the first time along-track observations of SIT have been used in this way, with other centres assimilating gridded and temporally averaged observations. The assimilation leads to improvements in the SIT analysis and forecast fields generated by FOAM, particularly in the Canadian Arctic. Arctic-wide observation-minus-background assimilation statistics for 2015–2017 show improvements of 0.75 m mean difference and 0.41 m root-mean-square difference (RMSD) in the freeze-up period and 0.46 m mean difference and 0.33 m RMSD in the ice break-up period. Validation of the SIT analysis against independent springtime in situ SIT observations from NASA Operation IceBridge (OIB) shows improvement in the SIT analysis of 0.61 m mean difference (0.42 m RMSD) compared to a control without SIT assimilation. Similar improvements are seen in the FOAM 5 d SIT forecast. Validation of the SIT assimilation with independent Beaufort Gyre Exploration Project (BGEP) sea ice draft observations does not show an improvement, since the assimilated CryoSat-2 observations compare similarly to the model without assimilation in this region. Comparison with airborne electromagnetic induction (Air-EM) combined measurements of SIT and snow depth shows poorer results for the assimilation compared to the control, despite covering similar locations to the OIB and BGEP datasets. This may be evidence of sampling uncertainty in the matchups with the Air-EM validation dataset, owing to the limited number of observations available over the time period of interest. This may also be evidence of noise in the SIT analysis or uncertainties in the modelled snow depth, in the assimilated SIT observations, or in the data used for validation. The SIT analysis could be improved by upgrading the observation uncertainties used in the assimilation. Despite the lack of CryoSat-2 SIT observations available for assimilation over the summer due to the detrimental effect of melt ponds on retrievals, it is shown that the model is able to retain improvements to the SIT field throughout the summer months due to prior, wintertime SIT assimilation. This also results in regional improvements to the July modelled sea ice concentration (SIC) of 5 % RMSD in the European sector, due to slower melt of the thicker sea ice.

Emma K. Fiedler↗