Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,693 records · Page 94

Mach 10 Stage Separation Analysis for the X43-A

This paper describes the pre-flight stage separation analysis that was conducted in support of the final flight of the X-43A. In that flight, which occurred less than eight months after the successful Mach 7 flight, the X-43A Research Vehicle attained a peak speed of Mach 9.6. Details are provided on how the lessons learned from the Mach 7 flight affected separation modeling and how adjustments were made to account for the increased flight Mach number. Also, the procedure for defining the feedback loop closure and feed-forward parameters employed in the separation control logic are described, and their effect on separation performance is explained. In addition, the range and nominal values of these parameters, which were included in the Mission Data Load, are presented. Once updates were made, the nominal pre-flight trajectory and Monte Carlo statistical results were determined and stress tests were performed to ensure system robustness. During flight the vehicle performed within the uncertainty bounds predicted in the pre-flight analysis and ultimately set the world record for airbreathing powered flight.

Tartabini, Paul V.↗

Advanced probabilistic method of development

Advanced structural reliability methods are utilized on the Probabilistic Structural Analysis Methods (PSAM) project to provide a tool for analysis and design of space propulsion system hardware. The role of the effort at the University of Arizona is to provide reliability technology support to this project. PSAM computer programs will provide a design tool for analyzing uncertainty associated with thermal and mechanical loading, material behavior, geometry, and the analysis methods used. Specifically, reliability methods are employed to perform sensitivity analyses, to establish the distribution of a critical response variable (e.g., stress, deflection), to perform reliability assessment, and ultimately to produce a design which will minimize cost and/or weight. Uncertainties in the design factors of space propulsion hardware are described by probability models constructed using statistical analysis of data. Statistical methods are employed to produce a probability model, i.e., a statistical synthesis or summary of each design variable in a format suitable for reliability analysis and ultimately, design decisions.

Wirsching, P. H.↗

Antiproton bounds on dark matter annihilation from a combined analysis using the DRAGON2 code

Abstract Early studies of the AMS-02 antiproton ratio identified a possible excess over the expected astrophysical background that could be fit by the annihilation of a weakly interacting massive particle (WIMP). However, recent efforts have shown that uncertainties in cosmic-ray propagation, the antiproton production cross-section, and correlated systematic uncertainties in the AMS-02 data, may combine to decrease or eliminate the significance of this feature. We produce an advanced analysis using the DRAGON2 code which, for the first time, simultaneously fits the antiproton ratio along with multiple secondary cosmic-ray flux measurements to constrain astrophysical and nuclear uncertainties. Compared to previous work, our analysis benefits from a combination of: (1) recently released AMS-02 antiproton data, (2) updated nuclear fragmentation cross-section fits, (3) a rigorous Bayesian parameter space scan that constrains cosmic-ray propagation parameters.We find no statistically significant preference for a dark matter signal and set strong constraints on WIMP annihilation tobb̅, ruling out annihilation at the thermal cross-section for dark matter masses below ∼ 200 GeV. We do find a positive residual that is consistent with previous work, and can be explained by a ∼ 70 GeV WIMP annihilating below the thermal cross-section. However, our default analysis finds this excess to have a local significance of only 2.8σ, which is decreased to 1.8σwhen the look-elsewhere effect is taken into account.

Astronomy & Astrophysics↗

End-To-End Uncertainty Quantification with Analytical Derivatives for Design Under Uncertainty

Uncertainty quantification (UQ) is a rapidly growing and evolving discipline, especially within the aerospace community. Performing analysis with UQ can provide decision makers with a wealth of information about a candidate design. However, the value of UQ is fully realized when the information gained during UQ analysis is leveraged in a feedback loop of a design optimization process, often referred to as design under uncertainty. Although design under uncertainty can be a powerful risk mitigation technique, there are a number of roadblocks that prevent its implementation. Two primary factors are computational costs and added complexity of the analysis. High fidelity simulations on the order tens of uncertain variables quickly become computationally infeasible. Also, implementing UQ into an existing multidisciplinary design and optimization (MDO) process often requires extensive knowledge of the UQ methods and careful treatment of the problem formulation. The objective of this work is to address these two primary roadblocks and enable practitioners to efficiently perform design under uncertainty with limited knowledge of the UQ discipline. Methods outlined in this paper demonstrate MDO incorporating UQ into the design process, leveraging an analytic derivative tool chain through the entire optimization. The proposed approach leverages machine learning techniques to generate a differentiable confidence interval output from polynomial chaos models. This technique, coupled with the incorporation of analytical derivatives through the Polynomial Chaos Expansion (PCE) process, eliminates the need to estimate derivatives which are usually obtained from finite difference, complex step, or similar methods. Developing a differentiable confidence interval allows mixed uncertainty problems (both epistemic and aleatory) to be modeled. Without such modeling, these problems cannot accurately predict objective functions containing statistical quantities such as mean and variance. The addition of analytic derivatives to a polynomial chaos-based UQ method decreases the computational costs of performing design under uncertainty by orders of magnitude in comparison with methods such as complex step. The method and codes developed are modular in nature and are a drop-in solution for design under uncertainty within existing MDO problems. A low-fidelity analytical multidisciplinary optimization under uncertainty for a wing design in OpenMDAO is detailed in this paper. This demonstration case will include both objective functions and constraints which are influenced by uncertain parameters.

Ben D Phillips↗

End-To-End Uncertainty Quantification with Analytical Derivatives for Design Under Uncertainty

Uncertainty quantification (UQ) is a rapidly growing and evolving discipline, especially within the aerospace community. Performing analysis with UQ can provide decision makers with a wealth of information about a candidate design. However, the value of UQ is fully realized when the information gained during UQ analysis is leveraged in a feedback loop of a design optimization process, often referred to as design under uncertainty. Although design under uncertainty can be a powerful risk mitigation technique, there are a number of roadblocks that prevent its implementation. Two primary factors are computational costs and added complexity of the analysis. High fidelity simulations on the order tens of uncertain variables quickly become computationally infeasible. Also, implementing UQ into an existing multidisciplinary design and optimization (MDO) process often requires extensive knowledge of the UQ methods and careful treatment of the problem formulation. The objective of this work is to address these two primary roadblocks and enable practitioners to efficiently perform design under uncertainty with limited knowledge of the UQ discipline. Methods outlined in this paper demonstrate MDO incorporating UQ into the design process, leveraging an analytic derivative tool chain through the entire optimization. The proposed approach leverages machine learning techniques to generate a differentiable confidence interval output from polynomial chaos models. This technique, coupled with the incorporation of analytical derivatives through the Polynomial Chaos Expansion (PCE) process, eliminates the need to estimate derivatives which are usually obtained from finite difference, complex step, or similar methods. Developing a differentiable confidence interval allows mixed uncertainty problems (both epistemic and aleatory) to be modeled. Without such modeling, these problems cannot accurately predict objective functions containing statistical quantities such as mean and variance. The addition of analytic derivatives to a polynomial chaos-based UQ method decreases the computational costs of performing design under uncertainty by orders of magnitude in comparison with methods such as complex step. The method and codes developed are modular in nature and are a drop-in solution for design under uncertainty within existing MDO problems. A low-fidelity analytical multidisciplinary optimization under uncertainty for a wing design in OpenMDAO is detailed in this paper. This demonstration case will include both objective functions and constraints which are influenced by uncertain parameters.

Ben Phillips↗

The Pantheon+ Analysis: Forward Modeling the Dust and Intrinsic Color Distributions of Type Ia Supernovae, and Quantifying Their Impact on Cosmological Inferences

Abstract Recent studies have shown that the observed color distributions of Type Ia supernovae (SNe Ia) can be well described by a combination of a dust distribution and an intrinsic color distribution. Using the Pantheon+ sample of 1701 SN Ia, we apply a new forward-modeling fitting method (Dust2Dust) to measure the parent dust and color distributions, including their dependence on host-galaxy mass. At each fit step, the SN Ia selection efficiency is determined from a large simulated sample that is reweighted to reflect the proposed distributions. We use five separate metrics to describe the goodness of fit: distribution of fitted light-curve color c , cosmological residual trends with c , cosmological residual scatter with c , fitted color–luminosity relationship β SALT2 , and intrinsic scatter σ int . We present the results and the uncertainty in 12-dimensional space. Furthermore, we measure that the uncertainty on this modeling propagates to an upper threshold uncertainty in the equation of state of dark energy w of 0.014(1) for the Pantheon+ cosmology analysis and contributes negligible uncertainty to the Hubble constant H 0 . The Dust2Dust code is made publicly available at https://github.com/djbrout/dustdriver .

79 ASTRONOMY AND ASTROPHYSICS↗

Boosting efficiency and reducing graph reliance: Basis adaptation integration in Bayesian multi-fidelity networks

The computational cost of high-fidelity numerical models makes outer-loop analysis, which requires repeated interrogation of the model such as uncertainty quantification, computationally demanding. Multi-fidelity methods, which construct a surrogate model using data from an ensemble of models of varying cost and accuracy, can substantially reduce the cost of outer-loop analysis. However, these methods can be difficult to apply when the model ensemble does not admit a clear hierarchy a priori and the correlations between models are low. Consequently, in this paper, we present a multi-fidelity method that leverages dimension reduction to enhance the correlation between models, thereby reducing the amount of data needed to train a surrogate from an unordered ensemble of models. Our method utilizes basis adaptation to build low-dimensional polynomial chaos expansions of each model and employs Multi-fidelity Networks to encode the relationships among models. We show that the resulting method exhibit two notable advantages over its counterpart: (1) enhanced accuracy (both reduced bias and variance); and (2) reduced dependency on the graph structure encoding relationships among models. We demonstrate the approach on an analytical test problem and a challenging finite element model for a spent nuclear fuel. Our method produces a surrogate model that is significantly more accurate than either a single-fidelity surrogate or a multi-fidelity surrogate constructed without basis adaptation.

42 ENGINEERING↗

Sample shape and boundary dependence of measured transverse thermal properties

In spite of increased interest in thermal Hall measurements for the analysis of insulating quantum materials, there remains large uncertainty in such measurements due to contact misalignment. In this paper, we propose that sample geometry and uncertain boundary conditions provide an additional source of uncertainty in the measurement of $D_{xy}$ or $κ_{xy}$. By running simple simulations in an open source finite-element solver, we demonstrate that measured $D_{xy}$ can be changed by a non-negligible fraction in samples with similar width and length. This geometric corrective factor depends on the distinction between a uniform heat flow and constant temperature boundary couplings to a bath. Sample geometry and boundary conditions can be accounted for through simulation or by using rectangular samples to make thermal Hall measurements more reliable and reproducible. Finally, we detail a contactless optical method for measuring $D_{xy}$ based on an existing photothermal microscope technique. This method is insensitive to the longitudinal diffusivity pollution caused by contact misalignment.

36 MATERIALS SCIENCE↗

Solution of nonlinear finite difference ocean models by optimization methods with sensitivity and observational strategy analysis

The paper studies with finite difference nonlinear circulation models the uncertainties in interesting flow properties, such as western boundary current transport, potential and kinetic energy, owing to the uncertainty in the driving surface boundary condition. The procedure is based upon nonlinear optimization methods. The same calculations permit quantitative study of the importance of new information as a function of type, region of measurement and accuracy, providing a method to study various observing strategies. Uncertainty in a model parameter, the bottom friction coefficient, is studied in conjunction with uncertain measurements. The model is free to adjust the bottom friction coefficient such that an objective function is minimized while fitting a set of data to within prescribed bounds. The relative importance of the accuracy of the knowledge about the friction coefficient with respect to various kinds of observations is then quantified, and the possible range of the friction coefficients is calculated.

Schroeter, Jens↗

SCALE 6.3 Validation: Reactor Physics

This study was performed to validate the SCALE/Polaris v6.3.0–PARCS v3.4.2 code procedure with the ENDF/B-VII.1 AMPX 56-group library for light-water reactor analysis by comparing the simulated results with the measured data for critical experiments and operating light-water reactors. Uncertainties of the SCALE/Polaris–PARCS code procedure for light-water reactor physics analysis were evaluated in the validation for key nuclear parameters such as reactivity, control bank work, temperature coefficients, and pin and assembly power peaking factors. In addition, the SCALE/TRITON v6.3.1 procedure with the ENDF/B-VII.1 and VIII.0 252-group and continuous-energy cross sections was validated for non-lightwater reactors including the HTR-10 reactor, the High-Temperature Test Reactor, the Molten Salt Reactor Experiment, and the Experimental Breeder Reactor II.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Efficient Distance-based Global Sensitivity Analysis for Terrestrial Ecosystem Modeling

Sensitivity analysis in terrestrial ecosystem modeling is important for understanding controlling processes, guiding model development, and targeting new observations to reduce parameter and prediction uncertainty. Complex and computationally expensive terrestrial ecosystem models (TEM) limit the number of ensemble simulations, requiring sophisticated and efficient methods to analyze sensitivities of multiple model responses to different types of parameter uncertainties. In this study, we propose a distance-based global sensitivity analysis (DGSA) method. DGSA first classifies model response samples into a small set of discrete classes and then calculates the distance between parameter frequency distributions in different classes to measure the parameter sensitivity. The principle is that, if the parameter distribution is the same in each class, then the model response is insensitive to the parameter, while a large difference in the distributions indicates the parameter is influential to the response. Built on this idea, DGSA can be applied to analyze sensitivity of a single and a group of responses to different kinds of parameter uncertainties including continuous, discrete and even stochastic. Besides the main-effect sensitivity from a single parameter, DGSA can also quantify the sensitivity from parameter interactions. Additionally, DGSA is computationally efficient which can use a small number of model evaluations to obtain an accurate and statistically significant result. We applied DGSA to two TEMs, one having eight parameters and three kinds of model responses, and the other having 47 parameters and a long-period response. We demonstrated that DGSA can be used for sensitivity problems with multiple responses and high-dimensional parameters efficiently.

Lu, Dan↗

A probabilistic creep model incorporating test condition, initial damage, and material property uncertainty

Uncertainty is prevalent in the creep resistance of alloys, where at elevated temperature and low pressure, rupture can range across logarithmic decades. In this study, a probabilistic continuum-damage-mechanics (CDM)-based model is derived to capture the uncertainty of creep resistance. To meet this objective, creep data for alloy 304 Stainless Steel is gathered. A constitutive model, “Sinh”, is calibrated deterministically to determine the statistical variability of the material properties. Three sources of uncertainty are injected into the model: test condition (stress and temperature), initial damage, and material properties. Probabilistic simulations are carried out by (a) calibrating probability distribution functions (pdfs) for each source of uncertainty (b) randomly sampling the pdfs using Monte Carlo methods and (c) executing simulations to replicate the uncertain creep behavior. A sensitivity analysis is performed to evaluate the relative effect of each source of uncertainty. In full probabilistic simulations, the cumulative uncertainty of creep behavior is evaluated. The probabilistic model accurately predicts the creep deformation and rupture of the available experiments. The probabilistic model is validated for interpolation but lacks extrapolation ability. Several future works are proposed to further improve the model.

36 MATERIALS SCIENCE↗

Future Wind Energy Resources and Cost Uncertainties Across the United States

This dataset contains results estimating projections of change of annual capacity factors and levelized cost of energy for several turbine technologies in the 2024 Annual Technology Baseline (ATB). Projections of change are based on downscaled earth system model (ESM) data from Sup3rCC. There has been evidence of reductions in average wind speeds over land in North America since the 1980s, and several models project that average wind speeds will continue to decrease. Concurrently, the cost of wind energy systems in the United States has been decreasing since around 2010, a trend also projected to continue. There is considerable uncertainty in these future projections, with quantitative estimates of future wind resource and system costs varying widely. To study this, we run land-based wind energy models with a range of possible future system costs, turbine designs, and meteorological inputs from multiple downscaled earth system models over the contiguous United States to estimate critical system performance metrics such as annual energy production (AEP) and levelized cost of energy. Where multiple earth system models agree, changes in mean AEP from the time period 2000-2019 to 2040-2059 can be as high as +10% in South Texas or as low as -20% in Iowa. Several additional states in the Midwest that currently have considerable wind generation capacity show the possibility of substantial decreases in AEP by mid-century. Larger turbines and moderate reductions in system costs can offset even the largest projected decreases in wind resource, but much uncertainty remains in the extent to which wind resources will actually change into the future and to what extent wind energy systems can drive down future costs. An analysis of variance shows, in several states in the Midwest, the uncertainty in future wind resource can be almost as important for future changes in the cost of wind energy as the uncertainty in future system costs.

17 WIND ENERGY↗

Variational Coupled Loads Analysis using the Hybrid Parametric Variation Method

Time-domain coupled loads analysis (CLA)is used to determine the response of a launch vehicle and payload system to transient forces, such as liftoff, engine ignitions and shutdowns, jettison events, and atmospheric flight loads, such as buffet. CLA, using Hurty/Craig-Bampton (HCB)component models, is the accepted method for the establishment of design-level loads for launch systems. However, uncertainty in the component models flows into uncertainty in predicted system results. Uncertainty in the structural responses during launch is a significant concern because small variations in launch vehicle and payload mode shapes and their interactions can result in significant variations in system loads. Uncertainty quantification (UQ)is used to determine statistical bounds on prediction accuracy based on model uncertainty. In this paper uncertainty is treated at the HCB component-model level. In an effort to account for model uncertainties and statistically bound their effect on CLA predictions, this work combines CLA with UQ in a process termed variational coupled loads analysis (VCLA). The modeling of uncertainty using a parametric approach, in which input parameters are represented by random variables, is common, but its major drawback is the resulting uncertainty is limited to the form of the nominal model. Uncertainty in model form is one of the biggest contributors to uncertainty in complex built-up structures. Model-form uncertainty can be represented using a nonparametric approach based on random matrix theory (RMT). In this work, UQ is performed using the hybrid parametric variation (HPV)method, which combines parametric with nonparametric uncertainty at the HCB component model level. The HPV method requires the selection of dispersion values for the HCB fixed-interface (FI)eigenvalues, and the HCB mass and stiffness matrices. The dispersions are based upon component test-analysis modal correlation results. During VCLA, random component models are assembled into an ensemble of random systems using a Monte Carlo (MC)approach. CLA is applied to each of the ensemble members to produce an ensemble of system-level responses for statistical analysis. The proposed methodology is demonstrated through its application to a buffet loads analysis of NASA’s Space Launch System (SLS)during the transonic regime fifty seconds after liftoff. Core stage (CS)section shears and moments are recovered, and statistics are computed.

Uncertainty Quantification↗

Monte-Carlo Analysis of Minimum Thermocouple Depths using Icarus

Icarus is a three-dimensional, unstructured, finite-volume material response solver developed at NASA Ames Research Center and has been verified against other NASA material response tools like FIAT, which have a long history of successfully designing thermal protection system (TPS). Icarus solves a set of conservation equations for mass and energy and uses Darcy’s Law in place of momentum conservation. An ecosystem of material response tools has been built around a general-purposed Icarus library that in addition to the typical material response analysis also supports TPS sizing (1-D and multi-dimensional), uncertainty quantification, and has been successfully integrated into a multi-physics architecture built around US3D. In this paper, a brief overview of Icarus and its capabilities will be presented using an illustrative Monte Carlo analysis of the one-dimensional, in-depth material response of a representative Dragonfly trajectory.

Material Response↗

Multi-model Hydroclimate Projections for the Alabama-Coosa-Tallapoosa River Basin in the Southeastern United States

Abstract This study uses a high-resolution, process-based modeling framework to assess the impacts of changing climate on water resources for the Alabama-Coosa-Tallapoosa River Basin in the southeastern United States. A 33-member ensemble of hydrologic projections was generated using 3 distributed hydrologic models (Precipitation-Runoff Modeling System, Variable Infiltration Capacity, and Distributed Hydrology Soil Vegetation Model) of different complexity. These hydrologic models were driven by dynamically downscaled and bias-corrected future climate simulations from 11 Coupled Model Intercomparison Project Phase 5 global climate models under Representative Concentration Pathway 8.5 emission scenario, with 40 years each in baseline (1966–2005) and future (2011–2050) periods. The hydroclimate response, in general, projects an increase in mean seasonal precipitation, runoff, and streamflow. The high and low flows are projected to increase and decrease, respectively, in general, suggesting increased likelihood of extreme rainfall events and intensification of the hydrologic cycle. The uncertainty associated with the ensemble hydroclimate response, analyzed through an analysis of variance technique, suggests that the choice of climate model is more critical than the choice of hydrologic model for the studied region. This study provides in-depth insights of hydroclimate response and associated uncertainties to support informed decisions by water resource managers.

54 ENVIRONMENTAL SCIENCES↗

Coupling SCALE with DAKOTA for Axial Burnup Profiles Assessment in Burnup Credit

This paper presents a computational study that demonstrates the application of the SCALE code system in conjunction with the Design Analysis Kit for Optimization and Terascale Applications (DAKOTA) for the analysis of key factors influencing the evaluation of burnup credit (BUC) in pressurized water reactors (PWRs). The primary objective of this analysis is to characterize the model by utilizing parameterization, uncertainty quantification, and optimization studies. Using this approach, we can comprehensively assess the system and conduct informed predictive studies. This study highlights the effectiveness of the SCALE code system integrated within the DAKOTA framework in terms of efficiency and capability. With the coupling of the burnup code ORIGAMI with the CSAS or TSUNAMI-3D sequence embedded in a DAKOTA analysis, we can characterize the factors that influence the k eff of PWR 17x17 spent nuclear fuel (SNF) in the GBC-32 computational benchmark cask for the assessment of BUC in criticality safety analysis. The coupling methodology used in this study is not exclusive to BUC analysis. However, the choice to apply this methodology to the BUC problem is particularly significant because of the diverse range of aspects it encompasses in nuclear criticality safety analyses. This problem presents a unique opportunity to explore and address multiple facets of such analyses related to BUC and illustrates the capability of the SCALE code system with DAKOTA. This analysis makes use of historical reference data for the axial burnup profile, where the entire space within the bounds is considered. Both SCALE and DAKOTA are currently integrated in the Nuclear Energy Advanced Modeling Simulation (NEAMS) Workbench code system, which has a user-friendly graphical interface that simplifies the setup of simulations and configuration of input parameters as well as the visualization of simulation results.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Robustness Analysis and Reliable Flight Regime Estimation of an Integrated Resilent Control System for a Transport Aircraft

Formal robustness analysis of aircraft control upset prevention and recovery systems could play an important role in their validation and ultimate certification. As a part of the validation process, this paper describes an analysis method for determining a reliable flight regime in the flight envelope within which an integrated resilent control system can achieve the desired performance of tracking command signals and detecting additive faults in the presence of parameter uncertainty and unmodeled dynamics. To calculate a reliable flight regime, a structured singular value analysis method is applied to analyze the closed-loop system over the entire flight envelope. To use the structured singular value analysis method, a linear fractional transform (LFT) model of a transport aircraft longitudinal dynamics is developed over the flight envelope by using a preliminary LFT modeling software tool developed at the NASA Langley Research Center, which utilizes a matrix-based computational approach. The developed LFT model can capture original nonlinear dynamics over the flight envelope with the ! block which contains key varying parameters: angle of attack and velocity, and real parameter uncertainty: aerodynamic coefficient uncertainty and moment of inertia uncertainty. Using the developed LFT model and a formal robustness analysis method, a reliable flight regime is calculated for a transport aircraft closed-loop system.

Shin, Jong-Yeob↗