Engineering PapersSearch

SEARCH · Engineering Papers

Results for “Model Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,009 records · Page 56

Nuclear Data Libraries Sensitivity Studies for ORSA Using SCALE

Subcritical assemblies offer valuable training capabilities in nuclear criticality safety (NCS) for individuals handling fissile material. At Oak Ridge National Laboratory(ORNL), the Oak Ridge Subcritical Assembly (ORSA), a new experimental facility, is being established to provide hands-on training for the Nuclear Criticality Safety Program (NCSP).It is essential to accurately determine the neutron multiplication factor (keff) to ensure that ORSA remains subcritical and safe during operations. This study investigated the sensitivity of keff to variations across Evaluated Nuclear Data File (ENDF/B) libraries, consisting of ENDF/B-VII.1, ENDF/B-VIII.0, and ENDF/B-VIII.1. The analysis was conducted using the CSAS6 sequence in the SCALE-6.3 code system. Individual isotopes in the ORSA model were replaced one at a time with ENDF/B-VII.1 as the base library and changing to ENDF/B-VIII.0or ENDF/B-VIII.1. The results demonstrated that the changes in keffof the nuclides associated with the ORSA model were mostly within the uncertainty of the base model (~24 pcm), except for primary nuclides like Uranium-235and H-poly with few other nuclides. The relative delta keff values of Uranium-235 and H-poly, expressed in pcm, were +280 and -212 in ENDF/B-VIII.0 and +332 and -275 in ENDF/B-VIII.1, respectively, which were notable changes in reactivity. These results demonstrated that ORSA was largely insensitive to variations across these nuclear data libraries.

Hong, Evan [North Carolina State University]

Dealing with Ion LET Uncertainties: An Application of Generalized Linear Models

Although most SEE rate estimation methods presume a fit to SEE cross section vs. LET, fitting SEE data is challenging because the data are not compatible with the assumptions of many common fitting techniques (e.g. linear regression. The difficulty of fitting such data is compounded when the LET of the ion responsible for an SEE is uncertain. We modify a Generalized Linear Model SEE data fitting methodology to accommodate uncertain LET and apply the method to the problem of backside heavy-ion SEE testing to demonstrate the utility of the method, explore the dependence of systematic errors that arise from improper treatment of LET uncertainty and develop guidelines for minimizing such systematic errors when proper treatment is not possible. Additional applications are suggested and assessed for suitability of treatment by the model.

Single-event effects

Health Management and Prognostics for Electric Aircraft Powertrain

W and c Any air borne vehicle needs incorporating safety as key parameter of measure, and inclusion of autonomy raises the critical need for safety under autonomous operations. Management of faults and component degradation is key as complexity in autonomous operations grow over the period of time. Therefore, in addition to basic operational requirements, an autonomous electric vehicle should be able to make accurate estimates of its current system health and take the correct decisions to complete its mission successfully. Real-time safety and state-awareness tools are therefore essential for the vehicle to be able to reach its destination in a safe and successful manner. The need for safety assurance and health management capabilities is particularly relevant for aircraft electric propulsion systems, which are relatively new and with limited historical to learn. They are critical systems requiring high power density along with reliability, resilience, efficient management of weight, and operational costs. A model- based fault diagnosis and prognostics approach of complex critical systems can successfully accomplish the safety and state awareness goal for such electric propulsion systems, enabling autonomous decision making capability for safe and efficient operation. To identify critical components in the system a Qualitative Bayesian approach using FMECA is implemented. This requires the assessment of some quantities representing the state of the electric unmanned aerial systems (e-UAS), as well as look-ahead forecasts of such states during the entire flight, presented in form of safety metrics (SM). In-service data and performance data gathered from degraded components sup- ports diagnostic and prognostic methods for these systems, but this data can be difficult to obtain as weight and packaging restrictions reduce redundancy and instrumentation on-board the vehicle. Therefore, an model-based framework should be capable or operating with limited data. In addition to data scarcity, the variability of such complex critical systems re- quires the model-based framework to reason in the presence of uncertainty, such as sensor noise, and modeling imperfections. Quantification of errors and uncertainties in the measured states and quantities is therefore a fundamental step for a precise estimation of such SMs; un-modeled uncertainty may result in erroneous state assessment and un- reliable predictions of future states of e-UAVs. Typical, centralized model-based schemes suffer from inherent disadvantages such as computational complexity, single point of failure, and scalability issues, and therefore may fail in such a complex scenario. This paper presents a methodology for developing a system level diagnostics and prognostics approach using a Qualitative Bayesian FMECA approach along with a formal uncertainty management framework for an e-UAS. In this work we demonstrate the efficacy of the framework to predict effects of sub-system level degradation on vehicle operation incorporating uncertainty management to predict future behavior under different operating conditions.

Kulkarni, Chetan

Exploring Afro-Asian water fluxes in CMIP5 and CMIP6 models: Present-day evaluation and future projections

Accurate representation and projection of water fluxes are vital, particularly in monsoon regions where seasonal variability and changes significantly impact water resources, agriculture, hydroelectric power generation, and the economy. This study uses both CMIP5 and CMIP6 models to investigate the present-day representation of key water flux components (including precipitation, evaporation, water vapor, and moisture advection) over the Afro-Asian region during the summer monsoon (JJAS). We also examine future changes under two emission scenarios and assess the underlying physical mechanisms driving these changes while identifying sources of projection uncertainty. Our results show that both models reasonably capture the present-day characteristics of water flux components, although with noticeable biases. Across most regions, we find that CMIP6 models demonstrate slight improvements over CMIP5 in the representation of these components. In a warmer future, a robust intensification of JJAS precipitation (exceeding 0.25 mm/day) is projected across the Afro-Asian region. This increase is largely driven by the vertical thermodynamic term associated with increasing temperature. We find that model uncertainty is the primary source of uncertainty in water flux projections, accounting for over 50 % of the total variance.

Climate change

Comparison between Hayabusa 2 Spectral Measurements and Simulations

Recent Hayabusa 2 spectral measurements are compared with state-of-the-art shock-layer radiation simulations resulting from the LAURA/HARA code suite. These simulations include coupled ablation, which accounts for the injection of ablation products into the flowfield, and coupled radiation, which accounts for radiative energy loss in the flowfield. To enable the cou- pled ablation simulations, a best-estimate model is developed for Hayabusa’s carbon-phenolic ablator based on available published information. The comparison between the simulations and measurements focuses on three atomic nitrogen lines, two atomic oxygen lines, one atomic hydrogen line, and the CN Violet band system. Parametric uncertainties are evaluated for these features using a recently developed capability in LAURA/HARA. These uncertainties capture the impact of flowfield and radiation modeling uncertainties on the observed radiation simulations, and include the impact of coupled radiation and ablation product emission. The resulting parametric uncertainties range from 50 to over 100% for the atomic lines, and 80% for CN Violet. Uncertainties in flowfield kinetics and non-Boltzmann modeling provide the dominant contribution to these uncertainties. For the atomic nitrogen and oxygen lines, com- parisons between the nominal simulations and measurements show agreement well within these simulation uncertainty bounds, with the measurements within 20% of the nominal simulation over most of the trajectory, and within 10% at peak emission. This excellent agreement is un- precedented for observed radiation measurements of atomic lines, where previous Stardust and Hayabusa 1 comparisons were significantly worse. The improved agreement for these Hayabusa 2 comparisons is both the result of improved measurement quality and enhanced flowfield and radiation modeling. For the ablation product emission from the 656 nm atomic hydrogen line, the agreement between measurements and simulations is within ±20% for all trajectory points except one outlier. This good comparison is surprising considering this species depends on the ablation rate and is shown to have strong wake contribution, which both contribute to the large ≈±70% parametric uncertainty. For the ablation product emission from CN Violet, the simulations over-predict the measurements by over a factor of two early in the trajectory, with the comparison improving later in the trajectory. This disagreement for CN Violet is consistent with the ≈±80% parametric uncertainty bounds evaluated for the simulations. To utilize the excellent agreement between the atomic line simulations and measurements in the assessment of the radiative heating margin for a future flight vehicle, the flowfield property binning (FPB) approach is applied. Using the Mars Sample Return (MSR) Earth Entry System (EES) as an example, the combination of the excellent Hayabusa comparisons and the FPB analysis justify nearly a 10% reduction in the radiative heating margin from an assumed baseline margin of 30%. This direct quantitative link between observed radiation measurements and the radia- tive heating margin of future flight vehicles demonstrates the value of these observed radiation measurements.

Shock-Layer Radiative Heating

Uncertainty Quantification of CFD Data Generated for a Model Scramjet Isolator Flowfield

Computational fluid dynamics is now considered to be an indispensable tool for the design and development of scramjet engine components. Unfortunately, the quantification of uncertainties is rarely addressed with anything other than sensitivity studies, so the degree of confidence associated with the numerical results remains exclusively with the subject matter expert that generated them. This practice must be replaced with a formal uncertainty quantification process for computational fluid dynamics to play an expanded role in the system design, development, and flight certification process. Given the limitations of current hypersonic ground test facilities, this expanded role is believed to be a requirement by some in the hypersonics community if scramjet engines are to be given serious consideration as a viable propulsion system. The present effort describes a simple, relatively low cost, nonintrusive approach to uncertainty quantification that includes the basic ingredients required to handle both aleatoric (random) and epistemic (lack of knowledge) sources of uncertainty. The nonintrusive nature of the approach allows the computational fluid dynamicist to perform the uncertainty quantification with the flow solver treated as a "black box". Moreover, a large fraction of the process can be automated, allowing the uncertainty assessment to be readily adapted into the engineering design and development workflow. In the present work, the approach is applied to a model scramjet isolator problem where the desire is to validate turbulence closure models in the presence of uncertainty. In this context, the relevant uncertainty sources are determined and accounted for to allow the analyst to delineate turbulence model-form errors from other sources of uncertainty associated with the simulation of the facility flow.

Baurle, R. A.

Component-level Performance and Mass Sensitivity Analysis of NEP MW-class Power System

Nuclear electric propulsion (NEP) is a promising option towards enabling missions to Mars and is an area of interest for NASA’s Space Nuclear Propulsion project. This project is currently investigating technology development opportunities for an NEP vehicle. Physics-based modeling can be used in the early stages of technology development to gain understanding of the effects of technology and performance assumptions on the system performance and mass. This information can then inform technology maturation planning for near term development. By using a Brayton power conversion model and vehicle mass model for megawatt class NEP applications, a sensitivity analysis is performed to assess the impact of individual components’ performance on the power conversion system performance and system mass. A Monte Carlo simulation is also used to determine the variability in system mass based on uncertainty within the modeling parameters. The sensitivity analysis shows a high sensitivity to power conversion inlet temperature, compressor inlet temperature, and recuperator performance. A Monte Carlo analysis suggests a range of -10% to +15% for a 90% confidence interval on system mass based on the uncertainties in the model inputs.

Nuclear electric propulsion

The Effect of Nondeterministic Parameters on Shock-Associated Noise Prediction Modeling

Engineering applications for aircraft noise prediction contain models for physical phenomenon that enable solutions to be computed quickly. These models contain parameters that have an uncertainty not accounted for in the solution. To include uncertainty in the solution, nondeterministic computational methods are applied. Using prediction models for supersonic jet broadband shock-associated noise, fixed model parameters are replaced by probability distributions to illustrate one of these methods. The results show the impact of using nondeterministic parameters both on estimating the model output uncertainty and on the model spectral level prediction. In addition, a global sensitivity analysis is used to determine the influence of the model parameters on the output, and to identify the parameters with the least influence on model output.

Dahl, Milo D.

Uncertainty Aware Structural Topology Optimization Via a Stochastic Reduced Order Model Approach

This work presents a stochastic reduced order modeling strategy for the quantification and propagation of uncertainties in topology optimization. Uncertainty aware optimization problems can be computationally complex due to the substantial number of model evaluations that are necessary to accurately quantify and propagate uncertainties. This computational complexity is greatly magnified if a high-fidelity, physics-based numerical model is used for the topology optimization calculations. Stochastic reduced order model (SROM) methods are applied here to effectively 1) alleviate the prohibitive computational cost associated with an uncertainty aware topology optimization problem; and 2) quantify and propagate the inherent uncertainties due to design imperfections. A generic SROM framework that transforms the uncertainty aware, stochastic topology optimization problem into a deterministic optimization problem that relies only on independent calls to a deterministic numerical model is presented. This approach facilitates the use of existing optimization and modeling tools to accurately solve the uncertainty aware topology optimization problems in a fraction of the computational demand required by Monte Carlo methods. Finally, an example in structural topology optimization is presented to demonstrate the effectiveness of the proposed uncertainty aware structural topology optimization approach.

Aguilo, Miguel A.

Relative effects on stratospheric ozone of halogenated methanes and ethanes of social and industrial interest

Four atmospheric modeling groups have calculated relative effects of several halocarbons (chlorofluorocarbons (CFC's)-11, 12, 113, 114, and 115; hydrochlorofluorocarbons (HCFC's) 22, 123, 124, 141b, and 142b; hydrofluorocarbons (HFC's) 125, 134a, 143a, and 152a, carbon tetrachloride; and methyl chloroform) on stratospheric ozone. Effects on stratospheric ozone were calculated for each compound and normalized relative to the effect of CFC-11. These models include the representations for homogeneous physical and chemical processes in the middle atmosphere but do no account for either heterogeneous chemistry or polar dynamics which are important in the spring time loss of ozone over Antarctica. Relative calculated effects using a range of models compare reasonably well. Within the limits of the uncertainties of these model results, compounds now under consideration as functional replacements for fully halogenated compounds have modeled stratospheric ozone reductions of 10 percent or less of that of CFC-11. Sensitivity analyses examined the sensitivity of relative calculated effects to levels of other trace gases, assumed transport in the models, and latitudinal and seasonal local dependencies. Relative effects on polar ozone are discussed in the context of evolving information on the special processes affecting ozone, especially during polar winter-springtime. Lastly, the time dependency of relative effects were calculated.

Fisher, Donald A.

Aircraft ride quality controller design using new robust root clustering theory for linear uncertain systems

The aspect of controller design for improving the ride quality of aircraft in terms of damping ratio and natural frequency specifications on the short period dynamics is addressed. The controller is designed to be robust with respect to uncertainties in the real parameters of the control design model such as uncertainties in the dimensional stability derivatives, imperfections in actuator/sensor locations and possibly variations in flight conditions, etc. The design is based on a new robust root clustering theory developed by the author by extending the nominal root clustering theory of Gutman and Jury to perturbed matrices. The proposed methodology allows to get an explicit relationship between the parameters of the root clustering region and the uncertainty radius of the parameter space. The current literature available for robust stability becomes a special case of this unified theory. The bounds derived on the parameter perturbation for robust root clustering are then used in selecting the robust controller.

Yedavalli, R. K.

Atmospheric Composition Change: Climate-Chemistry Interactions

Chemically active climate compounds are either primary compounds such as methane (CH4), removed by oxidation in the atmosphere, or secondary compounds such as ozone (O3), sulfate and organic aerosols, formed and removed in the atmosphere. Man-induced climate-chemistry interaction is a two-way process: Emissions of pollutants change the atmospheric composition contributing to climate change through the aforementioned climate components, and climate change, through changes in temperature, dynamics, the hydrological cycle, atmospheric stability, and biosphere-atmosphere interactions, affects the atmospheric composition and oxidation processes in the troposphere. Here we present progress in our understanding of processes of importance for climate-chemistry interactions, and their contributions to changes in atmospheric composition and climate forcing. A key factor is the oxidation potential involving compounds such as O3 and the hydroxyl radical (OH). Reported studies represent both current and future changes. Reported results include new estimates of radiative forcing based on extensive model studies of chemically active climate compounds such as O3, and of particles inducing both direct and indirect effects. Through EU projects such as ACCENT, QUANTIFY, and the AEROCOM project, extensive studies on regional and sector-wise differences in the impact on atmospheric distribution are performed. Studies have shown that land-based emissions have a different effect on climate than ship and aircraft emissions, and different measures are needed to reduce the climate impact. Several areas where climate change can affect the tropospheric oxidation process and the chemical composition are identified. This can take place through enhanced stratospheric-tropospheric exchange of ozone, more frequent periods with stable conditions favouring pollution build up over industrial areas, enhanced temperature-induced biogenic emissions, methane releases from permafrost thawing, and enhanced concentration through reduced biospheric uptake. During the last 510 years, new observational data have been made available and used for model validation and the study of atmospheric processes. Although there are significant uncertainties in the modelling of composition changes, access to new observational data has improved modelling capability. Emission scenarios for the coming decades have a large uncertainty range, in particular with respect to regional trends, leading to a significant uncertainty range in estimated regional composition changes and climate impact.

Atmosphere climate chemistry

Comparison of Aircraft Models and Integration Schemes for Interval Management in the TRACON

Reusable models of common elements for communication, computation, decision and control in air traffic management are necessary in order to enable simulation, analysis and assurance of emergent properties, such as safety and stability, for a given operational concept. Uncertainties due to faults, such as dropped messages, along with non-linearities and sensor noise are an integral part of these models, and impact emergent system behavior. Flight control algorithms designed using a linearized version of the flight mechanics will exhibit error due to model uncertainty, and may not be stable outside a neighborhood of the given point of linearization. Moreover, the communication mechanism by which the sensed state of an aircraft is fed back to a flight control system (such as an ADS-B message) impacts the overall system behavior; both due to sensor noise as well as dropped messages (vacant samples). Additionally simulation of the flight controller system can exhibit further numerical instability, due to selection of the integration scheme and approximations made in the flight dynamics. We examine the theoretical and numerical stability of a speed controller under the Euler and Runge-Kutta schemes of integration, for the Maintain phase for a Mid-Term (2035-2045) Interval Management (IM) Operational Concept for descent and landing operations. We model uncertainties in communication due to missed ADS-B messages by vacant samples in the integration schemes, and compare the emergent behavior of the system, in terms of stability, via the boundedness of the final system state. Any bound on the errors incurred by these uncertainties will play an essential part in a composable assurance argument required for real-time, flight-deck guidance and control systems,. Thus, we believe that the creation of reusable models, which possess property guarantees, such as safety and stability, is an innovative and essential requirement to assessing the emergent properties of novel airspace concepts of operation.

Neogi, Natasha

Radiation Quality Effects on Transcriptome Profiles in 3-D Cultures After Charged Particle Irradiation

In this work, we evaluated the differential effects of low- and high-LET radiation on 3-D organotypic cultures in order to investigate radiation quality impacts on gene expression and cellular responses. Current risk models for assessment of space radiation-induced cancer have large uncertainties because the models for adverse health effects following radiation exposure are founded on epidemiological analyses of human populations exposed to low-LET radiation. Reducing these uncertainties requires new knowledge on the fundamental differences in biological responses (the so-called radiation quality effects) triggered by heavy ion particle radiation versus low-LET radiation associated with Earth-based exposures. In order to better quantify these radiation quality effects in biological systems, we are utilizing novel 3-D organotypic human tissue models for space radiation research. These models hold promise for risk assessment as they provide a format for study of human cells within a realistic tissue framework, thereby bridging the gap between 2-D monolayer culture and animal models for risk extrapolation to humans. To identify biological pathway signatures unique to heavy ion particle exposure, functional gene set enrichment analysis (GSEA) was used with whole transcriptome profiling. GSEA has been used extensively as a method to garner biological information in a variety of model systems but has not been commonly used to analyze radiation effects. It is a powerful approach for assessing the functional significance of radiation quality-dependent changes from datasets where the changes are subtle but broad, and where single gene based analysis using rankings of fold-change may not reveal important biological information.

Patel, Zarana S.

Multi‐Model Ensembles in Ecosystem Modeling: Challenges and Best Practices for Decision‐Making

Ecosystem models are increasingly central to the decision-making for environmental policy, conservation planning, and climate-related investments. Yet, the growing reliance on Multi-Model Ensembles (MMEs) of ecosystem models by practitioners and policymakers, sometimes under tight timelines and imperfect information, has frequently outpaced the scientific rigor required to ensure ensemble reliability. Here, MMEs refer to approaches that combine targeted predictions from multiple models with the expectation of improving robustness and quantifying predictive uncertainty. Poorly designed MMEs may create a false sense of confidence and lead to suboptimal policy and market decisions. This perspective argues that robust decision-making-relevant MMEs must be grounded on two pillars: (1) rigorous Model Intercomparison Projects (MIPs), which identify inter-model agreement and disagreement, characterize model uncertainties, and evaluate robustness with observationally based benchmarks—MIPs' diagnostic evaluation is so critical that it must be needed to drive MME's decision in model selection and weighting, especially when only a limited number of models available; and (2) co-design by both stakeholders and scientists to ensure that scenarios, metrics and uncertainty requirements provide decision-relevant information. Building upon the past success and lessons from the existing MIPs-MMEs efforts (e.g., climate/Earth system/crop), we derived the theoretical basis for MMEs, addressed their specific challenges in ecosystem modeling, and highlighted proper consideration of model numbers and diversity, risk of model inter-dependence, effective calibration of model parameters, possible overdue of some ecosystem model development, critical roles of open benchmark data across a wide range of conditions, and suggested use of Artificial Intelligence to support MIPs-MMEs. We highlighted the under-recognized opportunity for MIPs and MMEs to drive scientific progress and innovation through identifying better performing models, systematic benchmarking, feedback loops, and targeted model improvement. By following actionable best practice guidelines, MMEs can evolve from ad hoc aggregation of models into a trusted backbone of environmental policy and decision-making.

ecosystem modeling

Uncertainty Quantification and Certification Prediction of Low-Boom Supersonic Aircraft Configurations

The primary objective of this work was to develop and demonstrate a process for accurate and efficient uncertainty quantification and certification prediction of low-boom, supersonic, transport aircraft. High-fidelity computational fluid dynamics models of multiple low-boom configurations were investigated including the Lockheed Martin SEEB-ALR body of revolution, the NASA 69 Delta Wing, and the Lockheed Martin 1021-01 configuration. A nonintrusive polynomial chaos surrogate modeling approach was used for reduced computational cost of propagating mixed, inherent (aleatory) and model-form (epistemic) uncertainty from both the computation fluid dynamics model and the near-field to ground level propagation model. A methodology has also been introduced to quantify the plausibility of a design to pass a certification under uncertainty. Results of this study include the analysis of each of the three configurations of interest under inviscid and fully turbulent flow assumptions. A comparison of the uncertainty outputs and sensitivity analyses between the configurations is also given. The results of this study illustrate the flexibility and robustness of the developed framework as a tool for uncertainty quantification and certification prediction of low-boom, supersonic aircraft.

West, Thomas K., IV

GCR Environmental Models I: Sensitivity Analysis for GCR Environments

Accurate galactic cosmic ray (GCR) models are required to assess crew exposure during long-duration missions to the Moon or Mars. Many of these models have been developed and compared to available measurements, with uncertainty estimates usually stated to be less than 15%. However, when the models are evaluated over a common epoch and propagated through to effective dose, relative differences exceeding 50% are observed. This indicates that the metrics used to communicate GCR model uncertainty can be better tied to exposure quantities of interest for shielding applications. This is the first of three papers focused on addressing this need. In this work, the focus is on quantifying the extent to which each GCR ion and energy group, prior to entering any shielding material or body tissue, contributes to effective dose behind shielding. Results can be used to more accurately calibrate model-free parameters and provide a mechanism for refocusing validation efforts on measurements taken over important energy regions. Results can also be used as references to guide future nuclear cross-section measurements and radiobiology experiments. It is found that GCR with Z>2 and boundary energies below 500 MeV/n induce less than 5% of the total effective dose behind shielding. This finding is important given that most of the GCR models are developed and validated against Advanced Composition Explorer/Cosmic Ray Isotope Spectrometer (ACE/CRIS) measurements taken below 500 MeV/n. It is therefore possible for two models to very accurately reproduce the ACE/CRIS data while inducing very different effective dose values behind shielding.

Slaba, Tony C.