Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,153 records · Page 64

Improved information criteria for Bayesian model averaging in lattice field theory

Bayesian model averaging is a practical method for dealing with uncertainty due to model specification. Use of this technique requires the estimation of model probability weights. Here, we revisit the derivation of estimators for these model weights. Use of the Kullback-Leibler divergence as a starting point leads naturally to a number of alternative information criteria suitable for Bayesian model weight estimation. We explore three such criteria, known to the statistics literature before, in detail: a Bayesian analog of the Akaike information criterion which we call the BAIC, the Bayesian predictive information criterion, and the posterior predictive information criterion (PPIC). We compare the use of these information criteria in numerical analysis problems common in lattice field theory calculations. We find that the PPIC has the most appealing theoretical properties and can give the best performance in terms of model-averaging uncertainty, particularly in the presence of noisy data, while the BAIC is a simple and reliable alternative.

97 MATHEMATICS AND COMPUTING↗

Modelling System Processes to Support Uncertainty Analysis and Robustness Evaluation

In the use of advanced systems control techniques in the development of a dynamic system, results from effective mathematical modelling is required. Historically, in some cases the use of a model which only reflects the "expected" or "nominal" important -information about the system's internal processes has resulted in acceptable system performance, but it should be recognized that for those cases success was due to a combination of the remarkable inherent potential of feedback control for robustness and fortuitously wide margins between system performance requirements and system performance capability. In the cases of a CELSS development, no such fortuitous combinations should be expected, and it should be expected that the uncertainty in the information on the system's processes will have to be taken into account in order to generate a performance robust design. In this paper, we develop one perspective of the issue of providing robustness as mathematical modelling impacts it, and present some examples of model formats which serve the needed purpose.

Blackwell, Charles↗

Updating and Refining BISON TRISO Assessment

Several advanced reactor concepts consider tristructural isotropic (TRISO) fuel in their designs. To support the advanced reactor industry, the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program within the U.S. Department of Energy (DOE) is developing modeling and simulation capabilities within the BISON fuel performance code. Assessment of these capabilities against available experi- mental data, such as the Advanced Gas Reactor (AGR) program, is essential in instilling confidence in the code predictions. Associated uncertainties in model inadequacy, experimental measurements, and manufacturing are also of importance. This report discusses the updating and standardization of the existing assessment suite in BISON for TRISO fuel performance analysis. The cases considered the AGR-1, AGR-2, and AGR-3/4 experimental programs. The report also includes a preliminary investigation into the sources of model inadequacy associated with silver (Ag) release fractions using the AGR-2 Compact 2-1-2 as a case study. The results indicate that uncertainties in the operating temperatures supplied to the model and the form of those temperature conditions (spatially averaged versus spatially resolved) both affect Ag release predictions. This suggests that previously observed model inadequacy can be attributed to both physical models and the operating conditions supplied to them. These findings will be leveraged to guide development of assessment cases for additional experiments and refinement of physical models for behaviors that potentially influence Ag release, such as palladium penetration.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Leveraging machine learning to improve understanding and predictability of weather/climate extremes and the resilience of human systems

Focal Area(s): Developing hybrid models for predicting weather/climate extremes at the intersection of the urban environment (focal area #2). Science Challenge: Limited by many sources of uncertainty, numerical models are unable to accurately simulate weather and climate processes and this problem is particularly acute for modeling extreme events, including hurricanes. Moreover, computational limits within these numerical models bound our ability to develop large ensembles to explore this uncertainty and the implications relative to characterization of risk and resilience within the human systems that are impacted by changes in extremes.

54 ENVIRONMENTAL SCIENCES↗

Uncertainty quantification of material parameters in modeling coupled metal and high explosive experiments

Experiments involving the coupling of metal and high explosives (HE) are of notable defense-related interest, and we seek to refine the uncertainty quantification associated with models of such experiments. In particular, our focus is on how uncertainty related to the metal constitutive model challenges our ability to infer high explosive model parameters when analyzing focused science experiments. We consider three focused experiments involving an HE accelerating metal: small plate tests with tantalum/LX-14 and tantalum/LX-17 pairings as well as a tantalum/LX-17 cylinder test. For all three models, we perform sensitivity analysis to ascertain the influence of metal strength on the coupled experimental response. Moreover, we calibrate each model in a Bayesian setting and study the quantification of metal strength on the inference of the HE parameters. Based on our results, we offer guidance for future metal/HE experiments.

36 MATERIALS SCIENCE↗

Soil enzymes as indicators of soil function: A step toward greater realism in microbial ecological modeling

Soil carbon (C) and nitrogen (N) cycles and their complex responses to environmental changes have received increasing attention. However, large uncertainties in model predictions remain, partially due to the lack of explicit representation and parameterization of microbial processes. One great challenge is to effectively integrate rich microbial functional traits into ecosystem modeling for better predictions. Here, using soil enzymes as indicators of soil function, we developed a competitive dynamic enzyme allocation scheme and detailed enzyme-mediated soil inorganic N processes in the Microbial-ENzyme Decomposition (MEND) model. We conducted a rigorous calibration and validation of MEND with diverse soil C-N fluxes, microbial C:N ratios, and functional gene abundances from a 12-year CO 2 × N grassland experiment (BioCON) in Minnesota, USA. In addition to accurately simulating soil CO 2 fluxes and multiple N variables, the model correctly predicted microbial C:N ratios and their negative response to enriched N supply. Model validation further showed that, compared to the changes in simulated enzyme concentrations and decomposition rates, the changes in simulated activities of eight C-N-associated enzymes were better explained by the measured gene abundances in responses to elevated atmospheric CO 2 concentration. In conclusion, our results demonstrated that using enzymes as indicators of soil function and validating model predictions with functional gene abundances in ecosystem modeling can provide a basis for testing hypotheses about microbially mediated biogeochemical processes in response to environmental changes. Further development and applications of the modeling framework presented here will enable microbial ecologists to address ecosystem-level questions beyond empirical observations, toward more predictive understanding, an ultimate goal of microbial ecology.

59 BASIC BIOLOGICAL SCIENCES↗

From Exploration Flight Test-1 to Artemis II--A NASA Langley's Orion Aerosciences Overview

The Orion Aerosciences program at NASA Langley has played a central role in advancing the aerodynamic and aeroheating prediction capabilities required for the Orion crew vehicle’s return from deep space. This presentation provides a technical overview of aerosciences contributions spanning Exploration Flight Test-1 (EFT-1), Artemis I, and the ongoing post-flight analysis of Artemis II. EFT-1 provided the first high-energy entry dataset for Orion, enabling critical validation of aerodynamic force and moment predictions, static and dynamic stability characteristics, and aeroheating environments at relevant flight Mach and Reynolds numbers. Flight-derived pressure data were used to refine the Flush Air Data System (FADS) methodology for atmospheric density reconstruction and to improve Best Estimated Trajectory (BET) solutions. The EFT-1 data also offered key insights into heat shield performance, including char layer recession, in-depth thermal response, and material retention behavior under flight conditions, informing updates to both thermal response models and uncertainty quantification practices. Building on EFT-1, Artemis I extended the database to true lunar-return conditions. Observations of heat shield performance, including localized char loss, bondline response, and recession variability, provided an unprecedented opportunity to reassess Thermal Protection System (TPS) and aeroheating modeling assumptions. Aerodynamic reconstruction efforts incorporated improved FADS calibration, enhanced atmospheric modeling, and refined force and moment databases to reduce trajectory and load uncertainties. Aeroheating comparisons between pre-flight predictions and flight data enabled targeted model updates, particularly in transitional flow environments and wake heating regions. For Artemis II, these lessons were systematically incorporated into the pre-flight prediction process. Updates included refined aerodynamic databases anchored to flight-validated corrections, improved density estimation and BET methodologies using enhanced database interpolation algorithm and FADS modeling, and revised aeroheating design environments informed by Artemis I material response observations. By the time of the workshop, Artemis II post-flight analysis will be underway, and preliminary findings will be presented where available, including early comparisons of aerodynamic reconstruction, atmospheric density estimation, and thermal protection system performance relative to updated predictions. Collectively, this body of work is a testament to the dedicated and multidisciplinary team whose sustained efforts have contributed to the program’s success and to the progressive maturation of Orion aerosciences modeling through numerical modeling, ground and flight data assimilation. The integrated advancement of aerodynamics, trajectory reconstruction, FADS-based density estimation, and aeroheating analysis has reduced predictive uncertainty and strengthened confidence for future crewed lunar and deep-space missions.

Orion↗

Robust Data-Driven Predictive Run-to-Run Control for Automated Serial Sectioning

This letter presents a one-step predictive run-to-run controller (R2R-MPC) for the automation of mechanical serial sectioning (MSS), a destructive material analysis process. To address the inherent uncertainty and disturbances in the MSS process, a robust closed-loop approach is presented. Here, the robust R2R-MPC models the uncertainty of the MSS process using a linear differential inclusion. As an analytical model of the MSS process is unavailable, the differential inclusion is identified from historical data. The R2R-MPC is posed as an optimization problem that computes incremental changes to the control input which minimize the worst-case material removal errors. This optimization-based controller is combined with a run-to-run controller to provide integral action that rejects constant disturbances and tracks constant reference removal rates. To demonstrate the efficacy of our robust R2R-MPC, we present simulation results which compare the presented controller with a conventional non-robust R2R.

42 ENGINEERING↗

Climate Change Signal in Atlantic Tropical Cyclones Today and Near Future

This manuscript discusses the challenges in detecting and attributing recently observed trends in the Atlantic tropical cyclone (TC) and the epistemic uncertainty we face in assessing future risk. We use synthetic storms downscaled from five CMIP5 models by the Columbia HAZard model (CHAZ), and directly simulated storms from high-resolution climate models. We examine three aspects of recent TC activity: the upward trend and multi-decadal oscillation of the annual frequency, the increase in storm wind intensity, and the decrease in forward speed. Some data sets suggest that these trends and oscillation are forced while others suggest that they can be explained by natural variability. Projections under warming climate scenarios also show a wide range of possibilities, especially for the annual frequencies, which increase or decrease depending on the choice of moisture variable used in the CHAZ model and on the choice of climate model. The uncertainties in the annual frequency lead to epistemic uncertainties in TC risk assessment. Here, we investigate the potential for reduction of these epistemic uncertainties through a statistical practice, namely likelihood analysis. We find that historical observations are more consistent with the simulations with increasing frequency than those with decreasing frequency, but we are not able to rule out the latter. We argue that the most rational way to treat epistemic uncertainty is to consider all outcomes contained in the results. In the context of risk assessment, since the results contain possible outcomes in which TC risk is increasing, this view implies that the risk is increasing.

54 ENVIRONMENTAL SCIENCES↗

Proton-induced fragmentation of carbon at energies below 100 MeV

Radiation effects caused by single cosmic ray particles have been studied for many years in radiobiological experiments for different biological objects and biological end-points. Additionally, single event effects in microelectronic devices have gained large interest. There are two fundamental mechanisms by which a single particle can cause radiation effects. On the one hand, a cosmic ray ion with high linear energy transfer can deposit a high dose along its path. On the other hand, in a nuclear collision, a high dose can be deposited by short range particles emitted from the target nucleus. In low earth orbits a large contribution to target fragmentation events originates from trapped protons which are encountered in the South Atlantic Anomaly. These protons have energies up to a few hundred MeV. We study the fragmentation of C, O and Si nuclei - the target nuclei of biological material and microelectronic devices - in nuclear collisions. Our aim is to measure production cross sections, energy spectra, emission directions and charge correlations of the emitted fragments. The present knowledge concerning these data is rather poor. M. Alurralde et al. have calculated cross sections and average energies of fragments produced from Si using the cascade-evaporation model. D.M. Ngo et al. have used the semiempirical cross section formula of Silberberg and Tsao to calculate fragment yields and the statistical model of Goldhaber to describe the reaction kinematics. Cross sections used in these models have uncertainties within a factor of two. Our data will help to test and improve existing models especially for energies below 300 MeV/nucleon. Charge correlations of fragments emitted in the same interaction are of particular importance, since high doses can be deposited if more than one heavy fragment with a short range is produced.

Schmitz, M.↗

National population mapping from sparse survey data: A hierarchical Bayesian modeling framework to account for uncertainty

Population estimates are critical for government services, development projects, and public health campaigns. Such data are typically obtained through a national population and housing census. However, population estimates can quickly become inaccurate in localized areas, particularly where migration or displacement has occurred. Some conflict-affected and resource-poor countries have not conducted a census in over 10 y. We developed a hierarchical Bayesian model to estimate population numbers in small areas based on enumeration data from sample areas and nationwide information about administrative boundaries, building locations, settlement types, and other factors related to population density. We demonstrated this model by estimating population sizes in every 10- m grid cell in Nigeria with national coverage. These gridded population estimates and areal population totals derived from them are accompanied by estimates of uncertainty based on Bayesian posterior probabilities. The model had an overall error rate of 67 people per hectare (mean of absolute residuals) or 43% (using scaled residuals) for predictions in out-of-sample survey areas (approximately 3 ha each), with increased precision expected for aggregated population totals in larger areas. This statistical approach represents a significant step toward estimating populations at high resolution with national coverage in the absence of a complete and recent census, while also providing reliable estimates of uncertainty to support informed decision making.

99 GENERAL AND MISCELLANEOUS↗

Dealing with Measurement Uncertainties as Nuisance Parameters in Bayesian Model Calibration

In the presence of model discrepancy, the calibration of physics-based models for physical parameter inference is a challenging problem. Lack of identifiability between calibration parameters and model discrepancy requires additional identifiability constraints to be placed on the model discrepancy to obtain unique physical parameter estimates. If these assumptions are violated, the inference for the calibration parameters can be systematically biased. In many applications, such as in dynamic material property experiments, many of the calibration inputs refer to measurement uncertainties. Here, we develop a metric for identifying overfitting of these measurement uncertainties, propose a prior capable of reducing this overfitting, and show how this leads to a diagnostic tool for validation of physical parameter inference. The approach is demonstrated for a benchmark example and applied for a material property application to perform inference on the equation of state parameters of tantalum.

97 MATHEMATICS AND COMPUTING↗

Validation of the DESI-DR1 3x2-pt analysis: scale cut and shear ratio tests

Combined survey analyses of galaxy clustering and weak gravitational lensing (3x2-pt studies) will allow new and accurate tests of the standard cosmological model. However, careful validation is necessary to ensure that these cosmological constraints are not biased by uncertainties associated with the modelling of astrophysical or systematic effects. In this study we validate the combined 3x2-pt analysis of the Dark Energy Spectroscopic Instrument Data Release 1 (DESI-DR1) spectroscopic galaxy clustering and overlapping weak lensing datasets from the Kilo-Degree Survey (KiDS), the Dark Energy Survey (DES), and the Hyper-Suprime-Cam Survey (HSC). By propagating the modelling uncertainties associated with the non-linear matter power spectrum, non-linear galaxy bias and baryon feedback, we design scale cuts to ensure that measurements of the matter density and the amplitude of the matter power spectrum are biased by less than 30% of the statistical error. We also test the internal consistency of the data and weak lensing systematics by performing new measurements of the lensing shear ratio. We demonstrate that the DESI-DR1 shear ratios can be successfully fit by the same model used to describe cosmic shear correlations, and analyse the additional information that can be extracted about the source redshift distributions and intrinsic alignment parameters. This study serves as crucial preparation for the upcoming cosmological parameter analysis of these datasets.

Emas, N. [Swinburne U., Ctr. Astrophys. Supercompu↗

CloudSat-Constrained Cloud Ice Water Path and Cloud Top Height Retrievals from MHS 157 and 183.3 GHz Radiances

Ice water path (IWP) and cloud top height (ht) are two of the key variables in determining cloud radiative and thermodynamical properties in climate models. Large uncertainty remains among IWP measurements from satellite sensors, in large part due to the assumptions made for cloud microphysics in these retrievals. In this study, we develop a fast algorithm to retrieve IWP from the 157, 183.3+/-3 and 190.3 GHz radiances of the Microwave Humidity Sounder (MHS) such that the MHS cloud ice retrieval is consistent with CloudSat IWP measurements. This retrieval is obtained by constraining the empirical forward models between collocated and coincident measurements of CloudSat IWP and MHS cloud-induced radiance depression (Tcir) at these channels. The empirical forward model is represented by a lookup table (LUT) of Tcir-IWP relationships as a function of ht and the frequency channel.With ht simultaneously retrieved, the IWP is found to be more accurate. The useful range of the MHS IWP retrieval is between 0.5 and 10 kg/sq m, and agrees well with CloudSat in terms of the normalized probability density function (PDF). Compared to the empirical model, current operational radiative transfer models (RTMs) still have significant uncertainties in characterizing the observed Tcir-IWP relationships. Therefore, the empirical LUT method developed here remains an effective approach to retrieving ice cloud properties from the MHS-like microwave channels.

cloud top height↗

ELM‐MOSART‐DOC: A Large‐Scale Riverine Dissolved Organic Carbon Model and Its Application Over the United States

Riverine dissolved organic carbon (DOC), primarily sourced from soil organic carbon (SOC), plays a crucial role in regional and global carbon cycles. However, the complexities of the underlying mechanisms and limited observations present significant challenges for predictive understanding of DOC at regional or larger scales. Recently, we developed a machine learning‐based (ML) map of DOC transformation rates, bridging the gap between SOC and DOC leaching flux and simplifying terrestrial DOC representation. Building on this advancement, we introduce ELM‐MOSART‐DOC, a DOC module integrated into the riverine component of the Energy Exascale Earth System Model (E3SM)—the Model for Scale Adaptive River Transport (MOSART). ELM‐MOSART‐DOC simulates DOC transport and transformation across both headwater streams and river networks, including those managed. Model validation demonstrates the ability of ELM‐MOSART‐DOC to accurately capture long‐term average DOC concentrations, with Kling‐Gupta Efficiency (KGE) scores of 0.58 and 0.76 at large and local stations, respectively. We further assess the impact of reservoirs through different simulation schemes, revealing that reservoirs significantly alter DOC fluxes by regulating streamflow patterns and promoting DOC mineralization. Model simulations indicate that reservoirs reduce total DOC flux from the Mississippi River into the ocean by 7.5%, with the long‐term average annual export decreasing from 3.34 to 3.14 teragrams (Tg) per year. ELM‐MOSART‐DOC integrates process‐based modeling with ML parameterization to enhance the predictive understanding of riverine biogeochemical processes. This approach reduces uncertainties in modeling regional and global carbon cycle ESMs and provides new insights into carbon cycling and its implications for global environmental change.

Li, Lingbo [Univ. of Houston, TX (United States); ↗

The Aqua-Planet Experiment (APE): CONTROL SST Simulation

Climate simulations by 16 atmospheric general circulation models (AGCMs) are compared on an aqua-planet, a water-covered Earth with prescribed sea surface temperature varying only in latitude. The idealised configuration is designed to expose differences in the circulation simulated by different models. Basic features of the aqua-planet climate are characterised by comparison with Earth. The models display a wide range of behaviour. The balanced component of the tropospheric mean flow, and mid-latitude eddy covariances subject to budget constraints, vary relatively little among the models. In contrast, differences in damping in the dynamical core strongly influence transient eddy amplitudes. Historical uncertainty in modelled lower stratospheric temperatures persists in APE.Aspects of the circulation generated more directly by interactions between the resolved fluid dynamics and parameterized moist processes vary greatly. The tropical Hadley circulation forms either a single or double inter-tropical convergence zone (ITCZ) at the equator, with large variations in mean precipitation. The equatorial wave spectrum shows a wide range of precipitation intensity and propagation characteristics. Kelvin mode-like eastward propagation with remarkably constant phase speed dominates in most models. Westward propagation, less dispersive than the equatorial Rossby modes, dominates in a few models or occurs within an eastward propagating envelope in others. The mean structure of the ITCZ is related to precipitation variability, consistent with previous studies.The aqua-planet global energy balance is unknown but the models produce a surprisingly large range of top of atmosphere global net flux, dominated by differences in shortwave reflection by clouds. A number of newly developed models, not optimised for Earth climate, contribute to this. Possible reasons for differences in the optimised models are discussed.The aqua-planet configuration is intended as one component of an experimental hierarchy used to evaluate AGCMs. This comparison does suggest that the range of model behaviour could be better understood and reduced in conjunction with Earth climate simulations. Controlled experimentation is required to explore individual model behavior and investigate convergence of the aqua-planet climate with increasing resolution.

AGCM↗

Hall Thruster Thermal Modeling and Test Data Correlation

The life of Hall Effect thrusters are primarily limited by plasma erosion and thermal related failures. NASA Glenn Research Center (GRC) in cooperation with the Jet Propulsion Laboratory (JPL) have recently completed development of a Hall thruster with specific emphasis to mitigate these limitations. Extending the operational life of Hall thursters makes them more suitable for some of NASA's longer duration interplanetary missions. This paper documents the thermal model development, refinement and correlation of results with thruster test data. Correlation was achieved by minimizing uncertainties in model input and recognizing the relevant parameters for effective model tuning. Throughout the thruster design phase the model was used to evaluate design options and systematically reduce component temperatures. Hall thrusters are inherently complex assemblies of high temperature components relying on internal conduction and external radiation for heat dispersion and rejection. System solutions are necessary in most cases to fully assess the benefits and/or consequences of any potential design change. Thermal model correlation is critical since thruster operational parameters can push some components/materials beyond their temperature limits. This thruster incorporates a state-of-the-art magnetic shielding system to reduce plasma erosion and to a lesser extend power/heat deposition. Additionally a comprehensive thermal design strategy was employed to reduce temperatures of critical thruster components (primarily the magnet coils and the discharge channel). Long term wear testing is currently underway to assess the effectiveness of these systems and consequently thruster longevity.

Hall thruster↗

Emissions Characterization and Smoke Transport of A Prescribed Fire

Under the background of climate change, vast regions of the world will face a hotter and probably drier future that favors ignition and spread of wildfires. This poses additional challenges to the communities who are fighting the ever-larger wildfires. Fire and smoke models are valuable tools to fire managers and decision-makers to mitigate the impact of fires. Existing fire modeling systems bear large uncertainties due to the difficulty in collecting data to characterize fire behavior and smoke transport. More observations are urgently needed for improvement of fire modeling and reduction in model uncertainty. The coordinated prescribed burn experiment, such as the Fire and Smoke Model and Measurement Evaluation Experiment (FSMMEE), will allow the concurrent collection of critical measurements of fuel, fire behavior, smoke, and meteorology to better understand and model fires. In this preliminary investigation, we employed the data from the prescribed burn experiment at Langdon Mountain, Utah, in November 2019, to reconstruct the fire emissions and characterize the smoke transport. The NASA Unified Weather Research and Forecasting Model (NU-WRF) was utilized to assist in identifying the potential pre-fire remote sensing capabilities, such as fuel load, moisture, and fire radiative power, which are helpful to model development and advancement. Along the way, two sets of NU-WRF experiments would be done by applying either a default fire emissions inventory (i.e., NASA’s Quick Fire Emissions Dataset, QFED) or reconstructed fire emissions using the data collected from the prescribed fire. The results would help answer the questions such as “How do reconstructed emissions compare to QFED emissions and their impact on plume transport”.

NU-WRF↗