Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Additively Manufactured Balances for Propulsive Force Measurement

Propulsive forces and moments during powered descent are not understood well enough to design an entry, decent, and landing vehicle with high confidence using solely computational fluid dynamics modelling (CFD). Therefore, wind tunnel testing is required to quantify uncertainties in computational modeling and simulation. Wind tunnel balances are structural, high-precision, multi-axis force transducers that provide direct measurement of these aerodynamic forces and moments, however their complex designs make them costly and time consuming to produce and approaches used to manufacture them have not changed significantly since the 1960s. This work demonstrates that additive manufacturing (AM) can be used to manufacture wind tunnel balances with significantly reduced fabrication time and expense. Moreover, the design flexibility afforded by the additive manufacturing process has the potential to enable new capabilities with respect to measuring propulsion forces during entry, decent, and landing testing. Here we present two novel balance designs enabled by AM. One will provide direct measurement of aerodynamic interference forces and moments on powered descent models (retropropulsion forces) to support CFD validation and further development of Mars human landing vehicle concepts. The second design will be used to characterize a reaction control system during entry decent and landing testing over a wide Mach number range.

Wind tunnel balance↗
NASA NTRSDate not supplied

Adding GPU Support to the Markov Chain Monte Carlo Code Catmip

In geophysics, we are confronted with many under-determined inverse problems. For example, all of our observations of earthquakes are made at the Earth’s surface. So, when we try to infer how slip during an earthquake evolves in space and time, we find that there are many potential slip histories that are consistent with our limited observations and our understanding of earthquake physics. One way to approach these problems is with Bayesian analysis which allows us to infer the ensemble of all potential slip models that satisfy the observations and our prior knowledge of earthquake physics. In Bayesian analysis, our prior knowledge is known as the prior probability density function or prior PDF, the fit to the data is known as the data likelihood, and the target PDF that satisfies both the prior PDF and data likelihood is known as the posterior PDF. However, simulating the posterior PDF typically requires using Markov Chain Monte Carlo (MCMC) to draw tens of billions of random realizations of earthquake slip models, which may not be computationally feasible. To make this and similar geophysical inversions computationally tractable, we developed the Cascading Adaptive Transitional Metropolis In Parallel (CATMIP) algorithm. CATMIP is an efficient parallel Markov Chain Monte Carlo (MCMC) sampler that is used for model fitting and uncertainty quantification in geophysics. Example use cases are earthquake rupture modeling, determining mineral composition on Mars, reconstructing the history of ocean salinity, and historical earthquake relocation. CATMIP employs many parallel instances of the Metropolis algorithm for sampling in a transitioning framework. Transitioning is a process in which a set of random samples at equilibrium with a known probability density function (PDF) are used as seeds for the Markov chains to sample successive target PDFs that incrementally move the distribution from the starting seeds to the final desired PDF that describes the relative plausibility of potential values for the model parameters. The algorithm is implemented as a Master-Worker model employing MPI for communication. The worker processes are loosely coupled with global parameters periodically optimized by the master process. This provides a very high amount of parallelism with little communication between updates. During the presentation we will discuss the history of the algorithm and elaborate the earthquake rupture modeling use case for the CATMIP package. Our first step toward GPU optimization was to optimize the code for the CPU. CPU profiling revealed that most of the compute time is spent in calls to level 2 BLAS routines and calls to GSL random number generators. We revised the algorithm to employ level 3 BLAS routines instead. In our presentation we will describe how this was accomplished. Adding GPU support to CATMIP consisted mostly of replacing the calls to GSL with calls to GPU vendor-provided library routines. A small number of loops were directly implemented in CUDA. In the presentation will provide implementation details. Finally, we will discuss methods for profiling and opportunities for further optimizing GPU execution. By creating a code with the flexibility to run on either a CPU or GPU architecture, CATMIP can be used on systems ranging from large CPU-based HPC environments to single servers with GPU acceleration and everything in between.

HECC↗
NASA NTRS2024

Deciphering the Spectra of Flowers to Map Landscape-scale Blooming Dynamics

Like leaves, floral coloration is driven by inherent optical properties, which are determined by pigments, scattering structure, and thickness. However, establishing the relative contribution of these factors to canopy spectral signals is usually limited to in-situ observations. Modeling flowering dynamics (e.g., blooming duration, spatial distribution) at the landscape scale may reveal insights into ecological processes and phenological adaptations to environmental changes. Multitemporal visible to shortwave infrared (VSWIR) imaging spectroscopy observations are especially suited for such efforts. Reflectance in this spectral range is sensitive to major flower pigments, flowering phenology traces, and biophysical differences between flowers and other plant parts. We explored how flowers contribute to spectral signals using a time series of imagery from the Airborne Visible InfraRed Imaging Spectrometer - Next Generation (AVIRIS-NG) collected as part of the SBG High-Frequency Time Series (SHIFT) campaign as a case study. Airborne data were collected weekly during the spring of 2022 across two natural reserves in California. Field spectra were gathered from blooming plots at leaf, flower, and canopy levels at two time points during the campaign. The processed data was used to investigate flowering species' spectro-temporal variation and spatial distribution using Spectral Mixture Residual, Gaussian clustering techniques, and a proposed narrow-band flowering index. Linear spectral unmixing allowed the computation of the weighted contribution of four major high-variance endmembers (leaves, flowers, soil, dark) and low-variance residual signal that comprises subtle spectral features used to track biophysical processes. The reflectance residual was projected on a low principal component basis to characterize flowering clusters' variation and spatial distribution based on the Gaussian mixture model, providing an uncertainty metric to assess the results. Mapping flowering events from modeling spectro-temporal dynamics throughout the season, from pre-blooming to post-flowering stages, allowed us to identify gradient variations in spectral features within the VSWIR spectral range linked to flowering pigments. Time series of the Mixture Residual Blooming Index and the Red-Edge Normalized Difference Vegetation Index revealed specific flowering and greenness phenophases across the two main species (Coreopsis gigantea, Artemisia californica) in the flowering areas. Overall, our approach opens opportunities for future satellite monitoring of floral cycles at broader scales.

Yoseline Angel↗
NASA NTRS2020

Using Flexible Execution, Replanning, and Model Parameter Updates to Address Environmental Uncertainty for a Planetary Lander

When planning in unknown environments, a planner must ensure robustness to unknown phenomena and manage unpredictable variation in execution. Productivity in the face of these challenges requires an integrated approach to planning and execution that is capable of reacting to variation while still maximizing overall utility. We examine this problem in the context of the Europa Lander mission concept. We propose a planning and execution framework that responds to feedback using three techniques: (1) flexible execution, (2) periodic replanning, and (3) online model parameter and utility updates. The efficacy of each of these techniques is examined through simulation of the Europa Lander concept, showing higher utility achievement compared to baseline approaches.

Chien, Steve A.↗
NASA NTRSDate not supplied

SLS Integrated Modal Test Uncertainty Quantification using the Hybrid Parametric Variation Method

Uncertainty in structural loading during launch is a significant concern in the development of spacecraft and launch vehicles. Small variations in launch vehicle and payload mode shapes and their interaction can result in significant variation in system loads. In many cases involving large aerospace systems it is difficult, not economical, or impossible to perform a system modal test. However, it is still vital to obtain test results that can be compared with analytical predictions to validate models. Instead, the “Building Block Approach” is used in which system components are tested individually. Component models are correlated and updated to agree as best they can with test results. The Space Launch System consists of a number of components that are assembled into a launch vehicle. Finite element models of the components are developed, reduced to Hurty/Craig-Bampton models and assembled to represent different phases of flight. The only opportunity to obtain modal test data from an assembled Space Launch System will be during the Integrated Modal Test. There is always uncertainty in every model, which flows into uncertainty in predicted system results. Uncertainty Quantification is used to determine statistical bounds on prediction accuracy based on model uncertainty. For the Space Launch System, model uncertainty is at the Hurty/Craig-Bampton component level. Uncertainty in the Hurty/Craig-Bampton components is quantified using the hybrid parametric variation approach that combines parametric and nonparametric uncertainty. Uncertainty in model form is one of the biggest contributors to uncertainty in complex built-up structures. This type of uncertainty cannot be represented by variations infinite element model input parameters and thus cannot be included in a parametric approach. However, model-form uncertainty can be modeled using a nonparametric approach based on random matrix theory. The hybrid parametric variation method requires the selection of dispersion values for the Hurty/Craig-Bampton fixed-interface eigenvalues, and the Hurty/Craig-Bampton stiffness matrices. Component test/analysis frequency error is used to identify the fixed-interface eigenvalue dispersions, while test/analysis cross-orthogonality is used to identify stiffness dispersion values. The hybrid parametric variation uncertainty quantification approach is applied to the Space Launch System Integrated Modal Test configuration. Monte Carlo analysis is performed, and statistics are determined for modal correlation metrics, frequency response from Integrated Modal Test shakers to selected accelerometers, as well as other metrics for determining how well target modes are excited and identified. If the predicted uncertainty envelopes future Integrated Modal Test results, then there will be increased confidence in the utility of the component-based hybrid parametric variation uncertainty quantification approach.

Uncertainty Quantification↗
NASA NTRS2016

The Pliocene Model Intercomparison Project (PlioMIP) Phase 2: Scientific Objectives and Experimental Design

The Pliocene Model Intercomparison Project (PlioMIP) is a co-ordinated international climate modelling initiative to study and understand climate and environments of the Late Pliocene, as well as their potential relevance in the context of future climate change. PlioMIP examines the consistency of model predictions in simulating Pliocene climate and their ability to reproduce climate signals preserved by geological climate archives. Here we provide a description of the aim and objectives of the next phase of the model intercomparison project (PlioMIP Phase 2), and we present the experimental design and boundary conditions that will be utilized for climate model experiments in Phase 2. Following on from PlioMIP Phase 1, Phase 2 will continue to be a mechanism for sampling structural uncertainty within climate models. However, Phase 1 demonstrated the requirement to better understand boundary condition uncertainties as well as uncertainty in the methodologies used for data-model comparison. Therefore, our strategy for Phase 2 is to utilize state-of-the-art boundary conditions that have emerged over the last 5 years. These include a new palaeogeographic reconstruction, detailing ocean bathymetry and land-ice surface topography. The ice surface topography is built upon the lessons learned from offline ice sheet modelling studies. Land surface cover has been enhanced by recent additions of Pliocene soils and lakes. Atmospheric reconstructions of palaeo-CO2 are emerging on orbital timescales, and these are also incorporated into PlioMIP Phase 2. New records of surface and sea surface temperature change are being produced that will be more temporally consistent with the boundary conditions and forcings used within models. Finally we have designed a suite of prioritized experiments that tackle issues surrounding the basic understanding of the Pliocene and its relevance in the context of future climate change in a discrete way.

climate models↗
NASA NTRS2016

Imaging Analysis of the Hard X-Ray Telescope ProtoEXIST2 and New Techniques for High-Resolution Coded-Aperture Telescopes

Wide-field (greater than or approximately equal to 100 degrees squared) hard X-ray coded-aperture telescopes with high angular resolution (greater than or approximately equal to 2 minutes) will enable a wide range of time domain astrophysics. For instance, transient sources such as gamma-ray bursts can be precisely localized without the assistance of secondary focusing X-ray telescopes to enable rapid followup studies. On the other hand, high angular resolution in coded-aperture imaging introduces a new challenge in handling the systematic uncertainty: the average photon count per pixel is often too small to establish a proper background pattern or model the systematic uncertainty in a timescale where the model remains invariant. We introduce two new techniques to improve detection sensitivity, which are designed for, but not limited to, a high-resolution coded-aperture system: a self-background modeling scheme which utilizes continuous scan or dithering operations, and a Poisson-statistics based probabilistic approach to evaluate the significance of source detection without subtraction in handling the background. We illustrate these new imaging analysis techniques in high resolution coded-aperture telescope using the data acquired by the wide-field hard X-ray telescope ProtoEXIST2 during a high-altitude balloon flight in fall 2012. We review the imaging sensitivity of ProtoEXIST2 during the flight, and demonstrate the performance of the new techniques using our balloon flight data in comparison with a simulated ideal Poisson background.

balloons - instrumentation: detectors - techniques↗
NASA NTRSDate not supplied

Aerothermal Uncertainty Quantification of Deployable Entry Technologies Using Multi-Fidelity Modeling

The objective of this work was to investigate the use of a co-Kriging based multi-fidelity modeling approach with a Monte Carlo uncertainty quantification analyses of surface heating on hypersonic inflatable aerodynamic decelerator vehicles and adaptable, deployable entry placement technology vehicles in Mars entry. A previously developed co-Kriging based multi-fidelity modeling approach was used to model the laminar and turbulent convective and radiative heat fluxes along the vehicle. Monte Carlo analyses of surface heat load for nine different vehicle nose radii was performed for both vehicles, assuming the same thermal protection system is used for both vehicles. The maximum heat loads and heat load uncertainties were found to occur at either the stagnation point or the vehicle shoulder. The maximum 95% confidence intervals for the total heat load for the hypersonic inflatable aerodynamic decelerator vehicle were found to be [-9.27, 7.81] % of the nominal value and [-6.09, 13.1] % of the nominal value for laminar and turbulent flow, respectively. The maximum 95% confidence intervals for the total heat load for the adaptable, deployable entry placement technology vehicle were found to be [-8.85, 7.22] % of the nominal value and [-9.33, 9.35] % of the nominal value for laminar and turbulent flow, respectively. The difference in heating uncertainties based on vehicle geometry between the two vehicle technologies was found to be minimal.

Mario Santos↗
DOE OSTI2025

Quantifying Groundwater Response and Uncertainty in Beaver‐Influenced Mountainous Floodplains Using Machine Learning‐Based Model Calibration

Abstract Beavers ( Castor canadensis ) alter river corridor hydrology by creating ponds and inundating floodplains, and thereby improving surface water storage. However, the impact of inundation on groundwater, particularly in mountainous alluvial floodplains with permeable gravel/cobble layers overlain by a soil layer, remains uncertain. Numerical modeling across various floodplain structures considers topographic and sediment complexity and multidirectional flow, linking inundation to groundwater response. This study develops a model‐data integration workflow to address uncertainty in groundwater response to beaver‐induced inundations in a mountainous alluvial floodplain in the Upper Colorado River Basin. Uncertain factors include seasonal hydrologic dynamics, hydraulic conductivities, floodplain structures, and meteorological forcings. We employed an ensemble of groundwater models, based on geophysical and hydrologic data, with machine learning‐based calibration using a neural density estimator. This allowed us to quantify the vertical flux from the soil layer to the permeable gravel bed, the down‐valley underflow within the gravel bed, and their ratios. Results show a significant increase in the vertical flux relative to down‐valley underflow, from 2 during dry pond periods to 20 during wet periods, serving as an analogy for conditions without and with beaver ponds. The study highlights the influence of floodplain structure on groundwater storage, water balance, and water quality impacted by beaver ponds. A thick gravel bed layer, with a large down‐valley underflow, minimizes the effect of beaver‐induced inundation on water quality. We emphasize the need for field‐scale measurements of floodplain structure and improved characterization of evapotranspiration changes to reduce uncertainty in groundwater response. Plain Language Summary Beavers change the flow of water in river corridors by creating ponds, expanding wetlands, and flooding floodplains. This increases surface water area, promotes plant growth, and enhances biodiversity. However, the impact of this flooding on groundwater flow is not well understood, especially in mountainous areas with gravel layers where water moves easily beneath soil. In this study, we used numerical modeling to investigate how beaver ponds influence groundwater in a mountainous floodplain of the Upper Colorado River Basin. We adapted a machine learning method to validate our numerical models using multiple field data sets. Our findings show that beaver ponds significantly increase vertical water flow from the soil to the gravel during wet periods, compared to when the ponds are fully drained. The study also highlights the importance of floodplain structure in controlling both water flow in gravel layers along the river direction and vertical flow from the soil to the gravel with the presence of beavers. To reduce uncertainty in groundwater response, we emphasize the need for more field‐scale measurements of floodplain structure, hydraulic properties, and evapotranspiration changes. Key Points Floodplain structures and hydraulic conductivities are important for groundwater response with beaver ponds in mountainous floodplains Large down‐valley underflow in permeability‐stratified floodplains reduces beaver‐induced impacts on groundwater storage and water quality Machine learning‐based model calibration methods are effective for estimating posterior distributions of groundwater model parameters

Wang, Lijing↗
DOE OSTI2024

Quantifying Streambed Grain Size, Uncertainty, and Hydrobiogeochemical Parameters Using Machine Learning Model YOLO

Abstract Streambed grain sizes control river hydro‐biogeochemical (HBGC) processes and functions. However, measuring their quantities, distributions, and uncertainties is challenging due to the diversity and heterogeneity of natural streams. This work presents a photo‐driven, artificial intelligence (AI)‐enabled, and theory‐based workflow for extracting the quantities, distributions, and uncertainties of streambed grain sizes from photos. Specifically, we first trained You Only Look Once, an object detection AI, using 11,977 grain labels from 36 photos collected from nine different stream environments. We demonstrated its accuracy with a coefficient of determination of 0.98, a Nash–Sutcliffe efficiency of 0.98, and a mean absolute relative error of 6.65% in predicting the median grain size of 20 ground‐truth photos representing nine typical stream environments. The AI is then used to extract the grain size distributions and determine their characteristic grain sizes, including the 10th, 50th, 60th, and 84th percentiles, for 1,999 photos taken at 66 sites within a watershed in the Northwest US. The results indicate that the 10th, median, 60th, and 84th percentiles of the grain sizes follow log‐normal distributions, with most likely values of 2.49, 6.62, 7.68, and 10.78 cm, respectively. The average uncertainties associated with these values are 9.70%, 7.33%, 9.27%, and 11.11%, respectively. These data allow for the computation of the quantities, distributions, and uncertainties of streambed HBGC parameters, including Manning's coefficient, Darcy‐Weisbach friction factor, top layer interstitial velocity magnitude, and nitrate uptake velocity. Additionally, major sources of uncertainty in grain sizes and their impact on HBGC parameters are examined.

58 GEOSCIENCES↗
NASA NTRS1980

Statistical aspects of carbon fiber risk assessment modeling

The probabilistic and statistical aspects of the carbon fiber risk assessment modeling of fire accidents involving commercial aircraft are examined. Three major sources of uncertainty in the modeling effort are identified. These are: (1) imprecise knowledge in establishing the model; (2) parameter estimation; and (3)Monte Carlo sampling error. All three sources of uncertainty are treated and statistical procedures are utilized and/or developed to control them wherever possible.

Gross, D.↗
NASA NTRS2019

Uncertainty of Observation Impact Estimation in an Adjoint Model Investigated with an Observing System Simulation Experiment

Adjoint models are often used to estimate the impact of different observations on short-term forecast skill. A common difficulty with the evaluation of short term forecast quality is the choice of verification fields. The use of self-analysis fields for verification is typical but incestuous, and introduces uncertainty due to biases and errors in the analysis field. In this study, an observing system simulation experiment (OSSE) is used to explore the uncertainty in adjoint model estimations of observation impact. The availability of the true state for verification in the OSSE framework in the form of the Nature Run allows calculation of the observation impact without the uncertainties present in self-analysis verification. These impact estimates are compared to estimates calculated using self-analysis verification. The Global Earth Observing System version 5 (GEOS-5) forecast model with Gridpoint Statistical Interpolation (GSI) is used with the National Aeronautics and Space Administration Global Modeling and Assimilation Office (NASA/GMAO) OSSE capability. The adjoint model includes moist processes, with total wet energy selected as the norm for evaluation of observation impacts. The results show that there are measurable but small discrepancies in the adjoint model estimation of observation impact. In general, observations of temperature and winds tend to have overestimated impacts with self-analysis verification, while observations of humidity and moisture-affected observations tend to have underestimated impacts. The small magnitude of the differences in impact estimates supports the robustness of the adjoint method of estimating observation impacts.

N C Prive↗
NASA NTRS2023

The Impact and Estimation of Uncertainty Correlation for Multi-Angle Polarimetric Remote Sensing of Aerosols and Ocean Color

Multi-angle polarimetric (MAP) measurements contain rich information for characterization of aerosol microphysical and optical properties that can be used to improve atmospheric correction in ocean color remote sensing. Advanced retrieval algorithms have been developed to obtain multiple geophysical parameters in the atmosphere-ocean system, although uncertainty correlation among measurements is generally ignored due to lack of knowledge on its strength and characterization. In this work, we provide a practical framework to evaluate the impact of the angular uncertainty correlation from retrieval results and a method to estimate correlation strength from retrieval fitting residuals. The Fast Multi-Angular Polarimetric Ocean coLor (FastMAPOL) retrieval algorithm, based on neural network forward models, is used to conduct the retrievals and uncertainty quantification. In addition, we also discuss a flexible approach to include a correlated uncertainty model in the retrieval algorithm. The impact of angular correlation on retrieval uncertainties is discussed based on synthetic AirHARP and HARP2 measurements using a Monte Carlo uncertainty estimation method. Correlation properties are estimated using auto-correlation functions based on the fitting residuals from both synthetic AirHARP and HARP2 data and real AirHARP measurement, with the resulting angular correlation parameters found to be larger than 0.9 and 0.8 for reflectance and DoLP, respectively, which correspond to correlation angles of 10° and 5°. Although this study focuses on angular correlation from HARP instruments, the methodology to study and quantify uncertainty correlation is also applicable to other instruments with angular, spectral, or spatial correlations, and can help inform laboratory calibration and characterization of the instrument uncertainty structure.

PACE↗
NASA NTRS2013

Estimating the Properties of Hard X-Ray Solar Flares by Constraining Model Parameters

We wish to better constrain the properties of solar flares by exploring how parameterized models of solar flares interact with uncertainty estimation methods. We compare four different methods of calculating uncertainty estimates in fitting parameterized models to Ramaty High Energy Solar Spectroscopic Imager X-ray spectra, considering only statistical sources of error. Three of the four methods are based on estimating the scale-size of the minimum in a hypersurface formed by the weighted sum of the squares of the differences between the model fit and the data as a function of the fit parameters, and are implemented as commonly practiced. The fourth method is also based on the difference between the data and the model, but instead uses Bayesian data analysis and Markov chain Monte Carlo (MCMC) techniques to calculate an uncertainty estimate. Two flare spectra are modeled: one from the Geostationary Operational Environmental Satellite X1.3 class flare of 2005 January 19, and the other from the X4.8 flare of 2002 July 23.We find that the four methods give approximately the same uncertainty estimates for the 2005 January 19 spectral fit parameters, but lead to very different uncertainty estimates for the 2002 July 23 spectral fit. This is because each method implements different analyses of the hypersurface, yielding method-dependent results that can differ greatly depending on the shape of the hypersurface. The hypersurface arising from the 2005 January 19 analysis is consistent with a normal distribution; therefore, the assumptions behind the three non- Bayesian uncertainty estimation methods are satisfied and similar estimates are found. The 2002 July 23 analysis shows that the hypersurface is not consistent with a normal distribution, indicating that the assumptions behind the three non-Bayesian uncertainty estimation methods are not satisfied, leading to differing estimates of the uncertainty. We find that the shape of the hypersurface is crucial in understanding the output from each uncertainty estimation technique, and that a crucial factor determining the shape of hypersurface is the location of the low-energy cutoff relative to energies where the thermal emission dominates. The Bayesian/MCMC approach also allows us to provide detailed information on probable values of the low-energy cutoff, Ec, a crucial parameter in defining the energy content of the flare-accelerated electrons. We show that for the 2002 July 23 flare data, there is a 95% probability that Ec lies below approximately 40 keV, and a 68% probability that it lies in the range 7-36 keV. Further, the low-energy cutoff is more likely to be in the range 25-35 keV than in any other 10 keV wide energy range. The low-energy cutoff for the 2005 January 19 flare is more tightly constrained to 107 +/- 4 keV with 68% probability.

X-rays↗
NASA NTRS1989

Space shuttle propulsion estimation development verification

The application of extended Kalman filtering to estimating the Space Shuttle Propulsion performance, i.e., specific impulse, from flight data in a post-flight processing computer program is detailed. The flight data used include inertial platform acceleration, SRB head pressure, SSME chamber pressure and flow rates, and ground based radar tracking data. The key feature in this application is the model used for the SRB's, which is a nominal or reference quasi-static internal ballistics model normalized to the propellant burn depth. Dynamic states of mass overboard and propellant burn depth are included in the filter model to account for real-time deviations from the reference model used. Aerodynamic, plume, wind and main engine uncertainties are also included for an integrated system model. Assuming uncertainty within the propulsion system model and attempts to estimate its deviations represent a new application of parameter estimation for rocket powered vehicles. Illustrations from the results of applying this estimation approach to several missions show good quality propulsion estimates.

Rogers, Robert M.↗
DOE OSTI2025

Impacts of benchmarking choices on inferred model skill of the Arctic–Boreal terrestrial carbon cycle

Abstract Land surface models require continuous validation against observations to improve and reduce simulation uncertainty. However, inferred model performance can be heavily influenced by subjective choices made in the selection and application of observational data products. A key area often misrepresented by models is the Arctic–Boreal region, which is a potential tipping point region in Earth’s climate system due to large permafrost carbon stocks that are vulnerable to release with climate warming. We use the International Land Model Benchmarking (ILAMB) framework to evaluate how the model skill of TRENDY-v9 models varies based on the choice of observational-based benchmark and how benchmarks are applied in model evaluation. This analysis uses global datasets integrated into ILAMB and new, regionally-specific observational products from the Arctic–Boreal Vulnerability Experiment. Our results cover the overall time period of 1979–2019 and show that model scores can vary substantially depending on the data product applied, with higher model scores indicating better model performance against observations. The lowest model scores occur when benchmarked against regional, compared to global, datasets. We also evaluate observed and modeled functional relationships between ecosystem respiration and air temperature and between gross primary production and precipitation. Here, we find that the magnitude and shape of the responses are strongly impacted by the choice of observational dataset and the approach used to construct the functional relationship benchmark. These results suggest that model evaluation studies could conclude a false sense of model skill if only using a single benchmark data product or if not applying regional data products when performing a regional model analysis. Collectively, our findings highlight the influence of benchmarking choices on model evaluation and point to the need for benchmarking guidelines when assessing model skill.

Poe, Jeralyn (ORCID:0000000318495278)↗
DOE OSTI2024

Platform Of Optimal Experiment Management

The platform of optimal experiment management, POEM, powered with automated machine learning to accelerate the discovery of optimal solutions, and automatically guide the design of experiments to be evaluated. POEM currently supports 1) random model explorations for experiment design, 2) sparse grid model explorations with Gaussian Polynomial Chaos surrogate model to accelerate experiment design ,3) time-dependent model sensitivity and uncertainty analysis to identify the importance features for experiment design, 4) model calibrations via Bayesian inference to integrate experiments to improve model performance, and 5) Bayesian optimization for optimal experimental design. In addition, POEM aims to simplify the process of experimental design for users, enabling them to analyze the data with minimal human intervention, and improving the technological output from research activities.

Wang, Congjian [Idaho National Laboratory (INL), I↗
NASA NTRS2012

Comprehensive Approach to Verification and Validation of CFD Simulations Applied to Backward Facing Step-Application of CFD Uncertainty Analysis

There are inherent uncertainties and errors associated with using Computational Fluid Dynamics (CFD) to predict the flow field and there is no standard method for evaluating uncertainty in the CFD community. This paper describes an approach to -validate the . uncertainty in using CFD. The method will use the state of the art uncertainty analysis applying different turbulence niodels and draw conclusions on which models provide the least uncertainty and which models most accurately predict the flow of a backward facing step.

Groves, Curtis E.↗