Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Aerothermal Analysis of the Rocket Lab Venus Probe Heatshield

This document provides an overview of the aerothermodynamic analyses performed by the Aerothermodynamics Branch at NASA Langley Research Center for the Rocket Lab Venus Probe (RLVP). In addition to defining the baseline heating environment to the heatshield, this document pursues the experimental validation of key physical models at RLVP-relevant conditions. This experimental validation analysis, which captures the model form uncertainty, is used as one of two primary components of the margin assessment, where the other component is the parametric uncertainty. These model form (experimental) and parametric uncertainty components are used to construct a spatial and time varying margin for the heating to the RLVP heatshield. The margin is evaluated as the sum of the parametric and model form uncertainty components. The model form uncertainty is defined as the difference between the RLVP-relevant measurements and their simulations, using the upper limit uncertainty bounds for both the measurements and simulations in the comparisons. The differences in the dominant physics in the stagnation region and flank lead to the separate RLVP-relevant measurements for assessing the model form uncertainty in these two regions. These regions are addressed as follows: Stagnation Region Heating Environment: For the high-temperature stagnation-region, both the radiative heating and impact of blowing on convective heating are significant, while the impacts of turbulence and roughness are negligible. Coupled radiation and ablation LAURA/HARA solutions with ray-tracing provide the radiative heating over the entire vehicle, including the contributions from the Venus atmosphere and ablation species. Non-ablating LAURA simulations provide the convective heating. During the material-response computation typically used for TPS sizing, this non-ablating convective heating is corrected for the impact of ablation using the blowing correction. Coupled ablation LAURA simulations that capture finite-rate sur-face processes show that this blowing correction may be non-conservative over most of the heatshield. This non-conservatism is due to hydrogen recombination in the finite-rate surface model, which tends to increase the coupled ablation convective heating to near the non-ablating values, therefore making any reduction in the non-ablating value through the blowing correction non-conservative. This non-conservatism due to H catalysis is captured in the parametric component of the margin. The best available ground-test measurements that capture the impact of blowing on stagnation region convective heating, at RLVP-relevant conditions, indicate that the current blowing reduction model is non-conservative by up to 20% at RLVP-relevant blowing rates (the coupled blowing simulations were also non-conservative). Because of the relatively low velocity of the ground tests and the non-Venus atmospheric chemistry, these measurements do not capture the chemistry and therefore do not inform the uncertainty due to H catalysis. However, they do capture the fluid mechanics of blowing. The non-conservatism of the blowing correction implied by these measurements is covered by the model form component of the margin, which leads to total margin values over 50%. For the radiative heating, the shock-tube informed bias approach suggests a model form uncertainty of roughly 20%, while the parametric uncertainty analysis suggests values over 100%. The combined stagnation-point radiation margin of over 100% leads to peak margined radiative heating values of over300 W/cm2, which remains small relative to the peak margined convective heating of nearly 2000 W/cm2. Based on this analysis, at the stagnation point, the peak margined heat rate is 2203 W/cm2 and the margined total heat load is 31.5 kJ/cm2 for the current nominal trajectory. Flank Heating Environment: The forebody flank (and near-shoulder) heating environment is dominated by the impact of turbulence, roughness augmentation, and ablation on the convective heating. An extensive collection of ground test measurements with RLVP-relevant turbulence and roughness is studied to show that the maximum difference between the simulated and measured convective heating is 5%. However, with the exception of the Holden measurements from the 1980s, these measurements do not include roughness elements extending into the supersonic region of the boundary layer, which is likely to occur for RLVP (due to the 45 degree sphere-cone geometry). The interaction between the supersonic flow and roughness could cause convective heating augmentation fundamentally different than for locally subsonic flow. Although these Holden measurements are consistent with the other measurements considered, another path was pursued to assure that the rough-ness height extending into supersonic flow does not fundamentally change the roughness augmentation. This additional path was a computational effort to resolve the roughness elements in the CFD grid, so that the interaction be-tween the roughness elements and locally supersonic flow may be simulated in detail. This roughness-resolved CFD simulation is feasible because of the RLVP forebody TPS’s patterned roughness, which may be approximated analytically, and because of the axisymmetric nominal flow field, which allows a narrow surface region to be simulated and therefore make the computational expense feasible. These grid-resolved roughness simulations, which are performed at actual RLVP flight conditions, result in heating augmentation values that are below the design approach for roughness augmentation. This provides evidence that the design approach for RLVP roughness augmentation is sufficient. Based on this analysis, at this flank or near-shoulder location, the peak margined total heat rate is 2088 W/cm2and the margined total heat load is 26.0 kJ/cm2for the current nominal trajectory. Heat flux, shear, pressure and heat transfer coefficient at the RLVP stagnation point and near shoulder location are evaluated for the entire trajectory, and curved fit to a functional form of F=AρB∞UC∞. These simplified relationships for the nominal and margined aerothermal environments are referred to as aerothermal indicators, and presented at the end of this document.

Christopher O Johnston↗

Robustness of Flexible Systems With Component-Level Uncertainties

Robustness of flexible systems in the presence of model uncertainties at the component level is considered. Specifically, an approach for formulating robustness of flexible systems in the presence of frequency and damping uncertainties at the component level is presented. The synthesis of the components is based on a modifications of a controls-based algorithm for component mode synthesis. The formulation deals first with robustness of synthesized flexible systems. It is then extended to deal with global (non-synthesized ) dynamic models with component-level uncertainties by projecting uncertainties from component levels to system level. A numerical example involving a two-dimensional simulated docking problem is worked out to demonstrate the feasibility of the proposed approach.

Maghami, Peiman G.↗

Amplified drought trends in Nepal increase the potential for Himalayan wildfires

Here we report in the spring 2021, Nepal underwent a record wildfire season in which active fires were detected at a rate 10 times greater than the 2002–2020 average. Prior to these major wildfire events, the country experienced a prolonged precipitation deficit and extreme drought during the post-monsoon period (starting in October 2020). An analysis using observational, reanalysis, and climate model ensemble data indicates that both climate variability and climate change-induced severe drought conditions were at play. Further analysis of climate model outputs suggests the likely reoccurrence of drought conditions, thus favoring active wildfire seasons in Nepal throughout the twenty-first century. While the inter-model uncertainty is large and direct modeling of wildfire spread and suppression has not been completed, the demonstrated relationship between a drought index (the standardized precipitation and evapotranspiration index) and subsequent fire activity may offer actionable opportunities for forest managers to employ the monitoring and projection of climate anomalies at sub-seasonal to decadal timescales to inform their management strategies for Nepal’s wildlands.

54 ENVIRONMENTAL SCIENCES↗

Do Machine Learning Approaches Offer Skill Improvement for Short-Term Forecasting of Wind Gust Occurrence and Magnitude?

Abstract Wind gusts, and in particular intense gusts, are societally relevant but extremely challenging to forecast. This study systematically assesses the skill enhancement that can be achieved using artificial neural networks (ANNs) for forecasting of wind gust occurrence and magnitude. Geophysical predictors from the ERA5 reanalysis are used in conjunction with an autoregressive term in regression and ANN models with different predictors, and varying model complexity. Models are derived and assessed for the warm (April–September) and cold (October–March) seasons for three high passenger volume airports in the United States. Model uncertainty is assessed by deriving models for 1000 different randomly selected training (70%) and testing (30%) subsets. Gust prediction fidelity in independent test samples is critically dependent on inclusion of an autoregressive term. Gust occurrence probabilities derived using five-layer ANNs exhibit consistently higher fidelity than those from regression models and shallower ANNs. Inclusion of the autoregressive term and increasing the number of hidden layers in ANNs from 1 to 5 also improve the model performance for gust magnitudes (lower RMSE, increased correlation, and model standard deviations that more closely approximate observed values). Deeper ANNs (e.g., 20 hidden layers) exhibit higher skill in forecasting strong (17–25.7 m s −1 ) and damaging (≥25.7 m s −1 ) wind gusts. However, such deep networks exhibit evidence of overfitting and still substantially underestimate (by 50%) the frequency of strong and damaging wind gusts at the three airports considered herein. Significance Statement Improved short-term forecasting of wind gusts will enhance aviation safety and logistics and may offer other societal benefits. Here we present a rigorous investigation of the relative skill of models of wind gust occurrence and magnitude that employ different statistical methods. It is shown that artificial neural networks (ANNs) offer considerable skill enhancement over regression methods, particularly for strong and damaging wind gusts. For wind gust magnitudes in particular, application of deeper learning networks (e.g., five or more hidden layers) offers tangible improvements in forecast accuracy. However, deeper networks are vulnerable to overfitting and exhibit substantial variability with the specific training and testing data subset used. Also, even deep ANNs reproduce only half of strong and damaging wind gusts. These results indicate the need for future work to elucidate the dynamical mechanisms of intense wind gusts and advance solutions to their prediction.

54 ENVIRONMENTAL SCIENCES↗

A global average model of atmospheric aerosols for radiative transfer calculations

A global average model is proposed for the size distribution, chemical composition, and optical thickness of stratospheric and tropospheric aerosols. This aerosol model is designed to specify the input parameters to global average radiative transfer calculations which assume the atmosphere is horizontally homogeneous. The model subdivides the atmosphere at multiples of 3 km, where the surface layer extends from the ground to 3 km, the upper troposphere from 3 to 12 km, and the stratosphere from 12 to 45 km. A list of assumptions made in construction of the model is presented and discussed along with major model uncertainties. The stratospheric aerosol is modeled as a liquid mixture of 75% H2SO4 and 25% H2O, while the tropospheric aerosol consists of 60% sulfate and 40% soil particles above 3 km and of 50% sulfate, 35% soil particles, and 15% sea salt below 3 km. Implications and consistency of the model are discussed.

Toon, O. B.↗

Robust time and frequency domain estimation methods in adaptive control

A robust identification method was developed for use in an adaptive control system. The type of estimator is called the robust estimator, since it is robust to the effects of both unmodeled dynamics and an unmeasurable disturbance. The development of the robust estimator was motivated by a need to provide guarantees in the identification part of an adaptive controller. To enable the design of a robust control system, a nominal model as well as a frequency-domain bounding function on the modeling uncertainty associated with this nominal model must be provided. Two estimation methods are presented for finding parameter estimates, and, hence, a nominal model. One of these methods is based on the well developed field of time-domain parameter estimation. In a second method of finding parameter estimates, a type of weighted least-squares fitting to a frequency-domain estimated model is used. The frequency-domain estimator is shown to perform better, in general, than the time-domain parameter estimator. In addition, a methodology for finding a frequency-domain bounding function on the disturbance is used to compute a frequency-domain bounding function on the additive modeling error due to the effects of the disturbance and the use of finite-length data. The performance of the robust estimator in both open-loop and closed-loop situations is examined through the use of simulations.

Lamaire, Richard Orville↗

Stratospheric responses to solar ultraviolet variations - Comparisons with photochemical models

At latitudes and altitudes where transport effects on ozone mixing ratio can be neglected, ozone and temperature responses to short-term changes in solar ultraviolet flux can be used to calculate implied bounds on two basic photochemical parameters: the odd oxygen photochemical relaxation time and the chemical sensitivity of odd oxygen to local temperature changes. Seasonally averaged values of these parameters are derived from response measurements and are compared with model calculations between 0.7 and 4 mbar at tropical latitudes. Results are in agreement within measurement and model uncertainties at all pressure levels. Model values of mean ozone and of the response of ozone to perturbations are functions of the same photochemical data. Therefore this agreement provides a constraint which should be considered when changes are proposed in model input data for the purpose of improving agreement between measured and calculated high-altitude ozone.

Hood, L. L.↗

Design of a flight control system for a highly maneuverable aircraft using mu synthesis

This paper presents a methodology for the design of longitudinal controllers for high performance aircraft operating over large ranges of angle of attack. The technique used for controller design is structured singular value or mu synthesis. The controller is designed to minimize the weighted H-infinity norm of the error between the aircraft response and the desired handling quality specifications without saturating the control actuators. The mu synthesis procedure ensures that the stability and performance of the aircraft is robust to parameter variations and modeling uncertainties included in the design model. Nonlinear simulations demonstrate that the controller satisfies handling quality requirements and provides excellent tracking of pilot inputs over a wide range of transient angles of attack and Mach number.

Reiner, Jacob↗

Hierarchical Bayesian modeling for Inverse Uncertainty Quantification of system thermal-hydraulics code using critical flow experimental data

The best estimate plus uncertainty methodology in nuclear system thermal-hydraulic studies necessitates a comprehensive understanding of uncertainties in system code predictions. The forward uncertainty quantification (UQ) process involves the propagation of input uncertainties through the computational models to obtain uncertainties in the outputs. To this end, achieving an accurate estimation of input uncertainties is important, which is the focus of inverse UQ (IUQ). Traditionally, research in Bayesian IUQ within the nuclear engineering domain has largely relied on single-level Bayesian inference. While being effective for relatively small datasets, this approach encounters limitations for cases with large datasets. The use of a single-level model may prove inefficient, as the resultant posterior distributions can significantly differ when distinct subsets of data are employed. To address this issue, we employ an hierarchical Bayesian model for IUQ. Furthermore, this approach involves organizing observations into different groups based on the test conditions, thereby accommodating varying calibration parameters across these distinct groups. In this study, we developed and implemented a hierarchical Bayesian IUQ method to consider the grouping effect of critical flow measurement data from various geometries. Comparing the outcomes of IUQ under different selections of test data using hierarchical Bayesian IUQ against those obtained from single-level Bayesian IUQ, the forward propagation of hierarchical Bayesian IUQ results demonstrates a notably improved agreement with the experimental data.

42 ENGINEERING↗

WIND Toolkit Long-Term Ensemble Dataset

WIND Toolkit Long-term Ensemble Dataset (WTK-LED), an updated version of the meteorological WIND Toolkit, is a meteorological dataset providing high-resolution time series, including interannual variability and model uncertainty of wind speed at every modeling grid point to indicate ranges of possible wind speeds. The data were produced using the Weather Research and Forecasting Model (WRF). The vertical grid used in WTK-LED includes many vertical layers in the atmospheric boundary layer to provide information of atmospheric quantities across the rotor layer of utility scale and distributed wind turbines. The WTK-LED includes: (1) Numerical simulations of wind speed and other meteorological variables covering the contiguous United States (CONUS) and Alaska, with high-resolution (5-minute [min], 2-kilometer [km]) data for 3 years (2018-2020): WTK-LED CONUS, WTK-LED Alaska. (2) Climate simulations from Argonne National Laboratory covering North America, including Alaska, Canada, and most of Mexico and the Caribbean islands. These simulations complement the new WTK-LED to offer a 4-km, hourly dataset covering 20 years (2001-2020): WTK-LED Climate. (3) Specific long-term, high-resolution offshore simulations have been conducted separately for the U.S. coasts, Hawaii, and the Great Lakes, leading to the 2023 National Offshore Wind dataset: NOW-23. The data for Hawaii include land-based data and are part of WTK-LED Hawaii. Because the accuracy of simulations from a mesoscale model, such as WRF, varies depending on the location and weather situation, and can reach up to several m/s for wind speed, we provide simulated wind speed uncertainty estimates to the community to be used in conjunction with the deterministic model simulations. This dataset was developed to satisfy a wide group of stakeholders across various wind energy disciplines, including but not limited to stakeholders in the distributed and utility scale wind industry, the new emerging airborne wind energy field, grid integration, power systems modeling, environmental modeling, and researchers in academia, and to close some of the gaps that current public datasets have. Based on our validation results to date, we suggest use cases and applications for each dataset of the WTK-LED as shown in "WTK-LED Use Cases" resource below.

Array↗

NESC Peer Review of Exploration Systems Development (ESD) Integrated Vehicle Modal Test, Model Correlation, Development Flight Instrumentation (DFI) and Flight Loads Readiness; Uncertainty Propagation for Model Validation Sub-task

This report details a sub-task (regarding Uncertainty Propagation for Model Validation) from a NASA Engineering and Safety Center assessment that is a multi-year activity spanning the complete development of the Space Launch System integrated vehicle structural dynamic models, and the development of the certification of flight readiness for the Artemis 1 and Artemis 2 vehicles and their variants.

Exploration Systems Development; Development Fligh↗

Performance-based earthquake early warning for tall buildings

The ShakeAlert Earthquake Early Warning (EEW) system aims to issue an advance warning to residents on the West Coast of the United States seconds before the ground shaking arrives, if the expected ground shaking exceeds a certain threshold. However, residents in tall buildings may experience much greater motion due to the dynamic response of the buildings. Therefore, there is an ongoing effort to extend ShakeAlert to include the contribution of building response to provide a more accurate estimation of the expected shaking intensity for tall buildings. Currently, the supposedly ideal solution of analyzing detailed finite element models of buildings under predicted ground-motion time histories is not theoretically or practically feasible. The authors have recently investigated existing simple methods to estimate peak floor acceleration (PFA) and determined these simple formulas are not practically suitable. Instead, this article explores another approach by extending the Pacific Earthquake Engineering Research Center (PEER) performance-based earthquake engineering (PBEE) to EEW, considering that every component involved in building response prediction is uncertain in the EEW scenario. Additionally, while this idea is not new and has been proposed by other researchers, it has two shortcomings: (1) the simple beam model used for response prediction is prone to modeling uncertainty, which has not been quantified, and (2) the ground motions used for probabilistic demand models are not suitable for EEW applications. In this article, we address these two issues by incorporating modeling errors into the parameters of the beam model and using a new set of ground motions, respectively. We demonstrate how this approach could practically work using data from a 52-story building in downtown Los Angeles. Using the criteria and thresholds employed by previous researchers, we show that if peak ground acceleration (PGA) is accurately estimated, this approach can predict the expected level of human comfort in tall buildings.

58 GEOSCIENCES↗

pnnl/SNAP

In this work, we detail two uncertainty quantification (UQ) methods that provide complementary information. Readout ensembling, by finetuning only the readout layers of an ensemble of foundation models, provides information about model uncertainty. Amending the final readout layer to predict upper and lower quantiles replaces point predictions with distributional predictions, which provide information about uncertainty within the underlying training data. We demonstrate our approach with the MACE-MP-0 model, applying UQ to both the foundation model and a series of finetuned models. The uncertainties produced by the ensemble and quantile methods are demonstrated to be distinct measures by which the quality of the NNP output can be judged.

Pope, Jenna (Bilbrey) [Pacific Northwest National ↗

Line-of-sight control of the CSI evolutionary model - mu control

The design, analysis, and simulation of a control law that guarantees a fine pointing performance under external disturbances and model uncertainties are investigated. The authors examine the achievable performance and modeling errors for the control-structure interaction (CSI) evolutionary model structure and highlight the importance of accurate knowledge of structural frequencies and damping values for very lightly damped structures. Numerical results indicate that a limited but significant line-of-sight pointing performance robustness can be attained in spite of modeled structured and unstructured uncertainties in the system. The simulation results reported demonstrate typical performance levels, types of uncertainties and their magnitudes, and design tradeoffs for a realistic laboratory model of a large flexible space structure.

Lim, K. B.↗

YAHFC: A Code Framework to Model Nuclear Reactions and Estimate Correlated Uncertainties

Reaction modeling is a key ingredient in designing experiments and interpreting their results, and is an essential component in the process of evaluating nuclear data and assembling nuclear data libraries used in nuclear technology applications. Typically, experimental data are available only for a handful of reaction channels and theory models are used to fill in the gaps. In addition, theory is often called upon as the arbitrator between discrepant data. Most importantly, theory and modeling are required for an accurate determination of uncertainties in the evaluated data and the correlations between the multiple channels. A fast, accurate, and flexible modeling capability has been developed at LLNL with the code system YAHFC (Yet Another Hauser-Feshbach Code). YAHFC is a Monte Carlo, Hauser-Feshbach code framework, making full use of dynamic memory allocation, derived types, and parallel computing. YAHFC can generate events to simulate experiments and is guiding experiments designed to measure inelastic neutron scattering from actinide targets. YAHFC is also being used to analyze decays from surrogate experiments, thereby enabling the inference of reaction cross sections inaccessible by direct measurement. Finally, by modeling nuclear reactions with constraints from experimental data, YAHFC can deliver complete nuclear data libraries, with evaluated uncertainties, using the modernized Generalized Nuclear Data Structure (GNDS).

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Autonomous frequency domain identification: Theory and experiment

The analysis, design, and on-orbit tuning of robust controllers require more information about the plant than simply a nominal estimate of the plant transfer function. Information is also required concerning the uncertainty in the nominal estimate, or more generally, the identification of a model set within which the true plant is known to lie. The identification methodology that was developed and experimentally demonstrated makes use of a simple but useful characterization of the model uncertainty based on the output error. This is a characterization of the additive uncertainty in the plant model, which has found considerable use in many robust control analysis and synthesis techniques. The identification process is initiated by a stochastic input u which is applied to the plant p giving rise to the output. Spectral estimation (h = P sub uy/P sub uu) is used as an estimate of p and the model order is estimated using the produce moment matrix (PMM) method. A parametric model unit direction vector p is then determined by curve fitting the spectral estimate to a rational transfer function. The additive uncertainty delta sub m = p - unit direction vector p is then estimated by the cross spectral estimate delta = P sub ue/P sub uu where e = y - unit direction vectory y is the output error, and unit direction vector y = unit direction vector pu is the computed output of the parametric model subjected to the actual input u. The experimental results demonstrate the curve fitting algorithm produces the reduced-order plant model which minimizes the additive uncertainty. The nominal transfer function estimate unit direction vector p and the estimate delta of the additive uncertainty delta sub m are subsequently available to be used for optimization of robust controller performance and stability.

Yam, Yeung↗