Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Development of an Uncertainty Model for the National Transonic Facility

This paper introduces an uncertainty model being developed for the National Transonic Facility (NTF). The model uses a Monte Carlo technique to propagate standard uncertainties of measured values through the NTF data reduction equations to calculate the combined uncertainties of the key aerodynamic force and moment coefficients and freestream properties. The uncertainty propagation approach to assessing data variability is compared with ongoing data quality assessment activities at the NTF, notably check standard testing using statistical process control (SPC) techniques. It is shown that the two approaches are complementary and both are necessary tools for data quality assessment and improvement activities. The SPC approach is the final arbiter of variability in a facility. Its result encompasses variation due to people, processes, test equipment, and test article. The uncertainty propagation approach is limited mainly to the data reduction process. However, it is useful because it helps to assess the causes of variability seen in the data and consequently provides a basis for improvement. For example, it is shown that Mach number random uncertainty is dominated by static pressure variation over most of the dynamic pressure range tested. However, the random uncertainty in the drag coefficient is generally dominated by axial and normal force uncertainty with much less contribution from freestream conditions.

Walter, Joel A.↗

Uncertainty Modeling for Mars Ascent Vehicle’s Aerodatabase Development

The design of the Mars Ascent Vehicle - Mars Sample Return (MAV-MSR) trajectories requires an accurate assessment of flight performance. Typically, these trajectories are developed by flight mechanics analysis to meet complex mission requirements and then flight performance assessed through Monte Carlo simulations. Consequently, it is crucial to develop an aerodynamic aerodatabase as an input model for flight mechanics analysis to provide static and dynamic force and moment coefficients under specific flight conditions. The force and moment coefficients in the MAV aerodatabase are determined using the FUN3D computational fluid dynamics solver. Firstly, an overview of the aerodatabase is presented to demonstrate its applicability to trajectory-defined simulations. This effort is followed by an initial attempt to quantify uncertainties in the force and moment coefficients necessary for updating the current aerodatabase. The uncertainty model identifies uncertainty adders and multipliers for coefficient-based forces and moments through a direct comparison between FUN3D and wind tunnel test data from NASA Marshall Space Center's 14x14 inch Trisonic Wind Tunnel. These uncertainties aim to encompass various changes in Mach number, angle of attack, and aerodynamic roll angle.

Uncertainty analysis↗

Uncertainty Modeling for Mars Ascent Vehicle’s Aerodynamic Database Development

The design of the Mars Ascent Vehicle - Mars Sample Return (MAV-MSR) trajectories requires an accurate assessment of flight performance. Typically, these trajectories are developed by flight mechanics analysis to meet complex mission requirements and then flight performance assessed through Monte Carlo simulations. Consequently, it is crucial to develop an aerodynamic aerodatabase as an input model for flight mechanics analysis to provide static and dynamic force and moment coefficients under specific flight conditions. The force and moment coefficients in the MAV aerodatabase are determined using the FUN3D computational fluid dynamics solver. Firstly, an overview of the aerodatabase is presented to demonstrate its applicability to trajectory-defined simulations. This effort is followed by an initial attempt to quantify uncertainties in the force and moment coefficients necessary for updating the current aerodatabase. The uncertainty model identifies uncertainty adders and multipliers for coefficient-based forces and moments through a direct comparison between FUN3D and wind tunnel test data from NASA Marshall Space Center's 14x14 inch Trisonic Wind Tunnel. These uncertainties aim to encompass various changes in Mach number, angle of attack, and aerodynamic roll angle.

Uncertainty analysis↗

Impact of Model Uncertainties on Quantitative Analysis of FUV Auroral Images: Peak Production Height

We demonstrate that small uncertainties in the modeled height of peak production for FUV emissions can lead to significant uncertainties in the analysis of these sai-ne emissions. In particular, an uncertainty of only 3 km in the peak production height can lead to a 50% uncertainty in the mean auroral energy deduced from the images. This altitude uncertainty is comparable to differences in different auroral deposition models currently used for UVI analysis. Consequently, great care must be taken in quantitative photometric analysis and interpretation of FUV auroral images.

Germany, G. A.↗

Characterizing model uncertainties in simulated coast-to-offshore wind over the northeast U.S. using multi-platform measurements from the TCAP field campaign

Numerical weather prediction (NWP) models, such as the Weather Research and Forecasting (WRF) model, are widely used to provide estimates of the offshore wind energy resource owing to their large spatial coverage compared to available observations. Nevertheless, spatiotemporal distribution of model biases is highly dependent on factors including model configuration, location, and the interplay of multi-scale physical processes. Here, in this study, we focus on the characterization of model uncertainties in simulated coast-to-offshore winds over the northeast U.S., by varying sea surface temperature (SST) forcings, surface layer (SL) and planetary boundary layer (PBL) parameterizations, as well as identifying biases that may be directly passed from initial and boundary conditions. Multiple measurements, including aircraft data collected during the U.S. Department of Energy's Two-Column Aerosol Project (TCAP) experiment, are used to constrain the model results and facilitate quantitative comparisons. Our analysis indicates while SST forcing has notable impacts on simulated air temperature and moisture within PBL, the modeled winds are in general more sensitive to the choices of SL and PBL physics than to SST. The model’s forcing data not only controls the vertical dependence of wind speed errors, but also alters regional variability in wind speed’s spatial correlation. Bias comparisons between ERA5 reanalysis and ensemble simulations revealed significant similarity, particularly in wind speed biases during winter, underscoring their dependency on initial and boundary conditions. Coastal and offshore near-surface wind speed biases tend to exhibit much higher similarity in winter than in summer due to the presence of much stronger and more persistent synoptic wind conditions. This study highlights the importance of accurate atmospheric forcing and parameterization choices in improving wind forecasts and suggests the potential for extrapolating coastal wind biases to offshore locations, aiding wind energy forecasting and informing the Wind Forecast Improvement Project-3 (WFIP3).

17 WIND ENERGY↗

An Entropy-Based Test and Development Framework for Uncertainty Modeling in Level-Set Visualizations

We present a simple comparative framework for testing and developing uncertainty modeling in uncertain marching cubes implementations. The selection of a model to represent the probability distribution of uncertain values directly influences the memory use, run time, and accuracy of an uncertainty visualization algorithm. We use an entropy calculation directly on ensemble data to establish an expected result and then compare the entropy from various probability models, including uniform, Gaussian, histogram, and quantile models. Our results verify that models matching the distribution of the ensemble indeed match the entropy. We further show that fewer bins in nonparametric histogram models are more effective whereas large numbers of bins in quantile models approach data accuracy.

Sisneros, Robert↗

Probabilistic Blast Damage Modeling Uncertainties and Sensitivities

Blast overpressure is the predominant source of ground damage posed by potentially hazardous asteroid strikes. Estimates of the extent, severity, and likelihoods of potential blast damage regions will be one of the key metrics needed to mount civil defense or disaster response plans in the face of an impending impact. However, there are many inherent sources of uncertainty in evaluating the damage, both in characterizing the properties of the incoming object and in the approaches used to model the entry/impact and resulting damage, which make it difficult to produce a single ‘accurate’ or ‘best guess’ prediction of ground damage. The current 2021 PDC hypothetical impact scenario poses a particular challenge due to its short warning time. The need for rapid disaster response to prepare for an immanent impact, combined with lack of observational opportunities to refine basic knowledge about the object’s basic size and properties, make understanding the range and relative likelihood of consequences particularly critical. The potential damage caused by these blasts can be evaluated using a range of modeling and simulation approaches and levels of fidelity. Fast-running engineering-level models can be used to run large numbers of probabilistically sampled cases covering wide variations of uncertain properties or parameters. High-fidelity simulations, on the other hand, can capture more detailed/accurate blast physics, but can only be performed for a small selection of specific cases, requiring many assumptions to be made about the initial object and its unpredictable entry/breakup characteristics. In order to provide a more complete picture of the potential threat for effective disaster response, both types of analysis need to be employed together. In this approach, high-fidelity simulations are used to refine and anchor engineering models, and the probabilistic engineering models are used to evaluate broad parameters spaces and guide selection of the most pertinent simulation cases for a given scenario. This presentation expands upon the probabilistic asteroid impact risk assessments being performed as part of the 2021 PDC hypothetical impact exercise, focusing on key aspects of blast damage modeling uncertainties and sensitivities. We review the current modeling and simulation approaches employed in the current assessment, compare the relative levels of uncertainty stemming from each main element of the problem (i.e., knowledge of the asteroid properties, modeling of the atmospheric entry/breakup and airburst, and estimates of the ground damage from the resulting blasts waves), and highlight any notable trends and sensitivities for the current scenario case.

SMD↗

Approximating and incorporating model uncertainty in an inversion for seismic source functions: Preliminary results

We present preliminary work on propagating model uncertainty into the estimation of the time domain source time functions of the seismic source. Our method is based on an estimated model covariance function, which we estimate from the data. The model covariance function is then used to construct a suite of surrogate Greens functions which we use in a Monte Carlo type inversion scheme. The result is a probability density function of the six independent source time functions, each of which corresponds to an individual component of the seismic moment tensor. We compare the results of our method with those obtained using a computationally expensive finite difference Monte Carlo method and find that our new method produces results that are deficient in low frequencies. The advantage of our new method, which we term the Karhunen-Loeve Monte Carlo (KLMC) method, is that is several orders of magnitude faster than our current method, which uses a finite difference scheme to produce the suite of forward models.

42 ENGINEERING↗

How initial conditions-, structural-, and parameter-based model uncertainty interact and influence predictions in permafrost ecosystems: Modeling Archive

This dataset contains model output and input data, as well as source code examples for the Terrestrial Ecosystem Model with the Dynamic Vegetation Model and Dynamic Organic Soil (DVM-DOS-TEM) for the field sites Imnavait creek and the Bonanza creek Long Term Ecological Research Network (LTER). The data covers simulations from the last glacial maximum (LGM) until 2100 for a selection of paleo scenarios, setting the mean temperature of the LGM up to 10°C lower than pre-industrial conditions. The model structure was modulated to represent various model versions, and this dataset contains the relevant changes in the source code. The raw output data, the processed statistical data, the setup and processing scripts as well as parameter value distribution files from a parameter sensitivity analysis are included as well. Model outputs include active layer depth, organic soil carbon, soil layer depths, gross primary productivity (GPP) with and without nitrogen limitation, net primary productivity (NPP), soil liquid water content, heterotrophic, maintenance, and growth respiration, soil temperature, and vegetation carbon (*.nc files). The Next-Generation Ecosystem Experiments in the Arctic (NGEE Arctic) project is a research effort to reduce uncertainty in the Department of Energy’s Energy Exascale Earth System Model (E3SM) by developing a predictive understanding of Arctic tundra ecosystems underlain by permafrost and to quantify feedbacks from the Arctic tundra to the Earth system. NGEE Arctic is supported by the Department of Energy's Office of Biological and Environmental Research.Over Phases 1–3, observations made by the NGEE Arctic team across a gradient of permafrost landscapes in Arctic Alaska improved the representation of tundra processes in the land surface component of E3SM (the E3SM Land Model, ELM). Model improvements emphasized unique aspects of permafrost environments and explored reductions in model complexity while retaining predictive power. The Arctic-informed ELM developed by NGEE Arctic has been used to make novel predictions on processes ranging from permafrost thaw to soil biogeochemical cycling to Earth system feedbacks associated with the unique characteristics of tundra plants. In Phase 4, the NGEE Arctic team is evaluating our new predictive understanding under novel conditions across the Arctic domain. In collaboration with partners at long-term pan-Arctic research sites we are examining whether an Arctic-informed ELM can faithfully simulate interactions among surface and subsurface processes at site, regional, and pan-Arctic scales. In turn, we are using variety of tools to dynamically extend and evaluate ELM inference, with an emphasis on data synthesis and pan-Arctic model evaluation, reintegration of code with an evolving E3SM, scaling across heterogeneous Arctic landscapes, and the appropriate representation of the impacts of increasingly frequent Arctic disturbances.

54 ENVIRONMENTAL SCIENCES↗

Effect of model uncertainty on failure detection - The threshold selector

The performance of all failure detection, isolation, and accomodation (DIA) algorithms is influenced by the presence of model uncertainty. A unique framework is presented to incorporate a knowledge of modeling error in the analysis and design of failure detection systems. The tools being used are very similar to those in robust control theory. A concept is introduced called the threshold selector, which is a nonlinear inequality whose solution defines the set of detectable sensor failure signals. The threshold selector represents an innovative tool for analysis and synthesis of DIA algorithms. It identifies the optimal threshold to be used in innovations-based DIA algorithms. The optimal threshold is shown to be a function of the bound on modeling errors, the noise properties, the speed of DIA filters, and the classes of reference and failure signals. The size of the smallest detectable failure is also determined. The results are applied to a multivariable turbofan jet engine example, which demonstrates improvements compared to previous studies.

Emami-Naeini, Abbas↗

Minimum-Variance Control Allocation Considering Parametric Model Uncertainty

The control allocation problem was investigated for linear dynamical systems with known parametric uncertainty. Minimizing a cost function that penalizes the variance of the error in achieving commanded forces and moments on the vehicle resulted in a special case of the weighted pseudo-inverse allocator. Rather than an engineer designing the weighting matrix, it is computed from the covariances of the control effectiveness parameters. This minimum-variance allocator balances the effectiveness of the control inputs against the corresponding levels of uncertainty. The approach was demonstrated using simulations of aircraft with realistic uncertainty levels operating in open-loop and closed-loop configurations. Results showed that when model uncertainty is known, significant, and unevenly distributed amongst the controls, the minimum-variance allocator more often achieves the intended forces and moments on the vehicle in comparison to other allocators, which can lead to increased performance, reliability, and safety during flight tests. The cost for this robustness is a diminished achievable moment space for the vehicle.

Control allocation↗

An efficient method to propagate model uncertainty when inverting seismic data for time domain seismic moment tensors

SUMMARY We present a computationally efficient method to approximately propagate uncertainty when linearly inverting seismic data for point source, time variable moment tensor components. The method is based on the assumption that the data residual, given by the difference between the observed seismic data and the data predicated by a linear inversion, contains the effects of both data and model uncertainty. Our method uses a distribution of data residuals, added directly to the data, in a pseudo-Monte Carlo scheme. Using the assumption that the data residual is a stochastic process, we use the well-known Karhunen–Loève (KL) theorem to construct a distribution of data residuals, where the required basis functions are constructed using Fourier series. The Fourier series are scaled by a product of a random variable and the real-valued spectral amplitudes of the original data residual’s spectrum. Thus, the Fourier series and spectral amplitudes are eigenfunction-eigenvalue pairs used in the KL-based construction of data residual distribution. Using tests with synthetic data, we show that our method compares closely with a Finite Difference Monte Carlo (FDMC) method that we presented previously. More importantly, the method presented here is computationally several orders of magnitude faster than our previous FDMC method, and requires no a priori assumptions of model and/or data uncertainty.

Poppeliers, Christian (ORCID:0000000159526849)↗

Evaluating the Effects of Detector Modeling Uncertainties on Sterile Neutrino Oscillation Analysis with the ICARUS Detector

he ICARUS T600 LArTPC detector was refurbished after an initial run at the underground LNGS labs and is currently taking data within its experimental hall at Fermilab after full commissioning. Regular data taking began in May 2021 with neutrinos from the Booster Neutrino Beam (BNB) and the Neutrinos at the Main Injector (NuMI) off-axis beam. As the far detector of the Short-Baseline Neutrino (SBN) Program, the ICARUS detector's capability in searching for both muon neutrino disappearance and electron neutrino appearance will allow for unprecedented sensitivity to light sterile neutrinos with eV-scale mass. The ultimate sensitivity of the detector to sterile neutrino oscillations depends on the understanding of the detector response and the uncertainties remaining after calibrating the detector model. This poster will review how detector-model-related uncertainties are quantified, evaluated and their impact on expected sterile neutrino oscillation sensitivities using the existing ICARUS data. The work pursued here is broadly applicable to other ICARUS analysis pathways such as neutrino-argon cross-sections and Beyond the Standard Model physics searches. It will finally discuss improvement pathways to reduce the systematic uncertainties to the level needed for the joint sterile neutrino oscillation analysis with the Short Baseline Near Detector (SBND) within the SBN Program.

43 PARTICLE ACCELERATORS↗

The Impact of Model Uncertainty on Spatial Compensation in Structural Acoustic Control

Turbulent boundary layer (TBL) noise is considered a primary contribution to the interior noise present in commercial airliners. There are numerous investigations of interior noise control devoted to aircraft panels; however, practical realization is a potential challenge since physical boundary conditions are uncertain at best. In most prior studies, pinned or clamped boundary conditions were assumed; however, realistic panels likely display a range of boundary conditions between these two limits. Uncertainty in boundary conditions is a challenge for control system designers, both in terms of the compensator implemented and the location of transducers required to achieve the desired control. The impact of model uncertainties, specifically uncertain boundaries, on the selection of transducer locations for structural acoustic control is considered herein. The final goal of this work is the design of an aircraft panel structure that can reduce TBL noise transmission through the use of a completely adaptive, single-input, single-output control system. The feasibility of this goal is demonstrated through the creation of a detailed analytical solution, followed by the implementation of a test model in a transmission loss apparatus. Successfully realizing a control system robust to variations in boundary conditions can lead to the design and implementation of practical adaptive structures that could be used to control the transmission of sound to the interior of aircraft. Results from this research effort indicate it is possible to optimize the design of actuator and sensor location and aperture, minimizing the impact of boundary conditions on the desired structural acoustic control.

Clark, Robert L.↗

The Impact of Model Uncertainty on Spatial Compensation in Active Structural Acoustic Control

Turbulent boundary layer (TBL) noise is considered a primary factor in the interior noise experienced by passengers aboard commercial airliners. There have been numerous investigations of interior noise control devoted to aircraft panels; however, practical realization is a challenge since the physical boundary conditions are uncertain at best. In most prior studies, pinned or clamped boundary conditions have been assumed; however, realistic panels likely display a range of varying boundary conditions between these two limits. Uncertainty in boundary conditions is a challenge for control system designers, both in terms of the compensator implemented and the location of actuators and sensors required to achieve the desired control. The impact of model uncertainties, uncertain boundary conditions in particular, on the selection of actuator and sensor locations for structural acoustic control are considered herein. Results from this research effort indicate that it is possible to optimize the design of actuator and sensor location and aperture, which minimizes the impact of boundary conditions on the desired structural acoustic control.

Cabell, Randolph H.↗

Simulation and Application of Bayesian Dose Uncertainty Modeling for Low-Boom Community Noise Surveys

In dose-response modeling, failing to account for dose uncertainty can cause artificial flattening of the estimated slope of the dose-response curve. Previous analyses of NASA sonic boom community noise survey data utilized a Bayesian multilevel logistic regression model, which did not account for dose uncertainty. The current work extends the model to account for either classical or Berkson dose uncertainty. The extended model is applied to two simulated dose-response datasets to illustrate conditions under which the dose uncertainty term does and does not correct for the artificial flattening introduced by dose uncertainty. Finally, the extended model is applied to two previous NASA sonic boom community noise surveys. The resulting dose-response curve slope for the average participant is 5 to 10% steeper, but the difference in the noise dose that elicits a 5% highly annoyed response is small (less than 1 dB). The difference remains insignificant when producing population summary dose-response curves. Commentary is included on applicability to future X-59 low-boom community noise survey data modeling and analysis.

X-59↗

Reducing Model Uncertainty of Climate Change Impacts on High Latitude Carbon Assimilation

The Arctic Boreal Region (ABR) has a large impact on global vegetation-atmosphere interactions and is experiencing markedly greater warming than the rest of the planet, a trend that is projected to continue with anticipated future emissions of CO 2 . The ABR is a significant source of uncertainty in estimates of carbon uptake in terrestrial biosphere models (TBMs) such that reducing this uncertainty is critical for more accurately estimating global carbon cycling and understanding the response of the region to global change. Process representation and parameterization associated with gross primary productivity (GPP) drives a large amount of this model uncertainty, particularly within the next 50 years, where the response of existing vegetation to climate change will dominate estimates of GPP for the region. Furthermore, we review our current understanding and model representation of GPP in northern latitudes, focusing on vegetation composition, phenology and physiology, and consider how climate change alters these three components. We highlight challenges in the ABR for predicting GPP, but also focus on the unique opportunities for advancing knowledge and model representation, particularly through the combination of remote sensing and traditional boots-on-the-ground science.

54 ENVIRONMENTAL SCIENCES↗

Evaluating SWAT + model uncertainties for human and natural outcomes: Application in a Great Lakes agricultural watershed

Nutrient exports from agricultural lands in the Great Lakes Region pose significant threats to water quality and ecological health through eutrophication, hypoxia, and harmful algal blooms. Climate change and agricultural adaptation practices complicate future nutrient loading due to intensified hydrologic cycles and land use decisions. Our research focuses on evaluating the Soil and Water Assessment Tool (SWAT) plus model parametric uncertainties for human and natural outcomes across different scales. These factors are integral to ensuring a balance between productive agricultural practices and maintaining the health of watershed hydrology. However, uncertainties in modeling such complex interactions pose significant challenges, limiting our ability to precisely determine critical factors that influence crop yield and soil moisture. Our analysis employs Sobol global sensitivity analysis to evaluate first-order, second order, and total-order indices for SWAT crop growth parameter, ensuring comprehensive assessment of individual and interactive effects on model outputs. The objective is to identify the parameters that significantly affect model outputs for crop yield and soil moisture and improve our understanding of their interactions at the basin and hydrological response unit (HRU) scale. Our case study, the Portage River Watershed, which drains into Lake Erie, is chosen to better capture finer scale interactions crucial for predicting nutrient loading under future climate scenarios. This foundational work is aimed at setting the stage for the future development of an agent-based model (ABM). The ABM model would incorporate SWAT outputs to dynamically simulate decision-making processes.

Bunyon, Enock↗