Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainty modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Developing Uncertainty Models for Robust Flutter Analysis Using Ground Vibration Test Data

A ground vibration test can be used to obtain information about structural dynamics that is important for flutter analysis. Traditionally, this information#such as natural frequencies of modes#is used to update analytical models used to predict flutter speeds. The ground vibration test can also be used to obtain uncertainty models, such as natural frequencies and their associated variations, that can update analytical models for the purpose of predicting robust flutter speeds. Analyzing test data using the -norm, rather than the traditional 2-norm, is shown to lead to a minimum-size uncertainty description and, consequently, a least-conservative robust flutter speed. This approach is demonstrated using ground vibration test data for the Aerostructures Test Wing. Different norms are used to formulate uncertainty models and their associated robust flutter speeds to evaluate which norm is least conservative.

Potter, Starr↗

The Economic Impact of Battery Degradation Modelling Uncertainty

Battery energy storage systems (BESS) are used for a variety of applications, with their economic benefit often being the decisive factor for deployment. A multitude of physico-chemical aging mechanisms lead to capacity fade over a BESS life cycle. The models that are used to describe this capacity fade are prone to inherent model errors. Through a holistic techno-economic modelling approach, we investigate the impact of battery degradation modelling uncertainty on the economic benefit of representative BESS applications. Here, it is shown how improved parameter fit quality can reduce the resulting economic uncertainty. Furthermore, we highlight that the consideration of degradation modelling uncertainty is especially crucial when: (i) the cash flow highly depends on the available battery capacity, (ii) a fixed, e.g. warranty mandated, state of health limit acts as the threshold for battery end-of-life, (iii) long evaluation periods and low discount rates are the focus of economic evaluation.

aging↗

Development of an Uncertainty Model for the National Transonic Facility

This paper introduces an uncertainty model being developed for the National Transonic Facility (NTF). The model uses a Monte Carlo technique to propagate standard uncertainties of measured values through the NTF data reduction equations to calculate the combined uncertainties of the key aerodynamic force and moment coefficients and freestream properties. The uncertainty propagation approach to assessing data variability is compared with ongoing data quality assessment activities at the NTF, notably check standard testing using statistical process control (SPC) techniques. It is shown that the two approaches are complementary and both are necessary tools for data quality assessment and improvement activities. The SPC approach is the final arbiter of variability in a facility. Its result encompasses variation due to people, processes, test equipment, and test article. The uncertainty propagation approach is limited mainly to the data reduction process. However, it is useful because it helps to assess the causes of variability seen in the data and consequently provides a basis for improvement. For example, it is shown that Mach number random uncertainty is dominated by static pressure variation over most of the dynamic pressure range tested. However, the random uncertainty in the drag coefficient is generally dominated by axial and normal force uncertainty with much less contribution from freestream conditions.

Walter, Joel A.↗

Uncertainty Modeling for Mars Ascent Vehicle’s Aerodatabase Development

The design of the Mars Ascent Vehicle - Mars Sample Return (MAV-MSR) trajectories requires an accurate assessment of flight performance. Typically, these trajectories are developed by flight mechanics analysis to meet complex mission requirements and then flight performance assessed through Monte Carlo simulations. Consequently, it is crucial to develop an aerodynamic aerodatabase as an input model for flight mechanics analysis to provide static and dynamic force and moment coefficients under specific flight conditions. The force and moment coefficients in the MAV aerodatabase are determined using the FUN3D computational fluid dynamics solver. Firstly, an overview of the aerodatabase is presented to demonstrate its applicability to trajectory-defined simulations. This effort is followed by an initial attempt to quantify uncertainties in the force and moment coefficients necessary for updating the current aerodatabase. The uncertainty model identifies uncertainty adders and multipliers for coefficient-based forces and moments through a direct comparison between FUN3D and wind tunnel test data from NASA Marshall Space Center's 14x14 inch Trisonic Wind Tunnel. These uncertainties aim to encompass various changes in Mach number, angle of attack, and aerodynamic roll angle.

Uncertainty analysis↗

Uncertainty Modeling for Mars Ascent Vehicle’s Aerodynamic Database Development

The design of the Mars Ascent Vehicle - Mars Sample Return (MAV-MSR) trajectories requires an accurate assessment of flight performance. Typically, these trajectories are developed by flight mechanics analysis to meet complex mission requirements and then flight performance assessed through Monte Carlo simulations. Consequently, it is crucial to develop an aerodynamic aerodatabase as an input model for flight mechanics analysis to provide static and dynamic force and moment coefficients under specific flight conditions. The force and moment coefficients in the MAV aerodatabase are determined using the FUN3D computational fluid dynamics solver. Firstly, an overview of the aerodatabase is presented to demonstrate its applicability to trajectory-defined simulations. This effort is followed by an initial attempt to quantify uncertainties in the force and moment coefficients necessary for updating the current aerodatabase. The uncertainty model identifies uncertainty adders and multipliers for coefficient-based forces and moments through a direct comparison between FUN3D and wind tunnel test data from NASA Marshall Space Center's 14x14 inch Trisonic Wind Tunnel. These uncertainties aim to encompass various changes in Mach number, angle of attack, and aerodynamic roll angle.

Uncertainty analysis↗

Impact of Model Uncertainties on Quantitative Analysis of FUV Auroral Images: Peak Production Height

We demonstrate that small uncertainties in the modeled height of peak production for FUV emissions can lead to significant uncertainties in the analysis of these sai-ne emissions. In particular, an uncertainty of only 3 km in the peak production height can lead to a 50% uncertainty in the mean auroral energy deduced from the images. This altitude uncertainty is comparable to differences in different auroral deposition models currently used for UVI analysis. Consequently, great care must be taken in quantitative photometric analysis and interpretation of FUV auroral images.

Germany, G. A.↗

Characterizing model uncertainties in simulated coast-to-offshore wind over the northeast U.S. using multi-platform measurements from the TCAP field campaign

Numerical weather prediction (NWP) models, such as the Weather Research and Forecasting (WRF) model, are widely used to provide estimates of the offshore wind energy resource owing to their large spatial coverage compared to available observations. Nevertheless, spatiotemporal distribution of model biases is highly dependent on factors including model configuration, location, and the interplay of multi-scale physical processes. Here, in this study, we focus on the characterization of model uncertainties in simulated coast-to-offshore winds over the northeast U.S., by varying sea surface temperature (SST) forcings, surface layer (SL) and planetary boundary layer (PBL) parameterizations, as well as identifying biases that may be directly passed from initial and boundary conditions. Multiple measurements, including aircraft data collected during the U.S. Department of Energy's Two-Column Aerosol Project (TCAP) experiment, are used to constrain the model results and facilitate quantitative comparisons. Our analysis indicates while SST forcing has notable impacts on simulated air temperature and moisture within PBL, the modeled winds are in general more sensitive to the choices of SL and PBL physics than to SST. The model’s forcing data not only controls the vertical dependence of wind speed errors, but also alters regional variability in wind speed’s spatial correlation. Bias comparisons between ERA5 reanalysis and ensemble simulations revealed significant similarity, particularly in wind speed biases during winter, underscoring their dependency on initial and boundary conditions. Coastal and offshore near-surface wind speed biases tend to exhibit much higher similarity in winter than in summer due to the presence of much stronger and more persistent synoptic wind conditions. This study highlights the importance of accurate atmospheric forcing and parameterization choices in improving wind forecasts and suggests the potential for extrapolating coastal wind biases to offshore locations, aiding wind energy forecasting and informing the Wind Forecast Improvement Project-3 (WFIP3).

17 WIND ENERGY↗

An Entropy-Based Test and Development Framework for Uncertainty Modeling in Level-Set Visualizations

We present a simple comparative framework for testing and developing uncertainty modeling in uncertain marching cubes implementations. The selection of a model to represent the probability distribution of uncertain values directly influences the memory use, run time, and accuracy of an uncertainty visualization algorithm. We use an entropy calculation directly on ensemble data to establish an expected result and then compare the entropy from various probability models, including uniform, Gaussian, histogram, and quantile models. Our results verify that models matching the distribution of the ensemble indeed match the entropy. We further show that fewer bins in nonparametric histogram models are more effective whereas large numbers of bins in quantile models approach data accuracy.

Sisneros, Robert↗

Probabilistic Blast Damage Modeling Uncertainties and Sensitivities

Blast overpressure is the predominant source of ground damage posed by potentially hazardous asteroid strikes. Estimates of the extent, severity, and likelihoods of potential blast damage regions will be one of the key metrics needed to mount civil defense or disaster response plans in the face of an impending impact. However, there are many inherent sources of uncertainty in evaluating the damage, both in characterizing the properties of the incoming object and in the approaches used to model the entry/impact and resulting damage, which make it difficult to produce a single ‘accurate’ or ‘best guess’ prediction of ground damage. The current 2021 PDC hypothetical impact scenario poses a particular challenge due to its short warning time. The need for rapid disaster response to prepare for an immanent impact, combined with lack of observational opportunities to refine basic knowledge about the object’s basic size and properties, make understanding the range and relative likelihood of consequences particularly critical. The potential damage caused by these blasts can be evaluated using a range of modeling and simulation approaches and levels of fidelity. Fast-running engineering-level models can be used to run large numbers of probabilistically sampled cases covering wide variations of uncertain properties or parameters. High-fidelity simulations, on the other hand, can capture more detailed/accurate blast physics, but can only be performed for a small selection of specific cases, requiring many assumptions to be made about the initial object and its unpredictable entry/breakup characteristics. In order to provide a more complete picture of the potential threat for effective disaster response, both types of analysis need to be employed together. In this approach, high-fidelity simulations are used to refine and anchor engineering models, and the probabilistic engineering models are used to evaluate broad parameters spaces and guide selection of the most pertinent simulation cases for a given scenario. This presentation expands upon the probabilistic asteroid impact risk assessments being performed as part of the 2021 PDC hypothetical impact exercise, focusing on key aspects of blast damage modeling uncertainties and sensitivities. We review the current modeling and simulation approaches employed in the current assessment, compare the relative levels of uncertainty stemming from each main element of the problem (i.e., knowledge of the asteroid properties, modeling of the atmospheric entry/breakup and airburst, and estimates of the ground damage from the resulting blasts waves), and highlight any notable trends and sensitivities for the current scenario case.

SMD↗

Approximating and incorporating model uncertainty in an inversion for seismic source functions: Preliminary results

We present preliminary work on propagating model uncertainty into the estimation of the time domain source time functions of the seismic source. Our method is based on an estimated model covariance function, which we estimate from the data. The model covariance function is then used to construct a suite of surrogate Greens functions which we use in a Monte Carlo type inversion scheme. The result is a probability density function of the six independent source time functions, each of which corresponds to an individual component of the seismic moment tensor. We compare the results of our method with those obtained using a computationally expensive finite difference Monte Carlo method and find that our new method produces results that are deficient in low frequencies. The advantage of our new method, which we term the Karhunen-Loeve Monte Carlo (KLMC) method, is that is several orders of magnitude faster than our current method, which uses a finite difference scheme to produce the suite of forward models.

42 ENGINEERING↗

How initial conditions-, structural-, and parameter-based model uncertainty interact and influence predictions in permafrost ecosystems: Modeling Archive

This dataset contains model output and input data, as well as source code examples for the Terrestrial Ecosystem Model with the Dynamic Vegetation Model and Dynamic Organic Soil (DVM-DOS-TEM) for the field sites Imnavait creek and the Bonanza creek Long Term Ecological Research Network (LTER). The data covers simulations from the last glacial maximum (LGM) until 2100 for a selection of paleo scenarios, setting the mean temperature of the LGM up to 10°C lower than pre-industrial conditions. The model structure was modulated to represent various model versions, and this dataset contains the relevant changes in the source code. The raw output data, the processed statistical data, the setup and processing scripts as well as parameter value distribution files from a parameter sensitivity analysis are included as well. Model outputs include active layer depth, organic soil carbon, soil layer depths, gross primary productivity (GPP) with and without nitrogen limitation, net primary productivity (NPP), soil liquid water content, heterotrophic, maintenance, and growth respiration, soil temperature, and vegetation carbon (*.nc files). The Next-Generation Ecosystem Experiments in the Arctic (NGEE Arctic) project is a research effort to reduce uncertainty in the Department of Energy’s Energy Exascale Earth System Model (E3SM) by developing a predictive understanding of Arctic tundra ecosystems underlain by permafrost and to quantify feedbacks from the Arctic tundra to the Earth system. NGEE Arctic is supported by the Department of Energy's Office of Biological and Environmental Research.Over Phases 1–3, observations made by the NGEE Arctic team across a gradient of permafrost landscapes in Arctic Alaska improved the representation of tundra processes in the land surface component of E3SM (the E3SM Land Model, ELM). Model improvements emphasized unique aspects of permafrost environments and explored reductions in model complexity while retaining predictive power. The Arctic-informed ELM developed by NGEE Arctic has been used to make novel predictions on processes ranging from permafrost thaw to soil biogeochemical cycling to Earth system feedbacks associated with the unique characteristics of tundra plants. In Phase 4, the NGEE Arctic team is evaluating our new predictive understanding under novel conditions across the Arctic domain. In collaboration with partners at long-term pan-Arctic research sites we are examining whether an Arctic-informed ELM can faithfully simulate interactions among surface and subsurface processes at site, regional, and pan-Arctic scales. In turn, we are using variety of tools to dynamically extend and evaluate ELM inference, with an emphasis on data synthesis and pan-Arctic model evaluation, reintegration of code with an evolving E3SM, scaling across heterogeneous Arctic landscapes, and the appropriate representation of the impacts of increasingly frequent Arctic disturbances.

54 ENVIRONMENTAL SCIENCES↗

235-F GoldSim Fate and Transport Model: Uncertainty Quantification

Building 235-F was configured with two missions in mind: Actinide Billet Line (ABL) and the fabrication of Pu-238 oxide for space program applications. ABL produced Np-237 billets for use in SRS reactors, whereas the design process, fabrication, and examination of Pu-238 oxide powder occurred within the following areas, respectively: Plutonium Experimental Facility (PEF), Plutonium Fuel Form (PuFF), and Old Metallography Lab (OML). By 1990 production ceased and by 2006 de-inventory occurred; however, assays have shown significant holdup remains within ABL and PuFF. As a result, 235-F is a Category 2 nuclear facility, with plans to undergo deactivation and decommission (D and D) via In-Situ Disposal (ISD). The purpose of this project is to ensure United States Environmental Protection Agency (USEPA) groundwater radiation maximum contaminant level (MCL) and dosage standards are met during the D and D of 235-F by quantifying uncertainty through probabilistic modeling and evaluation of various ISD alternatives. GoldSim is a dynamic modeling software package with a graphical, object-oriented interface capable of capturing the influence of complex system input variability on probabilistic system outcomes. A GoldSim stochastic fate and transport model for 235-F was developed and matched with a PORFLOW deterministic model to simulate probabilistic release and flow of radionuclides from ABL and PuFF into the vadose zone, the Upper Three Runs (UTR) Aquifer, and UTR Creek. The GoldSim model was used to probabilistically evaluate four ISD scenarios against USEPA groundwater radiation MCLs and dosage standards. The deterministic 235-F GoldSim fate and transport model continues to be refined to match the results of the PORFLOW deterministic model to ensure the model accurately represents radionuclide movement through the groundwater system. The stochastic variables that are utilized within the GoldSim model are founded on the most current data; a conservative perspective is taken where needed. Alignment with the PORFLOW deterministic model, coupled with input stochastic variability, allows the probabilistic 235-F GoldSim model to capture the conservative breadth of possible outcomes for radionuclide fate within this particular system. This ensures that the USEPA MCLs and dosage limits hold even in the worst case scenarios.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Effect of model uncertainty on failure detection - The threshold selector

The performance of all failure detection, isolation, and accomodation (DIA) algorithms is influenced by the presence of model uncertainty. A unique framework is presented to incorporate a knowledge of modeling error in the analysis and design of failure detection systems. The tools being used are very similar to those in robust control theory. A concept is introduced called the threshold selector, which is a nonlinear inequality whose solution defines the set of detectable sensor failure signals. The threshold selector represents an innovative tool for analysis and synthesis of DIA algorithms. It identifies the optimal threshold to be used in innovations-based DIA algorithms. The optimal threshold is shown to be a function of the bound on modeling errors, the noise properties, the speed of DIA filters, and the classes of reference and failure signals. The size of the smallest detectable failure is also determined. The results are applied to a multivariable turbofan jet engine example, which demonstrates improvements compared to previous studies.

Emami-Naeini, Abbas↗

Minimum-Variance Control Allocation Considering Parametric Model Uncertainty

The control allocation problem was investigated for linear dynamical systems with known parametric uncertainty. Minimizing a cost function that penalizes the variance of the error in achieving commanded forces and moments on the vehicle resulted in a special case of the weighted pseudo-inverse allocator. Rather than an engineer designing the weighting matrix, it is computed from the covariances of the control effectiveness parameters. This minimum-variance allocator balances the effectiveness of the control inputs against the corresponding levels of uncertainty. The approach was demonstrated using simulations of aircraft with realistic uncertainty levels operating in open-loop and closed-loop configurations. Results showed that when model uncertainty is known, significant, and unevenly distributed amongst the controls, the minimum-variance allocator more often achieves the intended forces and moments on the vehicle in comparison to other allocators, which can lead to increased performance, reliability, and safety during flight tests. The cost for this robustness is a diminished achievable moment space for the vehicle.

Control allocation↗

An efficient method to propagate model uncertainty when inverting seismic data for time domain seismic moment tensors

SUMMARY We present a computationally efficient method to approximately propagate uncertainty when linearly inverting seismic data for point source, time variable moment tensor components. The method is based on the assumption that the data residual, given by the difference between the observed seismic data and the data predicated by a linear inversion, contains the effects of both data and model uncertainty. Our method uses a distribution of data residuals, added directly to the data, in a pseudo-Monte Carlo scheme. Using the assumption that the data residual is a stochastic process, we use the well-known Karhunen–Loève (KL) theorem to construct a distribution of data residuals, where the required basis functions are constructed using Fourier series. The Fourier series are scaled by a product of a random variable and the real-valued spectral amplitudes of the original data residual’s spectrum. Thus, the Fourier series and spectral amplitudes are eigenfunction-eigenvalue pairs used in the KL-based construction of data residual distribution. Using tests with synthetic data, we show that our method compares closely with a Finite Difference Monte Carlo (FDMC) method that we presented previously. More importantly, the method presented here is computationally several orders of magnitude faster than our previous FDMC method, and requires no a priori assumptions of model and/or data uncertainty.

Poppeliers, Christian (ORCID:0000000159526849)↗

Evaluating the Effects of Detector Modeling Uncertainties on Sterile Neutrino Oscillation Analysis with the ICARUS Detector

he ICARUS T600 LArTPC detector was refurbished after an initial run at the underground LNGS labs and is currently taking data within its experimental hall at Fermilab after full commissioning. Regular data taking began in May 2021 with neutrinos from the Booster Neutrino Beam (BNB) and the Neutrinos at the Main Injector (NuMI) off-axis beam. As the far detector of the Short-Baseline Neutrino (SBN) Program, the ICARUS detector's capability in searching for both muon neutrino disappearance and electron neutrino appearance will allow for unprecedented sensitivity to light sterile neutrinos with eV-scale mass. The ultimate sensitivity of the detector to sterile neutrino oscillations depends on the understanding of the detector response and the uncertainties remaining after calibrating the detector model. This poster will review how detector-model-related uncertainties are quantified, evaluated and their impact on expected sterile neutrino oscillation sensitivities using the existing ICARUS data. The work pursued here is broadly applicable to other ICARUS analysis pathways such as neutrino-argon cross-sections and Beyond the Standard Model physics searches. It will finally discuss improvement pathways to reduce the systematic uncertainties to the level needed for the joint sterile neutrino oscillation analysis with the Short Baseline Near Detector (SBND) within the SBN Program.

43 PARTICLE ACCELERATORS↗

The Impact of Model Uncertainty on Spatial Compensation in Structural Acoustic Control

Turbulent boundary layer (TBL) noise is considered a primary contribution to the interior noise present in commercial airliners. There are numerous investigations of interior noise control devoted to aircraft panels; however, practical realization is a potential challenge since physical boundary conditions are uncertain at best. In most prior studies, pinned or clamped boundary conditions were assumed; however, realistic panels likely display a range of boundary conditions between these two limits. Uncertainty in boundary conditions is a challenge for control system designers, both in terms of the compensator implemented and the location of transducers required to achieve the desired control. The impact of model uncertainties, specifically uncertain boundaries, on the selection of transducer locations for structural acoustic control is considered herein. The final goal of this work is the design of an aircraft panel structure that can reduce TBL noise transmission through the use of a completely adaptive, single-input, single-output control system. The feasibility of this goal is demonstrated through the creation of a detailed analytical solution, followed by the implementation of a test model in a transmission loss apparatus. Successfully realizing a control system robust to variations in boundary conditions can lead to the design and implementation of practical adaptive structures that could be used to control the transmission of sound to the interior of aircraft. Results from this research effort indicate it is possible to optimize the design of actuator and sensor location and aperture, minimizing the impact of boundary conditions on the desired structural acoustic control.

Clark, Robert L.↗

The Impact of Model Uncertainty on Spatial Compensation in Active Structural Acoustic Control

Turbulent boundary layer (TBL) noise is considered a primary factor in the interior noise experienced by passengers aboard commercial airliners. There have been numerous investigations of interior noise control devoted to aircraft panels; however, practical realization is a challenge since the physical boundary conditions are uncertain at best. In most prior studies, pinned or clamped boundary conditions have been assumed; however, realistic panels likely display a range of varying boundary conditions between these two limits. Uncertainty in boundary conditions is a challenge for control system designers, both in terms of the compensator implemented and the location of actuators and sensors required to achieve the desired control. The impact of model uncertainties, uncertain boundary conditions in particular, on the selection of actuator and sensor locations for structural acoustic control are considered herein. Results from this research effort indicate that it is possible to optimize the design of actuator and sensor location and aperture, which minimizes the impact of boundary conditions on the desired structural acoustic control.

Cabell, Randolph H.↗