SEARCH · Engineering Papers

Results for “Model uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,549 records · Page 86

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Uncertainty Quantification of PV Annual Energy Estimates in the System Advisor Model

This work will detail a proposed uncertainty quantification method for PV annual energy estimates. Motivations behind the proposed methodology will be discussed, including the frequent underperformance of installed PV systems to calculated probability of exceedance values being seen in industry. A methodology in which uncertainty factors correlated to different parts of the PV annual energy model chain are applied to annual energy estimates in conjunction with uncertainty from inter-annual solar resource variability will be described. The application of this methodology in the System Advisor Model (SAM) will also be discussed with example cases and graphical outputs of the probability of exceedance data calculated for the PV annual energy estimates.

energy modeling↗

DOE OSTI2020

Issue Summary of INL Phase IV Transient Results for IAEA CRP on HTGR UAM Benchmark

This report details the Parallel and Highly Innovative Simulation for Idaho National Laboratory (INL) Code System (PHISICS)/Reactor Excursions and Leak Analysis Program (RELAP5)-3D results obtained for the transient core exercises defined for Phase IV of the International Atomic Energy Agency (IAEA) Coordinated Research Project (CRP) on high-temperature gas cooled reactor (HTGR) uncertainty analysis in modeling (UAM). The Phase III models and results are linked to the earlier Standardized Computer Analyses for Licensing Evaluation (SCALE)/Sampler/New ESC-based Weighting Transport (NEWT) data generated for the lattice physics (lattice) stage Phase I of the CRP. The focus of this report is the Uncertainty/Sensitivity Assessment (U/SA) of the prismatic modular high-temperature gas cooled reactor (MHTGR)-350 design, and specifically for Exercises IV-1 and IV-2 of the benchmark: the Control Rod Withdrawal (CRW) and Pressurised Loss of Cooling (PLOFC) events. The statistical U/SA methodology is implemented and demonstrated using the RAVEN code, based on perturbed cross-section libraries obtained from the SCALE/Sampler sequence. Uncertainties in nuclear data (cross-sections and the average number of neutrons produced per fission, 235U[¯v ]) lead to standard deviations (uncertainties of one s) of approximately 0.5% in the core eigenvalues of the MHTGR-350 and core models. For the coupled neutronics/thermal fluid model, local power density uncertainties up to 3.6% were observed in the colder regions of the core, while the local maximum fuel temperature uncertainties reached 1.5% for the models that included thermal fluid uncertainties. The addition of thermal fluid uncertainties dominated the impacts of nuclear data uncertainties in all cases. The main contributors to uncertainties in the power density and fuel temperatures during the transients were uncertainties in the reactor operating conditions (total power, inlet mass flow rate and inlet gas temperature). Variations in the bypass flows did not have significant impact on any of the output variables. For the nuclear data uncertainties it was found that the 235U(¯v ) / 235U(¯v ) covariance produced the largest sensitivities in terms of its impact on the eigenvalue and peak reactor power. It was also observed that the impact of any nuclear data uncertainties on the maximum fuel temperature was much less significant that the impact on eigenvalue and power. Another important finding was that although the use of eight or more energy groups is recommended for best-estimate HTGR simulation, two-group models produced acceptable uncertainty and sensitivity results for most FOMs. Since the statistical U/SA methodology is computationally expensive, and most transient solver requirements will scale directly with the number of energy groups, two energy groups could be used by HTGR developers during the early stages of design when larger uncertainty margins can be tolerated.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

NASA NTRS2012

The Use of Satellite-Measured Aerosol Optical Depth to Constrain Biomass Burning Emissions Source Strength in a Global Model GOCART

Small particles in the atmosphere, called "atmospheric aerosol" have a direct effect on Earth climate through scattering and absorbing sunlight, and also an indirect effect by changing the properties of clouds, as they interact with solar radiation as well. Aerosol typically stays in the atmosphere for several days, and can be transported long distances, affecting air quality, visibility, and human health not only near the source, but also far downwind. Smoke from vegetation fires is one of the main sources of atmospheric aerosol; other sources include anthropogenic pollution, dust, and sea salt. Chemistry transport models (CTMs) are among the major tools for studying the atmospheric and climate effects of aerosol. Due to the considerable variation of aerosol concentrations and properties on many temporal and spatial scales, and the complexity of the processes involved, the uncertainties in aerosol effects on climate are large, as is featured in the latest report of Intergovernmental Panel on Climate Change (IPCC) in 2007. Reducing this uncertainty in the models is very important both for predicting future climate scenarios and for regional air quality forecasting and mitigation. During vegetation fires, also called biomass burning (BB) events, complex mixture of gases and particles is emitted. The amount of BB emissions is usually estimated taking into account the intensity and size of the fire and the properties of burning vegetation. These estimates are input into CTMs to simulate BB aerosol. Unfortunately, due to large variability of fire and vegetation properties, the quantity of BB emissions is very difficult to estimate and BB emission inventories provide numbers that can differ by up to the order of magnitude in some regions. Larger uncertainties in data input make uncertainties in model output larger as well. A powerful way to narrow the range of possible model estimates is to compare model output to observations. We use satellite observations of aerosol properties, specifically aerosol optical depth, which is directly proportional to the amount of aerosol in the atmosphere, and compare it to the model output. Assuming the model represents aerosol transport and particle properties correctly, the amount of BB emissions determines the simulated aerosol optical depth. In this study, we explore the regional performance of 13 commonly used emission estimates. These are each input to global Goddard Chemistry Aerosol Radiation and Transport (GOCART) model. We then evaluate how well each emission estimate reproduces the smoke aerosol optical depth measured by the MODIS instrument. We compared GOCART-simulate aerosol optical depth with that measured from the satellite for 124 fire cases around the world during 2006 and 2007. We summarize the regional performance of each emission inventory and discuss reasons for their differences by considering the assumptions made during their development. We also show that because stronger wind disperses smoke plumes more readily, in cases with stronger wind, a larger increase in emission amount is needed to increase aerosol optical depth. In quiet, low-wind-speed environments, BB emissions produce a more significant increase in aerosol optical depth, other things being equal. Using the region-specific, quantitative relationships derived in our paper, together with the wind speed obtained from another source for a given fire case, we can constrain the amount of emission required in the model to reproduce the observations. The results of this paper are useful to the developers of BB emission inventories, as they show the strengths and weaknesses of individual emission inventories in different regions of the globe, and also for modelers who use these inventories and wish to improve their model results.

Petrenko, Mariya↗

DOE OSTI2024

New RES and DIS Uncertainties for NOvA Cross-Section Model

NOvA is a long-baseline neutrino experiment at Fermilab that studies neutrino oscillations via electron neutrino appearance and muon neutrino disappearance. The oscillation measurements compare the Far Detector data to an oscillated prediction informed by the Near Detector (ND) data. This ND-informed prediction is produced from the neutrino generator GENIE, which provides NOvA with a set of interaction uncertainties. However, this coverage does not account for all interaction uncertainties relevant for NOvA, in particular for resonance production (RES) and deep inelastic scattering (DIS) processes, which comprise a substantial portion of NOvA's interactions. Here we introduce six new cross section uncertainties that affect RES and DIS interactions, which represent degrees of freedom not available in the previous NOvA model. After careful studying of their impact, we incorporate them to the NOvA cross-section model. We show the impact of these new uncertainties on various reconstructed quantities.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2020

Uncertainty quantification of an empirical shell-model interaction using principal component analysis

Recent investigations have emphasized the importance of uncertainty quantification (UQ) in nuclear theory. Here, we carry out UQ for configuration-interaction shell-model calculations in the 1$\textit{s}$–0$\textit{d}$ valence space, investigating the sensitivity of observables to perturbations in the 66 parameters (matrix elements) of a high-quality empirical interaction. The large parameter space makes computing the corresponding Hessian numerically costly, so we compare a cost-effective approximation, using the Feynman-Hellmann theorem, to the full Hessian and find it works well. Diagonalizing the Hessian yields the principal components of the interaction: linear combinations of parameters ordered by sensitivity. This approximately decoupled distribution of parameters facilitates theoretical uncertainty propagation onto structure observables: electromagnetic transitions, Gamow-Teller decays, and dark matter-nucleus scattering matrix elements.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2024

Sensitivity of fatigue reliability in wind turbines: effects of design turbulence and the Wöhler exponent

Fatigue assessment of wind turbines involves three main sources of uncertainty: material resistance, load, and the damage accumulation model. Many studies focus on increasing the accuracy of fatigue load assessment to improve the fatigue reliability. Probabilistic modeling of the wind's turbulence standard deviation is an example of an approach used for this purpose. Editions 3 and 4 of the IEC standard for the design of wind energy generation systems (IEC 61400-1) suggest different probability distributions as alternatives for the representative turbulence in the normal turbulence model (NTM) of edition 1. There are debates on whether the suggested distributions provide conservative reliability levels, as the established design safety factors are calibrated based on the representative turbulence approach. The current study addresses the debate by comparing annual reliability based on different scenarios of NTM using a probabilistic approach. More importantly, it elaborates on the relative importance of load assessment accuracy in defining the fatigue reliability. Using the DTU 10 MW reference wind turbine and the first-order reliability method (FORM), we study the changes in the annual reliability level and its sensitivity to the three main random inputs. We perform the study considering the blade root flapwise and the tower base fore–aft moments, assuming different fatigue exponents in each load channel. The results show that integration over distributions of turbulence in each mean wind speed results in less conservative annual reliability levels than representative turbulence. The difference in the reliability levels varies according to turbulence distribution and the fatigue exponent. In the case of the tower base, the difference in the annual reliability index after 20 years can be up to 50 %. However, the model and material uncertainty have much higher effects on the reliability levels compared to load uncertainty. Knowledge about such differences in the reliability levels due to the choice of turbulence distribution is especially important, as it impacts the extent of lifetime extension through reliability reassessments.

17 WIND ENERGY↗

NASA NTRS2012

Reply to ''Comments on 'Why Hasn't Earth Warmed as much as Expected?'''

In response to our article, Why Hasnt Earth Warmed as Much as Expected? (2010), Knutti and Plattner (2012) wrote a rebuttal. The term climate sensitivity is usually defined as the change in global mean surface temperature that is produced by a specified change in forcing, such as a change in solar heating or greenhouse gas concentrations. We had argued in the 2010 paper that although climate models can reproduce the global mean surface temperature history over the past century, the uncertainties in these models, due primarily to the uncertainty in climate forcing by airborne particles, mean that the models lack the confidence to actually constrain the climate sensitivity within useful limits for climate prediction. Knutti and Plattner are climate modelers, and they argued essentially that because the models could reproduce the surface temperature history, the issue we raised was moot. Our response amounts to straightening out this confusion; for the models to be constraining, they must be able to reproduce the surface temperature history with sufficient confidence, not just to match the measurements, but to exclude alternative histories. As before, we concluded that if we can actually make the aerosol measurements using currently available, state-of-the-art techniques, we can determine the aerosol climate forcing to the degree required to constrain that aspect of model climate sensitivity. A technical issue relating to the timescale over which a change in CO2 emissions would be equilibrated in the environmental energy balance was also discussed, again, a matter of differences in terminology.

Schwartz, Stephen E.↗

NASA NTRS2001

Wind Tunnel Testing of the NASA-DFRC Flutterometer using a Two DOF Wing Section

Flutter of an aeroelastic structure is potentially destructive aeroelastic instability. This phenomenon has motivated research within the aeroelastic community to develop methods that can accurately predict aeroelastic instabilities. The Flutterometer method used herein, and as developed by NASA DFRC, is based upon the mu method which has been coupled with wavelet filtering processes in estimating aeroelastic models from flight data. The approach leads to a methodology to predict the occurrence of flutter boundaries, and may prove to reliably predict flutter boundaries during flight tests. An analytical model is used as the first estimate of the aeroelastic structural dynamics, and uncertainty operators are introduced into the system to model variations between the theoretical system and the physical system. The modelling uncertainties are then updated from experimental data. Although the model used did not work well with this particular experiment, a sensitivity analysis was additionally performed and improvements suggested.

Strganac, Thomas W.↗

DOE OSTI2024

Uncertainty Propagation from Experiment Measurements to Modeling Approaches: A Case for SMR Steam Entrainment Testing

To license new and advanced reactor designs, regulators must be convinced that their unique safety cases—relative to existing large scale reactors—have been adequately addressed by the designed reactor protection systems. In water cooled small modular reactors (SMRs), droplet entrainment in steam flow has significant implications on the progression of accident scenarios due to its compact design features, which requires representative test data applicable to SMR designs. Computer code, modeling and simulation (M&S) tools and models require adequate verification, assessment, and qualification. This includes M&S results validation against scaled empirical data within allowable uncertainty bands to gain regulatory approvals during the various stages of reactor system design, demonstration, and commercialization. However, measurement uncertainty within the empirical datasets and test data applicability ranges requires careful consideration of M&S inputs (i.e., boundary conditions, and initial conditions), and verification and validation efforts. This study focuses on uncertainty quantification in designing scaled test facilities for SMR applications with appropriate measurements and a standard data-reduction method to estimate thermal hydraulics characteristics parameters that incorporate physics phenomena of interest. In addition, this study supports the evaluation model development and assessment process using M&S that interfaces with advanced computing tools and digital twin capabilities. This will allow synchronization between experiment and modeling approaches for droplet entrainment testing and analysis, improving diagnostics, prognostics, and decision-making to accelerate regulatory approval.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2023

Sequential Bayesian Methods for Analyzing Computer Models

Efficient analysis of computer models is essential for the validation and uncertainty quantification of those models. Surrogate models, and Gaussian processes in particular, are a common and powerful approach to analyzing computer models that treat computer models as a black-box function. Gaussian processes form a Bayesian model over a space of functions that gives a measure of uncertainty about the computer model output at unobserved locations and a framework for sequential sampling. This tutorial will show how to fit Gaussian processes on a series of test functions and apply sequential design techniques to estimate extrema, level sets, and reliabilities of those test functions.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1982

Analytical model accuracy requirements for structural dynamic systems

A test/analysis correlation criterion for the analytical model accuracy requirement has been developed. It is based on the principle of equal errors from the model inaccuracy and the uncertainties of dynamic environments. The forcing functions are idealized to establish the base for uncertainty definition and the maximum allowable errors from these uncertainties are obtained. Then the model accuracy requirement is established by comparing the responses due to the model errors to those due to the forcing function uncertainties.

Chen, J.-C.↗

DOE OSTI2023

Expanded verification and validation studies of hypersonic aerodynamics with multiple physics-fidelity models

Hypersonic aerothermodynamics is an important domain of modern multiphysics simulation. The Multi-Fidelity Toolkit is a simulation tool being developed at Sandia National Laboratories to predict aerodynamic properties for compressible flows from a range of physics fidelities and computational speeds. These models include the Reynolds-averaged Navier–Stokes (RANS) equations, the Euler equations with momentum-energy integral technique (MEIT), and modified Newtonian aerodynamics with flat-plate boundary layer (MNA+FPBL) equations, and they can be invoked independently or coupled with hierarchical Kriging to interpolate between high-fidelity simulations using lower-fidelity data. However, as with any new simulation capability, verification and validation are necessary to gather credibility evidence. This work describes formal code- and solution-verification activities, as well as model validation with uncertainty considerations. Code verification activities on the MNA+FPBL model build on previous work by focusing on the viscous portion of the model. Viscous quantities of interest are compared against those from an analytical solution for flat-plate, inclined-plate, and cone geometries. The code verification methodology for the MEIT model is also presented. Test setup and results of code verification tests on the laminar and turbulent models within MEIT are shown. Solution-verification activities include grid-refinement studies on simulations that model the HIFiRE-1 wind tunnel experiments. These experiments are used for validation of all model fidelities. A thorough validation comparison with prediction error and uncertainty is also presented. Three additional HIFiRE-1 experimental runs are simulated in this study, and the solution verification and validation work examines the effects of the associated parameter changes on model performance. Finally, a study is presented that compares the computational costs and fidelities from each of the different models.

42 ENGINEERING↗

NASA NTRS2001

A Probabilistic Approach to Model Update

Finite element models are often developed for load validation, structural certification, response predictions, and to study alternate design concepts. In rare occasions, models developed with a nominal set of parameters agree with experimental data without the need to update parameter values. Today, model updating is generally heuristic and often performed by a skilled analyst with in-depth understanding of the model assumptions. Parameter uncertainties play a key role in understanding the model update problem and therefore probabilistic analysis tools, developed for reliability and risk analysis, may be used to incorporate uncertainty in the analysis. In this work, probability analysis (PA) tools are used to aid the parameter update task using experimental data and some basic knowledge of potential error sources. Discussed here is the first application of PA tools to update parameters of a finite element model for a composite wing structure. Static deflection data at six locations are used to update five parameters. It is shown that while prediction of individual response values may not be matched identically, the system response is significantly improved with moderate changes in parameter values.

Horta, Lucas G.↗

DOE OSTI2023

Revisiting Interior Water Mass Responses to Surface Forcing Changes and the Subsequent Effects on Overturning in the Southern Ocean

Abstract Two coupled climate models, differing primarily in horizontal resolution and treatment of mesoscale eddies, were used to assess the impact of perturbations in wind stress and Antarctic ice sheet (AIS) melting on the Southern Ocean meridional overturning circulation (SO MOC), which plays an important role in global climate regulation. The largest impact is found in the SO MOC lower limb, associated with the formation of Antarctic Bottom Water (AABW), which in both models is enhanced by wind and weakened by AIS meltwater perturbations. Even though both models under the AIS melting perturbation show similar AABW transport reductions of 4–5 Sv (50%–60%), the volume deflation of AABW south of 30°S is four times greater in the higher resolution simulation (−20 vs. −5 Sv). Water mass transformation (WMT) analysis reveals that surface‐forced dense water formation on the Antarctic shelf is absent in the higher resolution and reduced by half in the lower resolution model in response to the increased AIS melting. However, the decline of the AABW volume (and its inter‐model difference) far exceeds the surface‐forced WMT changes alone, which indicates that the divergent model responses arise from interactions between changes in surface forcing and interior mixing processes. This model divergence demonstrates an important source of uncertainty in climate modeling, and indicates that accurate shelf processes together with scenarios accounting for AIS melting are necessary for robust projections of the deep ocean's response to anthropogenic forcing.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Machine Learning for Improved Availability of the SNS Klystron High Voltage Converter Modulators

Beam availability has increased at the SNS, however, the targeted availability is greater than 95 %, while the SNS has failed to meet lower targets in the past. The HVCM used to power the linac klystrons have been one source of lost beam time and was chosen to explore using AI/ML techniques to improve reliability. Among the possibilities being explored are automating the tuning of HVCMs and predicting component failures such as capacitor aging, rectifier assemblies containing hundreds of diodes, and insulating oil degradation. The methodology pursued includes data cleaning, de-noising, post-analysis data labeling, and machine learning model development. We explore using Long Short-Term Memory and autoencoders for anomaly detection and prognostication used to schedule maintenance. We evaluate the use of model regularizers and constraints to improve the performance of the model and investigate methods to estimate the uncertainty of the models to provide a robust prediction with statistical interoperability. This paper describes the operational experience and known failures of the HVCMs and the proposed ML methodology and the preliminary results of training the AI/ML algorithms.

Pappas, G. C.↗

NASA NTRS1985

Progress in stratospheric hydroxyl measurement by balloon-borne lidar

Knowledge of the concentration of hydroxyl radical is crucial to understanding the chemistry of the stratosphere. Hydroxyl participates in several catalytic cycles which destroy ozone and strongly influences the cycles of chlorine and nitrogen oxides by its reactions which form or destroy reservoirs for chlorine and odd-nitrogen compounds. Measurements have been conducted of the concentration of hydroxyl radical between the altitudes of 32.5 and 38.5 km using the technique of laser-induced fluorescence. The results ranging from 4 to 9 x 10 to the 6th per cu cm (with an accuracy of + or - 50 percent) are about 2-3 times lower than predicted by current one-dimensional models, although the uncertainties in the determination and in the models are sufficiently large to explain the differences. A number of potential improvements to the instrument are discussed.

Heaps, W. S.↗

NASA NTRS1994

Parametric robust control and system identification: Unified approach

Despite significant advancement in the area of robust parametric control, the problem of synthesizing such a controller is still a wide open problem. Thus, we attempt to give a solution to this important problem. Our approach captures the parametric uncertainty as an H(sub infinity) unstructured uncertainty so that H(sub infinity) synthesis techniques are applicable. Although the techniques cannot cope with the exact parametric uncertainty, they give a reasonable guideline to model the unstructured uncertainty that contains the parametric uncertainty. An additional loop shaping technique is also introduced to relax its conservatism.

Keel, Leehyun↗

DOE OSTI2021

Machine Learning for Improved Availability of the SNS Klystron High Voltage Converter Modulators

Pappas, Chris↗