Assessing the Intrinsic Uncertainty and Structural Stability of Planetary Models: 1. Parameterized Thermal‐Tectonic History Models
Explore the source record for details and available documents.
Johnny Seales↗
SEARCH · Engineering Papers
Results for “Model uncertainty”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
rigorous model validation and engineering design under uncertainty
Explore the source record for details and available documents.
McKerns, Michael↗
Uncertainty Quantification Analysis in Planar MITL Modeling.
Abstract not provided.
Hamlin, Nathaniel Donald↗
Uncertainty Quantification in Large Scale Computational Models.
Abstract not provided.
Najm, Habib N.↗
mystic: tools for AI, UQ, ML, model validation, and robust design under uncertainty
Explore the source record for details and available documents.
McKerns, Michael↗
A Preliminary Radiological Risk Assessment Model for Disposition of Remote-Handled Transuranic Wastes at Los Alamos National Laboratory Area G - 20116
The U.S. Department of Energy (DOE) operates a low-level radioactive waste (LLW) disposal site at Material Disposal Area G, in Los Alamos, New Mexico, USA. Area G has been the primary LLW disposal site for Los Alamos National Laboratory (LANL) since the 1960's. In addition to LLW, Area G is host to a variety of other wastes, the disposition of which must be determined before closure of the site. A probabilistic Radiological Risk Assessment (RRA) for Area G is used in order to support decision making regarding some wastes that are not addressed in the extant Area G Performance Assessment (PA) and Composite Analysis (CA). Between 1979 and 1987, 33 special shafts were augered into the Bandelier Tuff at Area G. This volcanic tuff is present across Pajarito Plateau on the eastern slopes of the Jemez Mountains, and varies widely in its consistency, from weakly indurated non-welded layers to welded layers that uphold the mesa cliffs of the Plateau. These mesas are home to LANL, Area G, and the townsites of Los Alamos and White Rock, with residences about 1400 m from Area G. The 33 Shafts were lined with steel casing, and contain remote-handled (RH) transuranic wastes (TRU) resulting from experiments and analysis performed in special glove boxes at the Chemistry and Metallurgy Research (CMR) facility at LANL. Some of these wastes originated as used nuclear fuel. The purpose of the Area G RRA is to evaluate the potential future risk to humans and the environment from the RH TRU in the 33 Shafts in the context of the risk associated with the surrounding wastes at Area G. The analysis is responsive to expectations outlined in DOE Order 458.1, Radiation Protection of the Public and the Environment, and is informed by the Manual and Guidance accompanying DOE O 435.1, Radioactive Waste Management. Because the waste meets the definition of TRU, the regulatory context necessarily takes into consideration the regulation governing the disposal of TRU from the U.S. Environmental Protection Agency (EPA): 40 CFR 191, Environmental Radiation Protection Standards for Management and Disposal of Spent Nuclear Fuel, High-Level and Transuranic Radioactive Wastes. Given the broader regulatory context for the RRA, the analysis is subject to different assumptions from those made in the existing DOE O 435.1 PA and CA, such as allowing for future occupation of the site. The analysis begins with a comprehensive evaluation of features, events, processes, and exposure scenarios (FEPS) for Area G and the wastes it contains. These FEPSs are screened to eliminate from further consideration those of extremely low probability and/or consequence, and a conceptual site model (CSM) is subsequently developed. The scope and structure of the Area G RRA Model is informed by this CSM, and the Area G RRA Model is developed using the GoldSim systems analysis modeling platform. This paper presents the initial version of a defensible, transparent, and reasonably realistic model, which is based on the state of knowledge of the wastes, the site, and the FEPSs that govern contaminant transport from wastes into the environment and subsequent exposures to humans and other biota. Probabilistic model input distributions represent uncertainties inherent in the real and modeled systems. The results of the Area G RRA Model inform decisions regarding the disposition of the RH TRU in the 33 Shafts. (authors)
12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
Uncertainty quantification in scientific machine learning: Methods, metrics, and comparisons
Neural networks (NNs) are currently changing the computational paradigm on how to combine data with mathematical laws in physics and engineering in a profound way, tackling challenging inverse and ill-posed problems not solvable with traditional methods. However, quantifying errors and uncertainties in NN-based inference is more complicated than in traditional methods. This is because in addition to aleatoric uncertainty associated with noisy data, there is also uncertainty due to limited data, but also due to NN hyperparameters, overparametrization, optimization and sampling errors as well as model misspecification. Although there are some recent works on uncertainty quantification (UQ) in NNs, there is no systematic investigation of suitable methods towards quantifying the total uncertainty effectively and efficiently even for function approximation, and there is even less work on solving partial differential equations and learning operator mappings between infinite-dimensional function spaces using NNs. In this work, we present a comprehensive framework that includes uncertainty modeling, new and existing solution methods, as well as evaluation metrics and post-hoc improvement approaches. Further, to demonstrate the applicability and reliability of our framework, we present an extensive comparative study in which various methods are tested on prototype problems, including problems with mixed input-output data, and stochastic problems in high dimensions. In the Appendix, we include a comprehensive description of all the UQ methods employed. Further, to help facilitate the deployment of UQ in Scientific Machine Learning research and practice, we present and develop in [1] an open-source Python library (github.com/Crunch-UQ4MI/neuraluq), termed NeuralUQ, that is accompanied by an educational tutorial and additional computational experiments.
11 physics-informed neural networks↗
Uncertainty Quantification of Global Net Methane Emissions From Terrestrial Ecosystems Using a Mechanistically Based Biogeochemistry Model
Quantification of methane (CH4) emissions from wetlands and its sinks from uplands is still fraught with large uncertainties. Here, a methane biogeochemistry model was revised, parameterized, and verified for various wetland ecosystems across the globe. The model was then extrapolated to the global scale to quantify the uncertainty induced from four different types of uncertainty sources including parameterization, wetland type distribution, wetland area distribution, and meteorological input. We found that global wetland emissions are 212 ± 62 and 212 ± 32 Tg CH4 year−1 (1Tg = 1012 g) due to uncertain parameters and wetland type distribution, respectively, during 2000–2012. Using two wetland distribution data sets and three sets of climate data, the model simulations indicated that the global wetland emissions range from 186 to 212 CH4 year−1 for the same period. The parameters were the most significant uncertainty source. After combining the global methane consumption in the range of −34 to −46 Tg CH4 year−1, we estimated that the global net land methane emissions are 149–176 Tg CH4 year−1 due to uncertain wetland distribution and meteorological input. Spatially, the northeast United States and Amazon were two hotspots of methane emission, while consumption hotspots were in the Eastern United States and eastern China. During 1950–2016, both wetland emissions and upland consumption increased during El Niño events and decreased during La Niña events. This study highlights the need for more in situ methane flux data, more accurate wetland type, and area distribution information to better constrain the model uncertainty.
wetland methane emission↗
A Reference Ocean Surface Emission and Backscatter Model from Microwaves to Infrared
Satellite observations are vital for the initialization of Numerical Weather Prediction models, and very important for climate monitoring and prediction, as well as other applications such as hydrology and flood awareness prediction. Knowledge of radiative contributions from the Earth's surface is needed to sound the lower troposphere from space. The lack of a reference quality ocean emission and backscatter model is a major gap in our ability to provide absolute calibration of the satellite based observing system. Uncertainty in emissivity models is not well characterized and different models are used for different spectral bands, for active and passive instruments. An International Space Science Institute (ISSI) team was put together [4] to address these issues. The objectives of the team are to provide a reference model as a community software (i.e., documented and freely available code), that is maintained and supported, has traceable uncertainty estimations, and that enables new science from microwaves to infrared with bidirectional reflectance distribution function (BRDF) capability. We will present the model and its various components, discussing the choices between various parameterizations, building on the LOCEAN model of [2]. The model predictions will be evaluated at various frequencies, including comparisons to radiometric observations by SMAP, AMSR2 and GMI (e.g., [5]). We will discuss early model evaluation in the infrared and for active microwave sensors. Areas of ongoing research include improving the foam parametrization (coverage and emissivity) to provide consistent performances across frequencies, building on [1], and the azimuthal dependence of the active and passive signals. The model will be used to generate training data for fast models e.g., Fastem, [3], that are used in operational data assimilation and climate re-analysis.
Emmanuel Dinnat↗
Investigation of Ethane Dehydrogenation and Hydrogenolysis on Pt(111), Pt(211), and Pt(100): Bayesian Quantification and Correction of DFT-Based Enthalpic and Entropic Uncertainties
Computational investigations of heterogeneously catalyzed reactions using density functional theory (DFT) are often inaccurate, largely due to uncertainties in the choice of DFT functional (enthalpic uncertainty) and approximations for modeling adsorbate movement along the catalyst surface (entropic uncertainty). This work illustrates that both uncertainties are significant in the investigation of ethane dehydrogenation (EDH) and hydrogenolysis on Pt catalysts by considering the complete deconstruction of ethane on Pt(111), Pt(211), and Pt(100) using microkinetic modeling (MKM). Hence, this work uses both noncalibrated and Bayesian-calibrated MKMs to quantify and correct inaccuracies in macroscopic properties due to both uncertainties. A Bayesian approach to the correction of entropic errors was introduced using a “Modified Fermi Function (MFF)” to calibrate between the two bounds of entropy represented by the harmonic oscillator (HO) and free translator (FT) approximations. Regardless of enthalpic and entropic uncertainties, all three surfaces are capable of ethane activation; however, Pt(211) was found to be the most active and is largely responsible for methane production. Next, Pt(111) is largely responsible for acetylene production, and Pt(100) has the highest ethylene selectivity but is most susceptible to coking. By comparison of different calibrated models, the FT entropy approximation was found to better describe EDH under typical experimental conditions. Statistical evidence was found to support Pt(111) as the active site for EDH, assuming that one single site is responsible for the chemistry. On the three surfaces, competing second dehydrogenations to CH 2 CH 2 and CH 3 CH were observed as well as isomerization of CH 3 CH back to CH 2 CH 2 and deeper dehydrogenation of CH 3 CH. In conclusion, C–C cleavage was found to largely proceed via the CH 3 C intermediate on Pt(100) and Pt(111), while on Pt(211), it was via both CHC and CH 3 C.
Bayesian model selection↗
What Questions Would a Systems Engineer Ask to Assess Systems Engineering Models as Credible
Digital Systems Engineering strategies typically call for digital Systems Engineering models to be retained in repositories and certified as an authoritative source of truth (enabling model reuse, qualification, and collaboration). In order for digital Systems Engineering models to be certified as authoritative (credible), they need to be assessed - verified and validated - and with the amount of uncertainty in the model quantified (consider reusing someone else's model without knowing the author). Due to this increasing model complexity, the authors assert that traditional human-based methods for validating, verifying, and uncertainty quantification - such as human-based peer-review sessions - cannot sufficiently establish that a digital Systems Engineering model of a complex system is credible. Digital Systems Engineering models of complex systems can contain millions of nodes and edges. The authors assert that this level of detail is beyond the ability of any group of humans - even working for weeks at a time - to discern and catch every minor model infraction. In contrast, computers are highly effective at discerning infractions with massive amounts of information. The authors suggest that a better approach might be to focus the humans at what model patterns should be assessed and enable the computer to assess the massive details in accordance with those patterns - by running through perhaps 100,000 test loops. In anticipation of future projects to implement and automate the assessment of models at Sandia National Laboratories, a study was initiated to elicit input from a group of 25 Systems Engineering experts. The authors positioning query began with - 'What questions would a Systems Engineer ask to assess Systems Engineering models for credibility?" This report documents the results of that survey.
42 ENGINEERING↗
Satellite and Ground-based Radiometers Reveal Much Lower Dust Absorption of Sunlight than Used in Climate Models
The ability of dust to absorb solar radiation and heat the atmosphere is one of the main uncertainties in climate modeling and the prediction of climate change. Dust absorption is not well known due to limitations of in situ measurements. New techniques to measure dust absorption are needed in order to assess the impact of dust on climate. Here we report two new independent remote sensing techniques that provide sensitive measurements of dust absorption. Both are based on remote sensing. One uses satellite spectral measurements, the second uses ground based sky measurements from the AERONET network. Both techniques demonstrate that Saharan dust absorption of solar radiation is several times smaller than the current international standards. Dust cooling of the earth system in the solar spectrum is therefore significantly stronger than recent calculations indicate. We shall also address the issue of the effects of dust non-sphericity on the aerosol optical properties.
Kaufman, Y. J.↗
Benchmarking the performance of uncertainty quantification methods for neural network-based interatomic potentials
Machine-learned interatomic potentials (ML-IAPs) continue to gain popularity as accurate, computationally efficient replacements for traditional, physics-based interatomic potentials and expensive ab initio methods. Uncertainty quantification (UQ) of ML-IAPs is a growing area of research as UQ is critical in many applications of IAPs, such as developing curated datasets, active learning-based data augmentation, self-improving models, and estimating the uncertainty of molecular dynamics simulations. In this paper, we construct and benchmark a series of different neural network potentials (NNPs) with varying network architectures to determine the performance of these models with respect to both the mean and uncertainty calibration error. Each NNP method is specifically designed to predict either epistemic or aleatoric uncertainty with particular focus on the differences in behavior between the epistemic and aleatoric uncertainty estimates. We benchmark these methods using multiple datasets common in the ML-IAP literature. The results show that the aleatoric uncertainty from single-shot model architectures is a competitive alternative to ensemble-based epistemic uncertainty predictions in regions of sufficient data-density. However, in regions where the representative data is sparse, aleatoric uncertainty models tend to overpredict and epistemic methods tend to underpredict the actual model error. We conclude that the type of UQ is crucial when discussing performance of probabilistic model results as different methods have different performance characteristics depending on the regime in which they are evaluated. Therefore, the type of UQ method should be carefully evaluated against both the data characteristics and requirements for the intended application.
97 MATHEMATICS AND COMPUTING↗
Dark Energy Survey Year 3 results: Cosmology from combined galaxy clustering and lensing validation on cosmological simulations
In this work, we present a validation of the Dark Energy Survey Year 3 (DES Y3) 3×2-point analysis choices by testing them on Buzzard2.0, a new suite of cosmological simulations that is tailored for the testing and validation of combined galaxy clustering and weak-lensing analyses. We show that the buzzard2.0 simulations accurately reproduce many important aspects of the DES Y3 data, including photometric redshift and magnitude distributions, and the relevant set of two-point clustering and weak-lensing statistics. We then show that our model for the 3×2-point data vector is accurate enough to recover the true cosmology in simulated surveys assuming the true redshift distributions for our source and lens samples, demonstrating robustness to uncertainties in the modeling of the nonlinear matter power spectrum, nonlinear galaxy bias, and higher-order lensing corrections. Additionally, we demonstrate for the first time that our photometric redshift calibration methodology, including information from photometry, spectroscopy, clustering cross-correlations, and galaxy–galaxy lensing ratios, is accurate enough to recover the true cosmology in simulated surveys in the presence of realistic photometric redshift uncertainties.
79 ASTRONOMY AND ASTROPHYSICS↗
Assimilation of Satellite Data in Regional Air Quality Models
In terms of important uncertainty in regional-scale air-pollution models, probably no other aspect ranks any higher than the current ability to specify clouds and soil moisture on the regional scale. Because clouds in models are highly parameterized, the ability of models to predict the correct spatial and radiative characteristics is highly suspect and subject to large error. The poor representation of cloud fields from point measurements at National Weather Services stations and the almost total absence of surface moisture availability observations has made assimilation of these variables difficult to impossible. Yet, the correct inclusion of clouds and surface moisture are of first-order importance in regional-scale photochemistry.
SPATIAL DISTRIBUTION↗
Elimination LArTPC Simulation Uncertainty
Liquid Argon Time Projection Chambers (LArTPC) are crucial for measuring muons and neutrinos by capturing the paths of fast-moving particles through argon gas. However, these detectors face challenges such as electron-ion recombination, diffusion, and attenuation, which introduce uncertainties in simulation models. This study, conducted by Ka ren Mkrtchyan at FERMILAB, aims to reduce these uncertainties by adjusting the amplitude and width of signals detected by the TPC wires. Initial findings indicate that the current modification algorithm requires further refinement to better align simulations with observed data. Ongoing work focuses on correcting computational bugs and enhancing the simulation model for improved accuracy and statistical confidence.
Mkrtchyan, Ka'ren↗
A comparison of two accretional heating models
Models of accretional heating that include large-body impact effects are reviewed. Various details of the models are compared, as well as the results of their calculations. Within the uncertainties in the models, the results compare reasonably with each other, and a post-accretion moon with some melting in its outer layers, but not much towards the center, seems to be described by these analyses.
Ransford, G. A.↗
Automatic Flight Controller With Model Inversion
Automatic digital electronic control system based on inverse-model-follower concept being developed for proposed vertical-attitude-takeoff-and-landing airplane. Inverse-model-follower control places inverse mathematical model of dynamics of controlled plant in series with control actuators of controlled plant so response of combination of model and plant to command is unity. System includes feedback to compensate for uncertainties in mathematical model and disturbances imposed from without.
Meyer, George↗