Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Probabilistic models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Modeling Noise: Paths toward AI-Enabled Stochastic Earth System Models and Parameterizations

Some of the key challenges in Earth system prediction arise from an uncertain representation of unpredictable natural variability, across time and space scales. This variability, hereafter referred to as noise, represents the quantity against which the strength of a signal of interest is measured to assess predictability. Underestimating or overestimating this noise in Earth system models can lead to issues ranging between overconfidence in an erroneous prediction and a lack thereof in an otherwise accurate one. Noise is part of the physical processes in the Earth system and can amplify or damp a signal of interest in a complex manner that is not systematically characterized. Specifically, while there has been significant progress in our understanding of multiscale interactions among known modes of variability (potentially predictable signals), how these are impacted by the noise is not clear. Recent effort toward stochastic parametrization schemes that provide a representation of noise due to uncertain sub-grid processes in climate models (Berner et al., 2017 and references therein) has shown promise not only in reducing biases and improving probabilistic prediction but also in improving the representation of natural variability in the model toward what is observed. However, today’s standard schemes for stochastic parametrization are still simplistic as they do not take the state of the atmosphere into account (other than by the use of multiplicative noise for model tendencies). Furthermore they require hand-tuning and trial-and-error testing for the magnitude of the added noise, which is difficult in a chaotic system that is as complex as the Earth system.

58 GEOSCIENCES↗
DOE OSTI2021

A Generalized Copula-Polynomial Chaos Expansion for Probabilistic Power Flow Considering Nonlinear Correlations of PV Injections

This paper develops a generalized Copula-polynomial chaos expansion (PCE) framework for power system probabilistic power flow that can handle both linear and nonlinear correlations of uncertain power injections, such as wind and PVs. A data-driven Copula statistical model is used to capture the correlations of uncertain power injections. This allows us to resort to the Rosenblatt transformation to transform correlated variables into independent ones while preserving the dependence structure. This paves the way of leveraging the PCE for surrogate modeling and uncertainty quantification of power flow results, i.e., achieving the probabilistic distributions of power flows. Simulations carried out on the IEEE 57-bus system show that the proposed framework can get much more accurate results than other alternatives with different linear and nonlinear power injection correlations.

copula↗
DOE OSTI2021

Forecasting Marine Sediment Properties with Geospatial Machine Learning

Using a combination of geospatial machine learning prediction and sediment thermodynamic/physical modeling, we have developed a novel software workflow to create probabilistic maps of geoacoustic and geomechanical sediment properties of the global seabed. This new technique for producing reliable estimates of seafloor properties can better support Naval operations relying on sonar performance and seabed strength, can constrain models of shallow tomographic structure important for nuclear treaty compliance monitoring/detection, and can provide constraints on the distribution and inventory of shallow methane gas and gas hydrate accumulations on the continental shelves.

58 GEOSCIENCES↗
DOE OSTI2025

Applying Gaussian Process Machine Learning and Modern Probabilistic Programming to Satellite Data to Infer CO 2 Emissions

Satellite data provides essential insights into the spatiotemporal distribution of CO 2 concentrations. However, many atmospheric inverse models fail to adequately incorporate the spatial and temporal correlations inherent in satellite observations and often lack rigorous methods for estimating parameters like spatial length scales. We introduce an inference model that processes the spatiotemporal covariance in satellite data and estimates hyperparameters such as covariance length scales. Our approach uses the Gaussian process (GP) machine learning (ML) and modern probabilistic programming languages (PPLs) to perform atmospheric inversions of emissions from satellite data. We develop a GP ML inversion system based on modern PPLs and the GEOS-Chem chemical transport model, simulating atmospheric CO 2 concentrations corresponding to the Orbiting Carbon Observatory-2/3 (OCO-2/3) data for July 2020. In our supervised learning framework, we treat the GEOS-Chem simulated data set as the target, with predictors derived by scaling the target with sector-specific factors hidden from the GP machine. Our results show that the GP model, combined with GPU-enabled PPLs, effectively retrieves true emission scaling factors and infers noise levels concealed within the data. This suggests that our method could be applied over larger areas with more complex covariance structures, enabling comprehensive analysis of the spatiotemporal patterns observed in OCO-2/3 and similar satellite data sets.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Practical Probabilistic Programming

Recent advances in probabilistic programming languages (PPLs) have provided the capability for exact inference: computing a closed-form probability distribution for a given probabilistic program. In particular, the new language Roulette uses a language oriented programming (LOP) approach, wherein analysts build new programming languages on top of a set of primitives provided by Roulette, which then translates these structures into a weighted model counting problem which can be solved by automated reasoning tools. However, because Roulette provides few convenience features, developing these new languages is challenging even for expert users. We developed a standard library of common probability functions for Roulette with the goal of improved usability. This included approximation of continuous probability density functions using discrete probability mass functions. We demonstrated this approach by modeling a cosmic ray striking a RAM controller. We found that Roulette provides a powerful interface for highly expressive probabilistic programs to be generated. In collaboration with the NNSA Advanced Simulation and Computing program, which resulted in development of a tool called Circulette, we were able to model complex circuits expressed in Verilog using probabilistic programs with an expressivity not previously possible. Our research question that motivated the development of a Roulette standard library was to determine whether non-experts could use a PPL to model relevant problems regarding radiation effects on microelectronics. This standard library improved the expressivity of Roulette by implementing common probability density functions, mathematical operators on distributions, and support for empirical distributions. While Roulette is a powerful modeling language, the untyped, LOP approach makes error messages difficult to understand and requires expert aid. We recommend further research on Roulette, especially with its error messages, to enable improved usability. At the same time, this project demonstrated that for users familiar with Roulette and the LOP approach, Roulette provides powerful new capabilities that can be integrated with other Sandia modeling capabilities.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

HAIMOS Ensemble Forecasts for Intra-day and Day- Ahead GHI, DNI and Ramps

The objective of this research is to develop a hybrid physics-based/data-driven forecast model to improve direct normal and global horizontal irradiance (DNI and GHI) prediction for horizons ranging from 1 to 72 hours. Project objectives also address key gaps in state-of-the-art solar forecasting: accurate probabilistic solar forecasts and the forecasting of large irradiance ramps (ramp onset and magnitude). The proposed model ensembles Numerical Weather Prediction (NWP) forecasts, determinist physics-based algorithms, and new-generation cloud cover products (high-resolution rapid refresh satellite images and Large Eddy Simulations). The result is the Hybrid Adaptive Input Model Objective Selection (HAIMOS) ensemble model. HAIMOS blends state of the art machine learning methodologies with physics-based models for cloud cover and cloud optical depth forecasts. The technical activities followed a two-pronged strategy. First, the preprocessing of data, the selection of inputs to the nonlinear approximators, the type of approximator and objective functions, and post-processing ensembling techniques included in HAIMOS were all optimized adaptively to find the best model for a specific goal (reduce DNI/GHI forecast error, improve the prediction of ramp onset, etc.). Second, a large effort was put in improving cloud identification and the forecast of cloud cover and cloud optical depth. To this end, new-generation cloud parametrization products were developed in this work. These include improved algorithms to assist in cloud identification, cloud classification and cloud parametrization from satellite images – three key factors in the accuracy of 1 to 6-hours irradiance forecasts and prediction of ramp onset. Furthermore, we also included cloud information extracted from high resolution rapid refresh satellite images (GOES-16) and Large Eddy Simulations (LES). LES was used to model the atmosphere in detail over locations of interest and produce cloud optical depth forecasts. Once these data streams were validated, they were used as input data to the HAIMOS forecast. The model was developed using data from several climatologically distinct locations with potential for high solar penetration. In the last year of the project, we conducted a validation campaign according to the guidelines stipulated by the Topic Area 1 project as described in the FOA. This effort brings, for the first time, proven machine-learning methodologies for generating state-of-the-art solar forecasts interweaved with detailed physics-based models for cloud detection, and cloud optical depth forecasts. HAIMOS will generate accurate irradiance probabilistic forecast to assist in reducing solar generation prediction error. Globally optimized solar forecast models are more likely to impact solar energy stakeholders. The goal of this project was to increase the state-of-the-art forecast skill from their present values of 10 to 35%. At the end of the project, we achieved between 30% and 50% forecast skill across a wide range of horizons for both GHI and DNI.

14 SOLAR ENERGY↗
DOE OSTI2021

Noise Robustness and Experimental Demonstration of a Quantum Generative Adversarial Network for Continuous Distributions

Abstract The potential advantage of machine learning in quantum computers is a topic of intense discussion in the literature. Theoretical, numerical, and experimental explorations will most likely be required to understand its power. There have been different algorithms proposed to exploit the probabilistic nature of variational quantum circuits for generative modeling. In this paper, a hybrid architecture for quantum generative adversarial networks (QGANs) is employed and their robustness in the presence of noise is studied. A simple way of adding different types of noise to the quantum generator circuit is devised, and the noisy hybrid QGANs (HQGANs) are simulated numerically to learn continuous probability distributions, and to show that the performance of HQGANs remains unaffected. The effect of different parameters on the training time is also investigated to reduce the computational scaling of the algorithm and simplify its deployment on a quantum computer. The training on Rigetti's Aspen‐4‐2Q‐A quantum processing unit is then performed, and the results from the training are presented. The authors' results pave the way for experimental exploration of different quantum machine learning algorithms on noisy intermediate‐scale quantum devices.

Anand, Abhinav↗
DOE OSTI2025

Ensemble‐Based, Large‐Eddy Reconstruction of Wind Turbine Inflow in a Near‐Stationary Atmospheric Boundary Layer Through Generative Artificial Intelligence

ABSTRACT To validate the second‐by‐second dynamics of turbines in field experiments, it is necessary to accurately reconstruct the winds going into the turbine. Current time‐resolved inflow reconstruction techniques estimate wind behavior in unobserved regions using relatively simple spectral‐based models of the atmosphere. Here, we develop a technique for time‐resolved inflow reconstruction that is rooted in a large‐eddy simulation model of the atmosphere. Our “large‐eddy reconstruction” technique blends observations and atmospheric model information through a diffusion model machine learning algorithm, allowing us to generate probabilistic ensembles of reconstructions for a single 10‐min observational period. Our generated inflows can be used directly by aeroelastic codes or as inflow boundary conditions in a large‐eddy simulation. We verify the second‐by‐second reconstruction capability of our technique in three synthetic field campaigns, finding positive Pearson correlation coefficient values () between ground‐truth and reconstructed streamwise velocity, as well as smaller positive correlation coefficient values for unobserved fields (spanwise velocity, vertical velocity, and temperature). We validate our technique in three real‐world case studies by driving large‐eddy simulations with reconstructed inflows and comparing to independent inflow measurements. The reconstructions are visually similar to measurements, follow desired power spectra properties, and track second‐by‐second behavior ().

17 WIND ENERGY↗
DOE OSTI2023

Probabilistic feasibility assessment of sequestration reliance for climate targets

Countries worldwide are transforming their energy systems to achieve Carbon-Neutrality. Investing in renewable resources-based technologies and implementing Carbon Capture and Storage (CCS) are common strategies to achieve higher sequestration levels. Negative emissions through Bioenergy with CCS are expected to play an essential role in the transition to full decarbonization. On top of that, biomass is a limited resource that depends on environmental factors, which create uncertainties related to the amount that can be sustainably provided to the energy system. Here this study emphasizes the relevance of variability in carbon sequestration for achieving climate targets by 2050. Here this paper proposes a probabilistic approach that integrates the Global Change Analysis Model for Latin America (GCAM-LA) with a chance constraint approach. GCAM-LA is used to assess the impact on the energy sector of different limits of sustainable biomass and carbon budget scenarios. The risk associated with exceeding the sequestration capacity of a given region is modeled via Chance Constraint. Results show that electrification is an appropriate long-term decarbonization strategy. It smoothes the effects of uncertainty in sequestration capacity and responds to end-user demands. For this case study, higher levels of electrification are obtained at likelihood levels >66% for end-use sectors.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

RePOWERD: Restoration of Power Outage from Wide-area Severe Weather Disruptions

The purpose of the RePOWERD project is to develop a probabilistic and a simulation based power restoration forecasting model for tropical storms based on geographic utility service areas, impacts to energy infrastructures and transportation networks, time-varying customer outage number, crew information (i.e., crew size, crew staging requirements), and utility restoration plans. Energy infrastructure is a critical lifeline essential for the United States’ national and economic security. Like other critical infrastructures, this infrastructure is aging and is at a high risk of damages from extreme weather events. Based on the number of reported outages in EAGLE-I during 2020 and 2021, it is evident that the current energy infrastructure is not equipped to handle extreme event impacts and will contribute to significant outages. From a resilience perspective, it is essential to forecast restoration time in the event of a severe weather induced power outage to assist the US Department of Energy, emergency managers, and first responders with resource planning. This project contributes to this crucial need. This report details the models, that were developed in this pilot study, to determine the rate of restoration and estimated time of restoration (ETR) during tropical storm events within counties and utility service areas based on damage to energy infrastructures and total number of customers experiencing outages.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Hazards and Probabilistic Risk Assessments of a Light-Water Reactor Coupled with Industrial Facilities

This report provides a roadmap and toolkit for site-specific risk assessments across a broad range of industrial customers co-located with nuclear power plants (NPPs). This report builds upon the body of work sponsored by the Department of Energy (DOE) Light-Water Reactor Sustainability (LWRS) Flexible Plant Operation and Generation Pathway that presented hazards assessment and generic probabilistic risk assessments (PRAs) for the addition of a heat extraction system (HES) to light-water reactors co-located with hydrogen production facilities. The report expands the hazards assessments to include other industrial facilities: an oil refinery, a methanol plant, a synthetic fuel (synfuel) plant, the production of synthetic gas (syngas) as part of the methanol and synfuel plants, and wood pulp and paper mills. All these facilities are specified through industrial process and requirements research performed by national laboratories, universities, and interaction with industry. Many of the processes used in this report are pre-conceptual designs to use for decarbonization of the current technology facilities. A process of failure modes and effects analysis (what can go wrong) and accidentology (what has historically gone wrong) was used to determine the hazards presented to the NPP by the addition of the HES and the industrial customer. Chemical properties of feedstocks and products are summarized as part of the hazards assessment. Example analysis procedures are provided for each of the hazard types identified. These deterministic analyses can be used to assess adherence to licensing criteria. They can also be used to meet other safety goals like protection of the public, workers, or industrial facility equipment. The probabilistic analysis consisted of three sizes of HESs modeled in a PRA to assess the impact on the initiating events (IE) and results of the PRA. The PRA results conclude that the resulting increases in IE frequencies are below the limits required for small changes to existing NPPs under 10 CFR 50.59.

08 HYDROGEN↗
DOE OSTI2023

Causal CCF Parameter Estimations 2020

This report documents the quantitative results of the causal common-cause failure (CCF) parameter estimations for the failure cause groups “component,” “design,” “environment,” “human,” and “other,” based on CCF data through 2020 in the U.S. Nuclear Regulatory Commission (NRC) CCF database: https://rads.inl.gov/Pages/CCF.aspx. This report utilizes the same data period (2006–2020) and CCF templates as INL/EXT-21-62940, Revision 1, CCF Parameter Estimations, 2020 Update. The 2015 causal CCF prior distributions for the specific failure cause groups (instead of the 2015 generic CCF prior distributions) were used in this report to estimate the associated causal CCF parameters. All the 2015 causal CCF prior distributions and generic CCF prior distributions were developed in INL/EXT-21-43723, Developing Generic Prior Distributions for Common Cause Failure Alpha Factors and Causal Alpha Factors, using CCF data from 1997 to 2015. These quantitative results were developed to support the causal alpha factor model and should be used as appropriate in probabilistic risk assessment (PRA) studies such as the NRC Significance Determination Process for commercial nuclear power plants in the United States.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2025

A general kinetic framework for dislocation mobility derived from probabilistic cellular automaton simulations of the kink-pair mechanism

Dislocation mobility laws are essential components of dislocation-density-based crystal plasticity models. For dislocations governed by the kink-pair mechanism, however, existing formulations are typically limited to specific regimes due to the com plex interplay between stochastic kink-pair nucleation and lateral kink migration. In this work, we develop a general kinetic framework that expresses the average dislocation velocity as a function of mechanism-level variables: positive/negative kink pair nucleation rates, kink migration velocity, dislocation segment length, critical kink-pair width, and kink height. Probabilis tic cellular automaton simulations are used to capture the behavior of conceptual dislocation segments between the limiting conditions of migration outpacing nucleation on the one end and nucleation outpacing migration on the other. An elemen tary functional form that captures the system dynamics is suggested and fitted against the simulation results. This framework remains valid for arbitrary combinations of the six variables and is, therefore, compatible with any admissible constitutive re lations that describe their stress and temperature dependence. Comparisons with established approaches and experimental results confirm the robustness and physical consistency of the formulation, making it broadly applicable to material systems in which dislocation motion is governed by the kink-pair mechanism.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Dynamic probabilistic risk assessment and game theory for cyber security risk analysis in nuclear power plants

Nuclear Power Plants and energy systems have become more prone to cyber-attacks with their digitalization and the increased use of smart equipment. Hence, it is important to quantify the risk associated with cyber-attacks in such systems. Dynamic Probabilistic Risk Assessment which involves studying the evolution of a system due to random events and operator and attacker actions during a cyber-attack by employing a physics-based model of the system is a suitable framework to quantify cybersecurity risk in nuclear power plants. In addition to the plant dynamics, it is also important to model the strategies of the attackers and plant operators for an effective cybersecurity risk assessment. Game theory provides a set of necessary tools to model such strategic interactions. In this research, a framework that integrates dynamic probabilistic risk assessment with game theory for cybersecurity risk analysis in nuclear power plants is presented. The mathematical formulation is derived based on the theory of continuous event trees. We propose a game theory based action model, that utilizes physics-based rewards to define the strategies of attackers and operators at every decision epoch. As a case study, the risk associated with cyber-attacks on the digital components in the secondary side of a pressurized water reactor is studied using a reduced order model. A set of attacker actions and a set of operator actions are defined for the system. The operator and attacker interactions were modelled using simultaneous game, their action policies were computed using the concept of mixed strategy Nash equilibrium and the evolution of the system was studied.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Bayesian Structural Time Series for Behind-the-Meter Photovoltaic Disaggregation: Preprint

Distributed photovoltaic (PV) generation often occurs ``behind the meter": a grid operator can only observe the net load, which is the sum of the gross load and distributed PV generation. This lack of observability poses a challenge to system operation at both bulk level and distribution level. The lack of real-time or near-future disaggregated estimates of gross load and PV generation will lead to over scheduling of energy production and regulation reserves, reliability constraints violations, wear and tear of controller devices, and potentially cascading failures of a system. In this paper we propose the use of a Bayesian Structural Time Series (BSTS) model with local solar irradiance measurements to disaggregate the summed PV generation and gross load signals at a downstream measurement site. BSTSs are a highly expressive model class that blends classic time series models with the powerful Bayesian state space estimation framework. Disaggregation is done probabilistically, which automatically quantifies the uncertainties of the estimated PV generation and gross load consumption. Depending on the data availability in real-time, it can be used to disaggragate PV and gross load at customer site, or can be used at the feeder level. In this paper, we focus on solving the problem at feeder level. We compare the performance of a BSTS model as well as a handful of state-of-the-art methods on a Pecan Street AMI dataset, using the National Solar Radiation Database (NSRDB) to estimate local irradiance.

Bayesian structural time series↗
DOE OSTI2025

Probabilistic flux limiters

The stable numerical integration of shocks in compressible flow simulations relies on the reduction or elimination of Gibbs phenomena (unstable, spurious oscillations). A popular method to virtually eliminate Gibbs oscillations caused by numerical discretization in under-resolved simulations is to use a flux limiter. A wide range of flux limiters have been studied in the literature, with recent interest in their optimization via machine learning methods trained on high-resolution datasets. The common use of flux limiters in numerical codes as plug-and-play blackbox components makes them key targets for design improvement. Even for deterministic dynamical models, numerical uncertainty is introduced via coarse-graining required by insufficient computational power to solve all scales of motion. Conventional flux limiters are deterministic and lack the capacity to address uncertainties, both aleatoric (inherent randomness) and epistemic (modeling uncertainty due to limited knowledge), which arise in coarse-grained numerical simulations. Here, we introduce a conceptually distinct type of flux limiter that is designed to handle the effects of randomness in the model and uncertainty in model parameters. Unlike traditional single-function flux limiters, these new probabilistic flux limiters incorporate multiple flux limiting functions, each applied with a learned probability drawn from high-resolution data to mitigate the effects of uncertainty in numerical simulations. This approach departs from traditional single-function limiters by explicitly modeling and incorporating uncertainty into the shock capturing process. Using the example of Burgers' equation as a testbed, we show that a machine learned, probabilistic flux limiter may be used in a shock capturing code to more accurately capture shock profiles. In particular, we show that our probabilistic flux limiter outperforms standard limiters and can be successively improved upon (up to a point) by expanding the set of probabilistically chosen flux limiting functions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

An efficient method to identify uncertainties of WRF-Solar variables in forecasting solar irradiance using a tangent linear sensitivity analysis

Uncertainty in predicting solar energy resources introduces major challenges in power system management and necessitates the development of reliable probabilistic solar forecasts. As the first part of the development of probabilistic forecasts based on the Weather Research and Forecasting model with solar extensions (WRF-Solar), this study presents a tangent linear approach to identify input variables responsible for the largest uncertainties in predicting surface solar irradiance and clouds. A tangent linear analysis is capable of efficiently investigating sensitivities of output variables with respect to various input variables of WRF-Solar because this approach avoids the computational burden of perturbing the initial conditions of individual input variables. We develop tangent linear models (TLMs) for six WRF-Solar physics packages that control the formation and dissipation of clouds and solar radiation, and we evaluate the validity of TLMs using a linearity test. The tangent linear sensitivity analysis is conducted under various scenarios based on satellite observations and model simulations to consider realistic input conditions. A simple method is used to quantify the impact of the uncertainty of input variables on the output variables from the TLMs. The results demonstrate that uncertainties in the output variables that are the focus of this study—including global horizontal irradiance, direct normal irradiance, cloud mixing ratio, cloud tendency, cloud fraction, and sensible and latent heat fluxes—are highly sensitive to uncertainties in 14 input variables. This study indicates that the tangent linear method can identify key variables of physics modules in WRF-Solar that can be stochastically perturbed to generate ensemble-based probabilistic forecasts.

14 SOLAR ENERGY↗
DOE OSTI2022

A Bayesian Deep Learning Approach to Near-Term Climate Prediction

Since model bias and associated initialization shock are serious shortcomings that reduce prediction skills in state-of-the-art decadal climate prediction efforts, we pursue a complementary machine-learning-based approach to climate prediction. The example problem setting we consider consists of predicting natural variability of the North Atlantic sea surface temperature on the interannual timescale in the pre-industrial control simulation of the Community Earth System Model. While previous works have considered the use of recurrent networks such as convolutional LSTMs and reservoir computing networks in this and other similar problem settings, we currently focus on the use of feedforward convolutional networks. In particular, we find that a feedforward convolutional network with a Densenet architecture is able to outperform a convolutional LSTM in terms of predictive skill. Next, we go on to consider a probabilistic formulation of the same network based on Stein variational gradient descent and find that in addition to providing useful measures of predictive uncertainty, the probabilistic (Bayesian) version improves on its deterministic counterpart in terms of predictive skill. Finally, we characterize the reliability of the ensemble of machine learning models obtained in the probabilistic setting by using analysis tools developed in the context of ensemble numerical weather prediction.

54 ENVIRONMENTAL SCIENCES↗