Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Probabilistic models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Reduced-dimension Bayesian optimization for model calibration of transient vapor compression cycles

Development and calibration of first-principles dynamic models of vapor compression cycles (VCCs) is of critical importance for applications that include control design and fault detection and diagnostics. Nevertheless, the inherent complexity of models that are represented by large systems of differential–algebraic equations leads to significant challenges for model calibration processes that utilize classical gradient-based methods. Bayesian optimization (BO) is a sample-efficient and gradient-free approach using a probabilistic surrogate model and optimal search over a feasible parameter space. Despite the benefits of BO in reducing computational costs, challenges remain in dealing with a high-dimensional calibration task resulting from a large set of parameters that have significant impacts on system behavior and need to be calibrated simultaneously. This paper presents a reduced-dimension BO framework for calibrating transient VCCs models where the calibration space is projected to a low-dimensional subspace for accelerating convergence of the solution algorithm and consequently reducing the number of transient simulations. The proposed approach was demonstrated via two case studies associated with different VCC applications where 10 parameters were calibrated in each case using laboratory measurements. The reduced-dimension BO framework only required 1 / 8 th of the iterations associated with a standard BO method that deals with high-dimensional calibration parameters for converged solutions and yielded comparable accuracy. Furthermore, both calibrated models revealed significant accuracy improvements compared to uncalibrated models.

Ma, Jiacheng↗
DOE OSTI2020

Bayesian Optimization of a Free-Electron Laser

The Linac Coherent Light Source X-ray free-electron laser is a complex scienti c apparatus which changes con gurations multiple times per day, necessitating fast tuning strategies to reduce setup time for successive experiments. To this end, we employ a Bayesian approach to maximizing X- ray laser pulse energy by controlling groups of quadrupole magnets. A Gaussian process model provides probabilistic predictions for the machine response with respect to control parameters, enabling a balance of exploration and exploitation in the search for the global optimum. We show that the model parameters can be learned from archived scans, and correlations between devices can be extracted from the beam transport. Furthermore, the result is a sample-e cient optimization routine, combining both historical data and knowledge of accelerator physics to signi cantly outperform existing optimizers.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Discrete fracture network model benchmarks developed and applied in a DECOVALEX-2023 repository performance assessment study

This study presents newly developed benchmarks for modeling flow and transport within discrete fracture networks (DFNs) and useful methods for analyzing the results. The new benchmarks are designed to test modeling approaches for use in probabilistic performance assessment models of deep geologic repositories in fractured rock. The benchmarks simulate flow and transport through a 1 km 3 block of fractured rock. The first simulates migration of a short pulse of tracer through a simple network of four intersecting fractures. The second adds 1089 stochastically generated fractures. The third changes the pulse to a continuous point source. Evaluation of model performance relies on moment analysis and comparison of the results of different models. The expected nondimensional first moment of the conservative tracer for each benchmark is 1. The benchmarks were simulated by teams from Canada, Czechia, Germany, Korea, Sweden, Taiwan, and the United States as part of a DECOVALEX-2023 study (decovalex.org). The teams used various approaches, including explicit DFN modeling, DFN upscaling to an equivalent continuous porous medium (ECPM), and a combination of both methods. Transport mechanisms are modeled using either the advection-dispersion equation or particle tracking. Results demonstrate strong agreement among the models in breakthrough behavior up to the 75th percentile. Significant deviations in first moments and well-clustered outputs led to the identification of inaccuracies in several models. Such findings exemplify the benefit of exercising these benchmarks and using the presented methods to test DFN flow and transport models.

Benchmark↗
DOE OSTI2022

Creep anisotropy modeling and uncertainty quantification of an additively manufactured Ni-based superalloy

The advantages offered by additive manufacturing over traditional processes has driven a great deal of industrial and academic interest in recent years. However, the process is relatively new and requires additional investigation to become sufficiently mature for wide scale industrial adoption. Electron beam melting powder bed fusion is one technology that has shown promise for fabricating high temperature resistant materials such as nickel based superalloys. The resulting microstructures typically exhibit a strong fiber texture in the build direction giving rise to anisotropic time-dependent deformation behavior. In order to accelerate the qualification of these materials for industrial adoption accurate numerical models are needed for simulating their behavior. In this work a crystal plasticity model including non-Schmid effects is presented for capturing creep anisotropy observed in additively manufactured IN738LC. The model is calibrated via a probabilistic framework where model parameters are treated as random variables. An iterative sequential design strategy is utilized to efficiently identify the probability density of the unknown model parameters. As a case study the model is utilized to investigate the behavior of randomly oriented equiaxed grain clusters sometimes observed embedded in the additively manufactured columnar structure. A synthetic realization is simulated and uncertainty is propagated through to the full-field response. Results indicate that these features are the source of significant creep relaxation and strain accumulation which partially explains observed grain boundary decohesion at these locations.

36 MATERIALS SCIENCE↗
DOE OSTI2021

On the Stochastic Stability of Deep Markov Models

Deep Markov models (DMM) are generative models which are scalable and expressive generalization of Markov models for representation, learning, and inference problems. However, the fundamental stochastic stability guarantees of such models have not been thoroughly investigated. In this paper, we present a novel stability analysis method and provide sufficient conditions of DMM's stochastic stability. The proposed stability analysis is based on the contraction of probabilistic maps modeled by deep neural networks. We make connections between the spectral properties of neural network's weights and different types of used activation function on the stability and overall dynamic behavior of DMMs with Gaussian distributions. Based on the theory, we propose a few practical methods for designing constrained DMMs with guaranteed stability. We empirically substantiate our theoretical results via intuitive numerical experiments using the proposed stability constraints.

Drgona, Jan↗
DOE OSTI2026

Incorporating Local Extreme Weather Events into Reliability Assessments

Presentation discussing modeling extreme weather effects on the Bulk power system. Using a Production cost model to analyze weather related demand increases, generator outages, transmission outages, and fuel supply constraints. These results can be analyzed to inform on system reliability effects of extreme weather. This presentation was developed for the 2026 NERC Probabilistic Assessment Forum at EPRI in Charlotte NC.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

An Empirical Model For Intrinsic Alignments: Insights From Cosmological Simulations

We extend current models of the halo occupation distribution (HOD) to include a flexible, empirical framework for the forward modeling of the intrinsic alignment (IA) of galaxies. A primary goal of this work is to produce mock galaxy catalogs for the purpose of validating existing models and methods for the mitigation of IA in weak lensing measurements. This technique can also be used to produce new, simulation-based predictions for IA and galaxy clustering. Our model is probabilistically formulated, and rests upon the assumption that the orientations of galaxies exhibit a correlation with their host dark matter (sub)halo orientation or with their position within the halo. We examine the necessary components and phenomenology of such a model by considering the alignments between (sub)halos in a cosmological dark matter only simulation. We then validate this model for a realistic galaxy population in a set of simulations in the Illustris-TNG suite. We create an HOD mock with Illustris-like correlations using our method, constraining the associated IA model parameters, with the $\mathcal{X}$$^{2}_{dof}$ between our model’s correlations and those of Illustris matching as closely as 1.4 and 1.1 for orientation–position and orientation–orientation correlation functions, respectively. By modeling the misalignment between galaxies and their host halo, we show that the 3-dimensional two-point position and orientation correlation functions of simulated (sub)halos and galaxies can be accurately reproduced from quasi-linear scales down to 0.1 $\mathcal{h}$ –1 Mpc. We also find evidence for environmental influence on IA within a halo. Our publicly-available software provides a key component enabling efficient determination of Bayesian posteriors on IA model parameters using observational measurements of galaxy-orientation correlation functions in the highly nonlinear regime.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

On the Stochastic Stability of Deep Markov Models

Deep Markov models (DMM) are generative models which are scalable and expressive generalization of Markov models for representation, learning, and inference problems. DMMs using deep neural networks to parametrize the transition of Markov probability distributions have recently been shown to provide more expressiveness in modeling sequential data and dynamical system responses. However, the fundamental stochastic stability guarantees of such models have not been thoroughly investigated. In this paper, we present a rigorous analytical method to prove the necessary and sufficient conditions of DMM's stochastic stability. This task is achieved by spectral analysis of the efficiently computed Jacobians of probabilistic maps modeled by deep neural networks. We make theoretical connections between the eigenvalues of neural network's weights and the different activation function types used on the stability and overall dynamic behavior of DMMs with Gaussian distributions. We empirically substantiate our theoretical results on stochastic stability and eigenvalue spectra via several numerical experiments. Formal stability guarantees of DMMs can substantially improve their robustness and trustworthiness, necessary for reliable use in safety-critical real-world applications.

Drgona, Jan↗
DOE OSTI2020

Wattile: Probabilistic Deep Learning-based Forecasting of Building Energy Consumption [SWR-20-94]

Accurate energy forecasting is becoming critical due to many reasons: i ) optimal distributed energy resources operations and dispatch, ii) fault detection and diagnostics, and iii) meeting operational energy efficiency targets. Wattile uses deep learning (DL) for the building's short-term load forecasting application. Two specific types of neural networks called, Long Short Term Memory (LSTM) and Sequence-to-Sequence (S2S) models are used to make predictions. Forecasting models are trained using online historical weather and occupancy indicator data streams from the Intelligent Campus Program's data acquisition systems at the National Renewable Energy Laboratory (NREL) for main meters and sub-meters of multiple building types. These models use probabilistic methods to provide quantile-based forecasts in addition to nominal conditional median predictions of electricity consumption.

Frank, Stephen↗
DOE OSTI2021

Quantum information approach to high energy interactions

High energy hadron interactions are commonly described by using a probabilistic parton model that ignores quantum entanglement present in the light-cone wave functions. Here, we argue that since a high energy interaction samples an instant snapshot of the hadron wave function, the phases of different Fock state wave functions cannot be measured—therefore the light-cone density matrix has to be traced over these unobservable phases. Performing this trace with the corresponding U(1) Haar integration measure leads to ‘Haar scrambling’ of the density matrix, and to the emergence of entanglement entropy. This entanglement entropy is determined by the Fock state probability distribution, and is thus directly related to the parton structure functions. As proposed earlier, at large rapidity η the hadron state becomes maximally entangled, and the entanglement entropy is S E ~η according to QCD evolution equations. When the phases of Fock state components are controlled, for example in spin asymmetry measurements, the Haar average cannot be performed, and the probabilistic parton description breaks down.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

CSR in the Probabilistic Resource Adequacy Suite (PRAS): Fast Interregional Transmission Models for Renewable Integration Studies

NREL's Probabilistic Resource Adequacy Suite (PRAS) was developed for use in renewable integration studies, to assess the resource adequacy of large interconnected power systems with potentially significant interregional transfers of power. This presentation provides an overview of the tool and the methods it uses to solve multi-regional transmission and storage dispatch problems in a computationally-efficient manner.

composite system reliability↗
DOE OSTI2025

A Sequential Model Predictive and Deep Reinforcement Learning-Based Controller for Distribution System Outage Mitigation under Hurricane Events

This paper proposes a proactive outage mitigation framework for power distribution networks to withstand hurricane-induced disruptions. It leverages Model Predictive Control (MPC) to identify safe lines for proactive switching during hurricanes, minimizing the risk of cascading failures and voltage violations. The switching strategies optimized by MPC are sequentially integrated with a Deep Reinforcement Learning agent using the Advantage Actor-Critic algorithm, enabling dynamic line switching to maximize connected buses and minimize voltage violations in real time. Using a probabilistic hurricane model, the framework predicts line failures and adapts to varying conditions to enhance grid resilience. Simulations on the IEEE 123-bus system demonstrate its effectiveness in maintaining high connectivity and minimizing disruptions. Real-time testing with an RTDS confirms the practicality and reliability of the proposed approach.

Selim, Alaa [University of Connecticut]↗
DOE OSTI2026

Hazard and risk analysis framework for nuclear power plant–based integrated energy systems

Employing integrated energy systems (IESs) with nuclear power plants (NPPs) can improve NPP utilization by leveraging dedicated thermal and electric power delivery, but it may also increase operational safety risks. This paper presents a framework to identify and quantify hazards and risks for such IESs. The framework combines accidentology to review past industrial accidents with failure modes and effects analysis (FMEA) to identify potential future incidents. Hydrogen explosion and toxic chemical release hazards are of particular concern. Explosion consequences are quantified using the Bauwens-Dorofeev (Bauwens) and trinitrotoluene equivalent mass (TNT-EM) methods, while chemical release consequences are computed using the Gaussian atmospheric dispersion method. Operational disturbances from direct electrical and thermal integration that may affect NPP safety are modeled using probabilistic risk analysis (PRA). Hazards and risks are then evaluated for regulatory compliance. The framework is applied to IESs comprising pressurized or boiling water reactors supplying three levels of thermal and electrical power to industrial customers. Case studies include high-temperature steam electrolysis hydrogen plants of varying capacities and a synthetic fuel production plant. Sensitivity analysis examines piping component failures in the PRA model as a precursor to cost estimation for thermal extraction line design. Additionally, Fussel-Vessely (FV) and risk increase importance (RII) measures identify risk-informed design improvements for the thermal extraction system. FMEA highlights hazards such as loss of offsite power, prompt loss of electrical load, loss of thermal output, and immediate steam diversion, in addition to hydrogen explosions and toxic chemical releases. Both Bauwens and TNT-EM methods suggest maintaining several hundred meters of separation between the NPP and hydrogen facility to mitigate explosion risks. PRA results show a maximum initiating event frequency increase of 1.15% and an overall risk increase of 0.28%. Importance measure analysis identifies upstream pipe leak isolation components as critical. Evaluating the results against safety regulations, it is concluded that hazards and risks can be managed to comply with regulations through risk-informed thermal and electrical connection designs, component selection, maintenance programs, and safe separation distances between NPPs and integrated industrial facilities.

08 - HYDROGEN↗
DOE OSTI2022

Stress-controlled fatigue of HfNbTaTiZr high-entropy alloy and associated deformation and fracture mechanisms

The stress-controlled fatigue tests are carried out at a stress ratio of 0.1 and a frequency of 10 Hz, and span both low-cycle and high-cycle regimes by varying the applied stress amplitudes. The high-cycle fatigue regime gives a fatigue strength of 497 MPa and a fatigue ratio of 0.44. At equivalent conditions, the alloy's fatigue strength is greater than all other high-entropy alloys (HEAs) with reported high-cycle fatigue data, dilute body-centered cubic alloys, and many structural alloys such as steels, titanium alloys, and aluminum alloys. Through in-depth analyses of crack-propagation trajectories, fracture-surface morphologies and deformation plasticity by means of various microstructural analysis techniques and theoretical frameworks, the alloy's remarkable fatigue resistance is attributed to delayed crack initiation in the high-cycle regime, which is achieved by retarding the formation of localized persistent slip bands, and its good resistance to crack propagation in the low-cycle regime, which is accomplished by intrinsic toughening backed up by extrinsic toughening. Additionally, the stochastic nature of the fatigue data is neatly captured with a 2-parameter Weibull model.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Discrete Graph Structure Learning for Forecasting Multiple Time Series

Time series forecasting is an extensively studied subject in statistics, economics, and computer science. Exploration of the correlation and causation among the variables in a multivariate time series shows promise in enhancing the performance of a time series model. When using deep neural networks as forecasting models, we hypothesize that exploiting the pairwise information among multiple (multivariate) time series also improves their forecast. If an explicit graph structure is known, graph neural networks (GNNs) have been demonstrated as powerful tools to exploit the structure. In this work, we propose learning the structure simultaneously with the GNN if the graph is unknown. We cast the problem as learning a probabilistic graph model through optimizing the mean performance over the graph distribution. The distribution is parameterized by a neural network so that discrete graphs can be sampled differentiably through reparameterization. Empirical evaluations show that our method is simpler, more efficient, and better performing than a recently proposed bilevel learning approach for graph structure learning, as well as a broad array of forecasting models, either deep or non-deep learning based, and graph or non-graph based.

Shang, Chao↗
DOE OSTI2022

Decoding Golden Eagle Movement Behavior from High-Resolution, Variable-Rate Telemetry Data Through Bayesian Filtering

The recent advances in animal tracking technology have enabled the collection of a vast amount of in situ data regarding the movement of wildlife at high spatiotemporal resolution. These data are usually available at variable time resolutions and contains noise (error) originating from GPS fixes. Decoding movement characteristics, particularly of flying animals, from telemetry data while handling these factors is a challenging yet important task for conservation purposes. Typically, this task is broken into two subtasks: resampling, and model calibration. The resampling subtask converts the variable rate positional data into a constant time interval data, while the model calibration subtask uses the resampled data to tune time-invariant parameters of the proposed models. For telemetry data at high temporal resolutions (order of 1 second), it is very challenging to decouple noise from actual movements using interpolation-based resampling techniques. Any errors introduced during resampling can significantly alter the the calibration and prediction attributes of the movement model. We address this problem through a unified Bayesian state-space framework that can handle both the resampling and calibration tasks in a single step. In addition, we use the speed and heading of the bird from telemetry data to regularize the position information of the bird. We use a Kalman filtering approach to include these nonlinearly related motion parameters within the state space framework. We cross-validated to quantify how this inclusion affects the model performance in estimating true bird movements. The relationship between the true state of the bird and environmental and topographical covariates is then represented parametrically. These parameters are then tuned using stochastic sampling strategies like Markov Chain Monte Carlo (MCMC). We use the telemetry data collected from golden eagles in the western USA to demonstrate the applicability of this approach to build a predictive, probabilistic movement model. Our preliminary results show that this approach provides improved predictive performance in terms of capturing higher-order motion parameters such as angular and horizontal accelerations, which may have simpler and more direct relationships with environmental covariates than corresponding speeds. In this talk, we will demonstrate how this state-space approach benefits the prediction capabilities of a movement model in simulating golden eagle paths through a wind power plant in Wyoming given certain atmospheric conditions. The model outcomes are aimed at informing mitigation strategies that can minimize the potential for collisions of golden eagles with wind turbines.

Bayesian methods↗
DOE OSTI2024

Modeling Spatial Asymmetries in Teleconnected Extreme Temperatures

Abstract Combining strengths from deep learning and extreme value theory can help describe complex relationships between variables where extreme events have significant impacts (e.g., environmental or financial applications). Neural networks learn complicated nonlinear relationships from large datasets under limited parametric assumptions. By definition, the number of occurrences of extreme events is small, which limits the ability of the data-hungry, nonparametric neural network to describe rare events. Inspired by recent extreme cold winter weather events in North America caused by atmospheric blocking, we examine several probabilistic generative models for the entire multivariate probability distribution of daily boreal winter surface air temperature. We propose metrics to measure spatial asymmetries, such as long-range anticorrelated patterns that commonly appear in temperature fields during blocking events. Compared to vine copulas, the statistical standard for multivariate copula modeling, deep learning methods show improved ability to reproduce complicated asymmetries in the spatial distribution of ERA5 temperature reanalysis, including the spatial extent of in-sample extreme events.

Krock, Mitchell L.↗