Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stochastic models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,279 records · Page 71
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

A Logarithmic Bayesian Approach to Quantum Error Detection

We consider the problem of continuous quantum error correction from a Bayesian perspective, proposing a pair of digital filters using logarithmic probabilities that are able to achieve near-optimal performance on a three-qubit bit-flip code, while still being reasonable to implement on low-latency hardware. These practical filters are approximations of an optimal filter that we derive explicitly for finite time steps, in contrast with previous work that has relied on stochastic differential equations such as the Wonham filter. By utilizing logarithmic probabilities, we are able to eliminate the need for explicit normalization and can reduce the Gaussian noise distribution to a simple quadratic expression. The state transitions induced by the bit-flip errors are modeled using a Markov chain, which for log-probabilities must be evaluated using a LogSumExp function. We develop the two versions of our filter by constraining this LogSumExp to have either one or two inputs, which favors either simplicity or accuracy, respectively. Using simulated data, we demonstrate that the single-term and two-term filters are able to significantly outperform both a double threshold scheme and a linearized version of the Wonham filter in tests of error detection under a wide variety of error rates and time steps.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Reinforcement Learning-based Output Structured Feedback for Distributed Multi-Area Power System Frequency Control

Load frequency control (LFC) is a key factor to maintain the stable frequency in multi-area power systems. As the modern power systems evolve from centralized to decentralized paradigm, LFC needs to consider the decentralized scheme that considers limited information from the information-exchange graph for the generator control of each interconnected area. This paper aims to solve a data-driven constrained LQR problem with mean-variance risk constraints and output structured feedback, and applies this framework to solve the LFC problem in multi-area power systems. By reformulating the constrained optimization problem into a minimax problem, the stochastic gradient descent max-oracle (SGDmax) algorithm with zero-order policy gradient (ZOPG) is adopted to find the optimal feedback gain from the learning, while guaranteeing the convergence. In addition, to improve the adaptation of the proposed learning method to new or varying models, we construct an emulator grid that approximates the dynamics of a physical grid and performs training based on this model. Once the feedback gain is obtained from the emulator grid, it is applied to the physical grid with a robustness test to check whether the controller from the approximated emulator applies to the actual system. Numerical tests show that the obtained feedback controller can successfully control the frequency of each area, while mitigating the uncertainty from the loads, with reliable robustness that ensures the adaptability of the obtained feedback gain to the actual physical grid.

Kwon, Kyung-bin↗
DOE OSTI2022

Discovering causal structure with reproducing-kernel Hilbert space ε -machines

We merge computational mechanics’ definition of causal states (predictively equivalent histories) with reproducing-kernel Hilbert space (RKHS) representation inference. The result is a widely applicable method that infers causal structure directly from observations of a system’s behaviors whether they are over discrete or continuous events or time. A structural representation—a finite- or infinite-state kernel ϵ-machine—is extracted by a reduced-dimension transform that gives an efficient representation of causal states and their topology. In this way, the system dynamics are represented by a stochastic (ordinary or partial) differential equation that acts on causal states. We introduce an algorithm to estimate the associated evolution operator. Paralleling the Fokker–Planck equation, it efficiently evolves causal-state distributions and makes predictions in the original data space via an RKHS functional mapping. We demonstrate these techniques, together with their predictive abilities, on discrete-time, discrete-value infinite Markov-order processes generated by finite-state hidden Markov models with (i) finite or (ii) uncountably infinite causal states and (iii) continuous-time, continuous-value processes generated by thermally driven chaotic flows. The method robustly estimates causal structure in the presence of varying external and measurement noise levels and for very high-dimensional data.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

Fast and Universal Kohn-Sham Density Functional Theory Algorithm for Warm Dense Matter to Hot Dense Plasma

Understanding many processes, e.g., fusion experiments, planetary interiors, and dwarf stars, depends strongly on microscopic physics modeling of warm dense matter and hot dense plasma. This complex state of matter consists of a transient mixture of degenerate and nearly free electrons, molecules, and ions. This regime challenges both experiment and analytical modeling, necessitating predictive ab initio atomistic computation, typically based on quantum mechanical Kohn-Sham density functional theory (KS-DFT). However, cubic computational scaling with temperature and system size prohibits the use of DFT through much of the warm dense matter regime. A recently developed stochastic approach to KS-DFT can be used at high temperatures, with the exact same accuracy as the deterministic approach, but the stochastic error can converge slowly and it remains expensive for intermediate temperatures (< 50 eV). Here we have developed a universal mixed stochastic-deterministic algorithm for DFT at any temperature. This approach leverages the physics of KS-DFT to seamlessly integrate the best aspects of these different approaches. We demonstrate that this method significantly accelerated self-consistent field calculations for temperatures from 3 to 50 eV, while producing stable molecular dynamics and accurate diffusion coefficients.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Smart thermostat data-driven U.S. residential occupancy schedules and development of a U.S. residential occupancy schedule simulator

Occupancy schedule is one of the key inputs in Building Energy Modeling (BEM) to reflect the interaction between buildings and occupants. Over the past decades, standardized occupancy schedules, developed mainly by engineering rule-of-thumb, have been widely used in BEM due to its simplicity and lack of real measured occupancy data. However, the BEM community has recognized their association with uncertainty and reliability in simulation results from BEM. This study introduces representative occupancy schedules in the U.S. residential buildings, derived from a large smart thermostat dataset and time-series K-means clustering, and an open-source tool to generate a stochastic residential occupancy schedule. Over 90,000 residential occupancy schedules were estimated from the ecobee Donate Your Data dataset. Then, the representative occupancy schedules were identified through clustering. This study further investigated the impacts of three parameters (day, house type, and state) on residential occupancy schedules. Then, a tool, the Residential Occupancy Schedule Simulator (ROSS), is developed using the representative occupancy schedules derived in this study. Details of this tool are presented in this paper. In conclusion, the derived representative occupancy schedules and the ROSS tool can help improve the energy modeling of residential buildings.

42 ENGINEERING↗
DOE OSTI2022

Uncertainties in Local Intense Precipitation Flood Modeling

In the Task 1 report for the U.S. Nuclear Regulatory Commission (NRC) funded Local Intense Precipitation (LIP) Probabilistic Flood Hazard Assessment (PFHA) Pilot Study, the Pacific Northwest National Laboratory (PNNL) reviewed hydrologic and hydraulic modeling approaches for estimation of LIP flooding and their implementation in readily available simulation software packages (Prasad and Yuan 2020). NRC’s interest is in developing guidance for performing LIP PFHA at nuclear power plant (NPP) sites. This report describes the work done under Task 2 of the study that focused on describing uncertainties associated with LIP flood modeling. Two main types of uncertainties exist in LIP flood modeling: (1) aleatory uncertainties that arise from the inherent natural variability of the hydrometeorological system and (2) epistemic uncertainties that arise from the analysts’ incomplete knowledge of the hydrometeorological and site configuration. Principal sources for aleatory variability in LIP flood simulations at NPP sites include precipitation (i.e., magnitude, duration, and temporal distribution of LIP events), initial conditions (e.g., soil moisture content, stormwater drainage discharge, surface storage), boundary conditions (e.g., upstream discharge, downstream water surface elevations), and long-term temporal trends (e.g., climate change). This report describes approaches used for estimating the aleatory variability in precipitation including precipitation-frequency analysis, numerical weather prediction, and stochastic weather generation. Data sources that can be used to estimate aleatory variability in initial and boundary conditions are also described. Approaches to include effects of long-term trends like those from climate change into estimation of aleatory variability are summarized. Sources of epistemic uncertainty in LIP flood simulations at NPP sites include process representation (e.g., multiple approaches to represent runoff generation, stormwater drainage, and hydraulic routing), site configurations (e.g., site layout, flow features, status of temporary flood protection, blockage of drains), model resolution, and long-term temporal trends (e.g., known/planned site alterations, land-use changes at and in the vicinity of the site). The report describes alternative process representations (methods and models), particularly those implemented in the LIP flood simulation software packages reviewed in Task 1 report, and lists the associated model parameters. Approaches for estimating model parameters when surface and subsurface water exchanges occur are also described.

42 ENGINEERING↗
DOE OSTI2021

Reducing Ground-based Astrometric Errors with Gaia and Gaussian Processes

Stochastic field distortions caused by atmospheric turbulence are a fundamental limitation to the astrometric accuracy of ground-based imaging. This distortion field is measurable at the locations of stars with accurate positions provided by the Gaia DR2 catalog; we develop the use of Gaussian process regression (GPR) to interpolate the distortion field to arbitrary locations in each exposure. We introduce an extension to standard GPR techniques that exploits the knowledge that the 2D distortion field is curl-free. Applied to several hundred 90 s exposures from the Dark Energy Survey as a test bed, we find that the GPR correction reduces the variance of the turbulent astrometric distortions ≈12× , on average, with better performance in denser regions of the Gaia catalog. The rms per-coordinate distortion in the riz bands is typically ≈7 mas before any correction and ≈2 mas after application of the GPR model. The GPR astrometric corrections are validated by the observation that their use reduces, from 10 to 5 mas rms, the residuals to an orbit fit to riz-band observations over 5 yr of the r = 18.5 trans-Neptunian object Eris. We also propose a GPR method, not yet implemented, for simultaneously estimating the turbulence fields and the 5D stellar solutions in a stack of overlapping exposures, which should yield further turbulence reductions in future deep surveys.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Gravitational waves from fully general relativistic oscillon preheating

As long-lived quasisolitons from the fragmentation of a scalar condensate, oscillons may dominate the preheating era after inflation. During this period, stochastic gravitational waves can also be generated. Here we quantify the gravitational-wave production in this period with simulations accounting for full general relativity to capture all possible nonperturbative effects. We compute the gravitational-wave spectra across a range of choices of the oscillon preheating models and compare our results to a conventional perturbative approach on a Friedmann-Lemaître-Robertson-Walker (FLRW) background. We clarify the gauge ambiguities in computing induced gravitational waves from scenarios where dense nonperturbative objects such as oscillons are being formed. In particular, we find that the synchronous gauge tends to contain large artificial enhancements in the gravitational-wave spectrum due to gauge modes if gravity plays an important role in the formation of the oscillons, while other gauge choices, such as the radiation gauge or a suitably chosen “1+log” gauge, can efficiently reduce the contributions of gauge modes. The full general-relativistic simulations indicate that gravitational-wave spectra obtained from the perturbative approach on the FLRW background are fairly accurate, except when oscillon formation induces strong gravitational effects, for which case there can be an order unity enhancement.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

A tail of eternal inflation

Non-trivial inflaton self-interactions can yield calculable signatures of primordial non-Gaussianity that are measurable in cosmic surveys. We calculate the non-Gaussian corrections to Stochastic Inflation within the framework of Soft de Sitter Effective Theory, from which we derive the associated probability distribution for the scalar fluctuations. As a consequence of this new result, we show that the phase transition to slow-roll eternal inflation is often incalculable in these models. Instead, this transition is sensitive to the non-Gaussian tail of the distribution of scalar fluctuations, which probes physics inside the horizon, potentially beyond the cutoff scale of the Effective Field Theory of Inflation. We delineate the parameter space consistent with current observations and weak coupling at horizon crossing in which the large fluctuations relevant for eternal inflation can only be determined by appealing to a UV completion. We also argue that this breakdown of the perturbative description is required for the de Sitter entropy to reflect the number of de Sitter microstates.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Modern Monte Carlo methods for efficient uncertainty quantification and propagation: A survey

Uncertainty quantification (UQ) includes the characterization, integration, and propagation of uncertainties that result from stochastic variations and a lack of knowledge or data in the natural world. Monte Carlo (MC) method is a sampling-based approach that has widely used for quantification and propagation of uncertainties. However, the standard MC method is often time-consuming if the simulation-based model is computationally intensive. This article gives an overview of modern MC methods to address the existing challenges of the standard MC in the context of UQ. Specifically, multilevel Monte Carlo (MLMC) extending the concept of control variates achieves a significant reduction of the computational cost by performing most evaluations with low accuracy and corresponding low cost, and relatively few evaluations at high accuracy and corresponding high cost. Multifidelity Monte Carlo (MFMC) accelerates the convergence of standard Monte Carlo by generalizing the control variates with different models having varying fidelities and varying computational costs. Multimodel Monte Carlo method (MMMC), having a different setting of MLMC and MFMC, aims to address the issue of UQ and propagation when data for characterizing probability distributions are limited. Multimodel inference combined with importance sampling is proposed for quantifying and efficiently propagating the uncertainties resulting from small data sets. All of these three modern MC methods achieve a significant improvement of computational efficiency for probabilistic UQ, particularly uncertainty propagation. Finally, an algorithm summary and the corresponding code implementation are provided for each of the modern MC methods. The extension and application of these methods are discussed in detail.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Efficacy of the Cell Perturbation Method in Large-Eddy Simulations of Boundary Layer Flow over Complex Terrain

A challenge to simulating turbulent flow in multiscale atmospheric applications is the efficient generation of resolved turbulence motions over an area of interest. One approach is to apply small perturbations to flow variables near the inflow planes of turbulence-resolving simulation domains nested within larger mesoscale domains. While this approach has been examined in numerous idealized and simple terrain cases, its efficacy in complex terrain environments has not yet been fully explored. Here, we examine the benefits of the stochastic cell perturbation method (CPM) over real complex terrain using data from the 2017 Perdigão field campaign, conducted in an approximately 2-km wide valley situated between two nearly parallel ridges. Following a typical configuration for multiscale simulation using nested domains within the Weather Research and Forecasting (WRF) model to downscale from the mesoscale to a large-eddy simulation (LES), we apply the CPM on a domain with horizontal grid spacing of 150 m. At this resolution, spurious coherent structures are often observed under unstable atmospheric conditions with moderate mean wind speeds. Results from such an intermediate resolution grid are often nested down for finer, more detailed LES, where these spurious structures adversely affect the development of turbulence on the subsequent finer grid nest. We therefore examine the impacts of the CPM on the representation of turbulence within the nested LES domain under moderate mean flow conditions in three different stability regimes: weakly convective, strongly convective, and weakly stable. In addition, two different resolutions of the underlying terrain are used to explore the role of the complex topography itself in generating turbulent structures. We demonstrate that the CPM improves the representation of turbulence within the LES domain, relative to the use of high-resolution complex terrain alone. During the convective conditions, the CPM improves the rate at which smaller-scales of turbulence form, while also accelerating the attenuation of the spurious numerically generated roll structures near the inflow boundary. During stable conditions, the coarse mesh spacing of the intermediate LES domain used herein was insufficient to maintain resolved turbulence using CPM as the flow develops downstream, highlighting the need for yet higher resolution under even weakly stable conditions, and the importance of accurate representation of flow on intermediate LES grids.

17 WIND ENERGY↗
DOE OSTI2025

Discovering $\mu$Hz gravitational waves and ultra-light dark matter with binary resonances

In the presence of a weak gravitational wave (GW) background, astrophysical binary systems act as high-quality resonators, with efficient transfer of energy and momentum between the orbit and a harmonic GW leading to potentially detectable orbital perturbations. In this work, we develop and apply a novel modeling and analysis framework that describes the imprints of GWs on binary systems in a fully time-resolved manner to study the sensitivity of lunar laser ranging, satellite laser ranging, and pulsar timing to both resonant and nonresonant GW backgrounds. We demonstrate that optimal data collection, modeling, and analysis lead to projected sensitivities which are orders of magnitude better than previously appreciated possible, opening up a new possibility for probing the physics-rich but notoriously challenging to access $\mu\mathrm{Hz}$ frequency GWs. We also discuss improved prospects for the detection of the stochastic fluctuations of ultra-light dark matter, which may analogously perturb the binary orbits.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Assessments of epistemic uncertainty using Gaussian stochastic weight averaging for fluid-flow regression

Here, we use Gaussian stochastic weight averaging (SWAG) to assess the epistemic uncertainty associated with neural-network-based function approximation relevant to fluid flows. SWAG approximates a posterior Gaussian distribution of each weight, given training data, and a constant learning rate. Having access to this distribution, it is able to create multiple models with various combinations of sampled weights, which can be used to obtain ensemble predictions. The average of such an ensemble can be regarded as the 'mean estimation', whereas its standard deviation can be used to construct 'confidence intervals', which enable us to perform uncertainty quantification (UQ) with regard to the training process of neural networks. We utilize representative neural-network-based function approximation tasks for the following cases: (i) a two-dimensional circular-cylinder wake; (ii) the DayMET dataset (maximum daily temperature in North America); (iii) a three-dimensional square-cylinder wake; and (iv) urban flow, to assess the generalizability of the present idea for a wide range of complex datasets. SWAG-based UQ can be applied regardless of the network architecture, and therefore, we demonstrate the applicability of the method for two types of neural networks: (i) global field reconstruction from sparse sensors by combining convolutional neural network (CNN) and multi-layer perceptron (MLP); and (ii) far-field state estimation from sectional data with two-dimensional CNN. We find that SWAG can obtain physically-interpretable confidence-interval estimates from the perspective of epistemic uncertainty. This capability supports its use for a wide range of problems in science and engineering.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Spherical and sessile droplet dynamics by fluctuating hydrodynamics

We simulate the mesoscopic dynamics of droplets formed by phase-separated fluids at nanometer scales where thermal fluctuations are significant. Both spherical droplets fully immersed in a second fluid and sessile droplets which are also in contact with a solid surface are studied. Our model combines a Cahn–Hilliard formulation with incompressible fluctuating hydrodynamics; for sessile droplets, the fluid–solid contact angle is specified as a boundary condition. Deterministic simulations with an applied body force are used to measure the droplets' mobility from which a diffusion coefficient is obtained using the Einstein relation. Stochastic simulations are independently used to obtain a diffusion coefficient from a linear fit of the variance of a droplet's position with time. In some scenarios, these two measurements give the same value but not in the case of a spherical droplet initialized near a slip wall or in the case of sessile droplets with large contact angles (≥90°) on both slip and no-slip surfaces.

Bell, John B↗
DOE OSTI2026

Predictive Model for Starlink Maritime Performance Using Multi-Horizon RandomForest

Low Earth orbit (LEO) satellite systems have become a crucial enabler of broadband access for maritime industries, where traditional networks are unavailable. However, the high mobility of LEO constellations and constantly changing weather conditions result in unpredictable link fluctuations, limiting the ability of maritime platforms to plan bandwidth usage proactively. To the best of our knowledge, no prior work has developed a short-term predictive model for maritime LEO connectivity using real experimental field measurements. This paper proposes a data-driven forecasting model that predicts future downlink throughput using multi-horizon RandomForest regression. The model is trained using real experimental coastal measurement data incorporating recent throughput history, network-layer indicators, and environmental variables. The proposed approach reduces mean absolute error by approximately 31% compared to a persistence baseline for 15-minute horizons. It maintains a measurable improvement at 30 minutes, despite increased stochasticity. These findings confirm that proactive bandwidth awareness is feasible on maritime platforms and can effectively support operational decisions such as adaptive streaming, routing, and resource scheduling. The performance gap between forecasting horizons also highlights the need for expanded offshore datasets to improve prediction robustness under harsher maritime environments.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Risk-Constrained Reinforcement Learning for Inverter-Dominated Power System Controls

Here, this paper develops a risk-aware controller for grid-forming inverters (GFMs) to minimize large frequency oscillations in GFM inverter-dominated power systems. To tackle the high variability from loads/renewables, we incorporate a mean-variance risk constraint into the classical linear quadratic regulator (LQR) formulation for this problem. The risk constraint aims to bound the time-averaged cost of state variability and thus can improve the worst-case performance for large disturbances. The resulting risk-constrained LQR problem is solved through the dual reformulation to a minimax problem, by using a reinforcement learning (RL) method termed as stochastic gradient-descent with max-oracle (SGDmax). In particular, the zero-order policy gradient (ZOPG) approach is used to simplify the gradient estimation using simulated system trajectories. Numerical tests conducted on the IEEE 68-bus system have validated the convergence of our proposed SGDmax for GFM model and corroborate the effectiveness of the risk constraint in improving the worst-case performance while reducing the variability of the overall control cost.

Frequency control↗
DOE OSTI2019

A Monte Carlo Rectangle Packing Algorithm for Identifying Likely Spatial Distributions of Final Closure Cap Subsidence in the E-Area Low-Level Waste Facility

A Monte Carlo rectangle packing algorithm, summarized in Figure ES-1, has been developed to provide insights into the likely spatial distribution of subsided areas or holes in the final closure cap for the E-Area Low-Level Waste Facility (ELLWF) resulting from the placement of non-crushable waste containers within slit and engineered trench disposal units. Using historical records provided by Solid Waste Management as an indicator of future waste streams, a probability distribution of unique waste containers was constructed, and Monte Carlo sampling was used to sequentially select waste containers for placement in a rectangular region bounded by the disposal unit footprint. Within this Monte Carlo approach, the probability of any container type being selected is weighted by the fractional abundance relative to all other container types. For each Monte Carlo realization, the frequency of non-crushable waste containers appearing at each location on a spatially discretized mesh is updated. After many realizations, the location(s) with the highest frequencies of non-crushable waste containers are regarded as the most likely locations to experience subsidence (i.e., for a hole to form). Utilizing this approach has enabled the down-selection of a computationally intractable set of subsidence hole combinations to be explored in three-dimensional finite element groundwater flow and contaminant transport models. Such an approach can be applied to a number of different packaging problems.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗