Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stochastic models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,189 records · Page 66
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

A tail of eternal inflation

Non-trivial inflaton self-interactions can yield calculable signatures of primordial non-Gaussianity that are measurable in cosmic surveys. We calculate the non-Gaussian corrections to Stochastic Inflation within the framework of Soft de Sitter Effective Theory, from which we derive the associated probability distribution for the scalar fluctuations. As a consequence of this new result, we show that the phase transition to slow-roll eternal inflation is often incalculable in these models. Instead, this transition is sensitive to the non-Gaussian tail of the distribution of scalar fluctuations, which probes physics inside the horizon, potentially beyond the cutoff scale of the Effective Field Theory of Inflation. We delineate the parameter space consistent with current observations and weak coupling at horizon crossing in which the large fluctuations relevant for eternal inflation can only be determined by appealing to a UV completion. We also argue that this breakdown of the perturbative description is required for the de Sitter entropy to reflect the number of de Sitter microstates.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Modern Monte Carlo methods for efficient uncertainty quantification and propagation: A survey

Uncertainty quantification (UQ) includes the characterization, integration, and propagation of uncertainties that result from stochastic variations and a lack of knowledge or data in the natural world. Monte Carlo (MC) method is a sampling-based approach that has widely used for quantification and propagation of uncertainties. However, the standard MC method is often time-consuming if the simulation-based model is computationally intensive. This article gives an overview of modern MC methods to address the existing challenges of the standard MC in the context of UQ. Specifically, multilevel Monte Carlo (MLMC) extending the concept of control variates achieves a significant reduction of the computational cost by performing most evaluations with low accuracy and corresponding low cost, and relatively few evaluations at high accuracy and corresponding high cost. Multifidelity Monte Carlo (MFMC) accelerates the convergence of standard Monte Carlo by generalizing the control variates with different models having varying fidelities and varying computational costs. Multimodel Monte Carlo method (MMMC), having a different setting of MLMC and MFMC, aims to address the issue of UQ and propagation when data for characterizing probability distributions are limited. Multimodel inference combined with importance sampling is proposed for quantifying and efficiently propagating the uncertainties resulting from small data sets. All of these three modern MC methods achieve a significant improvement of computational efficiency for probabilistic UQ, particularly uncertainty propagation. Finally, an algorithm summary and the corresponding code implementation are provided for each of the modern MC methods. The extension and application of these methods are discussed in detail.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Efficacy of the Cell Perturbation Method in Large-Eddy Simulations of Boundary Layer Flow over Complex Terrain

A challenge to simulating turbulent flow in multiscale atmospheric applications is the efficient generation of resolved turbulence motions over an area of interest. One approach is to apply small perturbations to flow variables near the inflow planes of turbulence-resolving simulation domains nested within larger mesoscale domains. While this approach has been examined in numerous idealized and simple terrain cases, its efficacy in complex terrain environments has not yet been fully explored. Here, we examine the benefits of the stochastic cell perturbation method (CPM) over real complex terrain using data from the 2017 Perdigão field campaign, conducted in an approximately 2-km wide valley situated between two nearly parallel ridges. Following a typical configuration for multiscale simulation using nested domains within the Weather Research and Forecasting (WRF) model to downscale from the mesoscale to a large-eddy simulation (LES), we apply the CPM on a domain with horizontal grid spacing of 150 m. At this resolution, spurious coherent structures are often observed under unstable atmospheric conditions with moderate mean wind speeds. Results from such an intermediate resolution grid are often nested down for finer, more detailed LES, where these spurious structures adversely affect the development of turbulence on the subsequent finer grid nest. We therefore examine the impacts of the CPM on the representation of turbulence within the nested LES domain under moderate mean flow conditions in three different stability regimes: weakly convective, strongly convective, and weakly stable. In addition, two different resolutions of the underlying terrain are used to explore the role of the complex topography itself in generating turbulent structures. We demonstrate that the CPM improves the representation of turbulence within the LES domain, relative to the use of high-resolution complex terrain alone. During the convective conditions, the CPM improves the rate at which smaller-scales of turbulence form, while also accelerating the attenuation of the spurious numerically generated roll structures near the inflow boundary. During stable conditions, the coarse mesh spacing of the intermediate LES domain used herein was insufficient to maintain resolved turbulence using CPM as the flow develops downstream, highlighting the need for yet higher resolution under even weakly stable conditions, and the importance of accurate representation of flow on intermediate LES grids.

17 WIND ENERGY↗
DOE OSTI2025

Discovering $\mu$Hz gravitational waves and ultra-light dark matter with binary resonances

In the presence of a weak gravitational wave (GW) background, astrophysical binary systems act as high-quality resonators, with efficient transfer of energy and momentum between the orbit and a harmonic GW leading to potentially detectable orbital perturbations. In this work, we develop and apply a novel modeling and analysis framework that describes the imprints of GWs on binary systems in a fully time-resolved manner to study the sensitivity of lunar laser ranging, satellite laser ranging, and pulsar timing to both resonant and nonresonant GW backgrounds. We demonstrate that optimal data collection, modeling, and analysis lead to projected sensitivities which are orders of magnitude better than previously appreciated possible, opening up a new possibility for probing the physics-rich but notoriously challenging to access $\mu\mathrm{Hz}$ frequency GWs. We also discuss improved prospects for the detection of the stochastic fluctuations of ultra-light dark matter, which may analogously perturb the binary orbits.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Assessments of epistemic uncertainty using Gaussian stochastic weight averaging for fluid-flow regression

Here, we use Gaussian stochastic weight averaging (SWAG) to assess the epistemic uncertainty associated with neural-network-based function approximation relevant to fluid flows. SWAG approximates a posterior Gaussian distribution of each weight, given training data, and a constant learning rate. Having access to this distribution, it is able to create multiple models with various combinations of sampled weights, which can be used to obtain ensemble predictions. The average of such an ensemble can be regarded as the 'mean estimation', whereas its standard deviation can be used to construct 'confidence intervals', which enable us to perform uncertainty quantification (UQ) with regard to the training process of neural networks. We utilize representative neural-network-based function approximation tasks for the following cases: (i) a two-dimensional circular-cylinder wake; (ii) the DayMET dataset (maximum daily temperature in North America); (iii) a three-dimensional square-cylinder wake; and (iv) urban flow, to assess the generalizability of the present idea for a wide range of complex datasets. SWAG-based UQ can be applied regardless of the network architecture, and therefore, we demonstrate the applicability of the method for two types of neural networks: (i) global field reconstruction from sparse sensors by combining convolutional neural network (CNN) and multi-layer perceptron (MLP); and (ii) far-field state estimation from sectional data with two-dimensional CNN. We find that SWAG can obtain physically-interpretable confidence-interval estimates from the perspective of epistemic uncertainty. This capability supports its use for a wide range of problems in science and engineering.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Spherical and sessile droplet dynamics by fluctuating hydrodynamics

We simulate the mesoscopic dynamics of droplets formed by phase-separated fluids at nanometer scales where thermal fluctuations are significant. Both spherical droplets fully immersed in a second fluid and sessile droplets which are also in contact with a solid surface are studied. Our model combines a Cahn–Hilliard formulation with incompressible fluctuating hydrodynamics; for sessile droplets, the fluid–solid contact angle is specified as a boundary condition. Deterministic simulations with an applied body force are used to measure the droplets' mobility from which a diffusion coefficient is obtained using the Einstein relation. Stochastic simulations are independently used to obtain a diffusion coefficient from a linear fit of the variance of a droplet's position with time. In some scenarios, these two measurements give the same value but not in the case of a spherical droplet initialized near a slip wall or in the case of sessile droplets with large contact angles (≥90°) on both slip and no-slip surfaces.

Bell, John B↗
DOE OSTI2026

Predictive Model for Starlink Maritime Performance Using Multi-Horizon RandomForest

Low Earth orbit (LEO) satellite systems have become a crucial enabler of broadband access for maritime industries, where traditional networks are unavailable. However, the high mobility of LEO constellations and constantly changing weather conditions result in unpredictable link fluctuations, limiting the ability of maritime platforms to plan bandwidth usage proactively. To the best of our knowledge, no prior work has developed a short-term predictive model for maritime LEO connectivity using real experimental field measurements. This paper proposes a data-driven forecasting model that predicts future downlink throughput using multi-horizon RandomForest regression. The model is trained using real experimental coastal measurement data incorporating recent throughput history, network-layer indicators, and environmental variables. The proposed approach reduces mean absolute error by approximately 31% compared to a persistence baseline for 15-minute horizons. It maintains a measurable improvement at 30 minutes, despite increased stochasticity. These findings confirm that proactive bandwidth awareness is feasible on maritime platforms and can effectively support operational decisions such as adaptive streaming, routing, and resource scheduling. The performance gap between forecasting horizons also highlights the need for expanded offshore datasets to improve prediction robustness under harsher maritime environments.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Risk-Constrained Reinforcement Learning for Inverter-Dominated Power System Controls

Here, this paper develops a risk-aware controller for grid-forming inverters (GFMs) to minimize large frequency oscillations in GFM inverter-dominated power systems. To tackle the high variability from loads/renewables, we incorporate a mean-variance risk constraint into the classical linear quadratic regulator (LQR) formulation for this problem. The risk constraint aims to bound the time-averaged cost of state variability and thus can improve the worst-case performance for large disturbances. The resulting risk-constrained LQR problem is solved through the dual reformulation to a minimax problem, by using a reinforcement learning (RL) method termed as stochastic gradient-descent with max-oracle (SGDmax). In particular, the zero-order policy gradient (ZOPG) approach is used to simplify the gradient estimation using simulated system trajectories. Numerical tests conducted on the IEEE 68-bus system have validated the convergence of our proposed SGDmax for GFM model and corroborate the effectiveness of the risk constraint in improving the worst-case performance while reducing the variability of the overall control cost.

Frequency control↗
DOE OSTI2025

Benders Decomposition Using Graph Modeling and Multi-Parametric Programming

Benders decomposition is a widely used method for solving large and structured optimization problems, but its performance is affected by the repeated solution of subproblems. We propose a flexible and modular algorithmic framework for accelerating Benders decomposition. Specifically, we express the problem structure by using a graph-theoretic modeling abstraction in which nodes represent optimization subproblems and edges represent connectivity between subproblems. A key innovation of our approach is that we embed multiparametric programming (mp) surrogates for node subproblems, which maps the exact analytical map of the subproblem solution space. The use of mp surrogates allows us to replace subproblem solves with fast look-ups and function evaluations for primal and dual variables during the iterative Benders process. We formally show the equivalence between classical Benders cuts and those derived from the mp solution. We implement our framework in the open-source PlasmoBenders.jl software package. To demonstrate the capabilities of the proposed framework, we apply it to a two-stage stochastic programming problem, which aims to make optimal capacity expansion decisions under market uncertainty. We evaluate both single-cut and multicut variants of Benders decomposition and show that the use of mp surrogates achieves substantial speedups in subproblem solve time, while preserving the convergence guarantees of Benders decomposition. We highlight advantages in solution analysis and interpretability that is enabled by mp critical region tracking; specifically, we show that these reveal how decisions evolve geometrically across the Benders search. Our results aim to demonstrate that combining surrogate modeling with graph modeling offers a promising and extensible foundation for structure-exploiting decomposition. In addition, by decomposing the problem into more tractable subproblems, the proposed approach also aims to overcome scalability issues of mp. Finally, the use of mp surrogates provides a unifying and modular optimization framework that enables the representation of heterogeneous node subproblems as modeling objects with a homogeneous structure.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Impact of nuclear data covariance libraries on uncertainty quantification of sodium cooled fast reactor simulation

Uncertainty quantification in core modelling to assess reactor performance is a regular practice to identify design safety limits. Best-estimate plus uncertainty (BEPU) methods are commonly used to propagate uncertainties to core responses from input parameters, characterized by variance-covariance libraries. This study evaluates the impact of different covariance libraries on the uncertainty associated with core safety parameters and their propagation through reactor transient modelling for a metallic core (ABR-1000). The COMAC-1.0, COMMARA-2.0, and COMMARA-2.1 covariance libraries are used to propagate nuclear data uncertainties to neutron feedback coefficients using the Generalized Perturbation Theory, then through transient safety analyses to establish the confidence interval for safety performance of the reactor using stochastic sampling. The considered transients include Unprotected Transient Over Power and Unprotected Loss Of Flow. Most influential nuclide and reaction pairs in different variance-covariance libraries are identified and their impact on the uncertainty of safety parameters are evaluated. Significant differences were observed between uncertainties from COMAC compared to COMMARA libraries. Uncertainties from COMMARA libraries were consistently larger than COMAC for all cases. For structure, coolant density feedback coefficients and control rod worth, total nuclear data uncertainties were approximately 50% larger for COMMARA than COMAC. Differences were also observed in identification of top contributors of uncertainty in terms of reaction-cross sections. For instance, largest contribution to total uncertainty of radial expansion coefficient from COMMARA-2.0 and 2.1 originates from Na{sup 23} P1 Elastic cross section (0.81%) but from Pu{sup 239} Fission (0.53%) with COM C-1.0. Such differences are evaluated in this research for all quantities of interest. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2021

Data From: Influence of Hydrological Perturbations and Riverbed Sediment Characteristics on Hyporheic Zone Respiration of CO2 and N-2, Journal of Geophysical Research-Biogeosciences

This data package contains pumping data (.txt), parameter matrices, and R code (.R, .RData) to perform bootstrapping for parameter selection for the bioclogging model development. The pumping data were collected from the Russian River Riverbank Filtration site located in Sonoma County, California from 2010-2017 from three riverbank collection wells located alongside the study site. The pumping data is directly correlated with water table oscillations, so the code performs these correlations and simulates stochastic versions of water table oscillations. See Metadata Description.pdf for full details on dataset production. This dataset must be used with the R programming language. This dataset and R code is associated with the publication "Influence of Hydrological Perturbations and Riverbed Sediment Characteristics on Hyporheic Zone Respiration of CO2 and N-2"This research was supported by the Jane Lewis Fellowship from the University of California, Berkeley, the Sonoma County Water Agency (SCWA), the Roy G. Post Foundation Scholarship, the U.S. Department of Energy, Office of Science Graduate Student Research (SCGSR) Program, U.S. Department of Energy, Office of Science, Office of Biological and Environmental Research under award DE-AC02-05CH11231, and the UFZ-Helmholtz Centre for Environmental Research, Leipzig, Germany.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Stellar Mass Calibrations for Local Low-mass Galaxies

The stellar masses of galaxies are measured from integrated light via several methods—however, few of these methods were designed for low-mass (M ⋆ ≲ 10 8 M ⊙ ) “dwarf” galaxies, whose properties (e.g., stochastic star formation, low metallicity) pose unique challenges for estimating stellar masses. In this work, we quantify the precision and accuracy at which stellar masses of low-mass galaxies can be recovered using UV/optical/IR photometry. We use mock observations of 469 low-mass galaxies from a variety of models, including both semi-empirical models (GRUMPY and UniverseMachine-SAGA) and cosmological baryonic zoom-in simulations (MARVELous Dwarfs and FIRE-2), to test literature color–M ⋆ /L relations and multiwavelength spectral energy distribution (SED) mass estimators. We identify a list of “best practices” for measuring stellar masses of low-mass galaxies from integrated photometry. We find that literature color–M ⋆ /L relations are often unable to capture the bursty star formation histories (SFHs) of low-mass galaxies, and we develop an updated prescription for stellar mass based on g − r color that is better able to recover stellar masses for the bursty low-mass galaxies in our sample (with ∼0.1 dex precision). SED fitting can also precisely recover stellar masses of low-mass galaxies, but this requires thoughtful choices about the form of the assumed SFH: Parametric SFHs can underestimate stellar mass by as much as ∼0.4 dex, while nonparametric SFHs recover true stellar masses with insignificant offset (−0.03 ± 0.11 dex). Finally, we also caution that noninformative (wide) dust attenuation priors may introduce M ⋆ uncertainties of up to ∼0.6 dex.

de los Reyes, Mithi A. C. [Amherst College, MA (Un↗
DOE OSTI2020

Toroidal modeling of runaway electron loss due to 3-D fields in DIII-D and COMPASS

The 3-D field induced relativistic runaway electron (RE) loss has been simulated for DIII-D, COMPASS and ITER plasmas, utilizing the MARS-F code incorporated with the recently developed and updated RE orbit module (REORBIT). Modeling shows effectively 100% loss of a post-disruption, high-current runaway beam in DIII-D, due to the 1 kG level of magnetic field perturbation produced by a fast growing n = 1 resistive kink instability. The RE loss is shown to be independent of the particle energy or the initial location of particles in the configuration space. Applied resonant magnetic perturbation (RMP) fields from in-vessel coils are not effective for RE beam mitigation in DIII-D, but do produce finite (>10%) RE loss in COMPASS, consistent with experimental observations in above two devices. The major reasons for this difference in RE control by RMP between these two devices are (i) the coil proximity to the RE beam and (ii) the effective coil current scaling versus the machine size and the toroidal magnetic field. About 10% RE loss fraction is also predicted for an ITER 15 MA scenario with pre-disruption plasma, highlighting the role of the plasma response. Up to 30% loss is computed, however, by artificially scaling the equilibrium pressure to zero. This is due to the more resistive plasma response and stronger resulting field line stochasticity. Distributions of the lost REs to the limiting surface show poloidally peaked profile near the high-field-side in both DIII-D and COMPASS, covering about 100o poloidal angle. Higher perturbation field level and/or higher particle energy also result in REs being lost to the low-field-side of the limiting surface of these two devices, increasing the effective wetted area. Finally, for the modeled ITER plasmas, the applied RMP field, with optimal poloidal spectrum that maximizes the edge localized mode control, leads to REs being lost to the lower divertor region of the limiting surface within a narrow poloidal band.

3-D field↗
DOE OSTI2024

S-OPT: A Points Selection Algorithm for Hyper-Reduction in Reduced Order Models

While projection-based reduced order models can reduce the dimension of full order solutions, the resulting reduced models may still contain terms that scale with the full order dimension. Hyper-reduction techniques are sampling-based methods that further reduce this computational complexity by approximating such terms with a much smaller dimension. The goal of this work is to introduce the points selection algorithm developed by Shin and Xiu as a hyper-reduction method. The selection algorithm was originally proposed as a stochastic collocation method for uncertainty quantification. Since the algorithm aims at maximizing a quantity $\mathcal{S}$ that measures both the column orthogonality and the determinant, we refer to the algorithm as S-OPT. Numerical examples are provided to demonstrate the performance of S-OPT and to compare its performance with a gappy proper orthogonal decomposition (POD) algorithm. Here, we found that using the S-OPT algorithm is shown to predict the full order solutions with higher accuracy than gappy POD especially when the number of sampling points is small, although we note that S-OPT shows slow asymptotic convergence with respect to the number of samples for some applications, e.g., Lagrangian hydrodynamics.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Uncertainty quantification in scientific machine learning: Methods, metrics, and comparisons

Neural networks (NNs) are currently changing the computational paradigm on how to combine data with mathematical laws in physics and engineering in a profound way, tackling challenging inverse and ill-posed problems not solvable with traditional methods. However, quantifying errors and uncertainties in NN-based inference is more complicated than in traditional methods. This is because in addition to aleatoric uncertainty associated with noisy data, there is also uncertainty due to limited data, but also due to NN hyperparameters, overparametrization, optimization and sampling errors as well as model misspecification. Although there are some recent works on uncertainty quantification (UQ) in NNs, there is no systematic investigation of suitable methods towards quantifying the total uncertainty effectively and efficiently even for function approximation, and there is even less work on solving partial differential equations and learning operator mappings between infinite-dimensional function spaces using NNs. In this work, we present a comprehensive framework that includes uncertainty modeling, new and existing solution methods, as well as evaluation metrics and post-hoc improvement approaches. Further, to demonstrate the applicability and reliability of our framework, we present an extensive comparative study in which various methods are tested on prototype problems, including problems with mixed input-output data, and stochastic problems in high dimensions. In the Appendix, we include a comprehensive description of all the UQ methods employed. Further, to help facilitate the deployment of UQ in Scientific Machine Learning research and practice, we present and develop in [1] an open-source Python library (github.com/Crunch-UQ4MI/neuraluq), termed NeuralUQ, that is accompanied by an educational tutorial and additional computational experiments.

11 physics-informed neural networks↗
DOE OSTI2020

The clustering of DESI-like luminous red galaxies using photometric redshifts

ABSTRACT We present measurements of the redshift-dependent clustering of a DESI-like luminous red galaxy (LRG) sample selected from the Legacy Survey imaging data set, and use the halo occupation distribution (HOD) framework to fit the clustering signal. The photometric LRG sample in this study contains 2.7 million objects over the redshift range of 0.4 < z < 0.9 over 5655 deg2. We have developed new photometric redshift (photo-z) estimates using the Legacy Survey DECam and WISE photometry, with σNMAD = 0.02 precision for LRGs. We compute the projected correlation function using new methods that maximize signal-to-noise ratio while incorporating redshift uncertainties. We present a novel algorithm for dividing irregular survey geometries into equal-area patches for jackknife resampling. For a five-parameter HOD model fit using the MultiDark halo catalogue, we find that there is little evolution in HOD parameters except at the highest redshifts. The inferred large-scale structure bias is largely consistent with constant clustering amplitude over time. In an appendix, we explore limitations of Markov chain Monte Carlo fitting using stochastic likelihood estimates resulting from applying HOD methods to N-body catalogues, and present a new technique for finding best-fitting parameters in this situation. Accompanying this paper, we have released the Photometric Redshifts for the Legacy Surveys catalogue of photo-z’s obtained by applying the methods used in this work to the full Legacy Survey Data Release 8 data set. This catalogue provides accurate photometric redshifts for objects with z < 21 over more than 16 000 deg2 of sky.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Release a public version of HERON (HERON 2.0) with improved algorithms for the treatment of energy storage

Integrated energy systems (IESs) are essential for decarbonizing electricity and industrial sectors and fully exploiting these systems requires sophisticated planning, scheduling, and dispatching tools to maximize their socio-economic benefits. The Holistic Energy Resource Optimization Network (HERON) is a generic software plugin for the Risk Analysis Virtual Environment (RAVEN) to perform stochastic technoeconomic analysis of IES with economic drivers. This report summarizes the updates made to HERON 2.0. Particularly, we demonstrate one of the added features, Function-based Control Mechanics, by comparing a price-based dispatch strategy with the original perfect foresight baselines. Our case studies successfully demonstrate that the model is capable to incorporate artificial control algorithm into the dispatch of IES components. In addition, our results from the price-based strategy indicate that the control strategies of IES components are key to the economic and temporal performance of our model; therefore, more sophisticated dispatch strategies are required to improve the model performance.

25 ENERGY STORAGE↗