Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stochastic models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Wind Energy Accomplishments and Year-End Performance Report: Fiscal Year 2022

Four decades ago, construction was just beginning on experimental turbines at the National Wind Technology Center (NWTC). Today, the U.S. Department of Energy's (DOE's) National Renewable Energy Laboratory (NREL) facility is the centerpiece of the laboratory's Flatirons Campus, a world-class hub for renewable energy research. The nation's shift to 100% clean electricity by 2035 will require a mix of renewable energy sources and strategies - and together, wind and solar energy could account for 60% to 80% of that clean energy resource. In Fiscal Year (FY) 2022, NREL scientists, engineers, and analysts contributed to these visionary goals through their wind energy research. As wind innovations push into new areas, NREL continues to play a vital role in advancing technology and addressing deployment barriers in pursuit of more efficient, reliable, and predictable wind energy systems. FY 2022 wind research and development explored the potential for dramatic growth in land-based systems, the launch of the nation's first commercial-scale offshore installations, and transmission infrastructure buildout. Land-based wind energy is one of the most cost-effective electricity supply options - but utility-scale deployment will require up to 10 times the current number of turbines. An NREL plan addressed this need to accelerate U.S. wind technology rollout at distributed and utility scales. Another project conducted by NREL and the Pacific Northwest National Laboratory (PNNL) helps position the nation's first major offshore wind corridor for success. The WETO-funded Atlantic Offshore Wind Transmission Study is evaluating options for balancing electricity supply and demand, while supporting resilience of the grid and marine industries. WETO, NREL, and other partners are working to enable the enormous supply chain and workforce changes the U.S. wind energy industry will need to meet net-zero-carbon-emissions targets. As part of a seminal series of DOE-funded supply chain studies, NREL analysts reported on the trade-offs involved in manufacturing large volumes of wind technologies, while addressing cost, workforce, and logistics issues. All of this research is supported by NREL's outstanding research teams, tools, data, and facilities. A WETO-funded international wind energy field campaign, the American WAKE experimeNt (AWAKEN), has brought together experts from NREL, PNNL, and Sandia National Laboratories to create the world's most comprehensive set of high-resolution data on wind energy atmospheric phenomenon. This study could lead to more accurate predictions of losses from turbine-to-turbine wake interactions, eventually helping wind plants capture more energy and operators save millions of dollars. In addition, NREL researchers developed testing, modeling, and analysis tools to improve the security of power grids by identifying wind power plant dynamic stability problems. A new Stochastic Soaring Raptor Simulator (SSRS) protects golden eagles from turbine encounters by predicting flight paths. This report provides more detail on these top achievements and other accomplishments made by NREL and its partners during FY 2022 (between October 1, 2021, and September 30, 2022).

accomplishments↗
DOE OSTI2024

Stochastic Error Cancellation in Analog Quantum Simulation

Analog quantum simulation is a promising path towards solving classically intractable problems in many-body physics on near-term quantum devices. However, the presence of noise limits the size of the system and the length of time that can be simulated. In our work, we consider an error model in which the actual Hamiltonian of the simulator differs from the target Hamiltonian we want to simulate by small local perturbations, which are assumed to be random and unbiased. We analyze the error accumulated in observables in this setting and show that, due to stochastic error cancellation, with high probability the error scales as the square root of the number of qubits instead of linearly. We explore the concentration phenomenon of this error as well as its implications for local observables in the thermodynamic limit. Moreover, we show that stochastic error cancellation also manifests in the fidelity between the target state at the end of time-evolution and the actual state we obtain in the presence of noise. This indicates that, to reach a certain fidelity, more noise can be tolerated than implied by the worst-case bound if the noise comes from many statistically independent sources.

Analog quantum simulation↗
DOE OSTI2023

Enabling site-specific well leakage risk estimation during geologic carbon sequestration using a modular deep-learning-based wellbore leakage model

Geologic carbon sequestration (GCS) is a promising technology for mitigating net carbon emissions and growing climate concern by storing CO 2 in reservoirs. Oil and gas brownfields are an attractive option for CO 2 storage, but these sites have many historical wellbores from petroleum production and can be a potential leakage pathway for CO 2 or formation brine. Therefore, risk management of GCS operations requires an assessment of potential well leakage. Due to the high uncertainty of the system, stochastic approaches are ideal for quantifying the range of risk behaviors, but they must be computationally efficient in the face of complex physics. Here, we develop a new physics-centric deep learning wellbore model to predict the leakage of CO 2 and brine through leaky wellbores. Multi-physics numerical simulations were used to generate data sets, and physics-informed features were introduced. Neural networks were optimized with an automated searching algorithm. Feature analysis quantifies the impact of each feature on model prediction and confirms the role of physics-inspired parameters. The model shows high predictive performance across a wide range of geologic and injection conditions and well attributes. In conclusion, a case study illustrates how the model is applied to assess well leakage in GCS operations.

58 GEOSCIENCES↗
DOE OSTI2020

UQ Toolkit v 2.0

The Uncertainty Quantification (UQ) Toolkit is a software library for the characterizaton and propagation of uncertainties in computational models. For the characterization of uncertainties, Bayesian inference tools are provided to infer uncertain model parameters, as well as Bayesian compressive sensing methods for discovering sparse representations of high-dimensional input-output response surfaces, and also Karhunen-Loève expansions for representing stochastic processes. Uncertain parameters are treated as random variables and represented with Polynomial Chaos expansions (PCEs). The library implements several spectral basis function types (e.g. Hermite basis functions in terms of Gaussian random variables or Legendre basis functions in terms of uniform random variables) that can be used to represent random variables with PCEs. For propagation of uncertainty, tools are provided to propagate PCEs that describe the input uncertainty through the computational model using either intrusive methods (Galerkin projection of equations onto basis functions) or non-intrusive methods (perform deterministic operation at sampled values of the random values and project the obtained results onto basis functions).

Safta, Cosmin↗
DOE OSTI2024

Adaptive tau-leaping methods for microscopic-lattice kinetic Monte Carlo simulations

Traditional Kinetic Monte Carlo (KMC) approaches, rooted in Gillespie’s stochastic simulation algorithm, become computationally demanding in systems with a large range of timescales. The goal of this work is to propose and study new adaptive lattice-KMC time integration strategies for spatially non-uniform systems. To that end, two novel adaptive tau-leaping methods and their corresponding time integration strategies are developed based on the idea of the “n-fold” direct KMC method. These strategies allow for the simultaneous execution of multiple reactions, advancing time by adaptively selected coarse increments. We present numerical experiments comparing the proposed methods with existing approaches in a catalytic surface kinetics application involving ammonia decomposition.

Bimolecular reactions↗
DOE OSTI2025

High fidelity multiphysics tightly coupled model for a lead cooled fast reactor concept and application to statistical calculation of hot channel factors

A tightly coupled multiphysics code system is established using the MOOSE framework for hot channel factor (HCF) evaluation on a Lead Fast Reactor (LFR) concept. The coupled system is driven by the Griffin multiphysics coupling capability under which the MOOSE Heat Transfer module and NekRS computational fluid dynamics solver are coupled for conjugate heat transfer using the Cardinal application. The coupled capability is demonstrated on an LFR assembly model based on materials and geometry of a prototypical lead-cooled fast reactor design by Westinghouse Electric Company, LLC. Moreover, the work integrates the Multiphysics Object Oriented Simulation Environment (MOOSE) Stochastic Tools Module (STM) to perform calculations for statistical analysis of HCF. Furthermore, the coupling strategy and workflow demonstrated in this paper is not only useful for predicting accurate hot channel factors for different kinds of advanced reactors but also for other engineering applications such as control rod worth assessment, generation of high-fidelity database for Artificial intelligence (AI)/machine learning (ML) training, design optimization and multi-resolution modeling.

Cardinal↗
DOE OSTI2022

Fast and scalable quantum Monte Carlo simulations of electron-phonon models

We introduce methodologies for highly scalable quantum Monte Carlo simulations of electron-phonon models, and report benchmark results for the Holstein model on the square lattice. The determinant quantum Monte Carlo (DQMC) method is a widely used tool for simulating simple electron-phonon models at finite temperatures, but incurs a computational cost that scales cubically with system size. Alternatively, near-linear scaling with system size can be achieved with the hybrid Monte Carlo (HMC) method and an integral representation of the Fermion determinant. Here, we introduce a collection of methodologies that make such simulations even faster. To combat "stiffness" arising from the bosonic action, we review how Fourier acceleration can be combined with time-step splitting. To overcome phonon sampling barriers associated with strongly-bound bipolaron formation, we design global Monte Carlo updates that approximately respect particle-hole symmetry. To accelerate the iterative linear solver, we introduce a preconditioner that becomes exact in the adiabatic limit of infinite atomic mass. Finally, we demonstrate how stochastic measurements can be accelerated using fast Fourier transforms. Here, these methods are all complementary and, combined, may produce multiple orders of magnitude speedup, depending on model details.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2023

Mechanisms of Pacific decadal variability in ESMs: the roles of stochastic forcing, feedbacks & external forcing

This project explored how and why climate patterns in the Pacific Ocean—specifically Pacific Decadal Variability (PDV)—change over time, and how well leading Earth System Models (ESMs) capture these changes under different climate scenarios. By analyzing large climate model datasets and running new simulations, the team investigated how ocean and atmosphere processes interact to shape PDV. The study tested a leading scientific hypothesis using both simplified and complex models, helping to uncover the key mechanisms that drive long-term climate swings in the Pacific. This work improves our ability to detect, predict, and understand how human-driven climate change may influence major ocean-climate patterns in the future.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Development of Multiresolution Capabilities for the Holistic Energy Resource Optimization Network (HERON) tool A progress update

INL researchers work on technoeconomic analyses for integrated energy systems (IES) using the Framework for Optimization of ResourCes and Economics (FORCE). Within FORCE, researchers use the Holistic Energy Resource Optimization Network (HERON) tool to conduct optimization of grid portfolios under uncertain market conditions. These optimizations determine optimal capacities for all IES components and strategies for resource dispatch which maximize some economic metric (e.g., net present value). Resource dispatch occurs on finer timescales (typically hours) and thus are asked to respond to a given time series (e.g. hourly load demand profiles for a grid, or pre-determined electricity prices). Volatile and complex bidding dynamics as well as poorly forecasted weather events within deregulated markets add uncertainty to the time series; FORCE can address this uncertainty by training a reduced order model on historical time series and generate unique synthetic time series which represent individual scenarios or realizations of the market. The IES configuration can be simulated under these different sampled realizations and a stochastic optimization is conducted which optimizes the expected value of the desired economic metric. The training of a synthetic time series generator is limited by the chosen time resolution; dynamics can occur on different time scales. Seasonal demand trends can dominate faster dynamical events (such as power outages from certain sectors or severe weather events) which might not get captured correctly by the trained model. In this report, we investigate different ways of addressing the training and generation of time series on multiple time scales using three main algorithms: wavelet decomposition, dynamic mode decomposition, and generative adversarial networks for time series. We demonstrate a time series analysis that yields information on not just the frequency space but also temporal space: where a fast Fourier transform can provide what frequencies dominate, the new algorithms can provide when the frequencies dominate as well. These analyses can help improve IES optimization by allowing researchers to couple simulations at different timescales when it is most needed - seasonal, day-ahead, and real time optimization - with greater computational efficiency. Future work will include implementation of a subset of the proposed algorithms into the FORCE toolset and application of these analyses into multiple timescale optimization.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Modeling rarefied gas chemistry with QuiPS, a novel quasi-particle method

The goal of this work is to build up the capability of quasi-particle simulation (QuiPS), a novel flow solver, such that it can adequately model the rarefied portion of an atmospheric reentry trajectory. Direct simulation Monte Carlo (DSMC) is the conventional solver for such conditions, but struggles to resolve transient flows, trace species, and high-level internal energy states due to stochastic noise. Quasi-particle simulation (QuiPS) is a novel Boltzmann solver that describes a system with a discretized, truncated velocity distribution function. The resulting fixed-velocity, variable weight quasi-particles enable smooth variation of macroscopic properties. The distribution function description enables the use of a variance-reduced collision model, greatly minimizing expense near equilibrium. This work presents the addition of a neutral air chemistry model to QuiPS and some demonstrative 0D simulations. The explicit representation of internal distributions in QuiPS reveals some of the flaws in existing physics models. Overall, variance reduction, a key feature of QuiPS, can greatly reduce expense of multi-dimensional calculations, but is only cheaper when the gas composition is near chemical equilibrium.

42 ENGINEERING↗
DOE OSTI2025

Selecting samples of galaxies with fewer Fingers-of-God

The radial positions of galaxies inferred from their measured redshift appear distorted due to their peculiar velocities. We argue that the contribution from stochastic velocities — which gives rise to `Fingers-of-God' (FoG) anisotropy in the inferred maps — does not lend itself to perturbative modelling already on scales targeted by current experiments. To get around this limitation, we propose to remove FoG using data-driven indicators of their abundance that are local in nature and thus avoid selection biases. In particular, we show that the scale where the measured power spectrum quadrupole changes sign is tightly anti-correlated with both the satellite fraction and the velocity dispersion, and can thus be used to select galaxy samples with fewer FoG. In addition, we show that excluding galaxies in haloes more massive than a given mass threshold can help to discard many of the most problematic galaxies. Such selection could be achieved in practice using maps of the thermal Sunyaev-Zel'dovich distortion of the cosmic microwave background frequency spectrum. These techniques could potentially improve reconstructions of the large-scale velocity and displacement fields from the redshift-space positions of galaxies. They may also extend the reach of perturbative models for galaxy clustering, though in practice we find only marginal gains when fitting one-loop EFTofLSS models to simulations with mitigated FoG due to the relevance of other effects entering at two-loop order.

cosmological parameters from LSS↗
DOE OSTI2022

Cosmic Coincidences of Primordial-Black-Hole Dark Matter

If primordial black holes (PBHs) contribute more than 10% of the dark matter (DM) density, their energy density today is of the same order as that of the baryons. Such a cosmic coincidence might hint at a mutual origin for the formation scenario of PBHs and the baryon asymmetry of the Universe. Baryogenesis can be triggered by a sharp transition of the rolling rate of inflaton from slow-roll to (nearly) ultraslow-roll phases that produce large curvature perturbations for PBH formation in single-field inflationary models. We show that the baryogenesis requirement drives the PBH contribution to DM, along with the inferred PBH mass range, the resulting stochastic gravitational wave background frequency window, and the associated cosmic microwave background tensor-to-scalar ratio amplitude, into potentially observable regimes.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

An Evaluation of the Economic and Resilience Benefits of a Microgrid in Northampton, Massachusetts

Recent developments and advances in distributed energy resource (DER) technologies make them valuable assets in microgrids. This paper presents an innovative evaluation framework for microgrid assets to capture economic benefits from various grid and behind-the-meter services in grid-connecting mode and resilience benefits in islanding mode. In particular, a linear programming formulation is used to model different services and DER operational constraints to determine the optimal DER dispatch to maximize economic benefits. For the resiliency analysis, a stochastic evaluation procedure is proposed to explicitly quantify the microgrid survivability against a random outage, considering uncertainties associated with photovoltaic (PV) generation, system load, and distributed generator failures. Optimal coordination strategies are developed to minimize unserved energy and improve system survivability, considering different levels of system connectedness. The proposed framework has been applied to evaluate a proposed microgrid in Northampton, Massachusetts that would link the Northampton Department of Public Works, Cooley Dickenson Hospital, and Smith Vocational Area High School. The findings of this analysis indicate that over a 20-year economic life, a 441 kW/441 kWh battery energy storage system, and 386 kW PV solar array can generate $2.5 million in present value benefits, yielding a 1.16 return on investment ratio. Results of this study also show that forming a microgrid generally improves system survivability, but the resilience performance of individual facilities varies depending on power-sharing strategies.

25 ENERGY STORAGE↗
DOE OSTI2023

Chapter 6: Abuse Response of Batteries Subjected to Mechanical Impact

Electrochemical and thermal models to simulate nominal performance and abuse response of lithium-ion cells and batteries have been reported widely in the literature. Studies on mechanical failure of cell components and how such events interact with the electrochemical and thermal response are relatively less common. This chapter outlines a framework developed under the Computer Aided Engineering for Batteries program to couple failure modes resulting from external mechanical loading to the onset and propagation of electrochemical and thermal events that follow. Starting with a scalable approach to implement failure criteria based on thermal, mechanical, and electrochemical thresholds, we highlight the practical importance of these models using case studies at the cell and module level. The chapter also highlights a few gaps in our understanding of the comprehensive response of batteries subjected to mechanical crash events, the stochastic nature of some of these failure events, and our approach to build safety maps that help improve robustness of battery design by capturing the sensitivity of some key design parameters to heat generation rates under different mitigation strategies.

abuse simulations↗
DOE OSTI2021

Robust verification of stochastic simulation codes

We introduce a robust verification tool for computational codes, which we call Stochastic Robust Extrapolation based Error Quantification (StREEQ). Unlike the prevalent Grid Convergence Index (GCI) [1] method, our approach is suitable for both stochastic and deterministic computational codes and is generalizable to any number of discretization variables. Building on ideas introduced in the Robust Verification [2] approach, we estimate the converged solution and orders of convergence with uncertainty using multiple fits of a discretization error model. In contrast to Robust Verification, we perform these fits to many bootstrap samples yielding a larger set of predictions with smoother statistics. Here, bootstrap resampling is performed on the lack-of-fit errors for deterministic code responses, and directly on the noisy data set for stochastic responses. This approach lends a degree of robustness to the overall results, capable of yielding precise verification results for sufficiently resolved data sets, and appropriately expanding the uncertainty when the data set does not support a precise result. For stochastic responses, a credibility assessment is also performed to give the analyst an indication of the trustworthiness of the results. Furthermore, this approach is suitable for both code and solution verification, and is particularly useful for solution verification of high-consequence simulations..

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

SGD-Net: Efficient Model-Based Deep Learning with Theoretical Guarantees

Deep unfolding networks have recently gained popularity for solving imaging inverse problems. However, the computational and memory complexity of data-consistency layers within traditional deep unfolding networks scales with the number of measurements, limiting their applicability to large-scale imaging inverse problems. We propose SGD-Net as a new methodology for improving the efficiency of deep unfolding through stochastic approximations of the data-consistency layers. Our theoretical analysis shows that SGD-Net can be trained to approximate batch deep unfolding networks to an arbitrary precision. Our simulations on intensity diffraction tomography and sparse-view computed tomography show that SGD-Net can match the performance of the traditional batch network at a fraction of training and testing complexity.Deep unfolding networks have recently gained popularity for solving imaging inverse problems. However, the computational and memory complexity of data-consistency layers within traditional deep unfolding networks scales with the number of measurements, limiting their applicability to large-scale imaging inverse problems. We propose SGD-Net as a new methodology for improving the efficiency of deep unfolding through stochastic approximations of the data-consistency layers. Our theoretical analysis shows that SGD-Net can be trained to approximate batch deep unfolding networks to an arbitrary precision. Our simulations on intensity diffraction tomography and sparse-view computed tomography show that SGD-Net can match the performance of the traditional batch network at a fraction of training and testing complexity.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Diffusion-Model-Assisted Supervised Learning of Generative Models for Density Estimation

Here, we present a supervised learning framework of training generative models for density estimation. Generative models, including generative adversarial networks (GANs), normalizing flows, and variational auto-encoders (VAEs), are usually considered as unsupervised learning models, because labeled data are usually unavailable for training. Despite the success of the generative models, there are several issues with the unsupervised training, e.g., requirement of reversible architectures, vanishing gradients, and training instability. To enable supervised learning in generative models, we utilize the score-based diffusion model to generate labeled data. Unlike existing diffusion models that train neural networks to learn the score function, we develop a training-free score estimation method. This approach uses mini-batch-based Monte Carlo estimators to directly approximate the score function at any spatial-temporal location in solving an ordinary differential equation (ODE), corresponding to the reverse-time stochastic differential equation (SDE). This approach can offer both high accuracy and substantial time savings in neural network training. Once the labeled data are generated, we can train a simple, fully connected neural network to learn the generative model in the supervised manner. Compared with existing normalizing flow models, our method does not require the use of reversible neural networks and avoids the computation of the Jacobian matrix. Compared with existing diffusion models, our method does not need to solve the reverse-time SDE to generate new samples. As a result, the sampling efficiency is significantly improved. We demonstrate the performance of our method by applying it to a set of 2D datasets as well as real data from the University of California Irvine (UCI) repository.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

MDLoader: A Hybrid Model-Driven Data Loader for Distributed Graph Neural Network Training

Scalable data management is essential for processing large scientific dataset on HPC platforms for distributed deep learning. In-memory distributed storage is preferred for its speed, enabling rapid, random, and frequent data access required by stochastic optimizers. Processes use one-sided or collective communication to fetch remote data, with optimal performance depending on (i) dataset characteristics, (ii) training scale, and (iii) interconnection network. Empirical analysis shows collective communication excels with larger mini-batch sizes and/or fewer processes, whereas one-sided communication outperforms at larger scales. We propose MDLoader, a hybrid in-memory data loader for distributed graph neural network training. MDLoader features a model-driven performance estimator that dynamically selects between one-sided and collective communication at the beginning of training using Tree of Parzen Estimators (TPE). Evaluations on NERSC Perlmutter and OLCF Summit show MDLoader outperforms single-backend loaders by up to 2.83 × and predicts the suitable communication method with 96.3% (Perlmutter) and 94.3% (Summit) success rate.

Bae, Jonghyun↗