Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stochastic models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Emergency Asset Positioning for Resilient Transmission Grid Operation

In this paper we study a problem of hurricane emergency preparedness via placement of emergency generation assets prior to its strike. We present a two-stage stochastic model for choosing locations and quantities of emergency storage to help support the power grid through a hurricane event. The expectation of losses in our two-stage model is estimated using the sample average approximation. We construct damage scenarios for sample average approximation using WIND Toolkit meteorological data and fragility curves of various electric grid components. We demonstrate the efficacy of our two-stage planning model by simulating operations during Hurricane Dolly on the 2000-bus transmission test system. Our model, coupled with our scenario selection strategy, is effective at mitigating loss of load when compared to a model without emergency generation assets placed prior to an extreme event.

emergency preparedness↗

Emergency Generation Asset Positioning for Resilient Transmission Grid Operation: Preprint

In this paper we study a problem of hurricane emergency preparedness via placement of emergency generation assets prior to its strike. We present a two-stage stochastic model for choosing locations and quantities of emergency storage to help support the power grid through a hurricane event. The expectation of losses in our two-stage model is estimated using the sample average approximation. We construct damage scenarios for sample average approximation using WIND Toolkit meteorological data and fragility curves of various electric grid components. We demonstrate the efficacy of our two-stage planning model by simulating operations during Hurricane Dolly on the 2000-bus transmission test system. Our model, coupled with our scenario selection strategy, is effective at mitigating loss of load when compared to a model without emergency generation assets placed prior to an extreme event.

emergency preparedness↗

Process Optimization

Process optimization is the discipline of adjusting a process to optimize a specified set of parameters without violating engineering constraints. This article reviews data-driven optimization methods based on genetic algorithms and stochastic models and demonstrates their use in powder-bed fusion and directed energy deposition processes. In the latter case, closed-loop feedback is used to control melt pool temperature and cooling rate in order to achieve desired microstructure.

Sprayberry, Michael↗

Risk-Averse Bi-Level Stochastic Network Interdiction Model for Cyber-Security Risk Management

Security of cyber networks is crucial; recent severe cyber-attacks have had a devastating effect on many large organizations. The attack graph, which maps the potential attack paths of a cyber network, is a popular tool for analyzing cyber system vulnerability. In this study, we propose a bi-level stochastic network interdiction model on an attack graph to enable a risk-averse, resource constrained cyber network defender to optimally deploy security countermeasures that protect against attackers with an uncertain budget. This risk- averse conditional-value-at-risk (CVaR) model minimizes a weighted sum of the expected maximum loss over all scenarios and the expected maximum loss from the most damaging attack scenarios. We develop a customized constraint and column generation algorithm to solve our model as well as several acceleration techniques to improve the computational efficiency. Numerical experiments demonstrate that the acceleration techniques enable the solution of relatively large problems within a reasonable amount of time: applying all the acceleration techniques also reduces the average computation time of the basic algorithm by 71% for 100-node graphs. Using metrics called mean-risk value of stochastic solution and value of risk-aversion, computational results suggest that our stochastic risk-averse model significantly outperforms deterministic and risk-neutral models when 1) the distribution of attacker budget is heavy-right-tailed and 2) the defender is highly risk-averse.

Bhuiyan, Tanveer H.↗

Connectivity-informed drainage network generation using deep convolution generative adversarial networks

Abstract Stochastic network modeling is often limited by high computational costs to generate a large number of networks enough for meaningful statistical evaluation. In this study, Deep Convolutional Generative Adversarial Networks (DCGANs) were applied to quickly reproduce drainage networks from the already generated network samples without repetitive long modeling of the stochastic network model, Gibb’s model. In particular, we developed a novel connectivity-informed method that converts the drainage network images to the directional information of flow on each node of the drainage network, and then transforms it into multiple binary layers where the connectivity constraints between nodes in the drainage network are stored. DCGANs trained with three different types of training samples were compared; (1) original drainage network images, (2) their corresponding directional information only, and (3) the connectivity-informed directional information. A comparison of generated images demonstrated that the novel connectivity-informed method outperformed the other two methods by training DCGANs more effectively and better reproducing accurate drainage networks due to its compact representation of the network complexity and connectivity. This work highlights that DCGANs can be applicable for high contrast images common in earth and material sciences where the network, fractures, and other high contrast features are important.

42 ENGINEERING↗

Modeling and Analysis of DC Microgrids as Stochastic Hybrid Systems

This study proposes a method of predicting the influence of random load behavior on the dynamics of dc microgrids and distribution systems. This is accomplished by combining stochastic load models and deterministic microgrid models. Together, these elements constitute a stochastic hybrid system. The resulting model enables straightforward calculation of dynamic state moments, which are used to assess the probability of desirable operating conditions. Specific consideration is given to systems based on the dual active bridge (DAB) topology. Bounds are derived for the probability of zero voltage switching (ZVS) in DAB converters. A simple example is presented to demonstrate how these bounds may be used to improve ZVS performance as an optimization problem. In conclusion, predictions of state moment dynamics and ZVS probability assessments are verified through comparisons to Monte Carlo simulations.

42 ENGINEERING↗

Stochastic Thermo-Hydro Modeling and Neural Network Surrogate Development for Thermal Resource Assessment of the Galleries-to-Calories Geobattery

The Galleries-to-Calories Geobattery concept explores the use of abandoned coal mine workings for large-scale thermal energy transport and storage. The system involves injecting waste heat from a supercomputing facility into flooded mine galleries, where groundwater flow can store and transport thermal energy for potential recovery in downgradient district heating and cooling applications. To evaluate the feasibility and performance of the Geobattery under geological and operational uncertainty, we developed a suite of stochastic thermo-hydrological (TH) simulations using Monte Carlo sampling of key uncertain parameters (e.g., permeability, porosity, thermal conductivity, specific heat capacity) and operating conditions (e.g., injection rate, injection temperature). Results identified injection rate and temperature as the most influential parameters governing thermal front propagation, while the geometry of the room-and-pillar structure played a critical role in directing the extent and orientation of thermal advancement. Optimal combinations of material properties for maximizing heat recovery were also determined. To address the high computational cost of coupled-process stochastic modeling, we trained a neural network surrogate model on 24,000 physics-based realizations, achieving an R² > 0.99 and MAE < 0.1 for temperature predictions at monitoring locations. This surrogate enabled an additional 100,000 realizations for global sensitivity analysis and probabilistic thermal resource assessment. The integrated stochastic physics–surrogate modeling framework offers a computationally efficient tool for quantifying uncertainty, identifying key drivers, and informing early-stage design decisions for Geobattery systems.

15 - GEOTHERMAL ENERGY↗

Stochastic parametric skeletal dosimetry model for humans: General approach and application to active marrow exposure from bone-seeking beta-particle emitters

The objective of this study is to develop a skeleton model for assessing active marrow dose from bone-seeking beta-emitting radionuclides. This article explains the modeling methodology which accounts for individual variability of the macro- and microstructure of bone tissue. Bone sites with active hematopoiesis are assessed by dividing them into small segments described by simple geometric shapes. Spongiosa, which fills the segments, is modeled as an isotropic three-dimensional grid (framework) of rod-like trabeculae that “run through” the bone marrow. Randomized multiple framework deformations are simulated by changing the positions of the grid nodes and the thickness of the rods. Model grid parameters are selected in accordance with the parameters of spongiosa microstructures taken from the published papers. Stochastic modeling of radiation transport in heterogeneous media simulating the distribution of bone tissue and marrow in each of the segments is performed by Monte Carlo methods. Model output for the human femur at different ages is provided as an example. The uncertainty of dosimetric characteristics associated with individual variability of bone structure was evaluated. An advantage of this methodology for the calculation of doses absorbed in the marrow from bone-seeking radionuclides is that it does not require additional studies of autopsy material. The biokinetic model results will be used in the future to calculate individual doses to members of a cohort exposed to 89,90 Sr from liquid radioactive waste discharged to the Techa River by the Mayak Production Association in 1949–1956. Further study of these unique cohorts provides an opportunity to gain more in-depth knowledge about the effects of chronic radiation on the hematopoietic system. In addition, the proposed model can be used to assess the doses to active marrow under any other scenarios of 90 Sr and 89 Sr intake to humans.

59 BASIC BIOLOGICAL SCIENCES↗

Bayesian inference of structured latent spaces from neural population activity with the orthogonal stochastic linear mixing model

The brain produces diverse functions, from perceiving sounds to producing arm reaches, through the collective activity of populations of many neurons. Determining if and how the features of these exogenous variables (e.g., sound frequency, reach angle) are reflected in population neural activity is important for understanding how the brain operates. Often, high-dimensional neural population activity is confined to low-dimensional latent spaces. However, many current methods fail to extract latent spaces that are clearly structured by exogenous variables. This has contributed to a debate about whether or not brains should be thought of as dynamical systems or representational systems. Here, we developed a new latent process Bayesian regression framework, the orthogonal stochastic linear mixing model (OSLMM) which introduces an orthogonality constraint amongst time-varying mixture coefficients, and provide Markov chain Monte Carlo inference procedures. We demonstrate superior performance of OSLMM on latent trajectory recovery in synthetic experiments and show superior computational efficiency and prediction performance on several real-world benchmark data sets. We primarily focus on demonstrating the utility of OSLMM in two neural data sets: μ ECoG recordings from rat auditory cortex during presentation of pure tones and multi-single unit recordings form monkey motor cortex during complex arm reaching. We show that OSLMM achieves superior or comparable predictive accuracy of neural data and decoding of external variables (e.g., reach velocity). Most importantly, in both experimental contexts, we demonstrate that OSLMM latent trajectories directly reflect features of the sounds and reaches, demonstrating that neural dynamics are structured by neural representations. Together, these results demonstrate that OSLMM will be useful for the analysis of diverse, large-scale biological time-series datasets.

59 BASIC BIOLOGICAL SCIENCES↗

Polynomial Chaos Surrogate Construction for Random Fields with Parametric Uncertainty

Engineering and applied science rely on computational experiments to rigorously study physical systems. The mathematical models used to probe these systems are highly complex, and sampling-intensive studies often require prohibitively many simulations for acceptable accuracy. Surrogate models provide a means of circumventing the high computational expense of sampling such complex models. In particular, polynomial chaos expansions (PCEs) have been successfully used for uncertainty quantification studies of deterministic models where the dominant source of uncertainty is parametric. We discuss an extension to conventional PCE surrogate modeling to enable surrogate construction for stochastic computational models that have intrinsic noise in addition to parametric uncertainty. We develop a PCE surrogate on a joint space of intrinsic and parametric uncertainty, enabled by Rosenblatt transformations, which are evaluated via kernel density estimation of the associated conditional cumulative distributions. Furthermore, we extend the construction to random field data via the Karhunen–Loève expansion. We then take advantage of closed-form solutions for computing PCE Sobol indices to perform a global sensitivity analysis of the model which quantifies the intrinsic noise contribution to the overall model output variance. Additionally, the resulting joint PCE is generative in the sense that it allows generating random realizations at any input parameter setting that are statistically approximately equivalent to realizations from the underlying stochastic model. The method is demonstrated on a chemical catalysis example model and a synthetic example controlled by a parameter that enables a switch from unimodal to bimodal response distributions.

97 MATHEMATICS AND COMPUTING↗

Application of Sequential Design of Experiments (SDoE) to Large Pilot-Scale Solvent-Based CO2 Capture Process at Technology Centre Mongstad (TCM)

The United States Department of Energy’s Carbon Capture Simulation for Industry Impact (CCSI2) program has developed a framework for sequential design of experiments (SDoE) that aims to maximize knowledge gained from budget- and schedule-limited pilot scale testing. SDoE was applied to the planning and execution of campaigns for testing CO2 capture systems at pilot-scale in order to optimally allocate resources available for the testing. In this methodology, a stochastic process model is developed by quantifying the parametric uncertainty in submodels of interest; for a solvent-based CO2 capture system, these may include physical properties and equipment performance submodels (e.g., mass transfer, interfacial area). This uncertainty is propagated through the full process model, over variable operating conditions, for estimating the resulting uncertainty in key model outputs (e.g., percentage of CO2 capture, solvent regeneration energy requirement). In developing a data collection plan, the predicted output uncertainty is incorporated into an algorithm that seeks simultaneously to select process operating conditions for which the predicted uncertainty is relatively high and to ensure that the entire space of operation is well represented. This test plan is then used to guide operation of the pilot plant at varying steady-state conditions, with resulting process data incorporated into the existing model using Bayesian inference to refine parameter distributions. The updated stochastic model, with reduced parametric uncertainty from data collected, is then used to guide additional data collection, thus the sequential nature of the experimental design. The SDoE process was implemented at the pilot test unit (12 MWe in scale) at Norway’s Technology Centre Mongstad (TCM) in a summer 2018 test campaign with aqueous monoethanolamine (MEA). During the test campaign, the varied operating conditions included the flowrates of circulated solvent, flue gas, and reboiler steam and the CO2 concentration in the flue gas. The process data were used to update probability distributions of mass transfer and interfacial area parameters of a stochastic process model developed by the CCSI2 team. Two iterations of the SDoE process were executed, resulting in the uncertainty in model predicted CO2 capture percentage decreasing by an average of 58.0 ± 4.7% over the full input space of interest. This work demonstrates the potential of the SDoE process for model refinement through reduction in process model parametric uncertainty, and ultimately risk in scale-up, in CO2 capture technology performance.

carbon capture↗

Stochastic Unit Commitment: Model Reduction via Learning

As weather-dependent renewable generation increases its share in the generation mix of most electric energy systems, a stochastic unit commitment becomes the natural day-ahead scheduling tool. However, such a tool is generally computationally intractable if a detailed uncertainty description is considered. Taking this into account, we proposed a learning method to make the stochastic unit commitment problem tractable. Here, recent advances in statistical learning and machine learning to address optimization problems can be advantageously applied to the rather intractable stochastic unit commitment problem. Considering these advances, we explore simple learning techniques to drastically reduce the size of a stochastic unit commitment problem without significantly altering its optimal solution. The considered stochastic unit commitment problem is formulated as a two-stage stochastic programming problem. The first stage represents commitment decisions, while the second one represents the operation conditions under different scenarios. Taking into account historical solved instances (or proxies for them), we reduce the size (measured by numbers of constraints and variables) of the stochastic unit commitment problem by (i) fixing unchanged binary variables and by (ii) eliminating inactive inequality constraints. Our numerical results show that the reduced problem generally requires significantly less time to solve while obtaining high-quality solutions, which are very close to or indistinguishable from the one obtained by solving the original problem. We use an Illinois 200-bus system to illustrate and characterize the performance of the proposed problem-reduction method.

42 ENGINEERING↗

Performant Optimization Strategies for Multifidelity Stochastic Power Grid Models

This talk goes into the algorithmic work done under the Forest project in order to solve expensive power grid models. We explore multiple fidelities of models that balance accuracy and computational expense. We use bundling strategies and progressive hedging in order to parallelize large stochastic programs.

Alfant, Rachael May [Sandia National Laboratories ↗

Developing and Testing a Novel Stochastic Ice Microphysics Parameterization for Cloud and Climate Models Using ARM Field Campaign Data (Final Progress Report)

The major goals of this project were: 1) to use field campaign measurements from DOE’s Atmospheric Radiation Measurement (ARM) program to characterize variability of important parameters describing properties of ice particles in the atmosphere; 2) based on this observational analysis, to develop a parameterization scheme for weather and climate models that stochastically varies these parameters, and implement the new scheme into a weather model called the Weather Research and Forecasting model (WRF); 3) to use WRF coupled with the new stochastic scheme to simulate ARM field campaign thunderstorm cases and analyze how accounting for this parameter variability affects the model simulations. This work was performed jointly between the National Center for Atmospheric Research, University of Oklahoma, and University of Utah. To accomplish these goals, we extended an approach previously developed to characterize the variability in the size distribution of ice particles to parameters that are explicitly represented in models (i.e., relationships between ice particle mass and size, and between particle fall velocity and size). Our project was, to our knowledge, the first to apply observationally-constrained estimates of this parameter variability describing mass-size and fall velocity-size in a modeling framework. Our results showed efficacy of the approach, evaluated using ARM observations. Similarly, to our knowledge, work in this project was the first to propose and evaluate in detail a stochastic approach for unresolved turbulent mixing in high-resolution model simulations against detailed, benchmark large eddy simulations and ARM observations. Results showed some promising behavior, particularly with increased mixing and dilution of air in thunderstorm cores with surrounding environmental air, bringing the stochastic simulations closer to the benchmark large eddy simulations; however, results were somewhat degraded using stochastic mixing compared to observations from the AMIE/DYNAMO field campaign. This project also further refined and applied a modeling methodology called “piggybacking” that can robustly separate dynamical and thermodynamic impacts of model changes, and comparison studies of different models based on cases developed from ARM observations. Finally, this project directly supported three graduate students who completed their PhDs as well as a postdoctoral research fellow.

54 ENVIRONMENTAL SCIENCES↗

Evaluating the feasibility of using downwind methods to quantify point source oil and gas emissions using continuously monitoring fence-line sensors

The dependable reporting of methane (CH 4 ) emissions from point sources, such as fugitive leaks from oil and gas infrastructure, is important for profit maximization (retaining more hydrocarbons), evaluating climate impacts, assessing CH 4 fees for regulatory programs, and validating CH 4 intensity in differentiated gas programs. Currently, there are disagreements between emissions reported by different quantification techniques for the same sources. It has been suggested that downwind CH 4 quantification methods using CH 4 measurements on the fence line of production facilities could be used to generate emission estimates from oil and gas operations at the site level, but it is currently unclear how accurate the quantified emissions are. To investigate the accuracy of downwind methods, this study uses fence-line simulated data collected during controlled-release experiments as input for a non-standard closed-path eddy covariance (EC), the Gaussian plume inverse model (GPIM), and the backward Lagrangian stochastic (bLs) model in a range of atmospheric conditions. This study's EC attempt was unsuccessful due to data collection and instrumentation issues, resulting in invalid results characterized by underestimated emissions, large negative fluxes, and cospectra/ogives that deviated from their ideal shapes. Consequently, the EC results could not be compared with the GPIM and bLS model. The bLs model demonstrated the highest accuracy for single-release single-point emissions, though it exhibited greater uncertainty than GPIM under multi-release conditions. Across the GPIM and bLs model, the most reliable quantification was achieved with 15 min averaging and a narrow 5° wind sector range. Although EC was limited in this context, future studies should consider employing a standard EC system and further optimizing GPIM and bLs approaches – particularly for complex multi-source scenarios – to enhance quantification accuracy and reduce uncertainty.

03 NATURAL GAS↗

Stochastic agent-based model for predicting turbine-scale raptor movements during updraft-subsidized directional flights

Rapid expansion of wind energy development across the world has highlighted the need to better understand turbine-caused avian mortality. The risk to golden eagles (Aquila chrysaetos) is of particular concern due to their small population size and conservation status. Golden eagles subsidize their flight in part by soaring in orographic updrafts, which can place them in conflict with wind turbines utilizing the same low-altitude wind resource. Understanding the behavior of soaring raptors in varying atmospheric conditions can therefore be relevant to predicting and mitigating their risk of collision. We present a predictive movement model that simulates individual paths of golden eagles during directional flight (such as migration) that is subsidized by orographic updraft. We modeled eagles in a 50 km by 50 km study area in Wyoming containing three wind power plants with documented golden eagle collisions with turbines. The movement model is applicable to any region where ground elevation is known at turbine scale (50 m) and wind conditions are known at facility scale (3 km). For a given set of atmospheric conditions, the model simulates movements of thousands of orographic soaring eagles to produce a density map quantifying the relative probability of eagle presence. We validated the simulated tracks with GPS telemetry data showing four directional tracks made by golden eagles transiting through the area in 2019 and 2020. For each eagle track, validation was performed using the ratio of the model-simulated eagle presence likelihood with uniform eagle presence and the presence computed using directed random-walk movements. We found that the predictive performance of the model was significantly better (likelihood ratio 1) for low-altitude movements than high-altitude movements that can involve thermal-soaring. We employed the model to produce seasonal presence maps for migrating golden eagles. We found significant turbine-level variations in eagle presence between northerly and southerly migration routes through the study area. Overall, the proposed model offers a generalizable, probabilistic, and predictive tool to assist wind energy developers, ecologists, wildlife managers, and industry consultants in estimating the potential for conflict between soaring birds and wind turbines, thereby reducing the need for site-specific data on golden eagle movements.

17 WIND ENERGY↗