Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “STOCHASTIC PROCESSES”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Quantifying the Impacts of Grain-scale Heterogeneity on Mechanical Response

Driven by the exceedingly high computational demands of simulating mechanical response in complex engineered systems with finely resolved finite element models, there is a critical need to optimally reduce the fidelity of such simulations. The minimum required fidelity is constrained by error tolerances on the simulation results, but error bounds are often impossible to obtain a priori. One such source of error is the variability of material properties within a body due to spatially non-uniform processing conditions and inherent stochasticity in material microstructure. This study seeks to quantify the effects of microstructural heterogeneity on component- and system-scale performance to aid in the choice of an appropriate material model and spatial resolution for finite element analysis.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Development of a Physics-Based Combustion Model for Engine Knock Prediction

The objective of this project is to improve the prediction of engine knock by developing a new combustion modeling framework. Engine knock is a limiting factor to constrain the increase of fuel efficiency for spark ignition (SI) engines in most passenger cars. Efforts to increase fuel efficiency, increasing the compression ratio or downsizing, lead to the increase in the tendency of the knock occurrence. The knock is an undesired ignition of the end-gas, unburned fuel/air mixture ahead of the spark-ignited premixed flame, resulting in rapid in-cylinder pressure rises and engine damages. The combustion modeling framework developed in this project can consider turbulence-chemistry interactions during end-gas ignition, while using a reasonably detailed chemical mechanism developed for ignition and combustion reactions under engine relevant conditions, and the subtle characteristics of spark-ignited flame propagation. It is developed in the context of large eddy simulation (LES), which can capture stochastic in-cylinder processes. The developed model is incorporated into a commercial software for engine simulation, CONVERGE CFD, as a user defined function, and validated. Engine knock and knock-free experiments as well as direct numerical simulation (DNS) of end-gas ignition in homogeneous turbulence are performed to help model development and provide data sets for model validation. With further validation, the developed model is expected to advance the predictive capability for engine knock simulations and thus contribute to improving the fuel efficiency.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Arbitrarily accurate, nonparametric coarse graining with Markov renewal processes and the Mori–Zwanzig formulation

Stochastic dynamics, such as molecular dynamics, are important in many scientific applications. However, summarizing and analyzing the results of such simulations is often challenging due to the high dimension in which simulations are carried out and, consequently, due to the very large amount of data that are typically generated. Coarse graining is a popular technique for addressing this problem by providing compact and expressive representations. Coarse graining, however, potentially comes at the cost of accuracy, as dynamical information is, in general, lost when projecting the problem in a lower-dimensional space. This article shows how to eliminate coarse-graining error using two key ideas. First, we represent coarse-grained dynamics as a Markov renewal process. Second, we outline a data-driven, non-parametric Mori–Zwanzig approach for computing jump times of the renewal process. Numerical tests on a small protein illustrate the method.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Optimization of stochastic feature properties in laser powder bed fusion

Process parameter selection in laser powder bed fusion (LPBF) controls the as-printed dimensional tolerances, pore formation, surface quality and microstructure of printed metallic structures. Measuring the stochastic mechanical performance for a wide range of process parameters is cumbersome both in time and cost. As such, in this study, we overcome these hurdles by using high-throughput tensile (HTT) testing of over 250 dogbone samples to examine process-driven performance of strut-like small features, ~1 mm 2 in austenitic stainless steel (316 L). The output mechanical properties, porosity, surface roughness and dimensional accuracy were mapped across the printable range of laser powers and scan speeds using a continuous wave laser LPBF machine. Tradeoffs between ductility and strength are shown across the process space and their implications are discussed. While volumetric energy density deposited onto a substrate to create a melt-pool can be a useful metric for determining bulk properties, it was not found to directly correlate with output small feature performance.

316 L stainless steel↗
DOE OSTI2023

Uncertainty Quantification for Multiphase Computational Fluid Dynamics Closure Relations with a Physics-Informed Bayesian Approach

Multiphase Computational Fluid Dynamics (MCFD) based on the two-fluid model is considered a promising tool to model complex two-phase flow systems. MCFD simulation can predict local flow features without resolving interfacial information. As a result, the MCFD solver relies on closure relations to describe the interaction between the two phases. Those empirical or semi-mechanistic closure relations constitute a major source of uncertainty for MCFD predictions. In this paper, we leverage a physics-informed uncertainty quantification (UQ) approach to inversely quantify the closure relations’ model form uncertainty in a physically consistent manner. This proposed approach considers the model form uncertainty terms as stochastic fields that are additive to the closure relation outputs. Combining dimensionality reduction and Gaussian processes, the posterior distribution of the stochastic fields can be effectively quantified within the Bayesian framework with the support of experimental measurements. As this UQ approach is fully integrated into the MCFD solving process, the physical constraints of the system can be naturally preserved in the UQ results. Here, in a case study of adiabatic bubbly flow, we demonstrate that this UQ approach can quantify the model form uncertainty of the MCFD interfacial force closure relations, thus effectively improving the simulation results with relatively sparse data support.

42 ENGINEERING↗
DOE OSTI2024

Stochastic machine learning via sigma profiles to build a digital chemical space

This work establishes a different paradigm on digital molecular spaces and their efficient navigation by exploiting sigma profiles. To do so, the remarkable capability of Gaussian processes (GPs), a type of stochastic machine learning model, to correlate and predict physicochemical properties from sigma profiles is demonstrated, outperforming state-of-the-art neural networks previously published. The amount of chemical information encoded in sigma profiles eases the learning burden of machine learning models, permitting the training of GPs on small datasets which, due to their negligible computational cost and ease of implementation, are ideal models to be combined with optimization tools such as gradient search or Bayesian optimization (BO). Gradient search is used to efficiently navigate the sigma profile digital space, quickly converging to local extrema of target physicochemical properties. While this requires the availability of pretrained GP models on existing datasets, such limitations are eliminated with the implementation of BO, which can find global extrema with a limited number of iterations. A remarkable example of this is that of BO toward boiling temperature optimization. Holding no knowledge of chemistry except for the sigma profile and boiling temperature of carbon monoxide (the worst possible initial guess), BO finds the global maximum of the available boiling temperature dataset (over 1,000 molecules encompassing more than 40 families of organic and inorganic compounds) in just 15 iterations (i.e., 15 property measurements), cementing sigma profiles as a powerful digital chemical space for molecular optimization and discovery, particularly when little to no experimental data is initially available.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Identification of hot water end-use process of electric water heaters from energy measurements

This paper presents an algorithm for the identification of parameters for a stochastic hot water end-use process that drives a homogeneous population of thermostatically controlled electric water heaters (EWH). Usually, only metered interval consumption data (kWh) is collected and the hot water end-use process is unobservable to utility and aggregators. However, the availability of EWHs for demand response (DR) is closely coupled with the hot water end-use process. In this context, the hot water end-use process is modeled as a two-state Markov chain (Use / No use), which causes the thermostatic ON-OFF switching process to behave as a Markov renewal process (MRP). A set of first passage-time problems is developed to obtain the moments of the transition probability densities of the MRP. These problems are addressed by establishing a system of coupled partial differential equations characterizing the temperature evolution of the EWH population. A key quantity in the methodology for estimating the parameters is the total time an EWH is ON within a period of interest. It is referred to as the total busy time. Total busy time in this approach is a random variable for which analytical expressions of the moments are developed as a function of the metered window length. The latter expressions become the basis of a hot water demand model identification algorithm which is validated using agent-based simulations of EWHs.

42 ENGINEERING↗
DOE OSTI2020

Online Control of Process Variance Using Feedback

For many stochastic control problem formulations, design objectives typically include constraining the covariance of the outputs of the system. Recent engineering challenges have demonstrated an interest in controlling system output covariances to a setpoint. However, open-loop control of system output covariance can be exceptionally challenging when the system has significant plant uncertainties. This paper explores closed-loop control of the system’s output covariance using a windowed variance function. The stochastic nature of the windowed variance feedback means that root locus and other classical control design techniques cannot be immediately used. Expected value analysis is used to generate transfer functions for the average response of such systems, and the results are used to design controllers. Stochastic simulations are presented to verify the analytical results and make other observations concerning closed-loop variance control.

Bieniek, Mitchell↗
DOE OSTI2024

Advancing process-based flood frequency analysis for assessing flood hazard and population flood exposure

Recent studies have showcased the use of process-based hydrological models with Stochastic Storm Transposition (SST) techniques to conduct Flood Frequency Analysis (FFA). This framework, referred hereby FFA-SST, has proved to be a robust strategy to estimate peak flows of specific annual exceedance probability (e.g., 100-year peak flow) that can reflect natural and anthropogenic disturbances, including changes in land use and meteorological patterns. With the objective of advancing the FFA-SST framework, this study presents for the first time the use of an Integrated Surface-Subsurface Hydrological Model (ISSHM) to conduct FFA-SST by extending the analysis from peak flow responses to flood extent, enabling a unique view and analysis of flood hazard and population flood exposure at the basin scale. As a proof-of-concept, we used the ISSHM, Advanced Terrestrial Simulator (Amanzi-ATS) model, and the SST model, RainyDay, to conduct FFA-SST by simulating the flood response to 5,000 annual synthetic storm events in a 2,227 $km^2$ Southeast Texas watershed. We demonstrate that ATS, without site-specific calibration, provides a robust process-based representation of peak flows, flood extent, streamflow, evapotranspiration, soil moisture content, and water storage changes. Our results and analyses, covering frequency curves up to a 500-year return period for peak flows, basin inundation fractions, and the number of people exposed to flooding, offer a unique perspective to analyze flood impacts across spatial scales. Overall, this study provides critical insights for flood risk management by extending the FFA-SST framework to include both flood hazard and population flood exposure analyses at the basin scale. Such an approach will empower stakeholders and disaster emergency agencies with a more comprehensive understanding of flood impacts across the entire basin domain, facilitating informed decision-making for flood risk assessment and management.

58 GEOSCIENCES↗
DOE OSTI2021

Stochasticity in the Switching of Nanodisks for Probabilistic Computing

Stochasticity in magnetic nanodevices is an essential characteristic for harnessing these devices to computing based on population coding or the building blocks of probabilistic computing, p-bits. A magnetic tunneling junction (MTJ) consisting of a patterned magnetic element is considered a promising computing unit in the concept of artificial neurons and p-bits. A comprehensive understanding of the stochasticity in the switching of patterned magnetic elements is crucial for realizing MTJ-based probabilistic computing technology. In the present work, the stochastic behavior in the switching process of a perpendicularly magnetized Co/Pt disk within an array was directly observed utilizing full-field soft X-ray microscopy. Within 50 repeated hysteretic cycles, the stochastic magnetization switching of individual Co/Pt disks within disk arrays is identified. We found that the stochasticity in the magnetization switching of disks considerably depends on the disk size. The stochasticity initially decreases as the disk radius gets bigger from 125 to 375 nm (region I), then increases with further enlarging the disk size to 625 nm (region II). The variance of thermal fluctuation relevant to the disk size and the multilevel switching within a disk are severely involved in the observed size-dependent stochasticity. Furthermore, this work provides the way for controlling the stochasticity in the switching of nanopatterned elements, which is a key aspect of MTJ-based probabilistic computing.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Will Stochastic Devices Play Nice With Others in Neuromorphic Hardware?: There’s More to a Probabilistic System Than Noisy Devices

Achieving brain-like efficiency in computing requires a co-design between the development of neural algorithms, brain-inspired circuit design, and careful consideration of how to use emerging devices. The recognition that leveraging device-level noise as a source of controlled stochasticity represents an exciting prospect of achieving brain-like capabilities in probabilistic neural algorithms, but the reality of integrating stochastic devices with deterministic devices in an already-challenging neuromorphic circuit design process is formidable. Here, we explore how the brain combines different signaling modalities into its neural circuits as well as consider the implications of more tightly integrated stochastic, analog, and digital circuits. Further, by acknowledging that a fully CMOS implementation is the appropriate baseline, we conclude that if mixing modalities is going to be successful for neuromorphic computing, it will be critical that device choices consider strengths and limitations at the overall circuit level.

42 ENGINEERING↗
DOE OSTI2024

Review of In Situ Sensing for Directed Energy Deposition for Industrial Part Quality Assessment

As the use additive manufacturing (AM) processes continues to grow in critical industries, improved quality assurance methods are becoming increasingly sought after for qualification and certification of AM components. Traditional nondestructive evaluation of printed components is often unable to supply the required confidence in print quality to justify qualification and certification, but the layer-by-layer nature of AM provides unprecedented opportunities for in situ quality inspection. This document summarizes recent developments in process monitoring research specifically related to Directed Energy Deposition (DED). Particular attention is given to three aspects of the highlighted manuscripts: (1) the type of sensors used, (2) features extracted from each sensor modality, and (3) analysis of extracted features for AM quality assessment. Based on the review of the state-of-the-art, several observations have been made. First, none of the reviewed works have applied their trained models to real part geometries, with many of the works relying on single track experiments, thin-walled structures, and cubes. Similarly, there have not been any works demonstrating model generalizability, i.e., a model trained on data from one build allows for fruitful analysis of data from another build. Many works used machine learning techniques to distinguish different process regimes (i.e., normal, keyholing, lack-of-fusion), but very few papers have investigated stochastic variation in an already “optimized” process. Sensor fusion approaches are also limited in the DED sensing literature, but the few works that have employed such techniques have demonstrated the benefits. Finally, registration of in situ data to the build coordinate system is of paramount importance to producing industrially relevant in situ monitoring systems. Data registration allows direct correlations between process anomalies detected in the process monitoring data to localized departures in part quality, but such techniques are generally lacking in the current literature.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Resimulation-based self-supervised learning for pretraining physics foundation models

Self-supervised learning (SSL) is at the core of training modern large machine learning models, providing a scheme for learning powerful representations that can be used in a variety of downstream tasks. However, SSL strategies must be adapted to the type of training data and downstream tasks required. We propose resimulation-based self-supervised representation learning (RS3L), a novel simulation-based SSL strategy that employs a method of resimulation to drive data augmentation for contrastive learning in the physical sciences, particularly, in fields that rely on stochastic simulators. By intervening in the middle of the simulation process and rerunning simulation components downstream of the intervention, we generate multiple realizations of an event, thus producing a set of augmentations covering all physics-driven variations available in the simulator. Using experiments from high-energy physics, we explore how this strategy may enable the development of a foundation model; we show how RS3L pretraining enables powerful performance in downstream tasks such as discrimination of a variety of objects and uncertainty mitigation. In addition to our results, we make the RS3L dataset publicly available for further studies on how to improve SSL strategies.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Model data for Flood Frequency Analysis using Stochastic Storm Transposition and an Integrated Surface-Subsurface Hydrological Model

This archived provides scripts and input files used for the implementation of a novel approach to conduct process-based Flood Frequency Analysis using a Stochastic Storm Transposition (SST) and an Integrated Surface-Subsurface Hydrological Model (ISSHM). As a proof-of-concept, this study uses the ISSHM, Advanced Terrestrial Simulator (Amanzi-ATS) model, and the SST model, RainyDay, to conduct flood frequency analysis by simulating the flood response to 5,000 annual synthetic storm events in a ~2000 km2 Southeast Texas watershed.The Watershed Workflow package is implemented in Python3. The Jupyter notebooks can be executed through multiple open-source tools, for example, Anaconda Jupyter Lab, VS Studio Code, etc. Other data files include TXT, CSV, DAT, SBATCH, SHP, TIF, NetCDF, and HDF5 files, which can be read through Python scripts. The input files for the ATS model and RainyDay model have .XML and .SST extensions, respectively, and can be edited in any commonly used text editors.This archive contains:* Scripts and data files essential for generating the ATS model input. It uses the Watershed Workflow package to produce both mesh and ATS input files. * Jupyter notebooks designated for the ATS model evaluation, covering both long-term simulations and 40 rainfall-runoff events.* Input files required to simulate SST storm events using RainyDay.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Scalable Transmission Expansion Under Uncertainty Using Three-Stage Stochastic Optimization

The intermittent nature of renewable energy poses new challenges for power grids due to its variable and uncertain power output. These features of renewable generation are becoming more relevant to transmission planning as grids reach higher penetration levels of renewable energy. In this paper we present an approach for transmission planning based on scalable computational approaches which enable the explicit consideration of operational uncertainties in the planning process. Using three-stage stochastic programming and the progressive hedging algorithm, we compute transmission expansion decisions on a modified RTS-GMLC test system. We augment the grid with large amounts of wind generation and consider many operational scenarios subject to wind uncertainty.

multi-stage stochastic optimization↗
DOE OSTI2022

Scalable Energy System Expansion Under Uncertainty Using Multi-Stage Stochastic Optimization

The intermittent nature of renewable energy sources poses challenges for electrical grids. This is due to the variable and uncertain nature of the power output from these resources. These features of renewable generation are more relevant to energy system planning as grids reach higher penetration levels of renewable energy. We present approaches for energy system planning based on scalable computational approaches which enable explicit consideration of operational uncertainties in the planning process. Using multi-stage stochastic programming and the progressive hedging algorithm, we compute energy system expansion decisions on modified versions of the RTS-GMLC test system.

electrical↗
DOE OSTI2020

Scalable Stochastic Transmission Expansion: A Use Case for ExaSGD

The intermittent nature of renewable energy poses new challenges for power grids due to its variable and un- certain power output. These features of renewable generation are becoming more relevant to transmission planning as grids reach higher penetration levels of renewable energy. In this paper we present an approach for transmission planning based on scalable computational approaches which enable the explicit consideration of operational uncertainties in the planning process. Using three-stage stochastic programming and the progressive hedging algorithm, we compute transmission expansion decisions on a modified RTS-GMLC test system. We augment the grid with large amounts of wind generation and consider many operational scenarios subject to wind uncertainty. This is an example of a possible use of the ExaSGD security constrained AC optimal power flow solver.

Exascale Computing Project↗