Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “STOCHASTIC PROCESSES”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

High-Performance Electron Sources: Numerical Methods and Beam Dynamics at the Precision Frontier

Electron sources have a wide range of applications and there are many stakeholders that express continuing need for improvements and performance enhancements. Whether we consider ultra-cold, high-brightness, high-charge or high-average current source needs, there are some common themes from the point of view of the beam dynamics involved. These are the following ones: ability to model accurately the emission processes, including the presence of often complicated cathode and other boundary surfaces with a wide range of spatial scales; ability to deal accurately and efficiently with a large number of particles interacting pair-wise, including the stochastic part of these interactions with a wide range of spatial scales; and ability to propagate the particle distributions in time, including collisions with a wide range of temporal scales. These tasks require high precision and accuracy since the goal is usually generation, transport and preservation of very high-quality beams. This grant addressed one of the rem

43 PARTICLE ACCELERATORS↗
DOE OSTI2025

Energetic Electron Transport in Magnetized Plasma with Magnetic Islands (Final Technical Report)

The main scientific goal of this project was to investigate the interactions between energetic electrons and magnetic islands in magnetized plasmas from lab to space. The proposed plan of addressed the following specific objectives: (1) Determine if energetic electrons are trapped by magnetic islands. Specifically, test the hypothesis that energetic electrons are trapped near island O-points due to stable orbits and de-confined near island X-points due to X-point tangles. (2) Determine how electron transport changes with island width and location. Specifically, test the hypothesis that electrons are accelerated by contracting magnetic islands through a Fermi acceleration process. (3) Assess how electron transport is affected by island dynamics, including island rotation, bifurcation, and/or island overlap. Specifically, test the hypothesis that electrons are deconfined and possibly accelerated during island rotations, bifurcations, and overlap due to stochastization of the magnetic field lines.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2026

Persistent Elevated Soot Emissions Induced by Clustered Stochastic Preignition Events

Stochastic Preignition (SPI) is an abnormal combustion phenomenon that can occur in spark-ignition engines particularly under high-load operation. SPI is characterized by uncontrolled initiation of combustion prior to spark discharge, an abnormal combustion process that can lead to severe knock events and significant engine damage. SPI has been associated with fuel properties, lubricant composition, and engine design and operation. Here, in this work, a single-cylinder test engine with a dry-sump oil system was utilized to study the SPI response of E10 and E25 fuels with a range of Reid Vapor Pressure (RVP). An automated test procedure was employed, consisting of ten square-waved load profile segments, with each segment composed of 5 min of low-load operation followed by 25 min of sustained high-load operation. These tests were replicated across multiple days of testing including a lubricant triple flush between tests, and an online Fuel in Oil diagnostic measurement. Exhaust particulate emissions were continuously measured by an AVL microsoot sensor (MSS). Elevated particulate matter emissions were observed to occur concurrently with SPI events as blooms of soot. Particularly after clustered events (i.e., multiple SPI cycles occurring within 10 consecutive engine cycles), high soot emissions were observed to persist over several days of sequential operation despite daily lubricant changes, a complete warm-up procedure, and sustained low-load operation between test segments. This result implies that the particulate emissions trends may be dominated by deposit-based effects, where higher load operation is needed to alter deposition and formation processes. The observed soot blooms were also found to correspond to a reduction in the engine fueling and the fuel engine oil dilution rate despite the engine exhaust remaining at stoichiometric exhaust operation. These observations suggest that post-SPI events, pathways for lubricant migration and consumption into the combustion chamber may occur until these pathways are closed from deposit formation or ring dynamics during extended operation. These observed sooting propensity persisted with all fuels tests, but a linear correlation was observed between the summation of soot and particulate matter index (PMI) value for each fuel as well as SPI events, proving that PMI is a crucial fuel property for reducing SPI.

Splitter, Derek [Oak Ridge National Laboratory (OR↗
DOE OSTI2026

A large-scale benchmarking of deterministic and stochastic derivative-free optimization algorithms

This presentation summarizes our work in the PrOMMiS project on benchmarking of data-driven optimization algorithms and their applications in self-driving laboratories. This work supports the broader project goal of accelerating the identification of promising separation methods and operating conditions for critical minerals separation processes. We present a systematic benchmarking study of 42 data-driven optimization algorithms on a broad collection of 502 test problems. The results identify BAM, GLCCLUSTER, and MULTIMIN as the most effective optimization solvers, with BAM showing the highest overall performance and solving more than 80% of the benchmark problems. The study also shows that no single solver consistently outperforms the others across all problem types, indicating that our future laboratory applications may benefit from using a small set of strong solvers rather than relying on a single method. The presentation also illustrates an in-silico chemical reactor case study showing that data-driven optimization methods can guide autonomous experimentation in a self-driving laboratory and identify optimal operating conditions within a small number of experiments. Overall, the results provide a basis for selecting efficient optimization methods and demonstrate the practical use of data-driven optimization in self-driving laboratory workflows.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Machine Learning Guided Synthesis of Flash Graphene

Advances in nanoscience have enabled the synthesis of nanomaterials, such as graphene, from low-value or waste materials through flash Joule heating. Though this capability is promising, the complex and entangled variables that govern nanocrystal formation in the Joule heating process remain poorly understood. In this work, machine learning (ML) models are constructed to explore the factors that drive the transformation of amorphous carbon into graphene nanocrystals during flash Joule heating. An XGBoost regression model of crystallinity achieves an r 2 score of 0.8051 ± 0.054. Feature importance assays and decision trees extracted from these models reveal key considerations in the selection of starting materials and the role of stochastic current fluctuations in flash Joule heating synthesis. Furthermore, partial dependence analyses demonstrate the importance of charge and current density as predictors of crystallinity, implying a progression from reaction-limited to diffusion-limited kinetics as flash Joule heating parameters change. Finally, a practical application of the ML models is shown by using Bayesian meta-learning algorithms to automatically improve bulk crystallinity over many Joule heating reactions. Furthermore, these results illustrate the power of ML as a tool to analyze complex nanomanufacturing processes and enable the synthesis of 2D crystals with desirable properties by flash Joule heating.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2021

Attack-Resilient Weighted $\ell_{1}$ Observer with Prior Pruning

Security related questions for Cyber Physical Systems (CPS) have attracted much research attention in searching for novel methods for attack-resilient control and/or estimation. Specifically, false data injection attacks (FDIAs) have been shown to be capable of bypassing bad data detection (BDD), while arbitrarily compromising the integrity of state estimators and robust controller even with very sparse measurements corruption. Moreover, based on the inherent sparsity of pragmatic attack signals, ℓ1 -minimization scheme has been used extensively to improve the design of attack-resilient estimators. For this, the theoretical maximum for the percentage of compromised nodes that can be accommodated has been shown to be 50%. In order to guarantee correct state recoveries for larger percentage of attacked nodes, researchers have begun to incorporate prior information into the underlying resilient observer design framework. For the most pragmatic cases, this prior information is often obtained through some data-driven machine learning process. Existing results have shown strong positive correlation between the tolerated attack percentages and the precision of the prior information. In this paper, we present a pruning method to improve the precision of the prior information, given corresponding stochastic uncertainty characteristics of the underlying machine learning model. Then a weighted ℓ1 -minimization is proposed based on the pruned prior. The theoretical and simulation results show that the pruning method significantly improves the observer performance for much larger attack percentages, even when moderately accurate machine learning model used.

Resilient observer, Cyber-physical systems, prunin↗
DOE OSTI2020

Laser Powder Bed Fusion Additive Manufacturing In-Process Monitoring and Optimization Using Thermionic Emission Detection

In this project, the emission of electrons during laser powder bed fusion additive manufacturing was identified and investigated to resolve the underlying dynamics driven by laser-material interactions. Laser powder bed fusion involves the selective laser melting of metal powder particles layer by layer which fuse together forming a larger 3D structure. Laser-based additive manufacturing approaches such as laser powder bed fusion hold the potential to revolutionize manufacturing of complex metal components in the aerospace, medical, and automotive industries. However, the difficulty in producing defect-free components by metal 3D printing is a major hurdle for widespread commercial adoption. This project resolved important dynamics in laser powder bed fusion including the identification of plasma formation mechanisms, transitions between laser-induced melting modes and stochastic precursors to defect formation. These findings were realized through implementation of electronic sensing diagnostics into an existing testbed system and harnessing capabilities developed for the time dependent analysis of laser powder bed fusion datasets. Importantly, the results advance our understanding of laser-material interactions and reveal that detection of thermionic emission can also resolve information critical to optimization of the laser powder bed fusion fabrication process. The findings are critical for advancing our fundamental understanding of the laser powder bed fusion process and can help assure the requisite fidelity of fabricated components.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Mechanisms of Pacific decadal variability in ESMs: the roles of stochastic forcing, feedbacks & external forcing

This project explored how and why climate patterns in the Pacific Ocean—specifically Pacific Decadal Variability (PDV)—change over time, and how well leading Earth System Models (ESMs) capture these changes under different climate scenarios. By analyzing large climate model datasets and running new simulations, the team investigated how ocean and atmosphere processes interact to shape PDV. The study tested a leading scientific hypothesis using both simplified and complex models, helping to uncover the key mechanisms that drive long-term climate swings in the Pacific. This work improves our ability to detect, predict, and understand how human-driven climate change may influence major ocean-climate patterns in the future.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Moving the needle: Employing deep reinforcement learning to push the boundaries of coarse-grained vaccine models

Highly mutable infectious disease pathogens (hm-IDPs) such as HIV and influenza evolve faster than the human immune system can contain them, allowing them to circumvent traditional vaccination approaches and causing over one million deaths annually. Agent-based models can be used to simulate the complex interactions that occur between immune cells and hm-IDP-like proteins (antigens) during affinity maturation—the process by which antibodies evolve. Compared to existing experimental approaches, agent-based models offer a safe, low-cost, and rapid route to study the immune response to vaccines spanning a wide range of design variables. However, the highly stochastic nature of affinity maturation and vast sequence space of hm-IDPs render brute force searches intractable for exploring all pertinent vaccine design variables and the subset of immunization protocols encompassed therein. To address this challenge, we employed deep reinforcement learning to drive a recently developed agent-based model of affinity maturation to focus sampling on immunization protocols with greater potential to improve the chosen metrics of protection, namely the broadly neutralizing antibody (bnAb) titers or fraction of bnAbs produced. Using this approach, we were able to coarse-grain a wide range of vaccine design variables and explore the relevant design space. Our work offers new testable insights into how vaccines should be formulated to maximize protective immune responses to hm-IDPs and how they can be minimally tailored to account for major sources of heterogeneity in human immune responses and various socioeconomic factors. Our results indicate that the first 3 to 5 immunizations, depending on the metric of protection, should be specially tailored to achieve a robust protective immune response, but that beyond this point further immunizations require only subtle changes in formulation to sustain a durable bnAb response.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Environmental and Economic Assessments and Uncertainties of Multiple Lignocellulosic Biomass Utilization for Bioenergy Products: Case Studies

Life-cycle assessment (LCA) and techno-economic analysis (TEA) were applied to assess the economic feasibility and environmental benefits of utilizing multiple biomass feedstocks for bioenergy products under three different technological pathways with consideration of uncertainties. Three cases were studied for the production of pellets, biomass-based electricity, and pyrolysis bio-oil. A Monte Carlo simulation was used to examine the uncertainties of fossil energy consumption, bioenergy conversion efficiency, stochastic production rate, etc. The cradle-to-gate LCA results showed that pellet production had the lowest greenhouse gas (GHG) emissions, water and fossil fuels consumption (8.29 kg CO2 eq (equivalent), 0.46 kg, and 105.42 MJ, respectively). The conversion process presented a greater environmental impact for all three bioenergy products. When producing 46,929 Mg of pellets, 223,380 MWh of electricity, and 78,000 barrels of pyrolysis oil, the net present values (NPV) indicated that only pellet and electricity production were profitable with NPVs of $1.20 million for pellets, and $5.59 million for biopower. Uncertainty analysis indicated that pellet production showed the highest uncertainty in GHG emission, and bio-oil production had the least uncertainty in GHG emission but had risks producing greater-than-normal amounts of GHG. Biopower production had the highest probability to be a profitable investment with 85.23%.

09 BIOMASS FUELS↗
DOE OSTI2024

Real-Time KMC Simulation of Vacancy-Mediated Intermixing in Au@Ag Octahedral Core–Cubic Shell Nanocrystals with Ab Initio-Guided Kinetics

Utilization of core–shell rather than monometallic nanocrystals (NCs) facilitates fine-tuning of NC properties for applications. However, compositional evolution via intermixing can degrade these properties prompting recent experimental studies. We develop an atomistic-level stochastic model for vacancy-mediated intermixing exploiting a formalism which allows incorporation at an ab initio density functional theory level of not just the thermodynamics of vacancy formation, but also relevant diffusion barriers for a vast number of possible local environments (in the core and in the shell, at the interface, and in the intermixed phase). This facilitates a predictive treatment and comprehensive understanding of intermixing on the relevant time scale (e.g., 10 1 –10 3 s). In contrast, previous modeling at the atomistic level utilized only unrealistic generic prescriptions of barriers or employed simplified continuum treatments. For Au@Ag octahedral core–cubic shell NCs, our modeling not only captures the experimentally observed rate or time scale for intermixing of ~100 s at 450 °C for 60 nm NCs, but also elucidates the underlying rate controlling processes and the effective intermixing barrier.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Surrogate optimization of variational quantum circuits

Variational quantum eigensolvers are touted as a near-term algorithm capable of impacting many applications. However, the potential has not yet been realized, with few claims of quantum advantage and high resource estimates, especially due to the need for optimization in the presence of noise. Finding algorithms and methods to improve convergence is important to accelerate the capabilities of near-term hardware for VQE or more broad applications of hybrid methods in which optimization is required. To this goal, we look to use modern approaches developed in circuit simulations and stochastic classical optimization, which can be combined to form a surrogate optimization approach to quantum circuits. Using an approximate (classical CPU/GPU) state vector simulator as a surrogate model, we efficiently calculate an approximate Hessian, passed as an input for a quantum processing unit or exact circuit simulator. This method will lend itself well to parallelization across quantum processing units. We demonstrate the capabilities of such an approach with and without sampling noise and a proof-of-principle demonstration on a quantum processing unit utilizing 40 qubits.

Gustafson, Erik J. [RIACS, Mtn. View] (ORCID:00000↗
DOE OSTI2022

Scalable training of graph convolutional neural networks for fast and accurate predictions of HOMO-LUMO gap in molecules

Abstract Graph Convolutional Neural Network (GCNN) is a popular class of deep learning (DL) models in material science to predict material properties from the graph representation of molecular structures. Training an accurate and comprehensive GCNN surrogate for molecular design requires large-scale graph datasets and is usually a time-consuming process. Recent advances in GPUs and distributed computing open a path to reduce the computational cost for GCNN training effectively. However, efficient utilization of high performance computing (HPC) resources for training requires simultaneously optimizing large-scale data management and scalable stochastic batched optimization techniques. In this work, we focus on building GCNN models on HPC systems to predict material properties of millions of molecules. We use HydraGNN, our in-house library for large-scale GCNN training, leveraging distributed data parallelism in PyTorch. We use ADIOS, a high-performance data management framework for efficient storage and reading of large molecular graph data. We perform parallel training on two open-source large-scale graph datasets to build a GCNN predictor for an important quantum property known as the HOMO-LUMO gap. We measure the scalability, accuracy, and convergence of our approach on two DOE supercomputers: the Summit supercomputer at the Oak Ridge Leadership Computing Facility (OLCF) and the Perlmutter system at the National Energy Research Scientific Computing Center (NERSC). We present our experimental results with HydraGNN showing (i) reduction of data loading time up to 4.2 times compared with a conventional method and (ii) linear scaling performance for training up to 1024 GPUs on both Summit and Perlmutter.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Trustworthy Physics-Informed Deep Learning for Predictive Scientific Computing

This project has developed powerful trustworthy physics-informed deep learning (TPiDL) models and methods to fundamentally enhance the scale and power of computational modeling in the scientific and engineering domains. Deep learning (DL) has radically advanced the state-of-the-art in machine learning, computer vision, natural language processing, and also scientific computing. Nevertheless, progress has been driven almost entirely by empirical observations, hacks, and tricks. Under the support of this project, the graph operator learning tools and advanced trustworthy physical informed neural networks have been developed. In addition, stochastic gradient replica-exchange Markov Chain Monte Carlo (MCMC) sampling algorithms have been designed to quantify the uncertainties and speed up the training of large-scale neural networks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Understanding the interplay between pilot fuel mixing and auto-ignition chemistry in hydrogen-enriched environment

The diesel-piloted dual-fuel compression ignition combustion strategy is well-suited to accelerate the decarbonization of transportation by adopting hydrogen as a renewable energy carrier into the existing internal combustion engine with minimal engine modifications. Despite the simplicity of engine modification, many questions remain unanswered regarding the optimal pilot injection strategy for reliable ignition with minimum pilot fuel consumption. The present study uses a single-cylinder heavy-duty optical engine to explore the phenomenology and underlying mechanisms governing the pilot fuel ignition and the subsequent combustion of a premixed hydrogen-air charge. The engine is operated in a dual-fuel mode with hydrogen premixed into the engine intake charge with a direct pilot injection of n-heptane as a diesel pilot fuel surrogate. Optical diagnostics used to visualize in-cylinder combustion phenomena include high-speed IR imaging of the pilot fuel spray evolution as well as high-speed HCHO* and OH* chemiluminescence as indicators of low-temperature and high-temperature heat release, respectively. Three pilot injection strategies are compared to explore the effects of pilot fuel mass, injection pressure, and injection duration on the probability and repeatability of successful ignition. The thermodynamic and imaging data analysis supported by zero-dimensional chemical kinetics simulations revealed a complex interplay between the physical and chemical processes governing the pilot fuel ignition process in a hydrogen containing charge. Hydrogen strongly inhibits the ignition of pilot fuel mixtures and therefore requires longer injection duration to create zones with sufficiently high pilot fuel concentration for successful ignition. Results show that ignition typically tends to rely on stochastic pockets with high pilot fuel concentration, which results in poor repeatability of combustion and frequent misfiring. In conclusion, this work has improved the understanding on how the unique chemical properties of hydrogen pose a challenge for maximization of hydrogen’s energy share in hydrogen dual-fuel engines and highlights a potential mitigation pathway.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2025

Scalable multilevel Monte Carlo methods exploiting parallel redistribution on coarse levels

Here, we study an element agglomeration coarsening strategy that requires data redistribution at coarse levels when the number of coarse elements becomes smaller than the number of MPI processes used on the finest level. The overall procedure generates coarse elements (general unstructured unions of fine grid elements) within the framework of element-based algebraic multigrid methods (or AMGe) studied previously. The AMGe-generated coarse spaces have the ability to exhibit approximation properties of the same order as the fine-level spaces since by construction they contain the piecewise polynomials of the same order as on the fine level. These approximation properties are key for the successful use of AMGe in multilevel solvers for nonlinear partial differential equations as well as for multilevel Monte Carlo (MLMC) simulations. The ability to coarsen without being constrained by the number of MPI processes, as described in the present paper, allows to improve the scalability of these solvers as well as the overall MLMC method. The paper illustrates this latter fact with detailed scalability study of MLMC simulations applied to model Darcy equations with a stochastic log-normal permeability field.

AMGe↗
DOE OSTI2021

The Phase-Locking of Tropical North Atlantic and the Contribution of ENSO

The Tropical North Atlantic (TNA) is characterized by significant interannual variability in sea surface temperature (SST), which is phase-locked to the boreal spring. In this study, the phase-locking of TNA is investigated by adopting a linear stochastic-dynamical model (SDM) using seasonally modulated TNA feedbacks together with the seasonal modulation of ENSO forcing. In the observations, the role of local TNA feedbacks and ENSO forcing in TNA phase-locking are equivalently important with both preferring the peak of TNA variability to appear in the boreal spring. Besides, the seasonal modulation of TNA feedbacks and ENSO forcing strength are both mainly controlled by thermodynamic processes. In most climate models, the contribution of ENSO on TNA phase-locking is weaker than that in observations. The strength of ENSO-related TNA phase-locking is highly correlated with the relationship between ENSO and TNA, which is mainly determined by the amplitude of ENSO and its teleconnection patterns.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Understanding and Controlling Photoexcited Molecules in Complex Environments (Final Technical Report)

Predicting the outcome of a photochemical reaction is complicated by factors outside the scope of tradition theoretical chemistry. On such small scales, fluctuations of the environment render outcomes stochastic, nonadiabatic dynamics blur the separation between nuclear and electronic motion, and ultrafast relaxation renders typical assumptions of equilibrium inappropriate. This project aimed to elucidate and control nonadiabatic molecular dynamics in condensed phases. We developed accurate, efficient simulation tools to study irreversible molecular processes computational across a range of scales. We applied these methodological advances to study electron transfer under exotic conditions where spin and topology opened new pathways for reactivity. We also brought these ideas to bare on light harvesting systems, where energy and charge transport are coupled, and where long lifetimes can be deleterious to function. These advances helped to establish general principles for chemical efficiency and guide the design of nanoscale energy materials, molecular machines, and related technologies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗