Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stochastic tools”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

NREL CITIES Support (CRADA CRD-14-00558 Final Report)

The Technical University of Denmark has received a Grant from the Danish Council for Strategic Research for the project "CITIES - Centre for IT-Intelligent Energy Systems in Cities", a strategic research centre, which involves industrial partners and universities. The Alliance for Sustainable Energy, LLC will participate with DTU as an industrial partner in "CITIES" under this Cooperative Research and Development Agreement (CRADA). The Centre for IT based Intelligent Energy Systems in Cities (CITIES) Project is a Danish national research center focused on work in building short-term operational integrated energy system models that feed longer term plam1ing models, considering the spatio-temporal variations, interactions, dynamics and stochastics in the energy system, from production to consumption. CITIES will harness the extensive expertise and experience of its industrial and academic partners to conduct meaningful research with tangible outputs, including a roadmap to a fossil free future. Decision support tools will be developed to inform stakeholders of the impact of investment, control and policy measures and to identify further opportunities for energy system efficiency. Dissemination and transferring knowledge is a key value to this CRADA, and the use of results by Danish policymakers, industry and society is vital. All participants in the Centre for IT based Intelligent Energy Systems in Cities (CITIES) Project are therefore encouraged to use all means to communicate their findings to society. Wherever possible, and compatible with applicable intellectual property regulations, publications should be produced and disseminated under Open Science, Data, Source and Access principles.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Master equation emulation and coherence preservation with classical control of a superconducting qubit

Open quantum systems are a topic of intense theoretical research. The use of master equations to model a system's evolution subject to an interaction with an external environment is one of the most successful theoretical paradigms. General experimental tools to study different open system realizations have been limited, and so it is highly desirable to develop experimental tools which emulate diverse master equation dynamics and give a way to test open systems theories. In this paper we demonstrate a systematic method for engineering specific system-environment interactions and emulating master equations of a particular form using classical stochastic noise in a superconducting transmon qubit. We also demonstrate that non-Markovian noise can be used as a resource to extend the coherence of a quantum system and counteract the adversarial effects of Markovian environments.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Synthetic Electricity Market Data Generation and HERON Use Case Setup of Advanced Nuclear Reactors Coupled with Thermal Energy Storage Systems

This study evaluates and optimizes advanced nuclear reactors coupled with thermal energy storage (TES) systems in an Integrated Energy System (IES) architecture to enable advanced nuclear power plants (A NPP) to participate in multi-commodity markets, thus enhancing their economic competitiveness. Nuclear-TES coupling scenarios studied herein are designed attenuate the nuclear heat dynamics and defer energy delivery to a later time, enabling the nuclear reactor to continue operating at or near steady-state design conditions as usual while also enabling flexible generation. Three A-NPPs, namely, an advanced light-water reactor (A LWR), a high temperature gas-cooled reactor (HTGR) and a liquid-metal fast reactor (LMFR) were selected as the initial use cases for demonstrating the technoeconomic of thermally balanced energy storage coupling design for thermal power extraction. Each of the reactor technologies were evaluated in two different electricity markets. Stochastic optimization approach was adopted which included the evaluation of price signals from the Pennsylvania-New Jersey-Maryland (PJM) market, and Electric Reliability Council of Texas (ERCOT), using an autoregressive moving average (ARMA) model. Risk Analysis Virtual Environment (RAVEN) tool and its dispatch optimization plugin, the Holistic Energy Resource Optimization Network (HERON), were used to perform dispatch and capacity optimization, using the price data provided by the ARMA models. The results from the Nuclear-TES use cases will be used to design and characterize dynamic integrated system behavior and feedback.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Uncontrolled Learning: Codesign of Neuromorphic Hardware Topology for Neuromorphic Algorithms

Neuromorphic computing has the potential to revolutionize future technologies and our understanding of intelligence, yet it remains challenging to realize in practice. The learning-from-mistakes algorithm, inspired by the brain's simple learning rules of inhibition and pruning, is one of the few brain-like training methods. This algorithm is implemented in neuromorphic memristive hardware through a codesign process that evaluates essential hardware trade-offs. While the algorithm effectively trains small networks as binary classifiers and perceptrons, performance declines significantly with increasing network size unless the hardware is tailored to the algorithm. This work investigates the trade-offs between depth, controllability, and capacity—the number of learnable patterns—in neuromorphic hardware. This highlights the importance of topology and governing equations, providing theoretical tools to evaluate a device's computational capacity based on its measurements and circuit structure. The findings show that breaking neural network symmetry enhances both controllability and capacity. Additionally, by pruning the circuit, neuromorphic algorithms in all-memristive circuits can utilize stochastic resources to create local contrasts in network weights. Through combined experimental and simulation efforts, the parameters are identified that enable networks to exhibit emergent intelligence from simple rules, advancing the potential of neuromorphic computing.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

AlignOT: An Optimal Transport Based Algorithm for Fast 3D Alignment With Applications to Cryogenic Electron Microscopy Density Maps

Aligning electron density maps from Cryogenic electron microscopy (cryo-EM) is a first key step for studying multiple conformations of a biomolecule. As this step remains costly and challenging, with standard alignment tools being potentially stuck in local minima, we propose here a new procedure, called AlignOT, which relies on the use of computational optimal transport (OT) to align EM maps in 3D space. By embedding a fast estimation of OT maps within a stochastic gradient descent algorithm, our method searches for a rotation that minimizes the Wasserstein distance between two maps, represented as point clouds. Here, we quantify the impact of various parameters on the precision and accuracy of the alignment, and show that AlignOT can outperform the standard local alignment methods, with an increased range of rotation angles leading to proper alignment. We further benchmark AlignOT on various pairs of experimental maps, which account for different types of conformational heterogeneities and geometric properties. As our experiments show good performance, we anticipate that our method can be broadly applied to align 3D EM maps.

3D alignment↗

An improved Method for Determining Transient Fuel Dilution of Oil in an Internal-Combustion Engine Using Laser-Induced Florescence and Multivariate Least Square Calibration

An optical diagnostic, based on laser-induced fluorescence (LIF), has been developed for on-engine measurements of real-time fuel dilution of engine oil or fuel in oil (FIO). Fuel dilution of oil is broadly relevant to advancing engine technology including durability, calibration, and catalyst-system management, and believed to promote destructive stochastic pre-ignition (SPI) during high-load engine operations. While standard (e.g., ASTM D3524-90) methods are not capable of real-time transient measurements, the LIF technique resolves transient dilution on the minutes time scale. We have expanded on our original FIO instrument development by introducing an improved analysis based on multivariate least square chemometrics analysis. The measurement uses a fuel dye (180–1300 parts per million, by mass) and monitors for its presence in the oil using 532 nm excitation and LIF. While the original FIO instrument utilized a two-color ratio method for analysis, the improved chemometric analysis uses the fully resolved LIF dye spectra to provide better predictive FIO accuracy (>92%) over a wide FIO range (1.5–14%) typical of engine application. We also investigate the effect of oil temperature on the LIF signal. Limited engine applications for demonstrating and validating the improved FIO instrument are shown, and the related data used to quantify practical detection limit and sensitivity. The improved analysis is insensitive to laser power fluctuation and change in detector integration time, providing an excellent FIO sensitivity (1–2%) and detection limit (0.01 %FIO) over a wide range of loads and injection timings, illustrating this updated approach to be a promising tool for advancing engine technology.

42 ENGINEERING↗

On analysis and stochastic modeling of the particle kinetic energy equation in particle-laden isotropic turbulent flows

In this study, we analyze three-dimensional particle-laden, isotropic turbulence to develop an understanding of inertial particle dynamics from a kinetic energy perspective. Data trends implying inhomogeneous sampling of the flow by particles are identified and used to support a proposed particle behavior: particles appear to accumulate in regions of low flow kinetic energy over time because they lose kinetic energy and slow down in such regions, ultimately causing them to spend more time there. To elucidate this behavior, we derive a particle kinetic energy equation from the particle momentum equation, which incorporates inertial effects through the Schiller–Naumann drag correlation. Upon extracting fundamental physics from this equation, hypotheses regarding the role of the Stokes number in the temporal change of particle kinetic energy and the previously proposed particle behavior are evaluated using simulation data considering three Stokes numbers. Finally, a Fokker–Planck equation is used to derive the steady-state probability density function of the particle kinetic energy. The model fits the simulation data well and provides a tool for further investigation into understanding preferential concentration, as well as a reduced order model for predicting particle kinetic energy in turbulent flows.

42 ENGINEERING↗

Visualization of Multi-Fidelity Approximations of Stochastic Economic Dispatch

As renewable energy generation deployment increases, the operation of electrical grids becomes more complex. Economic dispatch is part of a grid operator's regular decision process where the amount of energy to generate is determined based on the number of available generators and the actual level of energy demand. Renewable generators are inherently stochastic due to the chaotic nature of weather patterns, and thus, real-time decisions of economic dispatch become increasingly complex. Modeling efforts to assist in these decisions in the highest fidelity typically take hours to days to solve on leadership-class computers; too long for the 5-minute operational time-frame demanded of operators. Alternatively, multi-fidelity approximations can be used to predict generation levels quickly and with sufficient accuracy to be used for real-time operations. We have developed a visualization tool to demonstrate the utility of multi-fidelity approximations by displaying contextual results of economic dispatch approximations, comparisons across fidelity levels of generation levels and possible failures to meet demand, and meta-data on the modeling setup.

interactive visualization↗

SoDa: An Irradiance-Based Synthetic Solar Data Generation Tool (SoDa) v0.1

SoDa is an irradiance-based synthetic Solar Data generation tool to generate realistic sub-minute solar photovoltaic (PV) power time series, that emulate the weather pattern for a certain geographical location. Our tool relies on the National Solar Radiation Database (NSRDB) to obtain irradiance and weather data patterns for the site. Irradiance is mapped onto a PV model estimate of a solar plant's 30-min power output, based on the configuration of the panel. We use a stochastic model with a switching behavior due to different weather regimes as provided by the cloud type label in the NSRDB, with parameters for the cloudy states trained on the high-resolution solar power measurements from a Phasor Measurement Unit (PMU).

Carreno, IgnacioLosada↗

GentenMPI: Distributed Memory Sparse Tensor Decomposition

GentenMPl is a toolkit of sparse canonical polyadic (CP) tensor decomposition algorithms that is designed to run effectively on distributed-memory high-performance computers. Its use of distributed-memory parallelism enables it to efficiently decompose tensors that are too large for a single compute node's memory. GentenMPl leverages Sandia's decades-long investment in the Trilinos solver framework for much of its parallel-computation capability. Trilinos contains numerical algorithms and linear algebra classes that have been optimized for parallel simulation of complex physical phenomena. This work applies these tools to the data science problem of sparse tensor decomposition. In this report, we describe the use of Trilinos in GentenMPl, extensions needed for sparse tensor decomposition, and implementations of the CP-ALS (CP via alternating least squares) and GCP-SGD (generalized CP via stochastic gradient descent) sparse tensor decomposition algorithms. We show that GentenMPl can decompose sparse tensors of extreme size, e.g., a 12.6-terabyte tensor on 8192 computer cores. We demonstrate that the Trilinos backbone provides good strong and weak scaling of the tensor decomposition algorithms.

97 MATHEMATICS AND COMPUTING↗

Stochastic reconstruction of fracture network pattern using spatial point processes

Fracture spatial patterns can strongly affect fluid flow in the subsurface. Proximity and distribution of fractures control reservoir flow behavior over various length scales. In many studies, however, simplified geometrical patterns are generated for fractures which may lead to unrealistic subsurface models. Here we introduce a new method for characterization and modeling of fracture spatial patterns based on outcrop observations. We use Ripley's K-function to characterize the arrangement of fracture barycenters and intersection points over various length scales. In addition, we use semivariograms to quantify spatial correlation in fracture intensity maps. Using this information, we develop a stochastic algorithm that generates two-dimensional fracture network realizations with spatial properties similar to those of a real fracture network measured in the field. Numerical simulation models indicate that the generated fracture realizations exhibit similar flow behaviors as that of the original fracture network. Furthermore, such modeling tools expand and improve our capability in building representative fracture models and in quantification of uncertainty in naturally and hydraulically fractured reservoirs.

58 GEOSCIENCES↗

Stochastic nonlinear analysis of unidirectional fiber composites using image-based microstructural uncertainty quantification

Here, we present a data-driven nonlinear uncertainty quantification and propagation framework to study the microstructure-induced stochastic performance of unidirectional (UD) carbon fiber reinforced polymer (CFRP) composites. The proposed approach integrates (1) microscopic image characterization, (2) stochastic microstructure reconstruction, and (3) efficient multiscale finite element simulations enabled by self-consistent clustering (SCA) analysis. To model the complex microstructural variability, the proposed UQ methods take the non-Gaussian uncertainty sources into account through a distribution-free sampling approach leveraging nonparametric and asymptotic statistical tools. A hierarchical conditional sampling strategy enables the simultaneous sampling of multiple sources of uncertainties. Our approach provides insights into the impact of microstructural variabilities, which are shown to have an increasing impact on the nonlinear responses of UD CFRP parts under progressive compression loading and ultimately on the failure rate over time. We discover that before CFRP parts start to fail, a characteristic time period emerges with distinctive uncertainty distributions specific to the microstructure variability and the probability of failure. Identifying the failure time period is crucial to the reliability prediction, which is an essential component of CFRP design.

36 MATERIALS SCIENCE↗

Machine Learning Assisted HPC Workload Trace Generation for Leadership Scale Storage Systems

Monitoring and analyzing a wide range of I/O activities in an HPC cluster is important in maintaining mission-critical performance in a large-scale, multi-user, parallel storage system. Center-wide I/O traces can provide high-level information and fine-grained activities per application or per user running in the system. Studying such large-scale traces can provide helpful insights into the system. It can be used to develop predictive methods for making predictive decisions, adjusting scheduling policies, or providing decisions for the design of next-generation systems. However, sharing real-world I/O traces to expedite such research efforts leaves a few concerns; i) the cost of sharing the large traces is expensive due to this large size, and ii) privacy concern is an issue.We address such issues by building an end-to-end machine learn- ing (ML) workflow that can generate I/O traces for large-scale HPC applications. We leverage ML based feature selection and gener- ative models for I/O trace generation. The generative models are trained on I/O traces collected by the darshan I/O characterization tool over a period of one year. We present a two-step generation process consisting of two deep-learning models, called the feature generator and the trace generator. The combination of two-step generative models provides robustness by reducing the bias of the model and accounting for the stochastic nature of the I/O traces across different runs of an application. We evaluate the performance of the generative models and show that the two-step model can generate time-series I/O traces with less than 20% root mean square error.

Paul, Arnab↗

AEOLUS: Advances in Experimental Design, Optimal Control, and Learning for Uncertain Complex Systems

Sustained advances in the mathematics of modeling and simulation have resulted in the capability today for routine simulation of a number of large scale complex DOE-relevant systems. As remarkable as this capability for solving the so-called forward problem is, it is typically only the first step-an inner loop within an outer loop that explores the simulation model's parameter space and decision space to characterize uncertainty in the model's predictions, learn unknown model parameters from data, design the most informative experiments, determine optimal control strategies, and create optimal designs. Broadly, what unifies all of these outer loop problems is that they are, in one form or another, optimization problems over parameter/control/design space that are constrained by complex uncertain models. To fully realize the power of scientific simulation as a basis for scientific discovery, technological innovation, and rational decision-making, it is imperative to move beyond simulation to tackle the outer loop of optimization for learning from data, experimental design, and control with complex uncertain models. When the models under consideration are large-scale and complex, and when the optimization variable and uncertain parameter spaces are high (or infinite) dimensional, this constitutes a grand challenge of the highest order, and is intractable with conventional methods. To overcome these challenges, the AEOLUS Center was established to develop a unified mathematical, computational, and statistical framework for (1) Learning predictive models from complex data via Bayesian inference and optimization, and (2) Optimizing experiments, processes, and designs using the resulting uncertain models. These problems are intractable with conventional methods, for several reasons: (1) The simulation problems that govern the inner loops of the optimization problems are expensive to execute (due to severe nonlinearity, heterogeneity, multiphysics/multiscale coupling); (2) The optimization variable and uncertain parameter spaces are high dimensional, often stemming from discretizations of infinite dimensional fields such as initial conditions, sources, or material properties. We argue that the key to overcoming these challenges is to develop new mathematical, computational, and statistical methods that exploit the structure of the Bayesian inference and optimization problems mediated by their underlying complex uncertain models. This structure includes the regularity, sparsity, geometry, low intrinsic dimensionality, and multifidelity nature of the maps from uncertain parameter/optimization variable spaces to the specific objectives targeted: Bayesian inference, optimal experimental design, and optimal control design. Black box methods developed as generic tools are incapable of exploiting this structure. To be successful, we must create, integrate, and cross-fertilize ideas across multiple areas of applied math--including approximation theory, Bayesian inference, data science, experimental design, information theory, machine learning, model reduction, optimal control theory, parallel algorithms, PDE-constrained optimization, randomized algorithms, stochastic optimization, and uncertainty quantification--all while exploiting the structure of the problems at hand. With this goal in mind, we have marshaled a team of leading authorities in these areas. While the methods we develop will be broadly applicable across a wide spectrum of DOE problems in which experiments inform models and the systems those models describe must be optimized under uncertainty, we have chosen a specific area, advanced manufacturing and materials, to drive our work. AMM is characterized by complex models across multiple scales, and is a rich source of challenging problems in inference, experimental design, and optimal control, requiring multifaceted and integrated advances in applied mathematics. As such, AMM serves as an excellent vehicle to motivate and demonstrate the advances in applied mathematics developed by our center.

97 MATHEMATICS AND COMPUTING↗

Survey on stochastic distribution systems: A full probability density function control theory with potential applications

Complex systems seen either in general engineering practice or economics are subjected to ever increased uncertainties that are mostly represented as random variables or parameters, and the characteristics of random variables are represented by their probability density functions (PDFs). Controlling their PDFs means to shape their stochastic distributions and in general it would provide a full treatment for system analysis and operational control and optimization. This leads to the development of stochastic distribution control (SDC) systems theory in the past decades, where the original aim of the controller design is to realize a shape control of the distributions of certain random variables in their PDFs sense for some engineering processes. Indeed, once the PDFs of these random variables or parameters are used to describe their distribution characters, the control task is to obtain control signals so that the output PDFs of stochastic systems are made to follow their target PDFs. The subject of SDC was initially originated for non-Gaussian stochastic control systems design but has found a wide spectrum of applications in general systems in terms of data-driven modeling, analysis, signal processing (filtering), data mining via multivariable statistics, decision-making (optimization) for systems subjected to uncertainties and even in economics. In this context, SDC constitutes an effective primer tool for complex system analysis, control and operational optimizations. In this review paper, a detailed survey of the developments on the research of SDC systems will be made together with their wide spectrum applications and future perspectives.

42 ENGINEERING↗

High-fidelity multiphysics load following and accidental transient modeling of microreactors using NEAMS tools: Application of NEAMS codes to perform multiphysics modeling analyses of micro-reactor concepts

The feasibility of modeling microreactors using high-fidelity models with the Nuclear Energy Advanced Modeling and Simulation (NEAMS) tools is investigated in this report. Three overarching questions guided this research: can NEAMS tools readily be applied for high-fidelity multiphysics modeling of different types of transients in microreactor designs; how accurate are the results obtained; and are improvements needed in accuracy or user experience of NEAMS tools, especially considering newly developed capabilities? This work builds upon FY-2022 work, and two microreactor concepts considering heat pipe (HP-MR) and gas-cooled (GC-MR) technologies were further analyzed using high-fidelity multiphysics simulations. The NEAMS tools considered and coupled within the MultiApp environment are Griffin for neutronics, BISON for thermo-mechanics, Sockeye for heat pipe modeling (in HP-MR), SAM for 1D Fluid – 3D solid modeling of coolant channels and system modeling of balance of plant components (in GC-MR), and the SWIFT code for hydrogen redistribution in hydride moderator. The Heat Pipe MicroReactor (HP-MR) concept was further analyzed in FY-2023 to demonstrate the stochastic TRISO failure modeling capability in BISON to check operational limits of the TRISO fuel. A new full-core Gas-Cooled MicroReactor (GC-MR) model was developed based on the initial assembly-model used in Y-2022 and used for steady-state and accidental depressurization transient simulations. Accuracy of the simulations performed was assessed through 1) verification analyses completed on the different physics with code-to-code comparison, and 2) validation of the multiphysics simulations based on modeling of the Kilopower Reactor Using Stirling Technology (KRUSTY) experiment. In FY-2023, the mesh and model of KRUSTY was updated to closely match publicly available data, and the neutronic model was verified and validated against experimental control rod worth measurements. The multiphysics model of KRUSTY was developed and used for steady-state analysis and for modeling reactivity insertion transient. The calculated power increase and stabilization agrees well with experimental data following adjustment in fuel thermal expansion coefficient. As an important component of this project, the ANL team gathered experience with a wide range of NEAMS tools: the MOOSE Mesh System, Griffin, BISON, SWIFT, Sockeye, SAM, Workbench, and the MOOSE MultiApp System, and provided assessment of new capabilities. Noteworthy are the user assessment of the “vapor-only” flow model in Sockeye and development of a multiphysics startup transient in HP-MR unit cell for use as tutorial in Sockeye. The full-core GC-MR model was used for assessment of SAM for balance of plant modeling and for demonstrating the SWIFT code capability for hydrogen redistribution modeling in multiphysics transient analyses. In this process, several bugs/issues were identified and reported to developers. Finally, the assembly GC-MR model developed in FY-2022 coupling Griffin, BISON and SAM through flow blockage and rod ejection transients was published to the National Reactor Innovation Center (NRIC) Virtual Test Bed (VTB). The Heat Pipe MicroReactor (HP-MR) concept high-fidelity multiphysics coupling of Griffin/BISON/Sockeye in load-following and heat pipe failure transients was also published on the VTB. Those submissions are enabling thorough review of these models as well as wide distribution to industry, regulator, and university users. In this analysis, several new research questions were uncovered, and follow-up analyses are recommended to further improve some models, consider additional transients, and continue development of VTB models.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Stochastic gravitational wave background from global cosmic strings

Global cosmic strings are generically predicted in particle physics beyond the Standard Model, e.g., a post-inflationary global U(1) symmetry breaking which may associate with axion-like dark matter. Here, we demonstrate that although subdominant to Goldstone emission, gravitational waves (GWs) radiated from global strings can be observable with current/future GW detectors. The frequency spectrum of such GWs is also shown to be a powerful tool to probe the Hubble expansion rate of the Universe at times prior to the Big Bang nucleosynthesis where the standard cosmology has yet to be tested.

97 MATHEMATICS AND COMPUTING↗

Classical shadows for quantum process tomography on near-term quantum computers

Quantum process tomography is a powerful tool for understanding quantum channels and characterizing the properties of quantum devices. Inspired by recent advances using classical shadows in quantum state tomography [H.-Y. Huang, R. Kueng, and J. Preskill, .], we have developed ShadowQPT, a classical shadow method for quantum process tomography. We introduce two related formulations with and without ancilla qubits. ShadowQPT stochastically reconstructs the Choi matrix of the device allowing for an classical evaluation of the device on arbitrary inputs with respect to arbitrary outputs. Using shadows, we then show how to compute overlaps, generate all k -weight reduced processes, and perform reconstruction via Hamiltonian learning. These latter two tasks are efficient for large systems as the number of quantum measurements needed scales only logarithmically with the number of qubits. A number of additional approximations and improvements are developed, including the use of a pair-factorized Clifford shadow and a series of postprocessing techniques that significantly enhance the accuracy for recovering the quantum channel. We have implemented ShadowQPT using both Pauli and Clifford measurements on the IonQ trapped ion quantum computer for quantum processes up to n = 4 qubits, and we achieved good performance. Published by the American Physical Society 2024

Levy, Ryan (ORCID:0000000349527156)↗