Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Stochastic systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 991 records · Page 55
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Resiliency in numerical algorithm design for extreme scale simulations

Here this work is based on the seminar titled ‘Resiliency in Numerical Algorithm Design for Extreme Scale Simulations’ held March 1–6, 2020, at Schloss Dagstuhl, that was attended by all the authors. Advanced supercomputing is characterized by very high computation speeds at the cost of involving an enormous amount of resources and costs. A typical large-scale computation running for 48 h on a system consuming 20 MW, as predicted for exascale systems, would consume a million kWh, corresponding to about 100k Euro in energy cost for executing 10 23 floating-point operations. It is clearly unacceptable to lose the whole computation if any of the several million parallel processes fails during the execution. Moreover, if a single operation suffers from a bit-flip error, should the whole computation be declared invalid? What about the notion of reproducibility itself: should this core paradigm of science be revised and refined for results that are obtained by large-scale simulation? Naive versions of conventional resilience techniques will not scale to the exascale regime: with a main memory footprint of tens of Petabytes, synchronously writing checkpoint data all the way to background storage at frequent intervals will create intolerable overheads in runtime and energy consumption. Forecasts show that the mean time between failures could be lower than the time to recover from such a checkpoint, so that large calculations at scale might not make any progress if robust alternatives are not investigated. More advanced resilience techniques must be devised. The key may lie in exploiting both advanced system features as well as specific application knowledge. Research will face two essential questions: (1) what are the reliability requirements for a particular computation and (2) how do we best design the algorithms and software to meet these requirements? While the analysis of use cases can help understand the particular reliability requirements, the construction of remedies is currently wide open. One avenue would be to refine and improve on system- or application-level checkpointing and rollback strategies in the case an error is detected. Developers might use fault notification interfaces and flexible runtime systems to respond to node failures in an application-dependent fashion. Novel numerical algorithms or more stochastic computational approaches may be required to meet accuracy requirements in the face of undetectable soft errors. These ideas constituted an essential topic of the seminar. The goal of this Dagstuhl Seminar was to bring together a diverse group of scientists with expertise in exascale computing to discuss novel ways to make applications resilient against detected and undetected faults. In particular, participants explored the role that algorithms and applications play in the holistic approach needed to tackle this challenge. This article gathers a broad range of perspectives on the role of algorithms, applications and systems in achieving resilience for extreme scale simulations. The ultimate goal is to spark novel ideas and encourage the development of concrete solutions for achieving such resilience holistically.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Effects of coupling a stochastic convective parameterization with the Zhang–McFarlane scheme on precipitation simulation in the DOE E3SMv1.0 atmosphere model

Abstract. A stochastic deep convection parameterization is implemented into the US Department of Energy (DOE) Energy Exascale Earth System Model (E3SM) Atmosphere Model version 1.0 (EAMv1). This study evaluates its performance in simulating precipitation. Compared to the default model, the probability distribution function (PDF) of rainfall intensity in the new simulation is greatly improved. The well-known problem of “too much light rain and too little heavy rain” is alleviated, especially over the tropics. As a result, the contribution from different rain rates to the total precipitation amount is shifted toward heavier rain. The less frequent occurrence of convection contributes to suppressed light rain, while more intense large-scale and convective precipitation contributes to enhanced heavy total rain. The synoptic and intraseasonal variabilities of precipitation are enhanced as well to be closer to observations. The sensitivity of the rainfall intensity PDF to the model vertical resolution is examined. The relationship between precipitation and dilute convective available potential energy in the stochastic simulation agrees better with that in the Atmospheric Radiation Measurement (ARM) observations compared with the standard model simulation. The annual mean precipitation is largely unchanged with the use of the stochastic scheme except over the tropical western Pacific, where a moderate increase in precipitation represents a slight improvement. The responses of precipitation and its extremes to climate warming are similar with or without the stochastic deep convection scheme.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Optimal control of coupled quantum systems based on the first-order Magnus expansion: Application to multiple dipole-dipole-coupled molecular rotors

This paper presents a method for performing approximate optimal control simulations for quantum systems with multiple coupled degrees of freedom. In this work, the time evolution is simulated using the first-order Magnus expansion in the interaction picture, where the couplings between different degrees of freedom are treated as the perturbation. A numerical implementation procedure is presented that leverages upon pairwise couplings and the separability of the zeroth-order time evolution operator to achieve a reduced computational cost, which is analyzed with respect to the number of degrees of freedom. The formulation is compatible with gradient-free methods to optimize the control field, and a stochastic hill climbing algorithm is adopted for this purpose. As illustrations, optimal control simulations are performed for systems of two and three dipole-dipole-coupled molecular rotors under the influence of a control field. For the two-rotor system, the field is optimized to achieve either orientation or entanglement objectives. For the three-rotor system, the field is optimized either to orient all three rotors in the same direction or to orient one rotor in a particular direction while the other two rotors point in the opposite direction.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

Characterization of Extremes and Compound Impacts: Applications of Machine Learning and Interpretable Neural Networks

Focal Area: This white paper responds to Focal area III by exploring data fusion, learning and explainable AI methods in characterizing hydrological extremes and interconnections. It also addresses Focal area II by using probabilistic AI and ensemble ML for predicting extremes and compound extremes. Science Challenge: A key question associated with the integrated water (or hydrological) cycle grand challenge in the Earth and Environmental Systems Sciences Division (EESSD) strategic plan, is how the frequency and intensity of hydrological events will change. Prediction of the tail behavior (extremes) of the hydrological cycle is especially challenging, because of their stochasticity and low probability. These extreme events and their compound impacts have significant societal and economic consequences. It is anticipated for the next-generation Earth System models (ESMs), that model predictability of the water cycle will improve with increased resolution (e.g., regionally refined E3SM), advanced software and computational architectures, and improved model physics based on the data from ARM measurements and high-fidelity models. However, the challenges for predictability of low-probability high-impact extreme events will unlikely be alleviated with conventional modeling and data-driven approaches, as ESMs are calibrated largely for capturing the high-frequency mean climate states. Recent AI and ML applications have shown great potential in quantifying well-defined climate extremes (e.g., supervised learning of tropical cyclones/atmospheric rivers by ClimateNet1) but few efforts are dedicated to compound events, extreme drivers and uncertainty estimation. We envision the opportunity to develop and apply ML and interpretable AI methods extended on the existing efforts, specifically, for: (1) identification of compound extremes, (2) diagnosing drivers of extremes, (3) bias correction in extreme predictions and (4) probabilistic modeling of extremes.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2016

Estimation of Optimum Stimulus Amplitude for Balance Training using Electrical Stimulation of the Vestibular System

Sensorimotor changes such as posture and gait instabilities can affect the functional performance of astronauts after gravitational transitions. Sensorimotor Adaptability (SA) training can help alleviate decrements on exposure to novel sensorimotor environments based on the concept of 'learning to learn' by exposure to varying sensory challenges during posture and locomotion tasks (Bloomberg 2015). Supra-threshold Stochastic Vestibular Stimulation (SVS) can be used to provide one of many challenges by disrupting vestibular inputs. In this scenario, the central nervous system can be trained to utilize veridical information from other sensory inputs, such as vision and somatosensory inputs, for posture and locomotion control. The minimum amplitude of SVS to simulate the effect of deterioration in vestibular inputs for preflight training or for evaluating vestibular contribution in functional tests in general, however, has not yet been identified. Few studies (MacDougall 2006; Dilda 2014) have used arbitrary but fixed maximum current amplitudes from 3 to 5 mA in the medio-lateral (ML) direction to disrupt balance function in healthy adults. Giving this high level of current amplitude to all the individuals has a risk of invoking side effects such as nausea and discomfort. The goal of this study was to determine the minimum SVS level that yields an equivalently degraded balance performance. Thirteen subjects stood on a compliant foam surface with their eyes closed and were instructed to maintain a stable upright stance. Measures of stability of the head, trunk, and whole body were quantified in the ML direction. Duration of time they could stand on the foam surface was also measured. The minimum SVS dosage was defined to be that level which significantly degraded balance performance such that any further increase in stimulation level did not lead to further balance degradation. The minimum SVS level was determined by performing linear fits on the performance variable at different stimulation levels. Results from the balance task suggest that there are inter-individual differences and the minimum SVS amplitude was found to be in the range of 1 mA to 2.5 mA across subjects. SVS resulted in an average decrement of balance task performance in the range of 62%-73% across different measured variables at the minimum SVS amplitude in comparison to the control trial (no stimulus). Training using supra-threshold SVS stimulation is one of the sensory challenges used for preflight SA training designed to improve adaptability to novel gravitational environments. Inter-individual differences in response to SVS can help customize the SA training paradigms using minimal dosage required. Another application of using SVS is to simulate acute deterioration of vestibular sensory inputs in the evaluation of tests for assessing vestibular function.

Goel, R.↗
DOE OSTI2020

Time-of-Use and Demand Charge Battery Controller Using Stochastic Model Predictive Control

Stationary batteries in residential and commercial buildings are often used to smooth customer load profiles and to lower customer electricity bills. Controllers for these battery systems should account for customer energy consumption, rate structures, and high internal battery temperatures, which can lead to reduced performance over the battery lifetime. It is important to consider the uncertainty in forecasting energy consumption and temperature, especially for customers with highly variable and uncertain loads. We propose a novel battery controller using stochastic model predictive control that accounts for these uncertainties and can handle complex rate structures, including demand charges. We show that the controller performs better than standard model predictive control when there is significant uncertainty in the forecast. We also show improvements in the performance with more accurate forecasts and with a more aggressive control strategy.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Battery Control Using Stochastic Model Predictive Control

Stationary batteries in residential and commercial buildings are often used to smooth customer load profiles and to lower customer electricity bills. Controllers for these battery systems should account for customer energy consumption, rate structures, and high internal battery temperatures, which can lead to reduced performance over the battery lifetime. It is important to consider the uncertainty in forecasting energy consumption and temperature, especially for customers with highly variable and uncertain loads. We propose a novel battery controller using stochastic model predictive control that accounts for these uncertainties and can handle complex rate structures, including demand charges. We show that the controller performs better than standard model predictive control when there is significant uncertainty in the forecast. We also show improvements in the performance with more accurate forecasts and with a more aggressive control strategy.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Simulating Open Quantum Systems Using Hamiltonian Simulations

We present a novel method to simulate the Lindblad equation, drawing on the relationship between Lindblad dynamics, stochastic differential equations, and Hamiltonian simulations. We derive a sequence of unitary dynamics in an enlarged Hilbert space that can approximate the Lindblad dynamics up to an arbitrarily high order. This unitary representation can then be simulated using a quantum circuit that involves only Hamiltonian simulation and tracing out the ancilla qubits. There is no need for additional postselection in measurement outcomes, ensuring a success probability of one at each stage. Our method can be directly generalized to the time-dependent setting. We provide numerical examples that simulate both time-independent and time-dependent Lindbladian dynamics with accuracy up to the third order. Published by the American Physical Society 2024

Ding, Zhiyan (ORCID:000000018863403X)↗
NASA NTRS1988

The influence of supernovae and passing stars on comets in the Oort cloud

It is demonstrated here that the passage of luminous stars through the Oort Cloud over the age of the solar system will subject all comets to heating episodes up to at least 16 K, and a sizeable fraction to 30 K. Stochastic supernovae have even more striking effects during monthlong events; conservative estimates of the supernovae are in the Galactic disk suggest that most comets have been heated to 45 K, and a fraction to about 60 K. These results imply that comets are not fully pristine relics of solar system formation.

Stern, S. Alan↗
NASA NTRS1984

Empirical orthogonal functions and normal modes

An attempt to provide physical insight into the empirical orthogonal function (EOF) representation of data fields by the study of fields generated by linear stochastic models is presented in this paper. In a large class of these models, the EOFs at individual Fourier frequencies coincide with the orthogonal mechanical modes of the system - provided they exist. The precise mathematical criteria for this coincidence are derived and a physical interpretation is provided. A scheme possibly useful in forecasting is formally constructed for representing any stochastic field by a linear Hermitian model forced by noise.

North, G. R.↗
DOE OSTI2024

Kubo-Anderson theory of polariton line shape

We apply the Kubo-Anderson stochastic theory of molecular spectral line shapes to the case of polaritons formed in the collective strong-coupling regime. We investigate both the fast and slow limits of the random frequency modulation of the emitter as well as the intermediate regime and show how the interplay between the characteristic timescales of the cavity and the molecular disorder is expressed in the observed polaritons line shapes. The analytical solution obtained for the slow limit is valid for any ratio between the inhomogeneous broadening of the molecules and the Rabi splitting, which is especially relevant for molecular polaritons where these two quantities can be of the same order of magnitude.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS2008

Stochastic Transport Theory for Investigating the Three-Dimensional Canopy Structure from Space Measurements

Radiation reflected from vegetation canopies exhibits high spatial variation. Satellite-borne sensors measure the mean intensities emanating from heterogeneous vegetated pixels. The theory of radiative transfer in stochastic media provides the most logical linkage between satellite observations and the three-dimensional canopy structure through a closed system of simple equations which contains the mean intensity and higher statistical moments directly as its unknowns. Although this theory has been a highly active research field in recent years, its potential for satellite remote sensing of vegetated surfaces has not been fully realized because of the lack of models of a canopy pair-correlation function that the stochastic radiative transfer equations require. The pair correlation function is defined as the probability of finding simultaneously phytoelements at two points. This paper presents analytical and Monte Carlo generated pair correlation functions. Theoretical and numerical analyses show that the spatial correlation between phytoelements is primarily responsible for the effects of the three-dimensional canopy structure on canopy reflective and absorptive properties. The pair correlation function, therefore, is the most natural and physically meaningful measure of the canopy structure over a wide range of scales. The stochastic radiative transfer equations naturally admit this measure and thus provide a powerful means to investigate the three-dimensional canopy structure from space. Canopy reflectances predicted by the stochastic equations are assessed by comparisons with the PARABOLA measurements from coniferous and broadleaf forest stands in the BOREAS Southern Study Areas. The pair correlation functions are derived from data on tree structural parameters collected during field campaigns conducted at these sites. The simulated canopy reflectances compare well with the PARABOLA data.

Huang, Dong↗
DOE OSTI2022

Modeling rarefied gas chemistry with QuiPS, a novel quasi-particle method

The goal of this work is to build up the capability of quasi-particle simulation (QuiPS), a novel flow solver, such that it can adequately model the rarefied portion of an atmospheric reentry trajectory. Direct simulation Monte Carlo (DSMC) is the conventional solver for such conditions, but struggles to resolve transient flows, trace species, and high-level internal energy states due to stochastic noise. Quasi-particle simulation (QuiPS) is a novel Boltzmann solver that describes a system with a discretized, truncated velocity distribution function. The resulting fixed-velocity, variable weight quasi-particles enable smooth variation of macroscopic properties. The distribution function description enables the use of a variance-reduced collision model, greatly minimizing expense near equilibrium. This work presents the addition of a neutral air chemistry model to QuiPS and some demonstrative 0D simulations. The explicit representation of internal distributions in QuiPS reveals some of the flaws in existing physics models. Overall, variance reduction, a key feature of QuiPS, can greatly reduce expense of multi-dimensional calculations, but is only cheaper when the gas composition is near chemical equilibrium.

42 ENGINEERING↗
DOE OSTI2022

Scalable training of graph convolutional neural networks for fast and accurate predictions of HOMO-LUMO gap in molecules

Abstract Graph Convolutional Neural Network (GCNN) is a popular class of deep learning (DL) models in material science to predict material properties from the graph representation of molecular structures. Training an accurate and comprehensive GCNN surrogate for molecular design requires large-scale graph datasets and is usually a time-consuming process. Recent advances in GPUs and distributed computing open a path to reduce the computational cost for GCNN training effectively. However, efficient utilization of high performance computing (HPC) resources for training requires simultaneously optimizing large-scale data management and scalable stochastic batched optimization techniques. In this work, we focus on building GCNN models on HPC systems to predict material properties of millions of molecules. We use HydraGNN, our in-house library for large-scale GCNN training, leveraging distributed data parallelism in PyTorch. We use ADIOS, a high-performance data management framework for efficient storage and reading of large molecular graph data. We perform parallel training on two open-source large-scale graph datasets to build a GCNN predictor for an important quantum property known as the HOMO-LUMO gap. We measure the scalability, accuracy, and convergence of our approach on two DOE supercomputers: the Summit supercomputer at the Oak Ridge Leadership Computing Facility (OLCF) and the Perlmutter system at the National Energy Research Scientific Computing Center (NERSC). We present our experimental results with HydraGNN showing (i) reduction of data loading time up to 4.2 times compared with a conventional method and (ii) linear scaling performance for training up to 1024 GPUs on both Summit and Perlmutter.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1979

Application of a hierarchical structure stochastic learning automation

A hierarchical structure automaton was developed using a two state stochastic learning automato (SLA) in a time shared model. Application of the hierarchical SLA to systems with multidimensional, multimodal performance criteria is described. Results of experiments performed with the hierarchical SLA using a performance index with a superimposed noise component of ? or - delta distributed uniformly over the surface are discussed.

Neville, R. G.↗
NASA NTRS1978

A study of parameter identification

A set of definitions for deterministic parameter identification ability were proposed. Deterministic parameter identificability properties are presented based on four system characteristics: direct parameter recoverability, properties of the system transfer function, properties of output distinguishability, and uniqueness properties of a quadratic cost functional. Stochastic parameter identifiability was defined in terms of the existence of an estimation sequence for the unknown parameters which is consistent in probability. Stochastic parameter identifiability properties are presented based on the following characteristics: convergence properties of the maximum likelihood estimate, properties of the joint probability density functions of the observations, and properties of the information matrix.

Herget, C. J.↗
NASA NTRS1985

The development of an interim generalized gate logic software simulator

A proof-of-concept computer program called IGGLOSS (Interim Generalized Gate Logic Software Simulator) was developed and is discussed. The simulator engine was designed to perform stochastic estimation of self test coverage (fault-detection latency times) of digital computers or systems. A major attribute of the IGGLOSS is its high-speed simulation: 9.5 x 1,000,000 gates/cpu sec for nonfaulted circuits and 4.4 x 1,000,000 gates/cpu sec for faulted circuits on a VAX 11/780 host computer.

Mcgough, J. G.↗