Two stochastic models for simulation of correlated random processes
Mathematical models for simulation of correlated stochastic processes with stationary Gaussian properties
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Mathematical models for simulation of correlated stochastic processes with stationary Gaussian properties
Traditional Kinetic Monte Carlo (KMC) approaches, rooted in Gillespie’s stochastic simulation algorithm, become computationally demanding in systems with a large range of timescales. The goal of this work is to propose and study new adaptive lattice-KMC time integration strategies for spatially non-uniform systems. To that end, two novel adaptive tau-leaping methods and their corresponding time integration strategies are developed based on the idea of the “n-fold” direct KMC method. These strategies allow for the simultaneous execution of multiple reactions, advancing time by adaptively selected coarse increments. We present numerical experiments comparing the proposed methods with existing approaches in a catalytic surface kinetics application involving ammonia decomposition.
A stochastic simulation model has been developed using the General Purpose Simulation System (GPSS) II language to analyze the operations of a fleet of Shuttle space vehicles. This paper presents the approach used in developing the model, results obtained from some of the analyses performed to date, and an interpretation of the results as they were presented to management personnel.
With the growing use of computer modeling and simulation, in all aspects of engineering, the scope of traditional optimization has to be extended to include simulation models. Some unique aspects have to be addressed while optimizing via stochastic simulation models. The optimization procedure has to explicitly account for the randomness inherent in the stochastic measures predicted by the model. This paper outlines a general purpose framework for optimization of terminating discrete-event simulation models. The methodology combines a chance constraint approach for problem formulation, together with standard statistical estimation and analyses techniques. The applicability of the optimization framework is illustrated by minimizing the operation and support resources of a launch vehicle, through a simulation model.
We propose an algorithm for simulating stochastic relativistic fluid dynamics based on Metropolis updates. Each step of the algorithm begins with an update based on ideal hydrodynamics. This is followed by proposing random (spatial) momentum transfers between fluid cells, keeping the total energy fixed. These proposals are then accepted or rejected using the change in entropy as a statistical weight. The algorithm reproduces relativistic viscous hydrodynamics in the “density frame,” which is a formulation of viscous hydrodynamics we review and clarify here. This formulation is first order in time and requires no auxiliary dynamical fields such as Π 𝜇𝜈 . The only parameters are the shear and bulk viscosities and the equation of state. Here, by adopting the 3+1 split of general relativity, we extend the Metropolis algorithm to general space-time coordinates, such as Bjorken coordinates, which are commonly used to simulate heavy-ion collisions.
Stochastic optimization and simulation models ubiquitously arise in designing and operating complex service/engineering systems. They can be extreme in scale due to high-dimensional data and decisions, and can also involve decisions made sequentially in response to newly revealed data, both causing significant computational challenge. The objective of this research is to explore a unified framework that integrates machine learning with discrete optimization and risk-averse modeling, to improve the efficiency of decomposition paradigms for stochastic optimization and simulations at extreme scale. The models we consider represent a broad class of complex decision-making problems, where 0-1 or continuous decisions are made before and/or after knowing multiple sources of uncertainties that could be correlated. We will employ machine learning methods to dynamically decide and prioritize computational procedures, including cut generation, branching, and bounding of the optimal objective. Furthermore, the research will shed new lights on the traditional decomposition algorithms for extreme-scale computing. Deliverables of the research include new modeling and computational methods for advancing the state-of-the-art research in optimization and simulation, bringing many relevant risk-averse, data-driven optimization problems in practice within the range of tractability. Examples include distributed computing server scheduling and sensor deployment for monitoring critical infrastructures. Success in this effort will enable progress in solving multiple extreme-scale problems in the complex system design and operations arising from DoE missions in energy, environment, and national security.
The PSAM (Probabilistic Structural Analysis Methods) program is developing a probabilistic structural risk assessment capability for the SSME components. An advanced probabilistic structural analysis software system, NESSUS (Numerical Evaluation of Stochastic Structures Under Stress), is being developed as part of the PSAM effort to accurately simulate stochastic structures operating under severe random loading conditions. One of the challenges in developing the NESSUS system is the development of the probabilistic algorithms that provide both efficiency and accuracy. The main probability algorithms developed and implemented in the NESSUS system are efficient, but approximate in nature. In the last six years, the algorithms have improved very significantly.
Orientation and completion for well pairs that have been subjected to multi-zonal stimulation play a critical role in the long-term performance of an Enhanced Geothermal Reservoir. Enhanced geothermal systems often rely on preferential flow along fractures between well injection and production locations. Modeling this preferential flow using discrete fracture networks (DNF) relies on stochastic realizations of the DFN based on geological sampling. Here we present the development of a stochastic optimization methodology to determine well completion options in a discrete fracture network based on using parallel subset simulation. Stochastic optimization will provide insight into regions where placements of the injection and production wells are optimal. An example optimization of well-pair location optimization based on a deterministic-stochastic DFN model representing FORGE follows a discussion of the theory.
We introduce Catalyst.jl, a flexible and feature-filled Julia library for modeling and high-performance simulation of chemical reaction networks (CRNs). Catalyst supports simulating stochastic chemical kinetics (jump process), chemical Langevin equation (stochastic differential equation), and reaction rate equation (ordinary differential equation) representations for CRNs. Through comprehensive benchmarks, we demonstrate that Catalyst simulation runtimes are often one to two orders of magnitude faster than other popular tools. More broadly, Catalyst acts as both a domain-specific language and an intermediate representation for symbolically encoding CRN models as Julia-native objects. This enables a pipeline of symbolically specifying, analyzing, and modifying CRNs; converting Catalyst models to symbolic representations of concrete mathematical models; and generating compiled code for numerical solvers. Leveraging ModelingToolkit.jl and Symbolics.jl, Catalyst models can be analyzed, simplified, and compiled into optimized representations for use in numerical solvers. Finally, we demonstrate Catalyst’s broad extensibility and composability by highlighting how it can compose with a variety of Julia libraries, and how existing open-source biological modeling projects have extended its intermediate representation.
We simulate the mesoscopic dynamics of droplets formed by phase-separated fluids at nanometer scales where thermal fluctuations are significant. Both spherical droplets fully immersed in a second fluid and sessile droplets which are also in contact with a solid surface are studied. Our model combines a Cahn–Hilliard formulation with incompressible fluctuating hydrodynamics; for sessile droplets, the fluid–solid contact angle is specified as a boundary condition. Deterministic simulations with an applied body force are used to measure the droplets' mobility from which a diffusion coefficient is obtained using the Einstein relation. Stochastic simulations are independently used to obtain a diffusion coefficient from a linear fit of the variance of a droplet's position with time. In some scenarios, these two measurements give the same value but not in the case of a spherical droplet initialized near a slip wall or in the case of sessile droplets with large contact angles (≥90°) on both slip and no-slip surfaces.
The energetics and kinetics of phenalene and phenalenyl growth reactions were studied theoretically. Rate constants of phenalene and phenalenyl H-abstraction and C 2 H 2 addition to the formed radicals were evaluated through quantum-chemical and rate-theory calculations. The obtained values, assigned to all π radicals, were tested in deterministic and kinetic Monte Carlo simulations of aromatics growth under conditions of laminar premixed flames. Kekulé and non-Kekulé structures of the polycyclic aromatic hydrocarbons (PAHs) evolving in the stochastic simulations were identified by on-the-fly constrained optimization. The numerical results demonstrated an increased PAH growth and qualitatively reproduced experimental observations of Homann and co-workers of non-decaying PAH concentrations with nearly equal abundances of even and odd carbon-atom PAHs. The analysis revealed that the PAH growth proceeds via alternating and sterically diverse acetylene and methyl HACA additions. Furthermore, the rapid and diverse spreading in the PAH population supports a nucleation model as PAH dimerization, assisted by the non-equilibrium phenomena, forming planar aromatics first and then transitioning to the PAH–PAH stacking with size.
Self-supervised learning (SSL) is at the core of training modern large machine learning models, providing a scheme for learning powerful representations that can be used in a variety of downstream tasks. However, SSL strategies must be adapted to the type of training data and downstream tasks required. We propose resimulation-based self-supervised representation learning (RS3L), a novel simulation-based SSL strategy that employs a method of resimulation to drive data augmentation for contrastive learning in the physical sciences, particularly, in fields that rely on stochastic simulators. By intervening in the middle of the simulation process and rerunning simulation components downstream of the intervention, we generate multiple realizations of an event, thus producing a set of augmentations covering all physics-driven variations available in the simulator. Using experiments from high-energy physics, we explore how this strategy may enable the development of a foundation model; we show how RS3L pretraining enables powerful performance in downstream tasks such as discrimination of a variety of objects and uncertainty mitigation. In addition to our results, we make the RS3L dataset publicly available for further studies on how to improve SSL strategies.
Investigations were performed to predict the power available from the wind at the Goldstone, California, antenna site complex. The background for power prediction was derived from a statistical evaluation of available wind speed data records at this location and at nearby locations similarly situated within the Mojave desert. In addition to a model for power prediction over relatively long periods of time, an interim simulation model that produces sample wind speeds is described. The interim model furnishes uncorrelated sample speeds at hourly intervals that reproduce the statistical wind distribution at Goldstone. A stochastic simulation model to provide speed samples representative of both the statistical speed distributions and correlations is also discussed.
At the NASA Glenn Research Center, the primal and dual integrated force methods are being extended for the stochastic analysis of structures. The stochastic simulation can be used to quantify the consequence of scatter in stress and displacement response because of a specified variation in input parameters such as load (mechanical, thermal, and support settling loads), material properties (strength, modulus, density, etc.), and sizing design variables (depth, thickness, etc.). All the parameters are modeled as random variables with given probability distributions, means, and covariances. The stochastic response is formulated through a quadratic perturbation theory, and it is verified through a Monte Carlo simulation.
Upcoming LIGO–Virgo–KAGRA (LVK) observing runs are expected to detect a variety of inspiralling gravitational-wave (GW) events that come from black hole and neutron star binary mergers. Detection of noninspiral GW sources is also anticipated. We report the discovery of a new class of noninspiral GW sources—the end states of massive stars—that can produce the brightest simulated stochastic GW burst signal in the LVK bands known to date, and could be detectable in LVK run A+. Some dying massive stars launch bipolar relativistic jets, which inflate a turbulent energetic bubble—cocoon—inside of the star. We simulate such a system using state-of-the-art 3D general relativistic magnetohydrodynamic simulations and show that these cocoons emit quasi-isotropic GW emission in the LVK band, ~10–100 Hz, over a characteristic jet activity timescale ~10–100 s. Our first-principles simulations show that jets exhibit a wobbling behavior, in which case cocoon-powered GWs might be detected already in LVK run A+, but it is more likely that these GWs will be detected by the third-generation GW detectors with an estimated rate of ~10 events yr –1 . The detection rate drops to ~1% of that value if all jets were to feature a traditional axisymmetric structure instead of a wobble. Accompanied by electromagnetic emission from the energetic core-collapse supernova and the cocoon, we predict that collapsars are powerful multimessenger events.
INTRODUCTION DNA damage is one of the most physiologically important effects of ionizing radiation. Clustered DNA damage events, like double-strand breaks (DSBs), have the most notable biological consequences. DNA damage types depend on both the track structure of the radiation and the spatial organization of the DNA. High linear energy transfer (LET) charged nuclei, found in galactic cosmic rays (GCR), are known to produce large numbers of complex DNA damage events. The human genome is packaged into chromatin, which can take on locus-dependent and cell type-dependent spatial conformations that correspond to epigenetic states, such as more open, extended structures in transcriptionally active chromatin. These epigenetic differences can affect DNA break patterns in response to ionizing radiation, potentially creating distinct DNA repair and signaling outcomes across the genome in different cells. MATERIAL AND METHODS The code RITRACKS (Relativistic Ion Tracks), which simulates stochastic radiation track structures and radiation chemistry, was used to model damage on isolated and histone-bound DNA by various types of ions and photons. The changes made to the code to perform radiation-induced DNA damage, and simulation results on single nucleosomes are given in our recent paper. In this work, the DNA building capabilities of RITRACKS have been extended to simulate more complex DNA structures build on the coarse-grain simulation framework meso-WLCsim. This code can sample generic chromatin fiber conformation ensembles based on the geometry of nucleosomes and mechanical properties of DNA. Using RITRACKS, we simulated the fragment length distributions (FLD) of irradiated DNA structures built using the chromatin conformations of WLCsim and obtained results representative of those obtained with Radiation-Induced Correlated Cleavage with sequencing (RICC-Seq) experiments [6]. We have also performed Fe ion and photon irradiations of K562, IMR90, BJ and RPE-1 cells at NSRL to experimentally validate results. Sample processing and data analysis are in progress and any available preliminary results will be discussed. DISCUSSION The recent updates in the code RITRACKS allow the calculation of several quantities such as the DNA damage yield and the FLD. This approach can be used to model epigenetic state-specific chromatin structure parameters to leverage the epigenetic state data available for many human cell types to infer relative DNA damage sensitivity among genomic loci.
The Global Reference Atmospheric Model was improved to produce more realistic simulations of vertical profiles of atmospheric parameters. A revised two scale random perturbation model using perturbation magnitudes which are adjusted to conform to constraints imposed by the perfect gas law and the hydrostatic condition is described. The two scale perturbation model produces appropriately correlated (horizontally and vertically) small scale and large scale perturbations. These stochastically simulated perturbations are representative of the magnitudes and wavelengths of perturbations produced by tides and planetary scale waves (large scale) and turbulence and gravity waves (small scale). Other new features of the model are: (1) a second order geostrophic wind relation for use at low latitudes which does not "blow up" at low latitudes as the ordinary geostrophic relation does; and (2) revised quasi-biennial amplitudes and phases and revised stationary perturbations, based on data through 1972.
Abstract Understanding spatially correlated floods and modeling joint hazard associated with threshold exceedances across multiple locations is crucial for accurate estimation of continental‐scale portfolio risk. This work uses a non‐parametric copula‐based spatial simulator to analyze peak floods across the United States to derive the first‐of‐its‐kind continental portfolio risk estimates at the 10‐ and 100‐year return levels. We find significant interdependence in floods across the nation, revealing the recurring pattern of extreme events affecting the Northeast, Central, West, and Northwest United States in the same year. The stochastic simulator effectively manages high‐dimensional data and offers reliable uncertainty estimates for both spatially dependent floods and the aggregated flood losses at the continental level. El Niño‐Southern Oscillation and Atlantic Multidecadal Oscillation are identified as statistically significant tele‐connectors of aggregate loss. This research aims to advance the understanding of compound continental flood hazard and the potential large‐scale climate teleconnections that lead to such compound floods.