Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Stochastic process”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48

Initialization and Restart in Stochastic Local Search: Computing a Most Probable Explanation in Bayesian Networks

For hard computational problems, stochastic local search has proven to be a competitive approach to finding optimal or approximately optimal problem solutions. Two key research questions for stochastic local search algorithms are: Which algorithms are effective for initialization? When should the search process be restarted? In the present work we investigate these research questions in the context of approximate computation of most probable explanations (MPEs) in Bayesian networks (BNs). We introduce a novel approach, based on the Viterbi algorithm, to explanation initialization in BNs. While the Viterbi algorithm works on sequences and trees, our approach works on BNs with arbitrary topologies. We also give a novel formalization of stochastic local search, with focus on initialization and restart, using probability theory and mixture models. Experimentally, we apply our methods to the problem of MPE computation, using a stochastic local search algorithm known as Stochastic Greedy Search. By carefully optimizing both initialization and restart, we reduce the MPE search time for application BNs by several orders of magnitude compared to using uniform at random initialization without restart. On several BNs from applications, the performance of Stochastic Greedy Search is competitive with clique tree clustering, a state-of-the-art exact algorithm used for MPE computation in BNs.

Mengshoel, Ole J.↗

Initial Stage of Nanoscale Imaging in Positive Tone Extreme UV Photoresists: The Influence of the Polymer Sequence

Photolithographic patterning using extreme ultraviolet (EUV, 92.5 eV) light is a radiolytic process that initially forms electrons, radical cations, anions, and neutral radicals in the polymeric photoresist matrix. These species may participate in the chemical reactions that define the ultimate resolution of the printed image, and their concentrations and nanometer-scale stochastic variations in their formation influence printed image quality. Proposals have been made that polymer chain uniformity may be advantageous in reducing stochastics due to spatial inhomogeneities, and this aspect of radiolysis is examined in this work. We have simulated the initial subpicosecond stages of the imaging process for a series of photoresist films that are identical in composition but vary in their polymer chain structures. We use detailed, physically accurate stochastic reaction-diffusion calculations to evaluate the influence of defined sequence and random copolymer structures on radiolytic spur formation, i.e., a cluster of species formed by electron-polymer interactions that defines the initial spatial characteristic of the imaging process. Predictions of electron thermalization in the present work are shown to be consistent with the literature, indicating that our overall computational approach for ultrafast nanoscale processes is sound. The computational results show that the polymer sequence has no significant effect on the spur composition. This suggests that any potential imaging improvements to be gained by sequence control must originate from postimaging lithographic process steps.

Absorption↗

HL-20 operations and support requirements for the Personnel Launch System mission

The processing, mission planning, and support requirements were defined for the HL-20 lifting-body configuration that can serve as a Personnel Launch System. These requirements were based on the assumption of an operating environment that incorporates aircraft and airline support methods and techniques that are applicable to operations. The study covered the complete turnaround process for the HL-20, including landing through launch, and mission operations, but did not address the support requirements of the launch vehicle except for the integrated activities. Support is defined in terms of manpower, staffing levels, facilities, ground support equipment, maintenance/sparing requirements, and turnaround processing time. Support results were drawn from two contracted studies, plus an in-house analysis used to define the maintenance manpower. The results of the contracted studies were used as the basis for a stochastic simulation of the support environment to determine the sufficiency of support and the effect of variance on vehicle processing. Results indicate the levels of support defined for the HL-20 through this process to be sufficient to achieve the desired flight rate of eight flights per year.

Morris, W. D.↗

Uncertainty quantification for Multiphase-CFD simulations of bubbly flows: a machine learning-based Bayesian approach supported by high-resolution experiments

In this paper, we developed a machine learning-based Bayesian approach to inversely quantify and reduce the uncertainties of multiphase computational fluid dynamics (MCFD) simulations for bubbly flows. The proposed approach is supported by high-resolution two-phase flow measurements, including those by double-sensor conductivity probes, high-speed imaging, and particle image velocimetry. Local distributions of key physical quantities of interest (QoIs), including the void fraction and phasic velocities, are obtained to support the Bayesian inference. In the process, the epistemic uncertainties of the closure relations are inversely quantified while the aleatory uncertainties from stochastic fluctuations of the system are evaluated based on experimental uncertainty analysis. The combined uncertainties are then propagated through the MCFD solver to obtain uncertainties of the QoIs, based on which probability-boxes are constructed for validation. The proposed approach relies on three machine learning methods: feedforward neural networks and principal component analysis for surrogate modeling, and Gaussian processes for model form uncertainty modeling. The whole process is implemented within the framework of an open-source deep learning library PyTorch with graphics processing unit (GPU) acceleration, thus ensuring the efficiency of the computation. The results demonstrate that with the support of high-resolution data, the uncertainties of MCFD simulations can be significantly reduced. The proposed approach has the potential for other applications that involve numerical models with empirical parameters.

42 ENGINEERING↗

Multilevel Analysis, Design, and Modeling of Coupling Advanced Nuclear Reactors and Thermal Energy Storage in an Integrated Energy System

This report discusses the different options for coupling thermal energy storage (TES) systems to advanced nuclear power plants (A-NPPs) in order to enable flexible and hybrid plant operation. An advanced light-water reactor (A LWR), a high-temperature gas-cooled reactor (HTGR) and a liquid-metal fast reactor (LMFR) were selected as the initial use cases for demonstrating a thermally balanced energy storage coupling design for thermal power extraction. The models presented herein showcase several design considerations, focusing on optimal deployment methodologies for achieving steady-state and transient-state operation with minimum disruption to the nuclear power cycle. This first part of the study presents steady-state models developed using Aspen HYSYS®, with the thermal energy bypass for NPP-TES coupling being varied at up to 50%. The various components were sized using the Aspen Process Economic Analyzer (APEA) and Aspen Exchanger Design and Rating (EDR), when applicable. Cost functions from these models were developed using the latest publicly available data obtained from APEA V11. The TES-coupled A-NPP steady-state models and cost functions then provided a baseline for dynamic operation and process optimization by using Idaho National Laboratory (INL)’s Framework for Optimization of Resources and Economics (FORCE) tools. A stochastic optimization of the various energy storage systems coupled to the A-NPPs was then performed using the Risk Analysis Virtual Environment (RAVEN) and its dispatch optimization plugin, the Holistic Energy Resource Optimization Network (HERON). The signal processing and synthetic history capabilities of RAVEN were used to account for the unpredictable behavior of electricity markets. An autoregressive moving average (ARMA) model was used to analyze price signals from the Pennsylvania-New Jersey-Maryland (PJM) market and were applied to the HERON analysis in order to optimize a system with the best economics. Transient modeling evaluation was then performed using Modelica models within the HYBRID repository, which was developed at INL for the Department of Energy Integrated Energy Systems program for the characterization of dynamic integrated system behavior and feedback. This includes evaluation of the TES-coupled A-LWR systems’ impact on physical and thermal system response during imposed system demands. Additional TES-coupled reactor types, coupling approaches, markets, and TES technologies will be evaluated in future work.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Decision-making based on Markov decision process in integrated artificial reasoning framework—Part I: Theory

This paper presents a decision-making framework based on an integrated artificial reasoning framework and Markov decision process (MDP). The integrated artificial reasoning framework provides a physics-based approach that converts system information into state transition models, and the analysis result will be represented by the transition probabilities that can be used with an MDP to find a traceable and explainable optimal pathway. A dynamic Bayesian network (DBN) is well suited for representing the structure of an MDP. The causality information among process variables (or among subsystems) is mathematically represented in a DBN by the conditional probabilities of the node’s states provided different probabilities of the parent node’s states. To define node states in a physically understandable manner, we used multilevel flow modeling (MFM). An MFM follows the fundamental energy and mass conservation laws and supports the selection of process variables that represent the system of interest so that causal relations among process variables are properly captured. An MFM-based DBN supports developing state transition models in an MDP to capture the effect of process variables of system having physical relations. The operators of the target system can capture stochastic system dynamics as multiple subsystem state transitions based on their physical relations and uncertainties coming from component degradation or random failures. We analyzed a simplified exemplary system to illustrate an optimal operational policy using the suggested approach.

Markov decision process↗

Nonadiabatic Force Matching for Alchemical Free-Energy Estimation

We propose a method to compute free-energy differences from nonadiabatic alchemical transformations by using flow-based generative models. The method, nonadiabatic force matching, hinges on estimating the dissipation along an alchemical switching process in terms of a nonadiabatic force field that can be learned through stochastic flow matching. The learned field can be used in conjunction with short-time trajectory data to evaluate upper and lower bounds on the alchemical free energy that variationally converge to the exact value if the field is optimal. Applying the method to evaluate the alchemical free energy of atomistic models shows that it can substantially reduce the simulation cost of a free-energy estimate at a negligible loss of accuracy when compared with thermodynamic integration.

Computational chemistry↗

Experimental quantum Bernoulli factories via Bell-basis measurements

Randomness processing in the Bernoulli factory framework provides a concrete setting in which quantum resources can outperform classical ones. We experimentally demonstrate quantum randomness processing based on Bell-basis measurements of two identical input quoins prepared on IBM superconducting hardware. Using only the measurement outcomes (and no external classical randomness source), we realize the classically inconstructible Bernoulli doubling primitive f(p)=2p, and, as intermediate outputs from the same Bell-measurement statistics, an exact fair coin f(p)=1/2 and the classically inconstructible function f(p)=4p(1−p). We benchmark the measured output biases against ideal predictions and discuss the impact of device noise. Our results establish a simple resource-efficient experimental primitive for quantum-to-classical randomness processing and support the viability of quantum Bernoulli factories for quantum-enhanced stochastic simulation and sampling tasks.

Roy, Tanay [Fermilab] (ORCID:000000019442862X)↗

Structured interactions drive abrupt transitions in the spatial organization of microbial communities

Bacteria possess diverse mechanisms to regulate their motility in response to environmental and physiological signals, enabling them to navigate complex habitats and adapt their behavior. Some of these mechanisms are species specific and enable cells to modulate their movement based on the ecological identity of neighboring species. Here, we introduce a model in which bacteria interact via local signals that either enhance or suppress the motility of neighboring cells depending on species type. Through large-scale simulations and a coarse-grained stochastic model, we demonstrate the emergence of a sharp transition driven by nucleation processes: increasing the density of motility-suppressing interactions drives the system from a fully mixed, motile phase to a state characterized by large, stationary bacterial clusters. Remarkably, in systems with a large number of interacting species, this transition can be triggered solely by altering the structure of the motility-regulation interaction matrix while maintaining species and interaction densities constant. In particular, we find that heterogeneous and modular interactions promote the transition more readily than homogeneous random ones. These findings add a dimension to the theory of motility-induced phase separation and contribute to the ongoing effort to understand microbial interactions, suggesting that structured, nonrandom ones may be key to reproducing commonly observed spatial patterns in microbial communities.

bacterial communities↗

Combined optimization of image-gathering optics and image-processing algorithm for edge detection

This paper investigates the relationships between the image-gathering and image-processing systems for minimum mean-squared error estimation of scene characteristics. A stochastic optimization problem is formulated in which the objective is to determine a spatial characteristic of the scene rather than a feature of the already blurred, sampled, and noisy image data. The Wiener filter for the sampled image case is obtained as a special case, where the desired characteristics is scene restoration. Optimal edge detection is investigated. It is shown that the optimal edge detector compensates for the blurring introduced by the image-gathering optics, and, notably, that it is not circularly symmetric. The lack of circular symmetry is largely due to the geometric effects of the sampling lattice used in image acquisition.

Halyo, N.↗

A stochastic model for eye movements during fixation on a stationary target.

A stochastic model describing small eye movements occurring during steady fixation on a stationary target is presented. Based on eye movement data for steady gaze, the model has a hierarchical structure; the principal level represents the random motion of the image point within a local area of fixation, while the higher level mimics the jump processes involved in transitions from one local area to another. Target image motion within a local area is described by a Langevin-like stochastic differential equation taking into consideration the microsaccadic jumps pictured as being due to point processes and the high frequency muscle tremor, represented as a white noise. The transform of the probability density function for local area motion is obtained, leading to explicit expressions for their means and moments. Evaluation of these moments based on the model is comparable with experimental results.

Vasudevan, R.↗

Semi-Analytical Hierarchical Bayesian Inference of Nonlinear Model Structure in Stochastic Dynamics: Applied to Compartmental Models of Infectious Diseases

A Bayesian computational framework for parsimonious inference in stochastic nonlinear dynamical systems is presented. This framework enables the concurrent estimation of system states, time-varying parameters, time-invariant parameters, and the optimal sparsity structure of the model parameters. Because differential equation-based models are often simplified mechanistic or phenomenological representations, robust inference from noisy measurement data requires explicit treatment of model error and uncertainty. Model error and time-varying parameters can be represented as random processes, enabling inference while making minimal assumptions about the underlying sources of discrepancy and variability. Adopting stochastic differential equation representations affords the model significant flexibility, but can also render it susceptible to overfitting during statistical inversion, where the inferred model may track noise rather than the underlying signal. To alleviate the effects of overfitting and to enable the discovery of the optimal sparse representation of the time-invariant parameters, a Bayesian sparse learning algorithm is embedded within the framework. This sparse learning framework adopts an approximate hierarchical Bayesian setting defined by a series of semi-analytical expressions. The model structure inference framework is validated using a stochastic compartmental model for tracking and forecasting active cases of an infectious disease. Compartmental models describe population-level infectious disease dynamics through interactions among population fractions grouped by disease state. Mathematically, such models consist of a system of coupled ordinary differential equations. This example adopts an expressive compartmental model that includes multiple possible interactions between disease states, motivated by early uncertainty surrounding COVID-19 reinfection dynamics and their implications for long-term epidemic forecasting. The sparse learning exercise permits the inference of a priori unknown epidemiological dynamics from simulated public health data, discovering the nested compartmental model that optimizes the trade-off between average data-fit and model complexity. It is shown that inducing sparsity among the model parameters eliminates redundant interactions between compartments, equivalently revealing the optimal coupling structure between differential equations.

97 MATHEMATICS AND COMPUTING↗

Stochastic pre-event preparation for enhancing resilience of distribution systems

Extreme weather events are the common causes for power supply interruptions and power outages in electrical distribution systems. Improving the distribution system and enhancing its resilience is becoming crucial due to the increased frequency of extreme weather events. Preparation and allocation of multiple flexible resources, such as mobile resources, fuel resources, and labor resources before extreme weather events can mitigate the effects of extreme weather events and enhance the resilience of power distribution systems. Here, in this paper, a two-stage stochastic mixed-integer linear programming (SMILP) is proposed to optimize the preparation and resource allocation process for upcoming extreme weather events, which leads to faster and more efficient post-event restoration. The objective of the proposed two-stage SMILP is to maximize the served load and minimize the operating cost of flexible resources. The first stage in the optimization problem selects the amounts and locations of different resources. The second stage considers the operational constraints of the distribution system and repair crew scheduling constraints. The proposed stochastic pre-event preparation model is solved by a scenario decomposition method, Progressive Hedging (PH), to ease the computational complexity introduced by a large number of scenarios. Furthermore, to show the impact of solar photovoltaic (PV) generation on system resilience, three types of PV systems are considered during a power outage and the resilience improvements with different PV penetration levels are compared. Numerical results from simulations on a large-scale (more than 10,000 nodes) distribution feeder have been used to validate the effectiveness and scalability of the proposed method.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Optoelectronic analogs of self-programming neural nets - Architecture and methodologies for implementing fast stochastic learning by simulated annealing

Self-organization and learning is a distinctive feature of neural nets and processors that sets them apart from conventional approaches to signal processing. It leads to self-programmability which alleviates the problem of programming complexity in artificial neural nets. In this paper architectures for partitioning an optoelectronic analog of a neural net into distinct layers with prescribed interconnectivity pattern to enable stochastic learning by simulated annealing in the context of a Boltzmann machine are presented. Stochastic learning is of interest because of its relevance to the role of noise in biological neural nets. Practical considerations and methodologies for appreciably accelerating stochastic learning in such a multilayered net are described. These include the use of parallel optical computing of the global energy of the net, the use of fast nonvolatile programmable spatial light modulators to realize fast plasticity, optical generation of random number arrays, and an adaptive noisy thresholding scheme that also makes stochastic learning more biologically plausible. The findings reported predict optoelectronic chips that can be used in the realization of optical learning machines.

Farhat, Nabil H.↗

Discrete stochastic model of point defect-dislocation interaction for simulating dislocation climb

Dislocation climb is an important high temperature process in metals plasticity, responsible for the phenomena such as creep, swelling, or hardening. Climb is defined by the ability of dislocations to leave their original glide plane by interacting with point defects. As such, dislocation climb is controlled by point defect diffusion/absorption/emission, all of which involve thermal activation. The existing thermodynamically consistent models for climb are generally formulated in a continuum framework, through the definition of effective defect fluxes and climb propensities in response to thermodynamic driving forces. However, the point-wise discrete nature of vacancies (and/or self-interstitials) confers a highly discrete nature to the climb dynamics, which is also strongly affected by elastic forces. The combination of discreteness, thermal activation, and elasticity makes this process too challenging for direct atomistic methods such as molecular dynamics. Here we develop a kinetic Monte Carlo model that captures vacancy generation and transport kinetics acting in conjuction with the evolving elastic fields provided by discrete dislocation dynamics simulations. The two models are coupled via the applied stresses and stress gradients generated by dislocation structures at vacancy locations. Our simulations reveal two surprising results. First that climb is dominated by vacancy emission even when the background vacancy concentration is much higher than the equilibrium one. And, second, that climb velocities might be much faster than otherwise believed when one uses the classical theories of climb. These effects are due to the locality of vacancy-dislocation processes, which are not captured in classical treatments that assume smooth vacancy fluxes and homogeneous concentrations. We apply the method to study elementary climb processes in body-centered cubic iron and furnish climb mobility functions to be used in parametric dislocation dynamics and/or crystal plasticity simulations. Here, we apply the technique to study non-conservative plastic bypass of spherical precipitates by edge dislocations and point out the differences between our discrete approach and existing continuum formulations.

36 MATERIALS SCIENCE↗

Stochastic treatment of electron multiplication without scattering in dielectrics

By treating the emission of optical phonons as a Markov process, a simple analytic method is developed for calculating the electronic ionization rate per unit length for dielectrics. The effects of scattering from acoustic and optical phonons are neglected. The treatment obtains universal functions in recursive form, the theory depending on only two dimensionless energy ratios. A comparison of the present work with other numerical approaches indicates that the effect of scattering becomes important only when the electric potential energy drop in a mean free path for optical-phonon emission is less than about 25% of the ionization potential. A comparison with Monte Carlo results is also given for Teflon.

Lin, D. L.↗

SSA Monte Carlo and Master Equation Modeling of Neutron Leakage Distributions

Strongly stochastic neutron populations in highly subcritical multiplying media containing weak spontaneous fission sources are unique indicators of the presence of SNM. For instance, in neutron multiplicity counting, an extended tail in the count number probability distribution is observed that is a characteristic of and sensitive to the amount of SNM present. Theoretical modeling and efficient computation of stochastic neutron distributions are complementary to experimental measurements and moreover shed light on the fundamental interactions and transport processes that underlie nuclear signatures. Modeling approaches that are intermediate between gross-system level models and high-fidelity but computationally demanding Monte Carlo simulations are of particular interest in this regard. Furthermore we present three advances on existing work in point kinetic or lumped geometry: (i) implementation of the Stochastic Simulation Algorithm (SSA), a system state-updating Monte Carlo method that is more e cient than single-event Monte Carlo in lumped geometries, (ii) application of the backward Master equation to obtain time-gated count moments, and (iii) reconstructing the count number distribution from the deterministically computed moments using a generalized Laguerre polynomial expansion.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗