Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Stochastic process”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,297 records · Page 72
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Representing the Sub-Grid Heterogeneity of Surface Precipitation in A General Circulation Model

Precipitation variability on spatial scales smaller than a typical general circulation model (GCM) grid box is often neglected, with the grid-mean precipitation rate being applied uniformly to underlying surface tiles. This reduces the extrema seen by the surface, with corresponding reductions in surface runoff and altered land-atmosphere fluxes. Here we present a novel approach to stochastically distribute precipitation across sub-grid surface tiles within a GCM. Based on 4 km Stage IV precipitation data, the scheme parameterizes the dry area fraction as a function of grid mean precipitation rate, and defines the relative distribution of intensities across non-dry surface tiles. To incorporate memory and mimic the persistence of precipitating storms, the relative intensity assigned to each sub-grid tile is determined by an autoregressive process. Using single column experiments, the scheme is shown to reproduce observed precipitation statistics at the scale of model surface tiles. We also document impacts on surface hydrology and energy partitioning, with notable increases in precipitation runoff, surface temperature variance, and the Bowen ratio.

GCM↗
DOE OSTI2022

Generative Ensemble Regression: Learning Particle Dynamics from Observations of Ensembles with Physics-informed Deep Generative Models

Here, we propose a new method for inferring the governing stochastic ordinary differential equations (SODEs) by observing particle ensembles at discrete and sparse time instants, i.e., multiple “snapshots.” Particle coordinates at a single time instant, possibly noisy or truncated, are recorded in each snapshot but are unpaired across the snapshots. By training a physics-informed generative model that generates “fake” sample paths, we aim to fit the observed particle ensemble distributions with a curve in the probability measure space, which is induced from the inferred particle dynamics. We employ different metrics to quantify the differences between distributions, e.g., the sliced Wasserstein distances and the adversarial losses in generative adversarial networks. We refer to this method as generative “ensemble-regression” (GER), in analogy to the classic “point-regression,” where we infer the dynamics by performing regression in the Euclidean space. We illustrate the GER by learning the drift and diffusion terms of particle ensembles governed by SODEs with Brownian motions and Lévy processes up to 100 dimensions. We also discuss how to treat cases with noisy or truncated observations. Apart from systems consisting of independent particles, we also tackle nonlocal interacting particle systems with unknown interaction potential parameters by constructing a physics-informed loss function. Finally, we investigate scenarios of paired observations and discuss how to reduce the dimensionality in such cases by proving a convergence theorem that provides theoretical support.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Introduction: Neuromorphic Materials

The explosive growth in data collection and the need to process it efficiently, as well as the desire to automate increasingly complex tasks in transportation, medical care, manufacturing, security and many other fields have motivated a growing interest in neuromorphic computing. Unlike the binary, transistorbased ON/OFF logic gates and separate logic and memory functionalities employed in digital computing, neuromorphic computing is inspired by animal brains that use interconnected synapses and neurons to perform processing, storage and transmission of information at the same location, while only consuming ~20 W or less of power. Motivated by the brain’s efficiency, adaptability, self-learning and resiliency qualities, neuromorphic computing can be broadly defined as an approach to processing and storing information using hardware and algorithms inspired by models of biological neural systems. Present research in neuromorphic computing encompasses approaches that vary significantly in their degree of neuro-inspiration, from systems that only incorporate features such as asynchronous, event-driven operation or use crossbar arrays of non-volatile memory (NVM) elements to accelerate deep neural networks (DNNs), to designs that embrace the extreme parallelism, sparsity, reconfigurability, adaptability, complexity and stochasticity observed in nervous systems. The term ‘neuromorphic’ computing is often credited to Carver Mead, who in the 1980s investigated Si-based analog electronics to replicate functions of the animal retina. Earlier important advances in this field include the work of Frank Rosenblatt, who proposed the concept of the perceptron, Bernard Widrow, who used this concept to build one of the first analog neural networks, the Adaline and many other researchers (see ref. 6 for an historical perspective on neuromorphic computing). With the recent increase in the use of artificial intelligence and large language models, and rising concerns over the associated energy costs, interest in neuromorphic hardware has expanded rapidly. According to some estimates, driven largely by the drastic growth in the training use of artificial intelligence (AI) models using the current computing architectures, the energy cost of computing is projected to reach the energy supply worldwide by 2045. Furthermore, while this is not a realistic outcome, it means that, if more efficient computing technologies are not developed -- soon -- the world will soon become one where demand for energy and market constraints limit the continued increase of societal access to AI and cloud services from data centers. Data centers used for training and use of these models consume hundreds of terawatt hours of electricity, already past 4% of the US electricity demand.

Circuits↗
DOE OSTI2020

Linking Small-Scale Flight Manoeuvers and Density Profiles to the Vertical Movement of Insects in the Nocturnal Stable Boundary Layer

Huge numbers of insects migrate over considerable distances in the stably-stratified night-time atmosphere with great consequences for ecological processes, biodiversity, ecosystem services and pest management. We used a combination of meteorological radar and lidar instrumentation at a site in Oklahoma, USA, to take a new look at the general assistance migrants receive from both vertical and horizontal airstreams during their long-distance flights. Movement in the nocturnal boundary layer (NBL) presents very different challenges for migrants compared to those prevailing in the daytime convective boundary layer, but we found that Lagrangian stochastic modelling is effective at predicting flight manoeuvers in both cases. A key feature for insect transport in the NBL is the frequent formation of a thin layer of fast-moving air – the low-level jet. Modelling suggests that insects can react rapidly to counteract vertical air movements and this mechanism explains how migrants are retained in the jet for long periods (e.g. overnight, and perhaps for several hours early in the morning). This results in movements over much longer distances than are likely in convective conditions, and is particularly significant for the reintroduction of pests to northern regions where they are seasonally absent due to low winter temperatures.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Ensemble cure kinetics network (ECK-Net): A method to derive cure kinetics of thermosetting resin

This paper introduces an Ensemble Cure Kinetics Network (ECK-Net), a neural network (NN)–based framework for modeling the cure kinetics of thermosetting resins within a phenomenological context. ECK-Net replaces traditional analytic models, which require extensive chemical insight and multiple isothermal/non-isothermal experiments, with a data-driven surrogate that maps nonlinear relationships between temperature, degree of cure, and reaction rate from differential scanning calorimetry data. The proposed approach predicts input-dependent kinetic coefficients of a generalized nth-order reaction equation rather than reaction rates directly, enabling a single unified model to represent various epoxy systems without relying on iso-conversional analysis or predefined functional forms. To ensure robustness, multiple independently trained networks under different random initializations are blended through an ensemble strategy, effectively mitigating the stochastic variability inherent to neural networks. The framework is validated using experimental datasets from multiple resin systems, including aerospace-grade materials (Toray 3900-2, Cycom 5320-1, and Hexcel 8552) and a windmill-grade resin (RIMR 035c). The model accurately reproduces the temporal evolution of the degree of cure under manufacturers’ recommended cure cycles across all tested resins systems, yielding Pearson’s correlation coefficients of 0.992, 0.994, 0.993, 0.997, respectively. To demonstrate process-level applicability, the trained network was implemented within the Abaqus environment to simulate out-of-autoclave (OOA) curing process of the CFRP panel composed of Toray T830H-6K/3900-2D prepreg. The simulation results showed excellent agreement with experimental temperature response (maximum peak temperature, simulation: 189.6 °C, experiment: 188.5 °C) and the final degree of cure (simulation: 0.948, experiment: 0.960 ± 0.013), confirming ECK-Net’s capability as a reliable alternative to conventional cure kinetics modeling methods.

Composite curing↗
NASA NTRSDate not supplied

Stochastic Reconstruction of Thermal Protection Material Properties from Arc-Jet Experiments

Material response models are used to assess reliability using variances in the bond-line temperature predictions based on uncertainties in trajectory, aerothermal environment, and material properties. A key deficiency in the current approach is that input uncertainties are too often subjective, empirical, or ad-hoc, and are not rigorously linked to the arc-jet test data used to develop the TPS material model. While materials such as PICA are well understood, future missions may require more novel materials such as HEEET where unknown uncertainties have real consequences on the ability to assess reliability. A quantifiable estimate of reliability requires an iterative methodology where the parameters driving the variance in bond-line temperature (for example) are systematically identified. A test campaign to collect data or develop new models can then be identified to reduce those input uncertainties. A Bayesian inference loop defines these connections mathematically, i.e., prior knowledge about uncertainty is updated based on observation. While these concepts are well known (and often applied intuitively in a non-rigorous approach), only recent advances in reduced-order modelling have made them computationally viable methods for engineering. By replacing deterministic inverse methods with stochastic approaches, the hope is new materials proposed for future missions can more rapidly be developed with a greater understanding of the TPS material reliability. Two additional steps for the analysis of arc jet test data are discussed. The first is ability to construct a reduced-order model using material response simulations (Icarus/US3D) of the arc-jet test articles, and the second is the inclusion of this surrogate model in the Bayesian inversion process. Both capabilities will be demonstrated using prior PICA arc-jet test data. The quality of a surrogate model will be investigated and the variances on the calibrated material properties will be compared to our current understanding of the PICA material model.

Material response↗
DOE OSTI2020

Stochasticity and robustness in spiking neural networks

Despite drawing inspiration from biological systems which are inherently noisy and variable, artificial neural networks have been shown to require precise weights to carry out the task which they are trained to accomplish. This creates a challenge when adapting these artificial networks to specialized execution platforms which may encode weights in a manner which restricts their accuracy and/or precision.Reflecting back on the non-idealities which are observed in biological systems, we investigated the effect these properties have on the robustness of spiking neural networks under perturbations to weights. First, we examined techniques extant in conventional neural networks which resemble noisy processes, and postulated they may produce similar beneficial effects in spiking neural networks. Second, we evolved a set of spiking neural networks utilizing biological non-idealities to solve a pole-balancing task, and estimated their robustness. We showed it is higher in networks using noisy neurons, and demonstrated that one of these networks can perform well under the variance expected when a hafnium-oxide based resistive memory is used to encode synaptic weights. Lastly, we trained a series of networks using a surrogate gradient method on the MNIST classification task. We confirmed that these networks demonstrate similar trends in robustness to the evolved networks. We discuss these results and argue that they display empirical evidence supporting the role of noise as a regularizer which can increase network robustness.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Manifold Learning-Based Polynomial Chaos Expansions for High-Dimensional Surrogate Models

In this work we introduce a manifold learning-based method for uncertainty quantification (UQ) in systems describing complex spatiotemporal processes. Our first objective is to identify the embedding of a set of high-dimensional data representing quantities of interest of the computational or analytical model. For this purpose, we employ Grassmannian diffusion maps, a two-step nonlinear dimension reduction technique which allows us to reduce the dimensionality of the data and identify meaningful geometric descriptions in a parsimonious and inexpensive manner. Polynomial chaos expansion is then used to construct a mapping between the stochastic input parameters and the diffusion coordinates of the reduced space. An adaptive clustering technique is proposed to identify an optimal number of clusters of points in the latent space. The similarity of points allows us to construct a number of geometric harmonic emulators which are finally utilized as a set of inexpensive pretrained models to perform an inverse map of realizations of latent features to the ambient space and thus perform accurate out-of-sample predictions. Thus, the proposed method acts as an encoder-decoder system which is able to automatically handle very high-dimensional data while simultaneously operating successfully in the small-data regime. The method is demonstrated on two benchmark problems and on a system of advection-diffusion-reaction equations which model a first-order chemical reaction between two species. In all test cases, the proposed method is able to achieve highly accurate approximations which ultimately lead to the significant acceleration of UQ tasks.

42 ENGINEERING↗
DOE OSTI2021

On the Representation of Hyporheic Exchange in Models for Reactive Transport in Stream and River Corridors

Efforts to include more detailed representations of biogeochemical processes in basin-scale water quality simulation tools face the challenge of how to tractably represent mass exchange between the flowing channels of streams and rivers and biogeochemical hotspots in the hyporheic zones. Multiscale models that use relatively coarse representations of the channel network with subgrid models for mass exchange and reactions in the hyporheic zone have started to emerge to address that challenge. Two such multiscale models are considered here, one based on a stochastic Lagrangian travel time representation of advective pumping and one on multirate diffusive exchange. The two models are formally equivalent to well-established integrodifferential representations for transport of non-reacting tracers in steady stream flow, which have been very successful in reproducing stream tracer tests. Despite that equivalence, the two models are based on very different model structures and produce significantly different results in reactive transport. In a simple denitrification example, denitrification is two to three times greater for the advection-based model because the multirate diffusive model has direct connections between the stream channel and transient storage zones and an assumption of mixing in the transient storage zones that prevent oxygen levels from dropping to the point where denitrification can progress uninhibited. By contrast, the advection-based model produces distinct redox zonation, allowing for denitrification to proceed uninhibited on part of the hyporheic flowpaths. These results demonstrate that conservative tracer tests alone are inadequate for constraining representation of mass transfer in models for reactive transport in streams and rivers.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2017

Transverse eV Ion Heating by Random Electric Field Fluctuations in the Plasmasphere

Charged particle acceleration in the Earth inner magnetosphere is believed to be mainly due to the local resonant wave-particle interaction or particle transport processes. However, the Van Allen Probes have recently provided interesting evidence of a relatively slow transverse heating of eV ions at distances about 2-3 Earth radii during quiet times. Waves that are able to resonantly interact with such very cold ions are generally rare in this region of space, called the plasmasphere. Thus, non-resonant wave-particle interactions are expected to play an important role in the observed ion heating. We demonstrate that stochastic heating by random transverse electric field fluctuations of whistler (and possibly electromagnetic ion cyclotron) waves could explain this weak and slow transverse heating of H+ and O+ ions in the inner magnetosphere. The essential element of the proposed model of ion heating is the presence of trains of random whistler (hiss) wave packets, with significant amplitude modulations produced by strong wave damping, rapid wave growth, or a superposition of wave packets of different frequencies, phases, and amplitudes. Such characteristics correspond to measured characteristics of hiss waves in this region. Using test particle simulations with typical wave and plasma parameters, we demonstrate that the corresponding stochastic transverse ion heating reaches 0.07-0.2 eV/h for protons and 0.007-0.015 eV/h for O+ ions. This global temperature increase of the Maxwellian ion population from an initial Ti approx. 0.3 eV could potentially explain the observations.

Artemyev, A. V.↗
DOE OSTI2022

On-the-fly response function generation method for composite coarse mesh

The hybrid stochastic deterministic transport code COMET, based on the incident response expansion theory, is used to model reactor cores with high fidelity and formidable computational speed. COMET models a reactor core using a library of incident flux response expansion coefficients that are pre computed for all the unique lattice cells (e.g., fuel assemblies, reflector blocks, etc.) in the core. In order to further improve its computational efficiency in pre-calculating the response library a new response function generation method is developed to compute the response functions for the composite coarse meshes made of a smaller set of unique lattices on the fly within the COMET's deterministic transport core sweep. The efficiency is achieved by eliminating a number of unique lattices that can be made up from the reduced set of unique meshes on the fly. The numerical process consists of the following steps. First, the boundary condition on composite coarse mesh boundaries is projected onto the expansion basis to compute the incident flux moments on external surfaces of all the basic (reduced set of unique) coarse meshes. Secondly, the deterministic sweeping solver in COMET is used to converge on the outgoing/incoming flux expansion moments crossing interfaces between the basic coarse meshes. Thirdly, the response functions for the composite coarse meshes are constructed as a superposition on the fly. The new response function generation method was tested on 88 composite coarse meshes consisting of CANDU fuel bundles and moderator blocks. It was found that response functions generated by the new method agree very well with those generated by direct Monte Carlo calculations. The average and maximum relative differences in the surface-to-surface response coefficients computed by the two methods are 0.10% and 0.20%, respectively. Similarly, the average and maximum relative differences in the response fission densities are 0.13% and 0.43%, respectively. These discrepancies are within one standard deviation of the stochastic uncertainties. The new method is five times faster than the original direct Monte Carlo method. The size of the response function library for the new method is five times smaller than that for the original method, leading to significantly less requirement for the computer hard drive space and memory. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2021

Solving inverse problems in stochastic models using deep neural networks and adversarial training

Inverse problems associated with stochastic models constitute a significant portion of scientific and engineering applications. In such cases the unknown quantities are distributions. The applicability of traditional methods is limited because of their demanding assumptions or prohibitive computational consumption; for example, maximum likelihood methods require closed-form density functions, and Markov Chain Monte Carlo needs a large number of simulations. We propose a new method that estimates the unknown distribution by matching the statistical properties between observed and simulated random processes. We leverage the expressive power of neural networks to approximate the unknown distribution and use a discriminative neural network for computing the statistical discrepancies between the observed and simulated random processes. Here we demonstrated numerically that the proposed methods can estimate both the model parameters and learn complicated unknown distributions.

42 ENGINEERING↗
DOE OSTI2021

Evaluate the impact of sensor accuracy on model performance in data-driven building fault detection and diagnostics using Monte Carlo simulation

The performance of data-driven fault detection and diagnostics (FDD) is heavily dependent on sensors. However, sensor inaccuracy and sensor faults are pervasive in building operation: inaccurate and missing sensor readings deteriorate FDD performance; sensor inaccuracy will also affect the selection of sensor for data-driven FDD in the model training process, which is another key factor of data-driven FDD performance. Sensor accuracy and sensor selection individually are well-studied research topics in this field, but the impact of sensor accuracy on sensor selection and its further impact on FDD performance has not been evaluated and quantified. In this paper, we developed a novel analysis methodology that comprehensively evaluates sensor fault on sensor selection and FDD accuracy. Monte Carlo simulation is applied to deal with multiple stochastic sensor inaccuracy and provide probabilistic analysis results of the impact of sensor inaccuracy on sensor selection and FDD accuracy. This methodology focuses on the net impact of fault states across a full sensor set. The developed methodology can be used for the early-stage sensor design and operation-stage sensor maintenance. Furthermore, a case study is conducted to demonstrate the analysis methodology using a commercial building model crated to Flexible Research Platform located at Oak Ridge National Laboratory, USA.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2026

Spatial Correlations of the Poisson Model for Radiation Transport

Characterizing the relationship between bulk physical properties and mixing in randomly heterogeneous media is a central challenge across many areas of science and engineering. A benchmark model for such studies is the Poisson model, a random tessellation of space by a Poisson process of hyperplanes. In radiation transport studies, the lack of exact expressions for the Poisson model’s spatial multipoint functions has led to approximate methods being used, introducing unquantified sources of error. Here, we recently introduced an exact solution for the Poisson model’s multipoint functions and closely related conditional probability functions (CPFs), providing a new opportunity to understand and reduce these sources of error. In this paper, we enable a more rigorous investigation of radiation transport in stochastic media by applying the recently introduced exact solution for the Poisson model’s CPFs. This paper consists of three main contributions. First, we introduce a unified framework for CPFs of the Poisson model, encompassing the recently introduced exact CPFs as well as the previously introduced atomic mix, nearest-neighbor, and combination CPFs. This framework also includes existing pruning techniques for the approximate CPFs, such as angular exclusion, as well as a novel form of angular exclusion suitable for the exact CPFs. Second, we use the exact CPFs to characterize the spatial regions where each approximate three-point CPF is most accurate, thereby explaining the observed hierarchy of accuracy among the approximate models. Finally, we evaluate material transmittance, reflectance, and flux in a three-dimensional test problem using conditional point sampling, demonstrating the relationship between CPF accuracy and transport simulation accuracy.

Poisson model↗
NASA NTRS1990

The cost of conservative synchronization in parallel discrete event simulations

The performance of a synchronous conservative parallel discrete-event simulation protocol is analyzed. The class of simulation models considered is oriented around a physical domain and possesses a limited ability to predict future behavior. A stochastic model is used to show that as the volume of simulation activity in the model increases relative to a fixed architecture, the complexity of the average per-event overhead due to synchronization, event list manipulation, lookahead calculations, and processor idle time approach the complexity of the average per-event overhead of a serial simulation. The method is therefore within a constant factor of optimal. The analysis demonstrates that on large problems--those for which parallel processing is ideally suited--there is often enough parallel workload so that processors are not usually idle. The viability of the method is also demonstrated empirically, showing how good performance is achieved on large problems using a thirty-two node Intel iPSC/2 distributed memory multiprocessor.

Nicol, David M.↗
NASA NTRS2000

Radiation Physics for Space and High Altitude Air Travel

Galactic cosmic rays (GCR) are of extra-solar origin consisting of high-energy hydrogen, helium, and heavy ions. The GCR are modified by physical processes as they traverse through the solar system, spacecraft shielding, atmospheres, and tissues producing copious amounts of secondary radiation including fragmentation products, neutrons, mesons, and muons. We discuss physical models and measurements relevant for estimating biological risks in space and high-altitude air travel. Ambient and internal spacecraft computational models for the International Space Station and a Mars mission are discussed. Risk assessment is traditionally based on linear addition of components. We discuss alternative models that include stochastic treatments of columnar damage by heavy ion tracks and multi-cellular damage following nuclear fragmentation in tissue.

Cucinotta, F. A.↗
DOE OSTI2024

Optimal Zeno Dragging for Quantum Control: A Shortcut to Zeno with Action-Based Scheduling Optimization

The quantum Zeno effect asserts that quantum measurements inhibit simultaneous unitary dynamics when the “collapse” events are sufficiently strong and frequent. This applies in the limit of strong continuous measurement or dissipation. It is possible to implement a dissipative control that is known as “Zeno dragging” by dynamically varying the monitored observable, and hence also the eigenstates, which are attractors under Zeno dynamics. This is similar to adiabatic processes, in that the Zeno-dragging fidelity is highest when the rate of eigenstate change is slow compared to the measurement rate. We demonstrate here two theoretical methods for using such dynamics to achieve control of quantum systems. The first, which we shall refer to as “shortcut to Zeno,” is analogous to the shortcuts to adiabaticity (counterdiabatic driving) that are frequently used to accelerate unitary adiabatic evolution. In the second approach, we apply the Chantasri-Dressel-Jordan stochastic action [PRA 88, 042110 (2013)], and demonstrate that the extremal-probability readout paths derived from this are well suited to setting up a Pontryagin-style optimization of the Zeno-dragging schedule. A fundamental contribution of the latter approach is to show that an action suitable for measurement-driven control optimization can be derived quite generally from statistical arguments. Implementing these methods on the Zeno dragging of a qubit, we find that both approaches yield the same solution, namely, that the optimal control is a unitary that matches the motion of the Zeno-monitored eigenstate. We then show that such a solution can be more robust than a unitary-only operation and we comment on solvable generalizations of our qubit example embedded in larger systems. These methods open up new pathways toward systematically developing dynamic control of Zeno subspaces to realize dissipatively stabilized quantum operations. Published by the American Physical Society 2024

Physics↗
DOE OSTI2023

MLMOD: Machine Learning Methods for Data-Driven Modeling in LAMMPS

MLMOD is a software package for incorporating machine learning approaches and models into simulations of microscale mechanics and molecular dynamics in LAMMPS. Recent machine learning approaches provide promising data-driven approaches for learning representations for system behaviors from experimental data and high fidelity simulations. The package facilitates learning and using data-driven models for (i) dynamics of the system at larger spatial-temporal scales (ii) interactions between system components, (iii) features yielding coarser degrees of freedom, and (iv) features for new quantities of interest characterizing system behaviors. MLMOD provides hooks in LAMMPS for (i) modeling dynamics and time-step integration, (ii) modeling interactions, and (iii) computing quantities of interest characterizing system states. The package allows for use of machine learning methods with general model classes including Neural Networks, Gaussian Process Regression, Kernel Models, and other approaches. Here we discuss our prototype C++/Python package, aims, and example usage. For related papers, examples, updates, and additional information see https://github.com/atzberg/mlmod and http://atzberger.org/.

97 MATHEMATICS AND COMPUTING↗