Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Stochastic modelling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,711 records · Page 95
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Surrogate Model Based Optimization for Finding Robust Deep Learning Model Architectures

Deep Learning (DL) models are increasingly used throughout the sciences. However, their performance and usefulness depend greatly on their architecture which is defined by hyperparameters such as the number of nodes, layers, the learning rate, etc. Tuning these hyperparameters is time-consuming because evaluating their performance requires a lengthy training step. Stochastic optimizers used in training lead to performance variability and potentially prediction reliability issues. In this talk, we will describe an automated optimization method based on surrogate models and active learning strategies for tuning DL model architectures. We take into account the prediction variability with the goal to identify architectures that make reliable and robust predictions. We demonstrate our developments on an application arising in particle physics.

deep learning↗
NASA NTRS2019

The NANOGrav 12.5 yr Data Set: The Frequency Dependence of Pulse Jitter in Precision Millisecond Pulsars

Low-frequency gravitational-wave experiments require the highest timing precision from an array of the moststable millisecond pulsars. Several known sources of noise on short timescales in single radio pulsar observationsare well described by a simple model of three components: template fitting from a finite signal-to-noise ratio, pulsephase/amplitude jitter from single-pulse stochasticity, and scintillation errors from short-timescale interstellarscattering variations. Currently template-fitting errors dominate, but as radio telescopes push toward higher signalto-noise ratios, jitter becomes the next dominant term for most millisecond pulsars. Understanding the statistics ofjitter becomes crucial for properly characterizing arrival time uncertainties. We characterize the radio frequencydependence of jitter using data on 48 pulsars in the North American Nanohertz Observatory for GravitationalWaves timing program. We detect significant jitter in 43 of the pulsars and test several functional forms for itsfrequency dependence; we find significant frequency dependence for 30 pulsars. We find moderate correlations ofrms jitter with pulse width (R = 0.62) and number of profile components (R = 0.40); the single-pulse rms jitter istypically 1% of pulse phase. The average frequency dependence for all pulsars using a power-law model hasindex 0.42. We investigate the jitter variations for the interpulse of PSR B1937+21 and find no significantdeviations from the main pulse rms jitter. We also test the time variation of jitter in two pulsars and find thatsystematics likely bias the results for high-precision pulsars. Pulsar timing array analyses must properly modeljitter as a significant component of the noise within the detector.

Lam, M. T.↗
DOE OSTI2021

Transport in Stochastic Media with Random Chord Length Distributions

Thermal radiation transport computations in binary Markovian random mixtures rely almost exclusively on the Levermore-Pomraning (LP) model which is obtained by applying a heuristic closure to the ensemble averaged random medium transport equation. The validity of this model has been extensively tested by comparing numerical results over a broad parameter range (material types and mixing parameters) against benchmark solutions in planar geometry. The conditions under which the LP-model provides useful results and when it breaks down are now well established, but work to date has been largely restricted to homogeneous mixing statistics, i.e., the mean chord lengths of both materials are taken to be spatially constant. In recent work, this limitation was relaxed by allowing the mean chord lengths and, in a consistent fashion, the volume fractions in the LP-model to vary spatially and in a follow-up investigation benchmark solutions were obtained by ensemble averaging results over material realizations sampled from a nonhomogeneous Poisson process (NHPP). Numerical experiments in rod geometry with specifically linear and quadratic spatial dependence of chord lengths showed that the material averaged radiation intensities vary nonmonotonically with depth into the medium, in stark contrast to solutions obtained assuming uniform chord lengths. Moreover, depending on the local optical thickness and strength of scattering, the LP-model results showed locally more nuanced deviations from the benchmark solutions than was the case with constant chord lengths. These limited numerical investigations highlight the nontrivial qualitative and quantitative consequences of nonhomogeneous mixing statistics, in particular that closure approximations may not be uniformly valid or invalid over the problem domain.

42 ENGINEERING↗
DOE OSTI2022

Moving the needle: Employing deep reinforcement learning to push the boundaries of coarse-grained vaccine models

Highly mutable infectious disease pathogens (hm-IDPs) such as HIV and influenza evolve faster than the human immune system can contain them, allowing them to circumvent traditional vaccination approaches and causing over one million deaths annually. Agent-based models can be used to simulate the complex interactions that occur between immune cells and hm-IDP-like proteins (antigens) during affinity maturation—the process by which antibodies evolve. Compared to existing experimental approaches, agent-based models offer a safe, low-cost, and rapid route to study the immune response to vaccines spanning a wide range of design variables. However, the highly stochastic nature of affinity maturation and vast sequence space of hm-IDPs render brute force searches intractable for exploring all pertinent vaccine design variables and the subset of immunization protocols encompassed therein. To address this challenge, we employed deep reinforcement learning to drive a recently developed agent-based model of affinity maturation to focus sampling on immunization protocols with greater potential to improve the chosen metrics of protection, namely the broadly neutralizing antibody (bnAb) titers or fraction of bnAbs produced. Using this approach, we were able to coarse-grain a wide range of vaccine design variables and explore the relevant design space. Our work offers new testable insights into how vaccines should be formulated to maximize protective immune responses to hm-IDPs and how they can be minimally tailored to account for major sources of heterogeneity in human immune responses and various socioeconomic factors. Our results indicate that the first 3 to 5 immunizations, depending on the metric of protection, should be specially tailored to achieve a robust protective immune response, but that beyond this point further immunizations require only subtle changes in formulation to sustain a durable bnAb response.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Stochastic and a posteriori optimization to mitigate coil manufacturing errors in stellarator design

Abstract It was recently shown in Wechsung et al (2022 Proc. Natl Acad. Sci. USA 119 e2202084119) that there exist electromagnetic coils that generate magnetic fields, which are excellent approximations to quasi-symmetric fields and have very good particle confinement properties. Using a Gaussian process-based model for coil perturbations, we investigate the impact of manufacturing errors on the performance of these coils. We show that even fairly small errors result in noticeable performance degradation. While stochastic optimization yields minor improvements, it is not possible to mitigate these errors significantly. As an alternative to stochastic optimization, we then formulate a new optimization problem for computing optimal adjustments of the coil positions and currents without changing the shapes of the coil. These a-posteriori adjustments are able to reduce the impact of coil errors by an order of magnitude, providing a new perspective for dealing with manufacturing tolerances in stellarator design.

Physics↗
NASA NTRS1989

Stochastic evolution of refractory interstellar dust during the chemical evolution of a two-phase interstellar medium

The evolution course of refractoary interstellar dust during the chemical evolution of a two-phase interstellar medium (ISM) is studied using a simple model of the chemical evolution of ISM. It is assumed that, in this medium, the stars are born in molecular clouds, but new nucleosynthesis products and stellar return are entered into a complementary diffuse medium; the well-mixed matter of each interstellar phase is repeatedly cycled stochastically through the complementary phase and back. The dust is studied on a particle-by-particle bases as it is sputtered by shock waves in the diffuse medium, accretes an amorphous mantle of gaseous refractory atoms while its local medium joins the molecular cloud medium, and encounters the possibility of astration within molecular clouds. Results are presented relevant to the size spectrum of accreted mantles, its age spectrum and the distinction among its several lifetimes, depletion factors of refractory atoms in the diffuse gas, and isotopic anomalies.

Liffman, Kurt↗
DOE OSTI2021

Evaluating Gaussian process metamodels and sequential designs for noisy level set estimation

Abstract We consider the problem of learning the level set for which a noisy black-box function exceeds a given threshold. To efficiently reconstruct the level set, we investigate Gaussian process (GP) metamodels. Our focus is on strongly stochastic simulators, in particular with heavy-tailed simulation noise and low signal-to-noise ratio. To guard against noise misspecification, we assess the performance of three variants: (i) GPs with Student- t observations; (ii) Student- t processes (TPs); and (iii) classification GPs modeling the sign of the response. In conjunction with these metamodels, we analyze several acquisition functions for guiding the sequential experimental designs, extending existing stepwise uncertainty reduction criteria to the stochastic contour-finding context. This also motivates our development of (approximate) updating formulas to efficiently compute such acquisition functions. Our schemes are benchmarked by using a variety of synthetic experiments in 1–6 dimensions. We also consider an application of level set estimation for determining the optimal exercise policy of Bermudan options in finance.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Blinking statistics and molecular counting in direct stochastic reconstruction microscopy (dSTORM)

Abstract Motivation Many recent advancements in single-molecule localization microscopy exploit the stochastic photoswitching of fluorophores to reveal complex cellular structures beyond the classical diffraction limit. However, this same stochasticity makes counting the number of molecules to high precision extremely challenging, preventing key insight into the cellular structures and processes under observation. Results Modelling the photoswitching behaviour of a fluorophore as an unobserved continuous time Markov process transitioning between a single fluorescent and multiple dark states, and fully mitigating for missed blinks and false positives, we present a method for computing the exact probability distribution for the number of observed localizations from a single photoswitching fluorophore. This is then extended to provide the probability distribution for the number of localizations in a direct stochastic optical reconstruction microscopy experiment involving an arbitrary number of molecules. We demonstrate that when training data are available to estimate photoswitching rates, the unknown number of molecules can be accurately recovered from the posterior mode of the number of molecules given the number of localizations. Finally, we demonstrate the method on experimental data by quantifying the number of adapter protein linker for activation of T cells on the cell surface of the T-cell immunological synapse. Availability and implementation Software and data available at https://github.com/lp1611/mol_count_dstorm. Supplementary information Supplementary data are available at Bioinformatics online.

Patel, Lekha↗
NASA NTRS1996

Fluid Physics in a Fluctuating Acceleration Environment

We summarize several aspects of an ongoing investigation of the effects that stochastic residual accelerations (g-jitter) onboard spacecraft can have on experiments conducted in a microgravity environment. The residual acceleration field is modeled as a narrow band noise, characterized by three independent parameters: intensity (g(exp 2)), dominant angular frequency Omega, and characteristic correlation time tau. Realistic values for these parameters are obtained from an analysis of acceleration data corresponding to the SL-J mission, as recorded by the SAMS instruments. We then use the model to address the random motion of a solid particle suspended in an incompressible fluid subjected to such random accelerations. As an extension, the effect of jitter on coarsening of a solid-liquid mixture is briefly discussed, and corrections to diffusion controlled coarsening evaluated. We conclude that jitter will not be significant in the experiment 'Coarsening of solid-liquid mixtures' to be conducted in microgravity. Finally, modifications to the location of onset of instability in systems driven by a random force are discussed by extending the standard reduction to the center manifold to the stochastic case. Results pertaining to time-modulated oscillatory convection are briefly discussed.

Thomson, J. Ross↗
DOE OSTI2021

NRAP-Open-IAM Analytical Reservoir Model: Development and Testing

Geological carbon sequestration (GCS) is a key technology for reducing global carbon dioxide (CO 2 ) emissions. Over the last decade, the U.S. Department of Energy has invested in understanding the science base, developing practical implementation methods, and demonstrating secure GCS technologies to mitigate the environmental impacts associated with the atmospheric release of CO 2 . As part of the National Risk Assessment Partnership, a systems-level risk assessment tool, called the NRAP-Open-IAM, has been developed to conduct risk assessment and enable safe operations at a GCS site. The current NRAP-Open-IAM contains a simple reservoir model component that calculates the evolution of CO 2 saturation and fluid pressure in a storage reservoir during CO 2 injection operations. This report presents the development and testing of a new analytical reservoir reduced-order model (ROM), which is extended from an existing semi-analytical model for estimation of CO 2 and brine leakage along legacy wells, and enhances the capability of the NRAP-Open-IAM to simulate more types of reservoir conditions. The developed model is validated against three reference studies, and the results indicate that the new ROM predicts the behavior of the two-phase fluids (brine and injected CO 2 ) well and is applicable to different reservoir simulation boundary conditions (i.e., constant pressure boundary and infinite-acting boundary) without a priori user specification of the boundary type. Sensitivity analysis for a set of model parameters is performed using 4,000 synthetic cases prepared via a fully automated process and using machine-learning-based feature selection. The stochastic analysis identifies gravitational number (i.e., ratio of gravitational forces to viscous force) and distance between the injection well and observation location as the most impactful parameters for matching the pressure and CO 2 saturation, respectively, between the numerical simulations and the ROM. This report details the possible ROM uncertainties and serves as a guide for users to understand the use and limitations of this ROM. The code implementation of the model will be released as a module within the NRAP-Open-IAM.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Investigation of turbulent inflow specification in Euler–Lagrange simulations of mid-field spray

The process of atomization of a liquid jet by a parallel high-speed gas stream results in a spray, whose downstream development is of considerable interest to several applications. The round jet spray can be spatially divided into (i) a near-field (near-nozzle) region of liquid atomization and (ii) a downstream mid-field region of fully-dispersed droplets. In order to accurately model mid-field droplet dispersion, this work aims at developing a rigorous and robust injection model for Euler–Lagrange spray simulations. Results from experiments are used to obtain the relevant droplet number density, size distribution, and mean and standard deviation velocity distributions of the injection model, systematically in a step-by-step process. Two-phase large eddy simulations are performed by stochastically generating the Lagrangian droplets at the inlet of the mid-field region. Number flux, diameter distribution, mean velocity, and other time-averaged statistics at several downstream locations are shown to agree well with the corresponding experimental data.

42 ENGINEERING↗
DOE OSTI2023

Multinucleon transfer mechanism in Cf 250 + Th 232 collisions using the quantal transport description based on the stochastic mean-field approach

Production cross sections of heavy neutron-rich isotopes are calculated by employing quantal transport description in 250 Cf + 232 Th collisions. This quantal transport description is based on the stochastic mean-field approach, and it provides a microscopic approach beyond time-dependent Hartree-Fock theory to include mean-field fluctuations. Deexcitation of primary fragments is determined by employing the statistical GEMINI++ code. Here, calculations provide predictions for production cross sections of neutron rich transfermium isotopes without any adjustable parameters.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Simulations of Stochastic Fluid Dynamics near a Critical Point in the Phase Diagram

Here, we present simulations of stochastic fluid dynamics in the vicinity of a critical endpoint belonging to the universality class of the Ising model. This study is motivated by the challenge of modeling the dynamics of critical fluctuations near a conjectured critical endpoint in the phase diagram of quantum chromodynamics (QCD). We focus on the interaction of shear modes with a conserved scalar density, which is known as model H. We show that the observed dynamical scaling behavior depends on the correlation length and the shear viscosity of the fluid. As the correlation length is increased or the viscosity is decreased we observe a crossover from the dynamical exponent of critical diffusion, z≃4, to the expected scaling exponent of model H, z≃3. We use our method to investigate the time-dependent correlation function of non-Gaussian moments M n (t) of the order parameter. We find that the relaxation time depends in a nontrivial manner on the power n.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

Correlation-aware binning for small-angle neutron scattering via Gaussian-process inference

Binning in small-angle neutron scattering (SANS) is typically performed empirically, with fixed parameters chosen for convenience rather than statistical optimality. Such practices often fail to balance statistical precision and spatial resolution, leading to inconsistencies across instruments and datasets. Here we establish a correlation-aware framework that determines the optimal bin width from first principles by extending the classical Freedman–Diaconis (FD) rule to account for inter-bin correlations with a Gaussian process. In this formulation, the scattering intensity is treated as a smooth stochastic field whose statistical coherence is described by a covariance matrix. Analytical expressions of errors derived from this model yield closed-form criteria that separate the total deviation into contributions from counting noise, aliasing distortion and curvature-dependent correlation effects. Expressed in reduced variables, the resulting dimensionless error surface reveals a continuous transition from the uncorrelated FD regime to the correlation-dominated limit, providing a unified description of noise suppression and resolution control. Because the formulation depends only on the profile characteristics of scattering intensity I(Q), specifically its average intensity and first- and second-order derivatives, it applies generally to any SANS measurement regardless of sample, instrument or geometry. Experimental validation using small- and ultra-small-angle neutron scattering data confirms the predicted scaling behavior, demonstrating that correlation-aware inference systematically reduces mean-squared error and enables information-efficient reproducible data reduction across materials and instruments.

Tung, Chi-Huan [ORNL] (ORCID:0000000221972074)↗
DOE OSTI2022

A stochastic covariance shrinkage approach to particle rejuvenation in the ensemble transform particle filter

Rejuvenation in particle filters is necessary to prevent the collapse of the weights when the number of particles is insufficient to properly sample the high-probability regions of the state space. Rejuvenation is often implemented in a heuristic manner by the addition of random noise that widens the support of the ensemble. This work aims at improving canonical rejuvenation methodology by the introduction of additional prior information obtained from climatological samples; the dynamical particles used for importance sampling are augmented with samples obtained from stochastic covariance shrinkage. A localized variant of the proposed method is developed. Numerical experiments with the Lorenz '63 model show that modified filters significantly improve the analyses for low dynamical ensemble sizes. Furthermore, localization experiments with the Lorenz '96 model show that the proposed methodology is extendable to larger systems.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1979

Investigation of the Multiple Method Adaptive Control (MMAC) method for flight control systems

The stochastic adaptive control of the NASA F-8C digital-fly-by-wire aircraft using the multiple model adaptive control (MMAC) method is presented. The selection of the performance criteria for the lateral and the longitudinal dynamics, the design of the Kalman filters for different operating conditions, the identification algorithm associated with the MMAC method, the control system design, and simulation results obtained using the real time simulator of the F-8 aircraft at the NASA Langley Research Center are discussed.

Athans, M.↗
NASA NTRS1982

On the contribution of a stochastic background of gravitational radiation to the timing noise of pulsars

The influence of a stochastic and isotropic background of gravitational radiation on timing measurements of pulsars is investigated, and it is shown that pulsar timing noise may be used to establish a significant upper limit of about 10 to the -10th on the total energy density of very long-wavelength stochastic gravitational waves. This places restriction on the strength of very long wavelength gravitational waves in the Friedmann model, and such a background is expected to have no significant effect on the approximately 3 K electromagnetic background radiation or on the dynamics of a cluster of galaxies.

Mashhoon, B.↗
NASA NTRS1987

A statistical rain attenuation prediction model with application to the advanced communication technology satellite project. Part 2: Theoretical development of a dynamic model and application to rain fade durations and tolerable control delays for fade countermeasures

A dynamic rain attenuation prediction model is developed for use in obtaining the temporal characteristics, on time scales of minutes or hours, of satellite communication link availability. Analagous to the associated static rain attenuation model, which yields yearly attenuation predictions, this dynamic model is applicable at any location in the world that is characterized by the static rain attenuation statistics peculiar to the geometry of the satellite link and the rain statistics of the location. Such statistics are calculated by employing the formalism of Part I of this report. In fact, the dynamic model presented here is an extension of the static model and reduces to the static model in the appropriate limit. By assuming that rain attenuation is dynamically described by a first-order stochastic differential equation in time and that this random attenuation process is a Markov process, an expression for the associated transition probability is obtained by solving the related forward Kolmogorov equation. This transition probability is then used to obtain such temporal rain attenuation statistics as attenuation durations and allowable attenuation margins versus control system delay.

Manning, Robert M.↗