Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “STOCHASTIC PROCESSES”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

MLMOD: Machine Learning Methods for Data-Driven Modeling in LAMMPS

MLMOD is a software package for incorporating machine learning approaches and models into simulations of microscale mechanics and molecular dynamics in LAMMPS. Recent machine learning approaches provide promising data-driven approaches for learning representations for system behaviors from experimental data and high fidelity simulations. The package facilitates learning and using data-driven models for (i) dynamics of the system at larger spatial-temporal scales (ii) interactions between system components, (iii) features yielding coarser degrees of freedom, and (iv) features for new quantities of interest characterizing system behaviors. MLMOD provides hooks in LAMMPS for (i) modeling dynamics and time-step integration, (ii) modeling interactions, and (iii) computing quantities of interest characterizing system states. The package allows for use of machine learning methods with general model classes including Neural Networks, Gaussian Process Regression, Kernel Models, and other approaches. Here we discuss our prototype C++/Python package, aims, and example usage. For related papers, examples, updates, and additional information see https://github.com/atzberg/mlmod and http://atzberger.org/.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

LandScan Mosaic

The LandScan program at Oak Ridge National Laboratory (ORNL), in collaboration with the National Geospatial-Intelligence Agency (NGA), continues to deliver the most accurate and up to date global, high resolution gridded population data. Additionally, the latest advancements in the LandScan HD methodology led to reduced latency in development of rapid updates for geopolitical events. With momentum towards reporting more up to date population estimates, feedback from the user community expressed interest in reporting population estimates in ranges - whether to express a level of uncertainty or confirm to leadership and stakeholders the modeled data are estimates. Building upon the need to understand uncertainty or confidence in the modeled data and report ranges at the global scale, LandScan Mosaic was developed. LandScan Mosaic represents the next generation of high-resolution population modeling, building upon the established success of previous LandScan HD iterations. While LandScan HD employed a deterministic big data fusion approach, LandScan Mosaic enhances this methodology by integrating advanced machine learning techniques to impute missing, yet crucial, population model parameters. This advancement allows for probabilistic modeling of building occupancy and population distribution, incorporating uncertainty quantification through Monte Carlo sampling methods. By combining big data fusion with machine learning-driven imputation and stochastic modeling, LandScan Mosaic provides a more comprehensive and robust representation of population dynamics. LandScan Mosaic will be following the in the footsteps of its longstanding counterpart LandScan Global and releasing a global gridded population raster, at the 3-arcsecond resolution. This technical report documents the current stage of development of LandScan Mosaic, detailing the methodologies and data sources behind the modeling. Stakeholders are encouraged to use this document as an authoritative reference for insight into Mosaic’s data development processes. However, readers should note that LandScan Mosaic remains in a late-stage research and development phase, and methodologies and data presented here are subject to refinements ahead of the anticipated global release in Summer 2025. Feedback and inquiries from users and stakeholders are welcomed as we continue to refine and enhance this important population resource.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Ion Acceleration and the Development of a Power-law Energy Spectrum in Magnetic Reconnection

How charged particles are accelerated efficiently and form a power-law energy spectrum in magnetic reconnection is a problem that is not well understood. In a previous paper, it was shown that the electron Kelvin–Helmholtz instability (EKHI) in force-free magnetic reconnection generates fast-expanding vortices that can accelerate electrons in a few tens of ion gyroperiods (less than 1 ms in the solar corona) to form a power-law energy distribution. In this paper, we present a particle-in-cell (PIC) simulation study of ion acceleration in force-free magnetic reconnection in the presence of the EKHI-induced turbulence. We find that ions are not significantly accelerated by the EKHI-induced stochastic electric field until the magnetic vortices expand to sizes comparable to the ion gyroradius. The Alfvén waves generated by the EKHI couple with the magnetic vortices, leading to resonance between the ions inside the magnetic vortices and Alfvén waves and enhanced ion heating. The induced Alfvén wave resonance results in a broken power-law energy spectrum with a breakpoint at $\sim {m}_{i}{v}_{A}^{2}$, where v A is the Alfvén velocity. Here, we show that the process that forms the nonthermal tail is a second-order Fermi mechanism and the mean spectral index is α = (1 + 4 a 2 D/R) /2, where D is the spatial scale of the inductive electric field, R is that of vortices, and a = B g /B 0 , with ratio of guide field B g and asymptotic B 0 .

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Deep Generative Models that Solve PDEs: Distributed Computing for Training Large Data-Free Models

Recent progress in scientific machine learning (SciML) has opened up the possibility of training novel neural network architectures that solve complex partial differential equations (PDEs). Several (nearly data free) approaches have been recently reported that successfully solve PDEs, with examples including deep feed forward networks, generative networks, and deep encoder-decoder networks. However, practical adoption of these approaches is limited by the difficulty in training these models, especially to make predictions at large output resolutions (≥1024×1024). Here we report on a software framework for data parallel distributed deep learning that resolves the twin challenges of training these large SciML models - training in reasonable time as well as distributing the storage requirements. Our framework provides several out of the box functionality including (a) loss integrity independent of number of processes, (b) synchronized batch normalization, and (c) distributed higher-order optimization methods. We show excellent scalability of this framework on both cloud as well as HPC clusters, and report on the interplay between bandwidth, network topology and bare metal vs cloud. We deploy this approach to train generative models of sizes hitherto not possible, showing that neural PDE solvers can be viably trained for practical applications. We also demonstrate that distributed higher-order optimization methods are 2-3× faster than stochastic gradient-based methods and provide minimal convergence drift with higher batch-size.

PDEs↗
DOE OSTI2022

General-Purpose Bayesian Tensor Learning With Automatic Rank Determination and Uncertainty Quantification

A major challenge in many machine learning tasks is that the model expressive power depends on model size. Low-rank tensor methods are an efficient tool for handling the curse of dimensionality in many large-scale machine learning models. The major challenges in training a tensor learning model include how to process the high-volume data, how to determine the tensor rank automatically, and how to estimate the uncertainty of the results. While existing tensor learning focuses on a specific task, this paper proposes a generic Bayesian framework that can be employed to solve a broad class of tensor learning problems such as tensor completion, tensor regression, and tensorized neural networks. We develop a low-rank tensor prior for automatic rank determination in nonlinear problems. Our method is implemented with both stochastic gradient Hamiltonian Monte Carlo (SGHMC) and Stein Variational Gradient Descent (SVGD). We compare the automatic rank determination and uncertainty quantification of these two solvers. We demonstrate that our proposed method can determine the tensor rank automatically and can quantify the uncertainty of the obtained results. We validate our framework on tensor completion tasks and tensorized neural network training tasks.

Bayesian inference↗
DOE OSTI2024

Single-molecule imaging of lignocellulose deconstruction by SCATTIRSTORM microscopy

The goal of this project is to build a multimodal optical microscope to measure the binding, processive degradation, and pausing behaviors of cellulases as they interact with and degrade both synthetic and naturally occurring lignocellulosic walls. To achieve this, we will use high spatio-temporal single-molecule imaging to track cellulases, while visualizing specific molecular components of cellulose, lignin and hemicellulose, that make up their lignocellulose substrate. The microscope will combine Interferometric Scattering (iSCAT), which provides unprecedented spatiotemporal resolution; Total Internal Reflection Fluorescence (TIRF), which provides single-molecule resolution of multiple fluorophore-labeled molecules; and Stochastic Reconstruction (STORM), which allows for three-dimensional super-resolution imaging of intact plant cell walls during degradation. Initial studies will investigate cellulase dynamics on in vitro-assembled cell wall analogs, and later work will progress to using native plant cell walls.

09 BIOMASS FUELS↗
DOE OSTI2021

Chaotic Dynamics Driven by Particle-Core Interactions

High-intensity beams in modern linacs are frequently encircled by diffuse halos, which drive sustained particle losses and result in gradual degradation of accelerating structures. In large part, the growth of halos is facilitated by internal space-charge forces within the beams, and detailed characterization of this process constitutes an active area of ongoing research. A partial understanding of dynamics that ensue within space-charge dominated beams is presented by the particle-core interaction paradigm – a mathematical model wherein single particle dynamics, subject to the collective potential of the core, are treated as a proxy for the broader behavior of the beam. In this work, we investigate the conditions for the onset of large-scale chaos within the framework of this model, and demonstrate that the propensity towards stochastic evolution is strongly dependent upon the charge distribution of the beam. In particular, we show that while particle motion within a uniformly charged beam is dominantly regular, rapid deterministic chaos readily arises within space-charge dominated Gaussian beams. Importantly, we find that for sufficiently high values of the beam’s space charge and beam pulsation amplitude, enhanced chaotic mixing between the core and the halo can lead to an enhanced radial diffusion of charged particles. We explain our results from analytic grounds by demonstrating that chaotic motion is driven by the intersection of two principal resonances of the system, and derive the relevant overlap conditions. Additionally, our analysis illuminates a close connection between the mathematical formulation of the particle-core interaction model and the Andoyer family of integrable Hamiltonians

43 PARTICLE ACCELERATORS↗
DOE OSTI2024

Rapid Optimization of Total Variation with Applications in Imaging, Additive Manufacturing, and Qualification

Total Variation optimization penalizes the gradient of a control variable or state. While this work focuses on image processing in particular, it has also found applications in inverse problems and topology optimization. In image processing, the goal is to maintain faithfulness to the original image while denoising and/or deblurring. Additionally, bilevel optimization over the spatially varying regularization weights can illuminate interfaces such as damage regions and other anomalies. We will address two fundamental challenges with TV-optimization: (i) the typical slow convergence of existing TV-optimization methods, and (ii) the selection of spatially varying TV parameters to promote interface detection. Additionally, we will apply such techniques to image data collected in additive manufacturing. In said context, stochasticity in build events induces flaws in the manufactured piece, compromising the integrity of said part. There is a critical need for in-situ monitoring to spot anomalies once they form, and in this setting we apply our total variation and hyperparameter solvers. We will develop a customized algorithm based on for extreme-scale TV-optimization that achieves super-linear or quadratic-convergence, a critical property for real-time, image-by-image analysis. A worst-case outcome is a preprocessing step that enhances image quality in-situ, specifically for out-of-focus and noisy images.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Experimental Validation of a Command and Control Traffic Detection Model

Network intrusion detection systems (NIDS) are commonly used to detect malware communications, including command-and-control (C2) traffic from botnets. NIDS performance assessments have been studied for decades, but mathematical modeling has rarely been used to explore NIDS performance. This paper details a mathematical model that describes a NIDS performing packet inspection and its detection of malware's C2 traffic. Here, the paper further describes an emulation testbed and a set of cyber experiments that used the testbed to validate the model. These experiments included a commonly used NIDS (Snort) and traffic with contents from a pervasive malware (Emotet). Results are presented for two scenarios: a nominal scenario and a “stressed” scenario in which the NIDS cannot process all incoming packets. Model and experiment results match well, with model estimates mostly falling within 95 % confidence intervals on the experiment means. Model results were produced 70-3000 times faster than the experimental results. Consequently, the model's predictive capability could potentially be used to support decisions about NIDS configuration and effectiveness that require high confidence results, quantification of uncertainty, and exploration of large parameter spaces. Furthermore, the experiments provide an example for how emulation testbeds can be used to validate cyber models that include stochastic variability.

mathematical model↗
DOE OSTI2021

An automated approach to the alignment of compound refractive lenses

Compound refractive lenses (CRLs) are established X-ray focusing optics, and are thus a key element of many beamlines at X-ray facilities, used to either to focus a beam or image a sample. While CRLs are quite established, the stack of single lens elements affords a very small numerical aperture because of the thick lens profile, making them far more difficult to align than classical optical lenses that obey the thin-lens approximation. This means that the alignment must be very precise and is highly sensitive to changes to the incident beam; aligning CRLs is thus typically treated as a time-consuming manual process. Many groups circumvent day-to-day realignment by using engineering controls (e.g. mounting optics) that sacrifice some of the beam’s focusing characteristics, i.e. spot size, or resolution. While these choices minimize setup time, there are clear disadvantages. This work presents a new automated approach to align CRLs using a simple alignment apparatus that is easy to adapt and install at different types of X-ray experiments or facilities. Our approach builds on recent CRL modeling efforts, using an approach based on the Stochastic Nelder-Mead (SNM) simplex method. We demonstrate the efficacy of this method by numerical simulation and then extend this test to real experiments conducted at the Advanced Photon Source to confirm its performance with a synchrotron X-ray beam. This work provides an opportunity to automate key instrumentation at X-ray facilities.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

A Kinetic Model for Predicting Trace Gas Uptake and Reaction

A model is developed to describe trace gas uptake and reaction with applications to aerosols and microdroplets. Gas uptake by the liquid is formulated as a coupled equilibria that links gas, surface, and bulk regions of the droplet or solution. Previously, this framework was used in explicit stochastic reaction-diffusion simulations to predict the reactive uptake kinetics of ozone with droplets containing aqueous aconitic acid, maleic acid, and sodium nitrite. With the use of prior data and simulation results, a new equation for the uptake coefficient is derived, which accounts for both surface and bulk reactions. Lambert W functions are used to obtain closed form solutions to the integrated rate laws for the multiphase kinetics; similar to previous expressions that describe Michaelis-Menten enzyme kinetics. Together these equations couple interface and bulk processes over a wide range of conditions and do not require many of the limiting assumptions needed to apply resistor model formulations to explain trace gas uptake and reaction.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Fabrication-robust silicon photonic devices in standard sub-micron silicon-on-insulator processes

Perturbations to the effective refractive index from nanometer-scale fabrication variations in waveguide geometry plague high index-contrast photonic platforms; this includes the ubiquitous sub-micron silicon-on-insulator (SOI) process. Such variations are particularly troublesome for phase-sensitive devices, such as interferometers and resonators, which exhibit drastic changes in performance as a result of these fabrication-induced phase errors. In this Letter, we propose and experimentally demonstrate a design methodology for dramatically reducing device sensitivity to silicon width variations. We apply this methodology to a highly phase-sensitive device, the ring-assisted Mach–Zehnder interferometer (RAMZI), and show comparable performance and footprint to state-of-the-art devices, while substantially reducing stochastic phase errors from etch variations. This decrease in sensitivity is directly realized as energy savings by significantly reducing the required corrective thermal tuning power, providing a promising path toward ultra-energy-efficient large-scale silicon photonic circuits.

Rizzo, Anthony (ORCID:000000034752797X)↗
DOE OSTI2024

EXPLORING INTERFEROMETRY DIAGNOSTICS FOR OPTICAL STOCHASTIC COOLING AT FAST/IOTA

Optical Stochastic Cooling (OSC) is an advanced beam-cooling technique that will advance the traditional stochastic cooling. This method leverages optical radiation and high-precision feedback to cool the particles more efficiently than traditional stochastic methods by more than three orders of magnitude. As such, it is an enabler for the development of next generation discovery science machines at the frontiers of energy and intensity. This paper focuses on the development of the second phase of OSC and improving extreme beam cooling techniques in accelerators. The goal was to build and characterize a Mach-Zehnder Interferometer (MZI) in the FAST laser lab using known glass plates thickness which will allow future measurements of unknown phase change due to nonlinear amplification processes.

Teriba, Folashade↗
DOE OSTI2025

Data and code for Daily and Multi-Day Extreme Rainfall Analysis Under Future Climates Using Stochastic Storm Transposition and NEX-GDDP-CMIP6 Over CONUS

This data package provides inputs, codes, and outputs for a comprehensive analysis of projected changes in extreme precipitation across 10 regions of the continental United States, using 34 downscaled Earth System Models (ESMs) from the NASA Earth Exchange Global Daily Downscaled Projections, Coupled Model Intercomparison Project Phase 6 (NEX-GDDP-CMIP6) dataset. These models are part of the Coupled Model Intercomparison Project Phase 6 (CMIP6), a coordinated climate modeling framework widely used to assess climate change impacts. The analysis applies a stochastic storm transposition method to quantify changes in extreme rainfall under two Shared Socioeconomic Pathway (SSP) climate scenarios—SSP2-4.5 (moderate emissions) and SSP5-8.5 (high emissions)—compared to historical conditions (1995–2014 vs. 2081–2100). The dataset includes rainfall depth estimates for extreme events with return periods from 2 to 500 years across multiple storm durations (1, 3, and 5 days) for each of the 10 U.S. regions. Weighted ensemble statistics are derived from individual ESM performance against historical precipitation patterns, enabling robust uncertainty quantification through both sign-based and permutation-test-based model agreement assessments. Key analyses address: (1) relative changes in extreme precipitation for each climate scenario, (2) differences between SSP scenarios (SSP5-8.5 vs. SSP2-4.5), (3) contrasts between rare and frequent events, and (4) variations between multi-day and daily storm durations. The workflow produces ensemble statistics—median, 5th, 25th, 75th, and 95th percentiles—along with model agreement metrics that identify regions and event types with robust climate change signals. The dataset includes: processed rainfall depth outputs (netCDF format) from the RainyDay Python package, ESM weights from historical performance evaluation using DayMet observations, ensemble statistics across all storm dimensions, and figures summarizing key findings.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Subordinated Gaussian Processes for Solar Irradiance

Traditionally the power grid has been a one-way street with power flowing from large transmission-connected generators through the distribution network to consumers. This paradigm is changing with the introduction of distributed renewable energy resources (DERs), and with it, the way the grid is managed. There is currently a dearth of high fidelity solar irradiance datasets available to help grid researchers understand how expansion of DERs could affect future power system operations. Realistic simulations of by-the-second solar irradiances are needed to study how DER variability affects the grid. Irradiance data are highly non-stationary and non-Gaussian, and even modern time series models are challenged by their distributional properties. We develop a subordinated non-Gaussian stochastic model whose simulations realistically capture the distribution and dependence structure in measured irradiance. We illustrate our approach on a fine resolution dataset from Hawaii, where our approach outperforms standard nonlinear time series models.

MATHEMATICS AND COMPUTING,SOLAR ENERGY↗
DOE OSTI2021

Machine learning-based analysis of COVID-19 pandemic impact on US research networks

Here in this study we explore how fallout from the changing public health policy around COVID-19 has changed how researchers access and process their science experiments. Using a combination of techniques from statistical analysis and machine learning, we conduct a retrospective analysis of historical network data for a period around the stay-at-home orders that took place in March 2020. Our analysis takes data from the entire ESnet infrastructure to explore DOE high-performance computing (HPC) resources at OLCF, ALCF, and NERSC, as well as User sites such as PNNL and JLAB. We look at detecting and quantifying changes in site activity using a combination of t-Distributed Stochastic Neighbor Embedding (t-SNE) and decision tree analysis. Our findings bring insights into the working patterns and impact on data volume movements, particularly during late-night hours and weekends.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Numerical simulation of asteroid geometry variance on airburst threat

For an atmospheric airburst the primary source of concern when assessing uncertainty is the size and velocity. Determining these properties provides the basis for threat assessment, as the total energy of the asteroid may then be estimated, and the threat investigated thoroughly. Even with clarity as to how much energy an asteroid may deposit, a great deal of uncertainty still exists for the actual energy deposition process. One such source of uncertainty is the geometry of the incoming asteroid. The geometry of an asteroid will alter the stress distribution during entry, which adds uncertainty to when fracture will occur. Here, in this study, we use Smoothed Particle Hydrodynamics to model the atmospheric airburst of Tunguska-scale asteroids with varying geometric profiles, including a sphere, ellipsoid, binary and superellipsoid. Each asteroid is modeled as a homogenous structure with strength. We assess uncertainty through a series of planar 2D simulation cases for each geometry, comparing the source of stochasticity across geometries. A single 3D airburst simulation for each geometry is also analyzed. Additionally, the 3D cases are compared to the highly uncertain Tunguska event, predicting variance in burst height across geometries, but all bounded by theoretical burst heights proposed for Tunguska.

Airburst↗
DOE OSTI2021

Fuel properties effects on wall-wetting and fuel-in-lube dilution under stochastic pre ignition prone conditions

Fuel-engine interactions have been shown to influence stochastic pre-ignition (SPI), however there is uncertainty on the root causes, participially if effects are primarily physical or chemical in nature. To better delineate the physical and chemical dependencies of fuel properties on SPI, this work studies interactions between aromatics, distillation, and particle matter index on SPI with a laser induced fluorescence (LIF) diagnostic to observe wall wetting. Fuels with high aromatic components or higher distillation temperatures tend to increase SPI events, but it is not well understood if the increased fuel dilution or a chemical aspect of this process is the primary mechanism for SPI. By employing the novel LIF in this work we measure fuel dilution in real-time in a running single cylinder research engine operated at SPI conditions. Three fuels were used in the present work, with the LIF diagnostic. Each fuel was operated at two injection timings, generating fuel specific effects on wall wetting. The LIF measurements are coupled with engine combustion measurements and SPI event counts. Results enable a deconvolution of fuel physical and chemical properties on SPI propensity, providing unique and novel insights into the dominant fuel effects affecting SPI.

Splitter, Derek↗