Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Distribution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

SWARM: Reimagining scientific workflow management systems in a distributed world

Modern scientific workflows process massive amounts of data from diverse instruments and sensors, leveraging geographically distributed, heterogeneous compute and storage resources—from leadership-class systems to edge devices—connected by high-performance networks. The diversity of resources introduces challenges in harnessing their full potential, with resilience issues arising across applications, system software, networks, storage, and hardware. Today, workflow management systems (WMS) coordinate the execution of computation and data management tasks across target resources. However, WMS’s centralized nature makes them vulnerable to faults and scalability issues that may result in failures of entire computational campaigns. In conclusion, this paper introduces a novel agentic framework for workflow management, fully distributing and decentralizing the WMS functions and modeling them as swarm intelligence agents infused with advanced artificial intelligence solutions and traditional distributed computing algorithms that can make coordinated decisions in the presence of failures of the underlying cyberinfrastructure.

Swarm intelligence↗
DOE OSTI2020

Comparison of fixed charge and polarizable models for predicting the structural, thermodynamic, and transport properties of molten alkali chlorides

Results from extensive molecular dynamics simulations of molten LiCl, NaCl, KCl, and RbCl over a wide range of temperatures are reported. Comparison is made between the “Polarizable Ion Model” (PIM) and the non-polarizable “Rigid Ion Model” (RIM). Densities, self-diffusivities, shear viscosities, ionic conductivities, and thermal conductivities are computed and compared with experimental data. In addition, radial distribution functions are computed from ab initio molecular dynamics simulations and compared with the two sets of classical simulations as well as experimental data. Here, the two classical models perform reasonably well at capturing structural and dynamic properties of the four molten alkali chlorides, both qualitatively and often quantitatively. With the singular exception of liquid density, for which the PIM is more accurate than the RIM, there are few clear trends to suggest that one model is more accurate than the other for the four alkali halide systems studied here.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

End-of-Winter Snow Depth, Temperature, Density, and SWE Measurements at Kougarok Road Site, Seward Peninsula, Alaska, 2022

Measurements of end-of-winter snow properties were collected at the NGEE Arctic Kougarok Road Site at mile marker 64 (KG_MM64) from April 2 to April 5, 2022. This dataset contains three *.csv data files of spatially distributed values of snow depth, snow water equivalent (SWE), and snow temperature at the snow surface and at the bottom of the snowpack. Data were collected toward the end of the winter season during early April, when the snowpack would be near its maximum. A Snow-Hydro MagnaProbe (http://www.snowhydro.com/products/column2.html) was used to improve collection efficiency and enhance spatial coverage. A user guide is included as a *.pdf. This dataset is a continuation of the previous end-of-winter snow surveys conducted at the Kougarok Road Site in 2018 (Wilson et al., 2021; https://doi.org/10.5440/1593874).The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Fiber Uncertainty Visualization for Bivariate Data With Parametric and Nonparametric Noise Models

Visualization and analysis of multivariate data and their uncertainty are top research challenges in data visualization. Constructing fiber surfaces is a popular technique for multivariate data visualization that generalizes the idea of level-set visualization for univariate data to multivariate data. Here, in this paper, we present a statistical framework to quantify positional probabilities of fibers extracted from uncertain bivariate fields. Specifically, we extend the state-of-the-art Gaussian models of uncertainty for bivariate data to other parametric distributions (e.g., uniform and Epanechnikov) and more general nonparametric probability distributions (e.g., histograms and kernel density estimation) and derive corresponding spatial probabilities of fibers. In our proposed framework, we leverage Green's theorem for closed-form computation of fiber probabilities when bivariate data are assumed to have independent parametric and nonparametric noise. Additionally, we present a nonparametric approach combined with numerical integration to study the positional probability of fibers when bivariate data are assumed to have correlated noise. For uncertainty analysis, we visualize the derived probability volumes for fibers via volume rendering and extracting level sets based on probability thresholds. We present the utility of our proposed techniques via experiments on synthetic and simulation datasets.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Fracture Intersections under Stress: Laboratory Data and Code [Data set]

The connectivity of natural and induced fractures governs the injection and withdrawal of fluids from subsurface reservoirs. Connectivity depends on intersections that control how fluids mix and move through the entire system. Here, we present data sets from 3D X-ray microscopy measurements of simple fracture networks under stress. 3D printing was used to create prismatic blocks that formed fracture networks composed of 2 orthogonal fractures. The network orientation was either "x" or "+" relative to an applied vertical stress. 3D data sets were collected for normal loads of 25, 100 and 200 Newtons for samples with fracture surfaces with either correlated or uncorrelated asperity distributions. The file contains data from the 12 samples analyzed along with an example code used to extract the intersection geometry. Additional experimental details can be found in the manuscript "Geologic Stress Modulates Fluid Mixing at Fracture Intersections" (10.1038/s43247-026-03525-9)and supplemental information to appear in Communications Earth & Environment in 2026.

02 PETROLEUM↗
DOE OSTI2020

Modeling the role of local crystallographic correlations in microstructures of Ti-6Al-4V using a correlated structure visco-plastic self-consistent polycrystal plasticity formulation

This paper presents a multi-level crystal plasticity-based simulation framework for modeling mechanical response and microstructure evolution of Ti-6Al-4V with α-lath/lamellar microstructures. Here, the model is a correlated structure visco-plastic self-consistent (CS-VPSC) formulation linking three scales: a single crystals micro-scale, a lath/lamellar colony meso-scale, and a lath/lamellar aggregate macro-scale. A selected hardening law for the evolution of critical resolved shear stress per slip system used in CS-VPSC is phenomenological. However, it adjusts the resistances of basal and prismatic slip systems based on the geometry of slip transfer between adjacent lamellae. Consistent with experimental evidences, the resolved shear stress on the pyramidal slip planes is dependent not only on the stress in the direction of slip but also on the two orthogonal shear stress components and the three normal stress components (non-Schmid effects). Electron backscatter diffraction (EBSD) data in conjunction with a procedure relying on α→β phase transformation is used to construct paired variants of α-laths/lamellae satisfying their local crystallographic correlations. The procedure fits volume fractions of individual laths/lamellae with the experimental EBSD data and selects a distribution of habit planes between adjacent variants with respect to the loading direction. The simulation framework is applied to interpret the deformation behavior in tension and compression along two sample directions of Ti-6Al-4V fabricated via laser powder bed fusion. Moreover, the model is used to simulate texture evolution during rolling of the material to large strains. It is demonstrated that the model is capable of predicting plastic anisotropy/asymmetry and the concomitant texture evolution. While the model reveals a significant effect of habit plane inclination with respect to the loading direction on yield stress, the comparison of the data and model predictions shows that a random distribution of habit planes fits the flow response. It is further inferred that the tension-compression asymmetry arises from the non-Schmid effects.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Light Water Reactor Sustainability Program: Use of Time Distributions to Predict Operator Procedure Performance in Dynamic Human Reliability Analysis

The Human Unimodel for Nuclear Technology to Enhance Reliability (HUNTER) framework affords software capable of conducting human reliability analysis (HRA) using a dynamic approach built around operating procedures (OPs) from nuclear power plants (NPPs). Previous HUNTER reports document the development of this software tool, the coupling of HUNTER to the simulator code, the collection of operator performance data by using simulators to calibrate HUNTER models, and linking HUNTER to probabilistic risk assessment (PRA) software. The present report largely addresses two topics. The first is a new function in HUNTER called the HUNTER Procedure Performance Predictor (P3). HUNTER P3 uses HUNTER’s built in Monte Carlo tools featuring human performance variability to identify potential error traps in procedures. The second topic is time distribution analysis to generate time inputs for dynamic HRA. The current analysis was performed to investigate time distributions for task primitives, which are the minimum task unit of analysis used in dynamic HRA modeling. Using the time distribution data, the elapsed time for human actions in an extended loss of AC power (ELAP) scenario is then investigated. Time data and prediction are essential for modeling procedure performance.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2025

MINERvA Experiment Open Data Release

This is an open data product that contains all the neutrino and antineutrino data from the MINERvA experiment, packaged in a way that you can use. The ultimate package will contain both neutrino and antineutrino data, and will contain both our Low energy and Medium Energy data, where the neutrino energy distributions peaked around 3GeV and 6GeV respectively. We also provide simulated data and a way to access our uncertainties on that simulation, including flux, neutrino interaction, and detector uncertainties. The data (and simulated data) has already been pre-selected to contain either a muon candidate or an electron candidate.

Collaboration, MINERvA [Fermi National Accelerator↗
DOE OSTI2020

Thoughts on Analyzing Neutron Multiplicity Data

Bayesian methods offer many advantages for analyzing neutron multiplicity data. Ideally one would make nonparametric estimates of the the posterior distributions, the probabilities - given the data - for unknowns to take on particular values. Once one has the posterior, uncertainty quantification is very natural. We describe how different ways of formulating the statistical theory of fission chains are mathematically equivalent. When confronted with actual data and the burden of finite statistics, different methods of expressing the theory offer advantages for understanding the underlying source parameters from an information theory standpoint.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Neural MUSE Analysis

Researchers at Oak Ridge National Laboratory (ORNL) created data as part of the MUSE (Multi-Agency Urban Search Experiment Detector and Algorithm Test Bed) project simulating illicit nuclear materials located in various buildings along a road. In the simulation, a truck containing a radiation detector drives down the road gathering listmode data (counting the and energy of incident gamma radiation). Building materials, source shielding, driving speed, truck direction, truck location on the road, source type, and source placement are all varied between runs of the data set. This data was created using deterministic neutron transport and Monte Carlo methods through a combination of SCALE, MAVRIC, MCNP, and GADRAS. As part of a follow-on NA-22 project, two Kaggle competitions were created to determine the best algorithms for finding and identifying gamma sources in this simulated urban environment. The winning algorithm was neural network-based and had a test accuracy of 76.4% accuracy for source identification. This work seeks to build upon this work and improve the results through the application of novel machine learning techniques. As a first step, the data was classified by a simple Convolutional Neural Network (CNN) To accomplish this, the data was first preprocessed into “waterfall plots.” These plots are composed of energy vs count plots that are stacked vertically to show progression in time. The horizontal axis indicating the particle energy incorporated user defined bin spacing with options for in linear-, logarithmic-, square root-, and user-spaced bins. The z or color dimension showed the number of counts corresponding the energy-time combination. This data was then used to generate more data, by generating a local estimate of the mean of the distribution for a bin and then randomly re-sampling that bin from a Poisson distribution. Once all of this data was generated, it was fed into a well-known CNN architecture, ResNet50. The output layer of this model was removed and replaced with layers corresponding to the shape desired isotope outputs. The provided training data was used to train the classifier and the remaining testing data was used to evaluate the model. Results are soon to be forthcoming.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2026

Roadmap and Benchmarking: Privacy in Federated Load Forecasting

Data-driven techniques for energy demand forecasting continue to emerge with promising impacts on distribution grid planning. However, the development of robust and generalizable machine learning models requires that representative high quality training data are available. Distributed energy resources have begun to embed intelligence, gathering large amounts of data on customer demand, behavior, and household devices that are connected to the grid. Though utilities aggregate meter-level demand data for load shaping, demand response, outage management, reliability planning, and billing applications, there lies an inherent privacy concern in sharing consumption data that may identify individual consumer behavioral patterns. Hence, while sharing the data is crucial, the private sensitive customer data must be safeguarded from being exposed or manipulated. In this study, we propose a roadmap for implementing a based privacy preserving framework to support the advancement of data-driven analytics in data-sensitive distributed energy resources environments. The roadmap incorporates federated learning–a distributed training framework, differential privacy–a statistical framework that provides guarantees to safeguard the leakage of sensitive data, secure multiparty computation and homomorphic encryption– techniques for encrypting model gradients and applying secure aggregation on the server. Moreover, we perform baseline experiments on the federated short-term load forecasting (STLF) task using open-source residential load profile datasets, offering insights into the challenges of integrating differential privacy into federated learning.

Abebe, Waqwoya [Oak Ridge National Laboratory (ORN↗
DOE OSTI2025

A Scalable Multi-Modal Framework for High-Fidelity Distributed Human Mobility Simulations

The development of data-driven models for human mobility in urban settings requires access to substantial and diverse real-world data. However, existing historical data often presents challenges such as limited volume, variety, and veracity, as well as missing data and privacy preservation concerns. Also, urban mobility modeling is inherently time-variant, complex, and multi-modal, encompassing everything from individual walking and running to private road travel and large-scale public transportation. These challenges call for innovative solutions to overcome data limitations and compute needs to model mobility behaviors accurately. To address these challenges, we propose a distributed, co-simulation-based architecture DURMOSim that integrates real-world data with scalable, high-fidelity simulations, demonstrating distributed co-simulation feasibility with existing mobility models. DURMOSim underpins a modular integration that would enable using any available mobility simulators for greater extensibility and scalability in performing various urban scenarios. In this paper, we present the design, implementation, and performance evaluation of DURMOSim, highlighting its capability to model population-scale mobility patterns. Our initial results show its ability to dynamically synchronize multiple simulation models at runtime with negligible computational overhead. We believe DURMOSim could be a robust tool for advancing urban mobility research and intelligent transportation systems.

Yoginath, Srikanth [ORNL] (ORCID:0000000184236050)↗
DOE OSTI2024

MEGASIM: Distribution and Detection of Earth Trojan Asteroids

Abstract Using N -body simulation results from the MEGASIM data set, we present spatial distributions of Earth Trojan Asteroids and assess the detectability of the population in current and next-generation ground-based astronomical surveys. Our high-fidelity Earth Trojan Asteroid (ETA) distribution maps show never-before-seen high-resolution spatial features that evolve over timescales up to 1 Gyr. The simulation was synchronized to start times and timelines of two observational astronomy surveys: (1) the Vera C. Rubin Observatory’s Legacy Survey of Space and Time (LSST) and (2) the Zwicky Transient Facility (ZTF). We calculate upper limits for the number of ETAs potentially observable with both the ZTF and LSST surveys. Due to the Yarkovsky Effect, we find no stable ETAs on billion-year timescales likely to be detected by any ETA survey, as no C-type or S-type ETAs (with H < 22 and H < 24, respectively) are likely to be stable on billion-year timescales, and ETAs large enough to remain stable on billion-year timescales are very rare relative to the rest of the ETA population. We find that a twilight ETA survey will not drastically increase the likelihood of individual ETA detection, but it would provide orders of magnitude more observations of select ETA populations. The null detection to date from ZTF restricts the potential ETA population to hundreds of objects larger than 100 m (at H ≈ 22), while a null detection by LSST will further restrict the ETA population to tens of objects larger than 100 m.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Data-Driven Multi-agent Deep Reinforcement Learning for Distribution System Decentralized Voltage Control with High Penetration of PVs

This paper proposes a novel model-free/data-driven centralized training and decentralized execution multi-agent deep reinforcement learning (MADRL) framework for distribution system voltage control with high penetration of PVs. The proposed MADRL can coordinate both the real and reactive power control of PVs with existing static var compensators and battery storage systems. Unlike the existing DRL-based voltage control methods, our proposed method does not rely on a system model during both the training and execution stages. This is achieved by developing a new interaction scheme between the surrogate modeling of the original system and the multi-agent soft actor critic (MASAC) MADRL algorithm. In particular, the sparse pseudo-Gaussian process with a few-shots of measurements is utilized to construct the surrogate model of the original environment, i.e., power flow model. This is a data-driven process and no model parameters are needed. Furthermore, the MASAC enabled MADRL allows to achieve better scalability by dividing the original system into different voltage control regions with the aid of real and reactive power sensitivities to voltage, where each region is treated as an agent. This also serves as the foundation for the centralized training and decentralized execution, thus significantly reducing the communication requirements as only local measurements are required for control. Comparative results with other alternatives on the IEEE 123-nodes and 342-nodes systems demonstrate the superiority of the proposed method.

14 SOLAR ENERGY↗
DOE OSTI2023

Commercial, industrial, and institutional discount rate estimation for efficiency standards analysis: Sector-level data 1998–2022

Underlying each of the U.S. Department of Energy’s (DOE’s) federal appliance and equipment energy conservation standards are a set of complex analyses of the projected costs and benefits of regulation. Any new or amended standard must be designed to achieve significant additional energy conservation, provided that it is technologically feasible and economically justified (42 U.S.C. 6295(o)(2)(A)). DOE determines economic justification based on whether the benefits exceed the burdens, considering a variety of factors, including the economic impact of the standard on consumers of the product and the savings in lifetime operating cost compared to any increase in price or maintenance expenses (42 U.S.C. 6295(o)(2)(B)). As part of this determination, DOE conducts a life-cycle cost (LCC) analysis, which models the combined impact of appliance first cost and operating cost changes on a representative commercial building sample to identify the fraction of customers achieving LCC savings or incurring net cost at the considered efficiency levels. Thus, the commercial discount rate value(s) used to calculate the present value of energy cost savings within the LCC model implicitly plays a role in estimating the economic impact of potential standard levels. This report provides an in-depth discussion of the commercial discount rate estimation process. It is an update to previous reports on estimating commercial discount rates from firm-level and sector-level financial data (e.g., Fujita, 2021, 2016). Major topics covered in this report include the following: -Discount rate estimation methods and rationale -Data sources used and data limitations -Discount rate distributions for use in standards analysis -Discount rate estimation methods and distributions specific to the small business subgroup analysis A version of this analysis was most recently released in 2022. Going forward, this report will be updated as data allow and analyses necessitate.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

End-of-Winter Snow Depth, Temperature, Density, and SWE Measurements at Teller Road Site, Seward Peninsula, Alaska, 2023

Measurements of end-of-winter snow properties were collected at the NGEE Arctic Teller Road Site at mile marker 27 (TL_MM27) from March 31 to April 3, 2023. This dataset contains one *.pdf user guide and four *.csv data files of spatially distributed values of snow depth, snow water equivalent (SWE), snow temperature, and snow density. Snow temperature and snow density were collected throughout the snowpack at different depths. Data were collected toward the end of the winter season from late March to early April, when the snowpack is typically near its maximum. A Snow-Hydro MagnaProbe (http://www.snowhydro.com/products/column2.html) was used to improve collection efficiency and enhance spatial coverage. This dataset is a continuation of the previous end-of-winter snow surveys conducted at the Teller Road Site in 2016-2018 (Wilson et al., 2020; https://doi.org/10.5440/1592103), 2019 (Bennett et al., 2021; https://doi.org/10.5440/1798170), and 2022 (Bennett et al., 2022; https://doi.org/10.5440/1887250).The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic) was a 15-year research effort (2012-2027) to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy’s Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy’s Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

PythonFOAM: In-situ data analyses with OpenFOAM and Python

Here, we outline the development of a general-purpose Python-based data analysis tool for OpenFOAM. Our implementation relies on the construction of OpenFOAM applications that have bindings to data analysis libraries in Python. Double precision data in OpenFOAM is cast to a NumPy array using the NumPy C-API and Python modules may then be used for arbitrary data analysis and manipulation on flow-field information. We highlight how the proposed wrapper may be used for an in-situ online singular value decomposition (SVD) implemented in Python and accessed from the OpenFOAM solver PimpleFOAM. Here, 'in-situ' refers to a programming paradigm that allows for a concurrent computation of the data analysis on the same computational resources utilized for the partial differential equation solver. In addition, to demonstrate parallel deployments, we deploy a distributed SVD, which collects snapshot data across the ranks of a distributed simulation to compute the global left singular vectors. Crucially, both OpenFOAM and Python share the same message passing interface (MPI) communicator for this deployment which allows Python objects and functions to exchange NumPy arrays across ranks. Subsequently, we provide scaling assessments of this distributed SVD on multiple nodes of Intel Broadwell and KNL architectures for canonical test cases such as the large eddy simulations of a backward facing step and a channel flow at friction Reynolds number of 395. Finally, we demonstrate the deployment of a deep neural network for compressing the flow-field information using an autoencoder to demonstrate an ability to use state-of-the-art machine learning tools in the Python ecosystem.

97 MATHEMATICS AND COMPUTING↗