Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed computation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Machine learning-driven predictive resource management in complex science workflows

Here, the collaborative efforts of large communities in science experiments, often comprising thousands of global members, reflect a monumental commitment to exploration and discovery. Recently, advanced and complex data processing has gained increasing importance in science experiments. Data processing workflows typically consist of multiple intricate steps, and the precise specification of resource requirements is crucial for each step to allocate optimal resources for effective processing. Estimating resource requirements in advance is challenging due to a wide range of analysis scenarios, varying skill levels among community members, and the continuously increasing spectrum of computing options. One practical approach to mitigate these challenges involves initially processing a subset of each step to measure precise resource utilization from actual processing profiles before completing the entire step. While this two-staged approach enables processing on optimal resources for most of the workflow, it has drawbacks such as initial inaccuracies leading to potential failures and suboptimal resource usage, along with overhead from waiting for initial processing completion, which is critical for fast-turnaround analyses. In this context, our study introduces a novel pipeline of machine learning models within a comprehensive workflow management system, the Production and Distributed Analysis (PanDA) system. These models employ advanced machine learning techniques to predict key resource requirements, overcoming challenges posed by limited upfront knowledge of characteristics at each step. Accurate forecasts of resource requirements enable informed and proactive decision-making in workflow management, enhancing the efficiency of handling diverse, complex workflows across heterogeneous resources.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Distribution of Mn Oxidation States in Grassland Soils and Their Relationships with Soil Pores

Manganese (Mn) is known to be an active contributor to processing and cycling of soil organic carbon (C), yet the exact mechanisms behind its interactions with C are poorly understood. Plant diversity in terrestrial ecosystems drives feedback links between plant C inputs and soil pores, where the latter, in turn, impact the redox environment and Mn. This study examined associations between soil pores (>36 μm Ø) and Mn within intact soils from two grassland ecosystems, after their >6-year implementation in a replicated field experiment. In this work, we used μ-XRF imaging and XANES spectroscopy to explore spatial distribution patterns of Mn oxidation states, combined with X-ray computed microtomography and 2D zymography. A high plant diversity system (restored prairie) increased soil C and modified spatial distribution patterns of soil pores as compared to a single species system (monoculture switchgrass). In switchgrass, the abundance of oxidized and reduced Mn oxidation states varied with distance from pores consistently with anticipated O 2 diffusion, while in the soil from restored prairie, the spatial patterns suggested that biological activity played a greater role in influencing Mn distributions. Based on the findings, we propose a hypothesis that Mn transformations promote C gains in soils of high plant diversity grasslands.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

A critical look at the prediction of the temperature field around a laser-induced melt pool on metallic substrates

The study of microstructure evolution in additive manufacturing of metals would be aided by knowing the thermal history. Since temperature measurements beneath the surface are difficult, estimates are obtained from computational thermo-mechanical models calibrated against traces left in the sample revealed after etching, such as the trace of the melt pool boundary. Here we examine the question of how reliable thermal histories computed from a model that reproduces the melt pool trace are. To this end, we perform experiments in which one of two different laser beams moves with constant velocity and power over a substrate of 17-4PH SS or Ti-6Al-4V, with low enough power to avoid generating a keyhole. We find that thermal histories appear to be reliably computed provided that (a) the power density distribution of the laser beam over the substrate is well characterized, and (b) convective heat transport effects are accounted for. Poor control of the laser beam leads to potentially multiple three-dimensional melt pool shapes compatible with the melt pool trace, and therefore to multiple potential thermal histories. Ignoring convective effects leads to results that are inconsistent with experiments, even for the mild melt pools here.

42 ENGINEERING↗
DOE OSTI2026

Computing neutrino cross sections from Euclidian responses

Energy integrated neutrino cross sections are integrals of nuclear responses weighted with kinematic prefactors. We decompose the prefactors into a limited set of functions of energy transfer and show the relevant integrals are the moments of the responses, and integrals weighted with $1/(a+ω)^n$ with $n\leq 2$. These can be directly obtained from the Euclidean response, avoiding the need for inversion of the Laplace transform. As a proof of concept we study the procedure with toy-model responses for the quasielastic peak. We show that the different contributions can be straightforwardly organized in terms of relative importance, and how flux-averaged cross sections can be obtained. Using a realistic model for the response and numerical uncertainty we show that it is feasible to obtain the required integrals from the Euclidean response, with large uncertainties only for the third moment. Due to kinematic restrictions, the integrals contain contributions from the unphysical region for neutrino scattering, coming from high-momentum nucleons. We show that (in the absence of two-body currents) robust corrections for this contamination are obtained from the single-nucleon momentum distribution. These results present an opportunity to compute certain neutrino cross sections with ab-initio methods with controlled uncertainties.

Nikolakopoulos, A. [Washington U., Seattle]↗
DOE OSTI2026

Computing neutrino cross sections from Euclidian responses

Energy integrated neutrino cross sections are integrals of nuclear responses weighted with kinematic prefactors. We decompose the prefactors into a limited set of functions of energy transfer and show the relevant integrals are the moments of the responses, and integrals weighted with $1/(a+ω)^n$ with $n\leq 2$. These can be directly obtained from the Euclidean response, avoiding the need for inversion of the Laplace transform. As a proof of concept we study the procedure with toy-model responses for the quasielastic peak. We show that the different contributions can be straightforwardly organized in terms of relative importance, and how flux-averaged cross sections can be obtained. Using a realistic model for the response and numerical uncertainty we show that it is feasible to obtain the required integrals from the Euclidean response, with large uncertainties only for the third moment. Due to kinematic restrictions, the integrals contain contributions from the unphysical region for neutrino scattering, coming from high-momentum nucleons. We show that (in the absence of two-body currents) robust corrections for this contamination are obtained from the single-nucleon momentum distribution. These results present an opportunity to compute certain neutrino cross sections with ab-initio methods with controlled uncertainties.

Nikolakopoulos, A. [Washington U., Seattle]↗
DOE OSTI2023

A neutron tomography study to visualize fluoride salt (FLiNaK) intrusion in nuclear-grade graphite

Manufactured graphite is a preferred material for in-core components of molten salt reactors and fluoride salt-cooled high-temperature reactors, which are in permanent contact with liquid salts. However, owing to the porous nature of nuclear graphite, under certain conditions, molten salts may intrude graphite's pores and affect graphite's properties and functionality. Therefore, a better understanding of molten salt intrusion (distribution across sample cross section and penetration depth) is needed to assess its effects. Here, in this work, we have demonstrated the use of neutron imaging (computed tomography) in the evaluation of salt penetration and distribution of a wide range of graphite grades with diverse microstructures that have been subjected to FLiNaK (LiF–NaF–KF) intrusion at 750 °C and 5 bar pressure for 12 h. Because of the great neutron attenuation contrast from scattering and adsorption between Li (from FLiNaK) and the graphite matrix, we have obtained direct visualization of FLiNaK salt distribution in the salt-impregnated graphites for the first time. Three-dimensional reconstructed images and cross-sectional concentration profiles demonstrate that salt penetration and density distribution are greatly dependent on the microstructural properties of the graphite grade.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Pressure Effects on the Relaxation of an Excited Ethane Molecule in High-Pressure Bath Gases

Here, we use molecular dynamics to calculate the rotational and vibrational energy relaxation of C 2 H 6 in Ar, Kr, and Xe bath gases over a pressure range of 10 to 400 atm and at temperatures of 300 K and 800 K. The C 2 H 6 is instantaneously excited by 80 kcal/mol randomly distributed into both vibrational and rotational modes. The computed relaxation rates show little sensitivity to the identity of the noble gas in the bath. Vibrational relaxation rates show a non-linear pressure dependence at 300 K. At 800 K the reduced range of bath gas densities covered by the range of pressures do not yet show any non-linearity in the pressure dependence. Rotational relaxation is characterized with two relaxation rates. The slower rate is comparable to the vibrational relaxation rate. The faster rate has a linear pressure dependence at 300 K but an irregular, nonlinear pressure dependence at 800 K. To understand this, a model was developed based on approximating the periodic box used in the molecular dynamics simulations by an equal-volume collection of cubes where each cube is sized to allow only single occupancy by the noble gas or the molecule. Combinatorial statistics then leads to a pressure and temperature dependent analytic distribution of the bath gas species the molecule encounters in a collision. This distribution, the dissociation energy of molecule/bath gas complexes and bath gas clusters, and the computed energy release per collision combine to show that only at 300 K is the energy release sufficient to dissociate likely complexes and clusters. This suggests that persistent and pressure-dependent clusters and complexes at 800 K may be responsible for the non-linear pressure dependence of rotational relaxation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Computationally efficient and error aware surrogate construction for numerical solutions of subsurface flow through porous media

Limiting the injection rate to restrict the pressure below a threshold at a critical location can be an important goal of simulations that model the subsurface pressure between injection and extraction wells. The pressure is approximated by the solution of Darcy’s partial differential equation for a given permeability field. The subsurface permeability is modeled as a random field since it is known only up to statistical properties. This induces uncertainty in the computed pressure. Solving the partial differential equation for an ensemble of random permeability simulations enables estimating a probability distribution for the pressure at the critical location. These simulations are computationally expensive, and practitioners often need rapid online guidance for real-time pressure management. An ensemble of numerical partial differential equation solutions is used to construct a Gaussian process regression model that can quickly predict the pressure at the critical location as a function of the extraction rate and permeability realization. The Gaussian process surrogate analyzes the ensemble of numerical pressure solutions at the critical location as noisy observations of the true pressure solution, enabling robust inference using the conditional Gaussian process distribution. Our first novel contribution is to identify a sampling methodology for the random environment and matching kernel technology for which fitting the Gaussian process regression model scales as O ( n log n ) instead of the typical O ( n 3 ) rate in the number of samples n used to fit the surrogate. The surrogate model allows almost instantaneous predictions for the pressure at the critical location as a function of the extraction rate and permeability realization. Our second contribution is a novel algorithm to calibrate the uncertainty in the surrogate model to the discrepancy between the true pressure solution of Darcy’s equation and the numerical solution. Finally, although our method is derived for building a surrogate for the solution of Darcy’s equation with a random permeability field, the framework broadly applies to solutions of other partial differential equations with random coefficients.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Preventive Power Outage Estimation Based on a Novel Scenario Clustering Strategy

The increasing occurrence of extreme weather events is challenging power grid operation. For extreme weather events, the system operator is responsible for estimating the power outages and scheduling the restoration resources. This paper proposes an outage evaluation framework to identify the possible unserved load profiles, vulnerable areas, and mobile energy adequacy. The outputs of an outage prediction model tool are used to generate numerous faulted line scenarios. Next, each scenario's nodal unserved load profile is obtained by solving a three-phase restoration model that considers repair crews and mobile energy resources (MERs). Then, a novel scenario clustering strategy is developed to cluster the unserved load profiles into multiple representative profiles which the system operator can focus on. Finally, case studies on a distribution system evaluate the damage caused by an extreme weather event and verify the effectiveness of the proposed scenario clustering strategy.

MATHEMATICS AND COMPUTING,POWER TRANSMISSION AND D↗
DOE OSTI2024

HPC resources for CMS offline computing: An integration and scalability challenge for the Submission Infrastructure

The computing resource needs of LHC experiments are expected to continue growing significantly during the Run 3 and into the HL-LHC era. The landscape of available resources will also evolve, as High Performance Computing (HPC) and Cloud resources will provide a comparable, or even dominant, fraction of the total compute capacity. The future years present a challenge for the experiments’ resource provisioning models, both in terms of scalability and increasing complexity. The CMS Submission Infrastructure (SI) provisions computing resources for CMS workflows. This infrastructure is built on a set of federated HTCondor pools, currently aggregating 400k CPU cores distributed worldwide and supporting the simultaneous execution of over 200k computing tasks. Incorporating HPC resources into CMS computing represents firstly an integration challenge, as HPC centers are much more diverse compared to Grid sites. Secondly, evolving the present SI, dimensioned to harness the current CMS computing capacity, to reach the resource scales required for the HLLHC phase, while maintaining global flexibility and efficiency, will represent an additional challenge for the SI. To preventively address future potential scalability limits, the SI team regularly runs tests to explore the maximum reach of our infrastructure. In this note, the integration of HPC resources into CMS offline computing is summarized, the potential concerns for the SI derived from the increased scale of operations are described, and the most recent results of scalability test on the CMS SI are reported.

Pérez-Calero Yzquierdo, Antonio↗
DOE OSTI2021

Whisper Use of Nuclear Data Covariances [Slides]

Whisper is statistical analysis code using sensitivity/uncertainty-based methods to determine baseline upper subcritical limit (USL) for nuclear criticality safety. Features of Whisper 1.1 include: GLLS method implemented to compute adjusted covariance based on current benchmark suite (1,100+ ICSBEP models), BLO “low-fidelity” covariance data used (44 energy groups), adjusted covariance is pre-computed and saved, and adjusted cross sections are NOT computed. Potential future efforts include: an extension to include angular distributions in benchmark selection and in GLLS adjustment, a move toward more modern covariance data (ENDF/B-VIII.0) and different group structure, and compute and store adjusted cross sections (trivial).

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Connecting Minds: AI Use Cases to Bridge Power Systems and Large Language Models for Practical Applications

Recent advances in artificial intelligence (AI) and development of large language models (LLMs) present the opportunity to develop a new generation of power systems applications. In contrast with early power system AI applications based on structured numerical data, LLMs offer unique capabilities to perform logical reasoning using text documents, unstructured data, and application programming interface (API) calls to computational software. This paper seeks to bridge the knowledge gap between power systems engineers and LLM developers through a crosscutting explanation of use cases, characteristics, requirements, practical considerations from the perspectives of both LLM capabilities and industry needs. Specific focus is given to applications that can be realistically deployed by electric utilities. After introducing the architecture of LLMs and unique challenges of the power systems domain, this paper proposes twenty representative LLM applications grouped into categories of 1) power system operations, 2) asset management, 3) system planning and analytics, and 4) energy management and protection systems. Five use cases are presented within each category with descriptions of the motivation, objectives, approaches, example inputs / outputs, and benefits of each use case.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Scalable Risk Assessment of Rare Events in Power Systems With Uncertain Wind Generation and Loads

Risk assessment of rare events has become increasingly important in power system planning and operation with the increasing integration of renewable energy and the presence of system uncertainties. However, quantifying the risk posed by rare events via the traditional method, i.e., Monte Carlo sampling (MCS), incurs substantial computational expense stemming from the vast ensemble of power flow simulations. To accelerate the assessment, this paper proposes a Deep Neural Network (DNN)-kernelized vector-valued Gaussian Process (VVGP) approach with excellent computational efficiency while maintaining high accuracy. Consequently, serving as a surrogate model for the power flow solver, the DNN-kernelized VVGP enables significantly faster but accurate risk assessment compared to the power flow solver. The developed surrogate model evaluates low-order N - k events that contain more than 90% instances by adeptly capturing the topological features while the high-order N - k events are assessed via a power flow solver, thereby striking a balance between computational efficiency and uncertainty quantification accuracy. Moreover, the model incorporates a Support Vector Machine (SVM) classifier to resample concerning low-probability tail events to counteract the biases potentially introduced during the DNN-kernelized VVGP evaluations. Simulations conducted on the modified IEEE 24-bus, 118-bus, and European 1354-bus systems demonstrate that the proposed method maintains the accuracy benchmark set by MCS while significantly reducing computational demands in large-scale power systems as compared to other state-of-the-art methods.

17 WIND ENERGY↗
DOE OSTI2021

Integrated modeling methodology for ash agglomeration in poly-disperse fluidized beds using particle population framework

This article discusses a unique agglomeration modeling methodology developed based on binary collisions to combine the effects of heterogeneity in ash chemistry and granular physics. A simple population balance is defined to find changes in the particle size distribution (PSD) of a fluidized bed. Thermodynamic equilibrium calculations and a computational fluid dynamics (CFD) code, are used to obtain hydrodynamic parameters. A method to calculate and use a distribution of collision frequencies in fluidized beds, corresponding to a poly-disperse particle size distribution, was developed in order to incorporate the particle level heterogeneities. A distribution of collision frequencies obtained for poly-dispersed particles showed a three orders of magnitude higher collision frequency amongst the smaller particles than the coarser ones, at the initiation of agglomeration. Ash agglomeration occurred when the slag amount (binder) was less than 10 wt% at temperatures <850 °C for Pittsburgh No. 8 coal.

42 ENGINEERING↗
DOE OSTI2025

Scalable Algorithms for Inverse Problems With High-Dimensional Parameter Spaces

Inverse problems, which involve inferring unknown parameters from observed data, present significant computational challenges, especially in large-scale settings with high-dimensional unknown parameters and nonlinear relationships between the unknowns and observations. Bayesian inference provides an approach for addressing these problems, often relying on sequential sampling methods like Markov chain Monte Carlo (MCMC) to approximate the posterior distribution of the parameters. However, MCMC methods become computationally demanding as the dimensionality of the problem increases, particularly in large-scale systems where likelihood evaluations rely on solving partial differential equations (PDEs) on large spatial domains with finely resolved meshes. To overcome these limitations, recent advancements have focused on designing scalable computa tional techniques – for both PDE simulations and sampling strategies – to make Bayesian methods feasible for high-dimensional problems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

I/O in Machine Learning Applications on HPC Systems: A 360-degree Survey

Growing interest in Artificial Intelligence (AI) has resulted in a surge in demand for faster methods of Machine Learning (ML) model training and inference. This demand for speed has prompted the use of high performance computing (HPC) systems that excel in managing distributed workloads. Because data is the main fuel for AI applications, the performance of the storage and I/O subsystem of HPC systems is critical. In the past, HPC applications accessed large portions of data written by simulations or experiments or ingested data for visualizations or analysis tasks. ML workloads perform small reads spread across a large number of random files. This shift of I/O access patterns poses several challenges to modern parallel storage systems. In this paper, we survey I/O in ML applications on HPC systems, and target literature within a 6-year time window from 2019 to 2024. We define the scope of the survey, provide an overview of the common phases of ML, review available profilers and benchmarks, examine the I/O patterns encountered during offline data preparation, training, and inference, and explore I/O optimizations utilized in modern ML frameworks and proposed in recent literature. Lastly, we seek to expose research gaps that could spawn further R&D.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Alternatives to Contour Visualizations for Power Systems Data

Electrical grids are geographical and topological structures whose voltage states are challenging to represent accurately and efficiently for visual analysis. The current common practice is to use colored contour maps, yet these can misrepresent the data. We examine the suitability of four alternative visualization methods for depicting voltage data in a geographically dense distribution system - Voronoi polygons, H3 tessellations, S2 tessellations, and a network-weighted contour map. We find that Voronoi tessellations and network-weighted contour maps more accurately represent the statistical distribution of the data than regular contour maps.

MATHEMATICS AND COMPUTING,POWER TRANSMISSION AND D↗
DOE OSTI2021

Data-Driven Distributed Algorithms for Estimating Eigenvalues and Eigenvectors of Interconnected Dynamical Systems

Here, the paper presents data-driven algorithms to estimate in a distributed manner the eigenvalues, right and left eigenvectors of an unknown linear (or linearized) interconnected dynamic system. In particular, the proposed algorithms do not require the identification of the system model in advance before performing the estimation. As a first step, we consider interconnected dynamical system with distinct eigenvalues. The proposed strategy first estimates the eigenvalues using the well-known Prony method. The right and left eigenvectors are then estimated by solving distributively a set of linear equations. One important feature of the proposed algorithms is that the topology of communication network used to perform the distributed estimation can be chosen arbitrarily, given that it is connected, and is also independent of the structure or sparsity of the system (state) matrix. The proposed distributed algorithms are demonstrated via a numerical example.

97 MATHEMATICS AND COMPUTING↗