Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Distributed Processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Observation of $t\bar{t}$ Production in Pb+Pb Collisions at $\sqrt{s_{NN}}$ = 5.02 TeV with the ATLAS Detector

Top-quark pair production is observed in lead–lead (Pb+Pb) collisions at $\sqrt{s_{NN}}$ = 5.02 TeV at the Large Hadron Collider with the ATLAS detector. The data sample was recorded in 2015 and 2018, amounting to an integrated luminosity of 1.9 nb −1 . Events with exactly one electron and one muon and at least two jets are selected. Top-quark pair production is measured with an observed (expected) significance of 5.0 (4.1) standard deviations. The measured top-quark pair production cross section is 𝜎 𝑡⁢$\tilde{i}$ = 3.6⁢$^{+1.0}_{−0.9}$⁢(stat)⁢ $^{+0.8}_{−0.5}$⁢(syst) μ⁢b, with a total relative uncertainty of 31%, and is consistent with theoretical predictions using a range of different nuclear parton distribution functions. The observation of this process consolidates the evidence of the existence of all quark flavors in the preequilibrium stage of the quark-gluon plasma at very high energy densities, similar to the conditions present in the early Universe.

Quark-gluon plasma↗
DOE OSTI2020

AWB-GCN: A Graph Convolutional Network Accelerator with Runtime Workload Rebalancing

The recent development of deep learning has been mostly focusing on Euclidean data, such as images, videos, audios, etc. However, most real-world information and relation are often expressed as graphs. To efficiently learn from graph data, graph convolutional networks (GCNs) emerge as a promising approach, showing advantages in several practical applications such as social network analysis, knowledge discovery, 3D modeling, motion capturing, etc. Real-world graphs are usually extremely large and imbalanced, posting significant performance demand and design challenges on the hardware dedicated for GCN inference. In this paper, we propose an architecture design called UW-GCN to accelerate graph convolutional network inference. To tackle the major performance bottleneck from workload imbalance, we propose dynamic neighborhood stealing and remote chunk shuffling techniques, relying on hardware flexibility to achieve hardware auto-tuning under negligible area or delay overhead. Specifically, UW-GCN is able to smartly profile the sparse graph pattern while continuously adjusting the workload distribution via routing reconfiguration among parallel processing elements (PEs). The ideal configuration is then reused in the remaining iterations. To the best of our knowledge, this is the first accelerator design particularly for GCN and the first work relying on hardware auto-tuning, which is normally based on software, to achieve near-optimal workload balance in processing sparse structures.

Geng, Tong↗
DOE OSTI2022

Occlusion-Perturbed Deep Learning for Probabilistic Solar Forecasting via Sky Images

Solar forecasting is shifting to the probabilistic paradigm due to the inherent uncertainty within the solar resource. Input uncertainty quantification is one of the widely used and best-performing ways to model solar uncertainty. However, compared to other sources of inputs, such as numerical weather prediction models, pure sky image-based probabilistic solar forecasting lags behind. In this research, an occlusion-perturbed convolutional neural network, named the PSolarNet, is developed. The PSolarNet provides very short-term deterministic forecasts, forecast scenarios, and probabilistic forecasts of the global horizontal irradiance from sky image sequences. Case studies based on 6 years of open-source data show that the developed PSolarNet is able to generate accurate 10-minute ahead deterministic forecasts with a 5.62% normalized root mean square error, realistic and diverse forecast scenarios with a 0.966 average correlation with the actual time series, and reliable and sharp probabilistic forecasts with a 2.77% normalized continuous ranked probability score.

Bayesian model averaging↗
DOE OSTI2023

Lagrangian and Eulerian Supersaturation Statistics in Turbulent Cloudy Rayleigh–Bénard Convection: Applications for LES Subgrid Modeling

Abstract Turbulent fluctuations of scalar and velocity fields are critical for cloud microphysical processes, e.g., droplet activation and size distribution evolution, and can therefore influence cloud radiative forcing and precipitation formation. Lagrangian and Eulerian water vapor, temperature, and supersaturation statistics are investigated in direct numerical simulations (DNS) of turbulent Rayleigh–Bénard convection in the Pi Convection Cloud Chamber to provide a foundation for parameterizing subgrid-scale fluctuations in atmospheric models. A subgrid model for water vapor and temperature variances and covariance and supersaturation variance is proposed, valid for both clear and cloudy conditions. Evaluation of phase change contributions through an a priori test using DNS data shows good performance of the model. Supersaturation is a nonlinear function of temperature and water vapor, and relative external fluxes of water vapor and heat (e.g., during entrainment-mixing and phase change) influence turbulent supersaturation fluctuations. Although supersaturation has autocorrelation and structure functions similar to the independent scalars (temperature and water vapor), the autocorrelation time scale of supersaturation differs. Relative scalar fluxes in DNS without cloud make supersaturation PDFs less skewed than the adiabatic case, where they are highly negatively skewed. However, droplet condensation changes the PDF shape response: it becomes positively skewed for the adiabatic case and negatively skewed when the sidewall relative fluxes are large. Condensation also increases correlations between water vapor and temperature in the presence of relative scalar fluxes but decreases correlations for the adiabatic case. These changes in correlation suppress supersaturation variability for the nonadiabatic cases and increase it for the adiabatic case. Implications of this work for subgrid microphysics modeling using a Lagrangian stochastic scheme are also discussed.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Scalable training of graph convolutional neural networks for fast and accurate predictions of HOMO-LUMO gap in molecules

Abstract Graph Convolutional Neural Network (GCNN) is a popular class of deep learning (DL) models in material science to predict material properties from the graph representation of molecular structures. Training an accurate and comprehensive GCNN surrogate for molecular design requires large-scale graph datasets and is usually a time-consuming process. Recent advances in GPUs and distributed computing open a path to reduce the computational cost for GCNN training effectively. However, efficient utilization of high performance computing (HPC) resources for training requires simultaneously optimizing large-scale data management and scalable stochastic batched optimization techniques. In this work, we focus on building GCNN models on HPC systems to predict material properties of millions of molecules. We use HydraGNN, our in-house library for large-scale GCNN training, leveraging distributed data parallelism in PyTorch. We use ADIOS, a high-performance data management framework for efficient storage and reading of large molecular graph data. We perform parallel training on two open-source large-scale graph datasets to build a GCNN predictor for an important quantum property known as the HOMO-LUMO gap. We measure the scalability, accuracy, and convergence of our approach on two DOE supercomputers: the Summit supercomputer at the Oak Ridge Leadership Computing Facility (OLCF) and the Perlmutter system at the National Energy Research Scientific Computing Center (NERSC). We present our experimental results with HydraGNN showing (i) reduction of data loading time up to 4.2 times compared with a conventional method and (ii) linear scaling performance for training up to 1024 GPUs on both Summit and Perlmutter.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Synthesis and behavior of bulk iron nitride soft magnets via high-pressure spark plasma sintering

Abstract In this study, dense bulk iron nitrides (Fe x N) were synthesized for the first time ever using spark plasma sintering (SPS) of Fe x N powders. The Fe 4 N phase of iron nitride in particular has significant potential to serve as a new soft magnetic material in both transformer and inductor cores and electrical machines. The density of SPSed Fe x N increased with SPS temperature and pressure. The microstructure of the consolidated bulk Fe x N was characterized with X-ray diffraction (XRD), scanning electron microscopy (SEM), transmission electron microscopy (TEM), and superconducting quantum interference device (SQUID) magnetometry. XRD revealed a primary phase of Fe 4 N with secondary phases of Fe 3 N and metallic iron. Finite element analysis (FEA) was also applied to investigate and explain localized heating and temperature distribution during SPS. The effects of processing on interface bonding formation and phase evolution were investigated and discussed in detail to provide insight into fundamental phenomena and microstructural evolution in SPSed Fe x N. Graphic abstract

36 MATERIALS SCIENCE↗
DOE OSTI2025

Screening analysis of enhanced weathering of igneous rocks and industrial waste materials

Enhanced weathering (EW) is a promising emerging carbon dioxide removal approach that involves harnessing and accelerating the natural weathering process by which atmospheric CO2 passively reacts with exposed alkaline minerals and is removed from the atmosphere. This manuscript reports on a screening level techno-economic analysis of EW. Two primary cases utilizing different sources of alkaline material are considered: (1) utilizing naturally occurring mined igneous rocks, and (2) utilizing industrial waste materials. The modeled EW process encompasses material purchase, comminution, transport, distribution of material on farmland, and measurement, reporting and verification of CO2 removal. Detailed sensitivities are performed to highlight promising scenarios for application. The analysis highlights that utilizing materials with high weathering potential in suitable locations may result in relatively low levelized cost of captured (less than $100 per total tonnes of CO2 captured from the atmosphere). NETL is publishing a detailed and transparent report titled “Enhanced Weathering: Techno-Economic and Life Cycle Screening Analysis” that includes more detail on the screening level techno-economic analysis and includes a life cycle analysis.

Leptinsky, Sarah [NETL Site Support Contractor, Na↗
DOE OSTI2022

Scalable and Energy-Efficient Methods for Interactive Exploration of Scientific Data

The main scientific contributions of this project are the following novel concepts for multidimensional arrays: shape-based similarity join (SIGMOD 2016), incremental view maintenance (SIGMOD 2017), user-defined stencil functions (HPDC 2017), and distributed caching for in-situ processing (SSDBM 2018). Building on our collaboration with the astrophysics group at LBNL, we applied these techniques to the data generated in the Palomar Transient Factory (PTF) astronomical survey. They played a pivotal role in the first-ever observation of a neutron star merger, which produces gravitational waves and turns out to be the origin of heavy elements, including gold. This has lead to a Science magazine article that has received extensive media coverage on ACM TechNews, Slashdot, FiveThirtyEight, and Quanta Magazine, among others. Additionally, two other articles detailing related aspects of the same discovery have been published in the Astrophysical Journal Letters journal. These publications have more than 3,000 citations according to Google Scholar (as of February 2022). This cross-disciplinary collaboration provided very good opportunities to apply database techniques to real-life scientific problems. The fact that they facilitated major discoveries in astrophysics proves the importance of our research. In addition to the work on multidimensional array databases, this project has also developed stochastic gradient descent (SGD) optimization algorithms for training large scale machine learning models, methods for querying in-situ data, and a database query optimizer based on sketch synopses.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Final Scientific/Technical Report: Real Time Particle Size and Settling Velocity for In-Situ Monitoring of Deep-Sea Polymetallic Nodule Mining

In the coming decade, it is anticipated that deep-sea mining activities will commence throughout the deep ocean, at depths around 4000-6000m where vast deposits of baseball-sized rocks called polymetallic nodules lay on the seabed. These nodules contain resources such as cobalt, copper and nickel which are needed to produce batteries for electric vehicles. Collector machines driving on the seabed and gathering these nodules will stir up clouds of sediment, and there is concern about how the resulting concentration of sediment in the near-bottom ocean water will affect deep and mid-ocean biology. There is currently no technology capable of comprehensively monitoring the concentrations and properties of stirred up sediment in the deep. This project addressed this critical gap by developing a deep-sea particle measurement system (Real-Time Size and Settling Velocity, RTSSV) that uses a multi-camera high-resolution video imaging system, with accompanying image processing, to measure the concentration, size distribution and settling speed of sediment. Importantly, these measurements are made in-situ, so that delicate sediment aggregates will not be disturbed, as is the case when collecting samples at depth to be measured in the lab. The instrument can be mounted on a variety of established deep-sea platforms such as moorings, AUVs and ROVs, providing data in near real time, where the key measurements need to be made—from the source of the sediment disturbance and throughout the resulting plume—vital for determining if deep-sea mining can be done in an environmentally responsible manner. The developed system (RTSSV) will possess the only such capability worldwide, giving a US-based group a substantial competitive advantage as this newly evolving global industry develops. As added value, the technology will also have widespread application to the offshore oil and gas industry, dredging industry, and to sediment science research.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Direct conversion of syngas to lower olefins precursors of jet fuel and chemicals

This study investigates the direct conversion of syngas to olefins as a pathway to produce sustainable aviation fuels. This approach combines methanol/ dimethyl ether synthesis with methanol-to-olefins into one unit operation to avoid the equilibrium limitation of methanol synthesis and the Anderson–Schulz–Flory distribution limitations from the Fischer Tropsch process. The ability to combine reactor functionalities into a single step are also projected to significantly lower capital costs over current synthesis approaches for the syngas to olefins process.

10 SYNTHETIC FUELS↗
DOE OSTI2024

Improving GCM Predictability of Mixed-Phase Clouds and Aerosol Interactions at High Latitudes with ARM Observations

The goal of this project is to improve the predictability of mixed-phase clouds and aerosol interactions in the Community Atmosphere Model version 6 (CAM6) through comparison with the ARM observations. There are three main objectives of the proposed study: (1) Improve the representation of ice microphysical processes in mixed-phase clouds; (2) Test the performance of ice microphysics in CESM-CAM6 with the ARM observations in northern and southern high latitudes; and (3) Examine mixed-phase cloud microphysics-aerosol-turbulence-radiation interactions in CESM-CAM6. In this project, we have (1) Improved the representation of ice microphysical processes in mixed-phase clouds in CESM-CAM6 by implementing the marine organic aerosol (MOA) and treating the ice nucleating particles (INPs) from MOA and its impacts on mixed-phase clouds. We made a first attempt to represent different secondary ice production (SIP) mechanisms in a GCM (CESM2-CAM6). We found that misrepresentation of these ice formation processes in global climate models (GCMs) leads to too weak negative cloud feedback over the Southern Ocean (SO) and too high climate sensitivity in the models. In addition to ice formation processes, we improved the treatment of ice depositional growth through the Wegener–Bergeron–Findeisen (WBF) process by considering the subgrid heterogeneous distributions between liquid droplets and ice crystals in mixed-phase clouds; (2) Tested the performance of our improved representations of ice microphysics with the ARM observations at high latitudes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Exploring DAOS as a Burst Buffer for a 100 Gbps DAQ Real-Time Streaming System

We present an experimental evaluation of a burst buffer for a real-time DAQ streaming system designed to transmit instrument data to remote data centers. The system is based on EJ-FAT, a load balancing system capable of Nx 100Gbps streams, distributing data from event sources to processing nodes. We explore applying the DAOS system as a burst buffer to serve a number of purposes: improve resiliency, elasticity and add new functions into the processing pipeline. In the evaluation a sender transmits events over a 100Gbps network to a receiver integrated with DAOS to store the reassembled events using DAOS APIs. We evaluate the system for possible bottlenecks and provide end-to-end evaluation with a burst buffer using DAOS storage abstractions. We show that a receiver node can support 38.1 Gbps. This proves the viability of our approach and allows us to extend this work to investigate scale-out properties and new streaming optimizations.

Mei, Xinxin↗
DOE OSTI2025

Assessment of North Slope of Alaska (NSA) Snow Monitoring Arrays

Arrays of instruments for monitoring winter precipitation (snowfall) and snow cover on the ground installed in 2017 at the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility’s North Slope of Alaska (NSA) C1 and at Oliktok Point sites became operational in 2018. In 2022, the instruments from Oliktok Point were moved to NSA E12, about 5.4 km south of NSA C1, where two arrays now operate. The instrument arrays monitor wind speed and direction, snow depth at multiple locations, the horizontal flux of blowing snow, and the number and fall speed of hydrometeors. The arrays are monitored using digital cameras. Collectively, the instruments produce a wealth of data on falling and accumulated snow, but, as with any instrument array, some data are more reliable and accurate than others. In this document, we present our findings on the efficacy, accuracy, and reliability of each type of instrument. Overall, a key finding is that no single instrument provides sufficient information to determine the source of falling snow particles nor the cause of changes in snow depth. However, if used in concert, the instruments produce a reliable understanding of the processes affecting the snow cover depth distribution and the true winter precipitation.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

SolarSTARTS: Solar-Assisted State-Aware and ResilienT infrastructure System

This final technical report provides a description and results of the design, development, testing, and validation of the Automated Resilience Management System (ARMS) solution, which integrates different systems to collect, store and process relevant information from the power distribution system to automatically manage the operation of multiple energy assets to enhance the resilience of the power grid against high-impact physical incidents (e.g., hurricanes) and cyber threats. The developed solution comprises a suite of novel AI-based algorithms designed to first detect, locate, and classify anomalies by collecting and analyzing data from multiple monitoring and control devices

14 SOLAR ENERGY↗
DOE OSTI2022

Occlusion-Perturbed Deep Learning for Probabilistic Solar Forecasting via Sky Images: Preprint

Solar forecasting is shifting to the probabilistic paradigm due to the inherent uncertainty within the solar resource. Input uncertainty quantification is one of the widely used and best-performing ways to model solar uncertainty. However, compared to other sources of inputs, such as numerical weather prediction models, pure sky image-based probabilistic solar forecasting lags behind. In this research, an occlusion-perturbed convolutional neural network, named the PSolarNet, is developed. The PSolarNet provides very short-term deterministic forecasts, forecast scenarios, and probabilistic forecasts of the global horizontal irradiance from sky image sequences. Case studies based on 6 years of open-source data show that the developed PSolarNet is able to generate accurate 10-minute ahead deterministic forecasts with a 5.62% normalized root mean square error, realistic and diverse forecast scenarios with a 0.966 average correlation with the actual time series, and reliable and sharp probabilistic forecasts with a 2.77% normalized continuous ranked probability score.

Bayesian model averaging↗
DOE OSTI2026

D$e^+e^-$ffusion: Capturing the Beam-Beam Physics of $e^+e^-$ Collisions with Diffusion Models

Beam-induced backgrounds at high-luminosity $e^+e^-$ colliders, such as the FCC-ee, are dominated by incoherent pair creation (IPC), and require computationally expensive simulations with dedicated Monte Carlo (MC) event generators. Reliable detector and machine-detector interface studies necessitate event samples that are several orders of magnitude larger than what is practically attainable with existing MC. To alleviate this bottleneck, we present D$e^+e^-$ffusion, a denoising diffusion probabilistic model that operates as a permutation-equivariant, set-valued surrogate for fast IPC simulation. Trained on a small GuineaPig++ sample, D$e^+e^-$ffusion faithfully reproduces the marginal and joint kinematic, angular, and positional distributions of all three IPC production processes. In addition, we assess the fidelity at the detector level by propagating both Geant4 and D$e^+e^-$ffusion events through a Geant4 simulation of the CLD vertex detector and by training a transformer-based two-sample classifier; the classifier achieves an area under the ROC curve of $0.553 \pm 0.016$. The trained model generates events nearly four orders of magnitude faster than Geant4, paving the way for a fast-simulation surrogate for FCC-ee design studies.

Chahine, Antonio [Imperial Coll., London]↗
DOE OSTI2024

Radiation image reconstruction and uncertainty quantification using a Gaussian process prior

We propose a complete framework for Bayesian image reconstruction and uncertainty quantification based on a Gaussian process prior (GPP) to overcome limitations of maximum likelihood expectation maximization (ML-EM) image reconstruction algorithm. The prior distribution is constructed with a zero-mean Gaussian process (GP) with a choice of a covariance function, and a link function is used to map the Gaussian process to an image. Unlike many other maximum a posteriori approaches, our method offers highly interpretable hyperparamters that are selected automatically with the empirical Bayes method. Furthermore, the GP covariance function can be modified to incorporate a priori structural priors, enabling multi-modality imaging or contextual data fusion. Lastly, we illustrate that our approach lends itself to Bayesian uncertainty quantification techniques, such as the preconditioned Crank–Nicolson method and the Laplace approximation. The proposed framework is general and can be employed in most radiation image reconstruction problems, and we demonstrate it with simulated free-moving single detector radiation source imaging scenarios. We compare the reconstruction results from GPP and ML-EM, and show that the proposed method can significantly improve the image quality over ML-EM, all the while providing greater understanding of the source distribution via the uncertainty quantification capability. Furthermore, significant improvement of the image quality by incorporating a structural prior is illustrated.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗