Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “fast machine learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Charged Wellbore Casing Controlled Source Electromagnetics (CWC-CSEM) for Reservoir Imaging and Monitoring (Final report)

This project addresses the needs of the U.S. Department of Energy (DOE) to develop advanced monitoring technologies and protocols to track the fate of subsurface carbon dioxide (CO2) plumes for carbon storage. Specifically, the project seeks to develop and test a unique and novel system of technologies consisting of electromagnetic data acquisition, coupled multiphysics imaging, and reservoir model enhancement to understand the migration and long-term distribution of CO2 in the subsurface. The overarching objective is to develop an integrated approach for long term monitoring of carbon storage. The two main components of the project include the methodology development and the test of the method at a field site. The methodology component consists of 1) developing the field procedure and protocol for collecting time-lapse controlled-source electromagnetic (CSEM) data with source electric current injected into the subsurface through wellbore casings; 2) building of background 3D electrical conductivity utilizing multiple sources of data such as supplemental surface transient EM (TEM) surveys, well-logs, and seismic structural information, for enhancing CSEM signal from reservoir depths; and 3) coupled multiphysics simulations and inversion of CSEM data constrained by production data and by structural information from seismic imaging of the reservoir and overlying formations. The testing component used the field site of Bell Creek Oil Field, which served both as a field laboratory for the method development as well as a test site to evaluate the CSEM signal strengths and the methodology developed in this research project. We have accomplished all the proposed tasks and developed the methodology as planned. These include the procedure for time-lapse CSEM data acquisition, data processing techniques, integration with 3D conductivity model building, fast reservoir simulation for history matching using machine learning, and interpreting CSEM data with coupling to the reservoir modeling. Collectively, the outcome of these tasks form a coherent workflow that can be applied to monitor dedicated carbon storage in saline reservoirs. The testing component evaluated the applicability and limitations of the method, and concluded that the method would be ideal for monitoring dedicated carbon storage sites utilizing saline reservoirs.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

OLCF’s Advanced Computing Ecosystem (ACE): FY25 Update for Ongoing Efforts

The advent of widespread use of artificial intelligence (AI) and machine learning (ML) models in science, coupled with fast data production rates of scientific instruments strain the traditional batch-oriented high-performance computing (HPC) environment. As scientific exploration continues to require more data and faster processing and analysis, new emerging technologies and capabilities to enable cross-facility and time-sensitive workflows are required for seamless integration of HPC and experimental facilities. The Advanced Computing Ecosystem (ACE) is a strategic initiative within the Oak Ridge Leadership Computing Facility (OLCF) established in 2024 to support the development of cutting-edge technologies to advance computational research and infrastructure at OLCF and across the Department of Energy (DOE). Several DOE initiatives are spearheading the evolution of the scientific landscape by blurring facility boundaries and connecting the user facilities to advance scientific capabilities and ensure energy dominance. The DOE Integrated Research Infrastructure (IRI) program is one example that is laying a foundation to support complex cross-facility workflows. The IRI program aims to integrate diverse computational resources, data infrastructures, and scientific instruments to facilitate collaboration and accelerate scientific discovery. The Interconnected Science Ecosystem (INTERSECT) initiative at Oak Ridge National Laboratory (ORNL) is another example that aims to revolutionize scientific research through AI-driven, interconnected autonomous laboratories and research facilities. Finally, the American Science Cloud (AmSC), recently announced in the “One Big Beautiful Bill”, aims to leverage prior infrastructure efforts of the IRI and automation and AI efforts of INTERSECT (and others) to build a federated, AI-augmented AmSC platform to unify the DOE’s computing, experimental, and data resources to catalyze scientific innovation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Understanding Mixed Precision GEMM with MPGemmFI: Insights into Fault Resilience

Emerging deep learning workloads urgently need fast general matrix multiplication (GEMM). Thus, one of the critical features of machine-learning-specific accelerators such as NVIDIA Tensor Cores, AMD Matrix Cores, and Google TPUs is the support of mixed-precision enabled GEMM. For DNN models, lower-precision FP data formats and computation offer acceptable correctness but significant performance, area, and memory footprint improvement. While promising, the mixed-precision computation on error resilience remains unexplored. To this end, we develop a fault injection framework that systematically injects fault into the mixed-precision computation results. We investigate how the faults affect the accuracy of machine learning applications. Based on the characteristics of error resilience, we offer lightweight error detection and correction solutions that significantly improve the overall model accuracy by 75% if the models experience hardware faults. The solutions can be efficiently integrated into the accelerator's pipelines.

Fang, Bo↗
DOE OSTI2023

AutoReP: Automatic ReLU Replacement for Fast Private Network Inference

The proliferation of the Machine-Learning-As-A-Service (MLaaS) market has brought to light a number of clients’ data privacy and security concerns. One promising solution is private inference (PI) techniques using cryptographic primitives. These techniques often come with high computation and communication overhead associated with the non-linear operator such as ReLU. Several approaches have been developed in reducing the number of ReLU operations, however, they either require a heuristic threshold selection or introduce significant accuracy drop. This work presents AutoReP, a gradient-based framework for non-linear operators reduction that aims to mitigate these concerns from a systematic perspective. AutoReP automates the process of discrete selection of ReLU and polynomial functions on neurons to accelerate PI applications. We also introduce distribution-aware polynomial approximation (DaPa) to accurately approximate ReLUs under given distribution, preserving model expressivity. Our experimental results demonstrate significant accuracy improvements of 6.12% (94.31%, 12.9K ReLU budget, CIFAR-10), 8.39% (74.92%, 12.9K ReLU budget, CIFAR-100), and 9.45% (63.69%, 55K ReLU budget, Tiny-ImageNet) over current state-of-the-art methods, e.g., SNL. Morever, AutoReP is applied to EfficientNet-B2 on ImageNet dataset, and achieved 75.55% accuracy with 176.1 × ReLU budget reduction.

Peng, Hongwu↗
DOE OSTI2024

Automatic Loss Factor Modeling and Attribution on Unlabeled PV Energy Data

We present a novel approach for modeling the loss factors of photovoltaic power generation systems (PV systems). This method is a white-box machine learning model built on convex optimization that is fast, interpretable, and auditable. It takes as an input the measured daily energy produced by the system, over a multi-year period, and returns a multiplicative decomposition model of the daily energy signal and full attribution of the total energy loss to each feature. The methods section of this paper has two major components: (1) the description of the signal decomposition (SD) model, expressed in the SD framework, and (2) the attribution of total energy losses via Shapley values. We validate the method on synthetic and open-source data sets and compare to similar methods from the literature.

artificial intelligence↗
DOE OSTI2022

SMALE: Enhancing Scalability of Machine Learning Algorithms on Extreme-Scale Computing Platforms

Deployment and execution of machine learning tasks on extreme-scale computing platforms face several significant technical challenges: 1) High computing cost incurred by dense networks – The computing workload of deep networks with densely-connected topology increases rapidly with the network size, imposing a non-scalable computing model of extreme-scale computing platforms; 2) Non-optimized workload distribution – Many advanced deep learning algorithms, e.g., sparsification and irregular net-work topology, produce very unbalanced workload distribution on extreme-scale computing platforms. The computation efficiency is greatly hindered by the incurred data and computation redundancies as well as long tails of the node with extensive workload; 3) Constraints in data movement and I/O bottle-neck – Inter-node data movement in extreme-scale computing platforms are associated with high energy and latency costs, and subject to the constraints of I/O bandwidth; and 4) Generalization of algorithm realization and acceleration on computing platforms – The large varieties of machine learning algorithms and structures of extreme-scale computing platforms make the derivation of a generalized algorithm realization and acceleration method very challenging, which, however, is the requirement by domain scientists and interested users. We call the above challenges Smale’s Problems in Machine Learning and Understanding for High-Performance Computing Scientific Discovery. The objective of our three-year research project is to develop a holistic innovation set at structure, assembly, and acceleration layers of machine learning algorithms to address the above challenges in algorithm deployment and execution. Three tasks are particularly performed, including: At the algorithm structure level, we investigate the techniques that can structurally sparsify on the topology of deep networks for computing workload reduction. We also study clustering and pruning techniques that can optimize the workload distributions over the extreme-scale computing platforms; At the algorithm assembly level, we derive a unified learning framework for unsupervised transfer learning and dynamic growing capabilities. Novel training methods are also exploited to enhance the training efficiency of the proposed framework; At the algorithm acceleration level, we will develop a series of techniques that can accelerate the computation of sparse matrix operations, which are one of the core executions in deep learning and optimize memory access of the concerned platforms. Our proposed techniques attack the fundamental problems in machine learning algorithms running on extreme-scale computing platforms by vertically integrating the solutions at three closely entangled layers, paving the long-term scaling path of machine learning applications under DOE context. Three tasks corresponding to the above respective research orientations are performed during the three-year project period with our collaborators at ORNL. The outcome of the proposed project is anticipated to form a holistic solution set of novel algorithms and network topologies, efficient training techniques, and fast acceleration methods to promote the computing scalability of the machine learning applications of particular interest to DOE.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Photometric classification of Hyper Suprime-Cam transients using machine learning

Abstract The advancement of technology has resulted in a rapid increase in supernova (SN) discoveries. The Subaru/Hyper Suprime-Cam (HSC) transient survey, conducted from fall 2016 through spring 2017, yielded 1824 SN candidates. This gave rise to the need for fast type classification for spectroscopic follow-up and prompted us to develop a machine learning algorithm using a deep neural network with highway layers. This algorithm is trained by actual observed cadence and filter combinations such that we can directly input the observed data array without any interpretation. We tested our model with a dataset from the LSST classification challenge (Deep Drilling Field). Our classifier scores an area under the curve (AUC) of 0.996 for binary classification (SN Ia or non-SN Ia) and 95.3% accuracy for three-class classification (SN Ia, SN Ibc, or SN II). Application of our binary classification to HSC transient data yields an AUC score of 0.925. With two weeks of HSC data since the first detection, this classifier achieves 78.1% accuracy for binary classification, and the accuracy increases to 84.2% with the full dataset. This paper discusses the potential use of machine learning for SN type classification purposes.

Takahashi, Ichiro↗
DOE OSTI2024

Advancing set-conditional set generation: Diffusion models for fast simulation of reconstructed particles

The computational intensity of detector simulation and event reconstruction poses a significant difficulty for data analysis in collider experiments. This challenge inspires the continued development of machine learning techniques to serve as efficient surrogate models. We propose a fast emulation approach that combines simulation and reconstruction. In other words, a neural network generates a set of reconstructed objects conditioned on input particle sets. To make this possible, we advance set-conditional set generation with diffusion models. Using a realistic, generic, and public detector simulation and reconstruction package (COCOA), we show how diffusion models can accurately model the complex spectrum of reconstructed particles inside jets.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Characterization of mechanical discontinuities based on data-driven classification of compressional-wave travel times

Wave propagation and diffusive transport phenomena are influenced by the mechanical discontinuities in material. Here this study shows that certain bulk properties of the network of low-velocity mechanical discontinuities (e.g. air-filled cracks) in a material can be characterized by processing compressional-wave travel times using traditional data-driven classification techniques. To that end, we perform three tasks in chronological order: (1) use the discrete fracture network (DFN) method to create two-dimensional (2D) numerical models of crack-bearing material embedded with various types of low-velocity mechanical discontinuities, (2) use the fast marching method (FMM) to simulate the propagation of the wave/diffusion front from a single source through the 2D crack-bearing material to multiple receivers placed on the boundary of the material, and (3) train 9 data-driven classifiers to characterize the crack-bearing materials (i.e. bulk properties of the network of mechanical discontinuities in the crack-bearing material) by learning from the simulations of travel times detected by multiple receivers placed around the crack-bearing material. The classifiers identified the orientation, spatial distribution, and dispersion of the low-velocity mechanical discontinuities. Voting classifier performs the best among the 9 classifiers. For the characterization of bulk dispersion and distribution of discontinuities, the sensors located on the adjacent boundaries are more important; whereas for the characterization of bulk orientation of discontinuities, the sensors located on the opposite side are more important.

42 ENGINEERING↗
DOE OSTI2026

Jumpstart Opportunities to Unleash Leadership in Energy Storage (JOULES)

Current-generation Li-ion batteries with cobalt- and nickel-containing cathodes and graphite anodes are approaching performance and cost limits. In this program, 24M Technologies, Inc. (24M) is teaming with the Massachusetts Institute of Technology (MIT) and University of Michigan (UM) to develop low cost and fast charging sodium metal batteries with good low-temperature performance and high energy density, building upon previous work performed under ARPA-E programs. Key achievements include optimization of solid electrolyte and anode current collector, optimized cathode active materials, development of high-performance electrolyte formulations, and integration of these components into full cells. The cell design incorporates (1) an ultra-thick cathode (>9 mAh/cm 2 ) comprising advanced cobalt-free, sodium cathode active material, (2) advanced fast-charging electrolyte (up to 12 mS/cm) developed using machine learning and automated high-throughput screening technology by UM, and (3) ceramic modified separator that enable smooth Na transport and deposition, developed at MIT, enabling a high-energy density anode-free configuration and maximizing the energy density of sodium batteries. The team has successfully combined these approaches to sodium chemistry and paved the way to meeting the fast-charging, high-energy density, and low-cost requirements of next-generation drone, electric vertical take-off and -landing, and electric vehicle batteries. Performance for anode-free sodium cells developed under this program is more powerful than the commercial Li-ion batteries. The final deliverable cell design has achieved over 300 Wh/kg and volumetric energy density above 800 Wh/L (Table 1). Additionally, the team has achieved over (1) a lifetime of 340 cycles, (2) 80% capacity retention at -20 °C (compared 25 °C), and (3) the ability to fast charge to 80% SOC in 20 minutes.

25 ENERGY STORAGE↗
DOE OSTI2024

Calibrating Bayesian generative machine learning for Bayesiamplification

Recently, combinations of generative and Bayesian deep learning have been introduced in particle physics for both fast detector simulation and inference tasks. These neural networks aim to quantify the uncertainty on the generated distribution originating from limited training statistics. The interpretation of a distribution-wide uncertainty however remains ill-defined. We show a clear scheme for quantifying the calibration of Bayesian generative machine learning models. For a Continuous Normalizing Flow applied to a low-dimensional toy example, we evaluate the calibration of Bayesian uncertainties from either a mean-field Gaussian weight posterior, or Monte Carlo sampling network weights, to gauge their behaviour on unsteady distribution edges. Well calibrated uncertainties can then be used to roughly estimate the number of uncorrelated truth samples that are equivalent to the generated sample and clearly indicate data amplification for smooth features of the distribution.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

On ultrafast x-ray scattering methods for magnetism

With the introduction of x-ray free electron laser sources around the world, new scientific approaches for visualizing matter at fundamental length and time-scales have become possible. As it relates to magnetism and ‘magnetic-type’ systems, advanced methods are being developed for studying ultrafast magnetic responses on the time-scales at which they occur. We describe three capabilities which have the potential to seed new directions in this area and present original results from each: pump-probe x-ray scattering with low energy excitation, x-ray photon fluctuation spectroscopy, and ultrafast diffuse x-ray scattering. By combining these experimental techniques with advanced modeling together with machine learning, we describe how the combination of these domains allows for a new understanding in the field of magnetism. Finally, we give an outlook for future areas of investigation and the newly developed instruments which will take us there.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2023

A 3D Implementation of Convolutional Neural Network for Fast Inference

Low latency inference has many applications in edge machine learning. In this paper, we present a run-time configurable convolutional neural network (CNN) inference ASIC design for low-latency edge machine learning. By implementing a 5-stage pipelined CNN inference model in a 3D ASIC technology, we demonstrate that the model distributed on two dies utilizing face-to-face (F2F) 3D integration achieves superior performance. Our experimental results show that the design based on 3D integration achieves 43% better energy-delay product when compared to the traditional 2D technology.

Miniskar, Narasinga Rao↗
DOE OSTI2025

Geant4 Event Biasing and Fast Simulation

Geant4 offers advanced event biasing techniques to significantly accelerate simulations involving rare events. Various biasing methods, such as leading particle selection, cross-section biasing, radioactive decay enhancement, and bremsstrahlung splitting, enable efficient event sampling, though they require careful handling. Additionally, Geant4 provides a Fast Simulation Interface, allowing the replacement of standard processes in specific region and for selected particles, enabling faster execution or external code integration. Applications of fast simulation include electromagnetic shower modeling in calorimeters, machine learning inference, and offloading tasks to specialized hardware like GPUs, making Geant4 a powerful tool for computationally demanding simulations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2026

Ionic Interdiffusion at Cathode|Solid-Electrolyte Interface: A Machine Learning–Assisted Multiscale Investigation and Mitigation Strategies

Future lithium batteries are expected to use solid electrolytes to achieve higher energy density and fast charge capabilities. However, most solid electrolytes are thermodynamically unstable against layered oxide cathodes. In this study, the stability of LiCoO2 (LCO) cathode with Li10GeP2S12 (LGPS) solid electrolyte is investigated using ab initio molecular dynamics (AIMD) and machine learning molecular dynamics (MLMD). The propensity of ionic interdiffusion, formation of a passivating interphase layer, and corresponding decay in cell performance is addressed using a continuum model. Large-scale MLMD simulations confirm that the LCO|LGPS interface permits interdiffusion of cobalt (Co) and other ionic species, leading to the formation and growth of a resistive interphase and to dramatic capacity fade even in the first cycle. We examine the literature evidence that incorporating a thin layer of LiNb0.5Ta0.5O3 (LNTO) between LCO and LGPS prevents the interdiffusion of ions. Atomistic simulations suggest that substituting lithium (Li) in LNTO with Co is thermodynamically unfavorable, thereby inhibiting ionic interdiffusion. The stable Nb5+/Ta5+ states form a rigid metal-oxide framework, which consequently also prevents the substitution of niobium (Nb) or tantalum (Ta). However, continuum-level analysis suggests that the higher mechanical stiffness of LNTO can lead to interfacial delamination between the LCO and LNTO. This phenomenon reduces the effectiveness of the protective layer. This paper, therefore, highlights the need to develop novel interlayers that balance low ionic interdiffusion with low mechanical stiffness.

Ncube, Musawenkosi K.↗
DOE OSTI2025

Liquid–Vapor Phase Equilibrium in Molten Aluminum Chloride (AlCl 3 ) Enabled by Machine Learning Interatomic Potentials

Molten salts are promising candidates in numerous clean energy applications, where knowledge of thermophysical properties and vapor pressure across their operating temperature ranges is critical for safe operations. Due to challenges in evaluating these properties using experimental methods, fast and scalable molecular simulations are essential to complement the experimental data. In this study, we developed machine learning interatomic potentials (MLIP) to study the AlCl 3 molten salt across varied thermodynamic conditions (T = 473–613 K and P = 2.7–23.4 bar), which allowed us to predict temperature-surface tension correlations and liquid–vapor phase diagram from direct simulations of two-phase coexistence in this molten salt. Two MLIP architectures, a Kernel-based potential and neural network interatomic potential (NNIP), were considered to benchmark their performance for AlCl 3 molten salt using experimental structure and density values. The NNIP potential employed in two-phase equilibrium simulations yields the critical temperature and critical density of AlCl 3 that are within 10 K (∼3%) and 0.03 g/cm 3 (∼7%) of the reported experimental values. An accurate correlation between temperature and viscosities is obtained as well. In doing so, we report that the inclusion of low-density configurations in their training is critical to more accurately represent the AlCl 3 system across a wide phase-space. The MLIP trained using PBE-D3 functional in the ab initio molecular dynamics (AIMD) simulations (120 atoms) also showed close agreement with experimentally determined molten salt structure comprising Al 2 Cl 6 dimers, as validated using Raman spectra and neutron structure factor. Furthermore, the PBE-D3 as well as its trained MLIP showed better liquid density and temperature correlation for AlCl 3 system when compared to several other density functionals explored in this work. Overall, the demonstrated approach to predict temperature correlations for liquid and vapor densities in this study can be employed to screen nuclear reactors-relevant compositions, helping to mitigate safety concerns.

Ab initio molecular dynamics↗
DOE OSTI2021

Understanding fission gas bubble distribution, lanthanide transportation, and thermal conductivity degradation in neutron-irradiated α-U using machine learning

U—10Zr based metallic nuclear fuel is the leading candidate for next-generation sodium-cooled fast reactors in the United States. US research reactors have used and tested this fuel type since the 1960s and accumulated considerable experience and knowledge about the fuel performance. Most of the knowledge, however, remains empirical. The lack of mechanistic understanding of fuel performance puts a large burden on proof through experimental verification for the qualification of U—10Zr fuel for commercial use. Further, this paper proposes an image data-driven machine learning approach, coupled with domain knowledge provided by advanced post irradiation examination, to provide unprecedented quantified insights into the morphology, size, density and the connectivity of fission gas bubbles and their effects on the fission product transportation and thermal conductivity. Specifically, we developed a method to automatically detect, extract statistics, and classify ~19,000 fission gas bubbles into different categories, and quantitatively link the data to lanthanide transportation through connected bubbles and degradation of thermal conductivity along the radial temperature gradient in a neutron irradiated U—10Zr annular fuel. Results indicate the approach can be modified to study other irradiation effects, such as secondary phase redistribution and gaseous fuel swelling in other irradiated nuclear fuels.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗