Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Machine Learning Models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,297 records · Page 72
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

A Probabilistic Approach To Selecting Build Configurations in Package Managers

In the past decade software has grown significantly in complexity and scale. Likewise the number of dependencies for most software has increased with typical software packages depending on tens to hundreds of other packages. Such large numbers of dependencies place a significant burden on package managers to correctly maintain dependency lists and constraints between them. Due to this package managers have incorporated sophisticated tooling such as SAT solvers into their dependency management mechanisms. Despite these tools package managers still rely on many human annotated constraints for dependency and version selection. These are error-prone and require a significant amount of labor to constantly update and test. In this paper we propose a methodology to make use of historical build results in selecting the version for package dependencies. Our method utilizes the flexibility of the Spack package manager’s heavily parameterized package configurations to incorporate a machine learning model trained to predict the probability of build outcomes. This work is able to build and install packages with a 13% higher success rate than the default version selection mechanism in Spack.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

A Complete Machine-Learning-Based Workflow to Illuminate Earthquake Processes

Under this grant we developed, tested, and made available, machine learning models to improve the tasks in the earthquake monitoring workflow (Figure 1). We implemented these models as a part of an end-to-end workflow for seismic network processing and demonstrated, in a variety of settings, that these methods generalize and that they result in dramatically more comprehensive earthquake catalogs. These catalogs illuminate earthquake processes in detail and to an extent that had previously not been possible, and they do so for both tectonic seismicity and seismicity induced by fluid injection related to unconventional hydrocarbon development. This report summarizes the results from the 15 publications that resulted from this grant. Those contributes are divided into: (1) the development of specific tasks related to monitoring (7 publications), (2) the organization of those tasks into workflows for seismic monitoring (2 publications), and (3) applications of those workflows to data (6 publications).

58 GEOSCIENCES↗
DOE OSTI2023

Machine Learning Enabled Sensor Fusion for In-Situ Defect Detection in Laser Powder Bed Fusion

Laser Powder Bed Fusion (L-PBF) Additive Manufacturing (AM) is among the metal 3D printing technologies most broadly adopted by the manufacturing industry. The current industry qualification paradigm for critical-application L-PBF parts relies heavily on expensive non-destructive inspection techniques such as X-Ray Computed Tomography (XCT), which significantly limits the use-cases of L-PBF. In situ monitoring of the process promises a less expensive alternative to ex situ testing, but existing sensor technologies and data analysis techniques struggle to detect sub-surface flaws (e.g., porosity and cracking) on production-scale L-PBF printers. RTX Technologies Research Center (RTRC) has licensed ORNL’s Peregrine software package – a printer- and camera-agnostic data analytics tool designed specifically for detecting process anomalies using in situ data collected during powder bed printing. The goal of this project was to feed temporally rich, multi-modal sensor data, including visible light, integrated near infrared (NIR), and spatially mapped co-axial melt pool thermal emission data into Peregrine to enable detection of subsurface flaws. XCT data was used as ground truth training data to allow Peregrine’s deep learning algorithms to recognize anomalies in these complex data streams in both test artifacts and industrially relevant geometries. Completion of this program has seen the successful implementation of multi-modal, multi-layer sensor data footprints for training of machine learning models in Peregrine. Flaws detected in XCT data have been successfully detected directly from this in situ data footprint, and initial analyses of the in situ probability-of-detection has been conducted, showing performance levels commensurate with traditional non-destructive evaluation (NDE) methods. The in situ monitoring methodology was then applied to an industrially relevant component that was using post-build NDE, highlighting the utility of the proposed method for hard-to-inspect AM components. As a direct result of this program, two journal manuscripts [1], [2] have been published in Additive Manufacturing, with additional manuscripts planned following program completion.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Deploying E3’s RESERVE Tool to Enable Advanced Operation of Clean Grids

Energy and Environmental Economics, Inc. (E3) developed an open-source machine learning model, RESERVE, for deriving ancillary services timeseries in deeply decarbonized electricity grids. E3 used a bespoke PLEXOS production simulation model of the California Independent System Operator’s (CAISO) balancing area to validate RESERVE’s ability to enable production cost, greenhouse gas emissions (GHG), and renewable energy curtailment savings. These savings were modeled by comparing PLEXOS cases with RESERVE’s outputs to PLEXOS cases with CAISO’s incumbent reserve product in the Western Energy Imbalance Market (EIM)’s 15-minute market. E3 also tested cases with solar operating flexibly to provide reserves. E3 found that, in a 2030 modeling year, using RESERVE and flexible solar enabled significant production cost, GHG and curtailment savings versus the incumbent CAISO method in cases with low penetrations of lithium-ion batteries. However, with the full 14 gigawatts (about 30% of peak CAISO demand) of 4-hour lithium-ion batteries that are expected to be installed by 2030, these savings approach zero due to batteries saturating ancillary services markets. E3 also found significant savings under a 2019 benchmarking year.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Controlling radioisotope proportions when randomly sampling from Dirichlet distributions in PyRIID

As machine learning models for radioisotope quantification become more powerful, likewise the need for high-quality synthetic training data grows as well. For problem spaces that involve estimating the relative isotopic proportions of various sources in gamma spectra it is necessary to generate training data that accurately represents the variance of proportions encountered. In this report, we aim to provide guidance on how to target a desired variance of proportions which are randomly when using the PyRIID Seed Mixer, which samples from a Dirichlet distribution. We provide a method for properly parameterizing the Dirichlet distribution in order to maintain a constant variance across an arbitrary number of dimensions, where each dimension represents a distinct source template being mixed. We demonstrate that our method successfully parameterizes the Dirichlet distribution to target a specific variance of proportions, provided that several conditions are met. This allows us to follow a principled technique for controlling how random mixture proportions are generated which are then used downstream in the synthesis process to produce the final, noisy gamma spectra.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

A High-level Design for Bidirectional Data Streaming to High-Performance Computing Systems from External Science Facilities

Cutting-edge science is increasingly data-driven due to the emergence of scientific machine learning models that can guide scientists toward fruitful areas of exploration. Experimental science facilities such as light and neutron sources, particle colliders, and radio astronomy telescopes are also producing raw measurement data at rates that exceed available data storage and computing capacity at those facilities. As a result, scientific workflows are being developed that concurrently couple experiments at science facilities with high-performance computing (HPC) facilities to enable analysis of experimental data while the experiment is ongoing, and where analysis results are potentially fed back to the experiment for use in experimental control and/or steering in a time-sensitive manner. Our goal is to design, prototype, and deploy a new capability for the Oak Ridge Leadership Computing Facility (OLCF) that enables such workflows through support for bidirectional, memory-based streaming of data from external experiments into and out of OLCF HPC systems. This high-level design document describes the related work and motivating use cases that inform our understanding of the technical requirements for this capability, and describes a proposed architectural solution that meets these requirements and our plans for demonstrating the capability.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Enhancing Data Quality Monitoring at CMS with Interactive Visualization Tools and Automated Reference Run Selection

Current data quality monitoring (DQM) tools at CMS offer granularity limited to per-run analysis. Consequently, issues manifesting at the per-lumisection level can go unnoticed or, even if detectable, often lead to the classification of the whole run as bad, resulting in unnecessary data loss. Additionally, shifters have to evaluate a large set of monitoring elements during their long shifts, increasing the probability of human errors or overlooked problems. In this contribution, we present ongoing work on the development of tools that will provide shifters with an accessible, granularity-enhanced view of DQM data through interactive and dynamic visualizations. Furthermore, we introduce a reference run selection tool currently under development, which will automate the selection based on data-taking conditions and will offer a curated set of training data for machine learning models that will be used for the partial automation of the offline data certification process. These endeavors will be integrated into the DIALS website, enabling enhancements in data certification accuracy and improving the accessibility of DQM at CMS.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Population-level Dark Energy Constraints from Strong Gravitational Lensing using Simulation-Based Inference

In this work, we present a scalable approach for inferring the dark energy equation-of-state parameter ($w$) from a population of strong gravitational lens images using Simulation-Based Inference (SBI). Strong gravitational lensing offers crucial insights into cosmology, but traditional Monte Carlo methods for cosmological inference are computationally prohibitive and inadequate for processing the thousands of lenses anticipated from future cosmic surveys. New tools for inference, such as SBI using Neural Ratio Estimation (NRE), address this challenge effectively. By training a machine learning model on simulated data of strong lenses, we can learn the likelihood-to-evidence ratio for robust inference. Our scalable approach enables more constrained population-level inference of $w$ compared to individual lens analysis, constraining $w$ to within $1\sigma$.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Hydra: Computer Vision for Data Quality Monitoring

Hydra: Computer Vision for Data Quality Monitoring Mar 13, 2024, 4:15 PM 30m Charles B. Wang Center, Stony Brook University Poster Track 1: Computing Technology for Physics Research Poster session with coffee break Speaker Ayan Roy Description Hydra is an extensible framework for training, managing, and deploying machine learning models for near real-time data quality monitoring. It is designed to take some of the burden off of shift crews by providing ‘round-the-clock’ monitoring of plots representing the data being collected. The Hydra system is backed by a database which is leveraged for near push button training and is primarily controlled and viewed through a set of web interfaces. This web interface contains a simple-to-use web based GUI for labeling of the datasets used in training; making it possible to label thousands of images quickly and efficiently. To aid in the analysis of Hydra inferences gradCAM, a method of interpretability, is performed and overlaid on the target image, highlighting regions of interest, making diagnosis of problems much faster. Development began in 2019 for the GlueX Experiment in Hall-D, the Hydra system has grown to encompass all of the experimental halls at Jefferson Laboratory. This talk will focus on the features of Hydra as well as provide details of the challenges present with deploying to disparate experimental halls. With a roadmap of development established, Hydra aims to continue to grow in richness of feature set and expand to encompass other monitoring tasks in differing communities.

Roy, Ayan↗
DOE OSTI2024

Towards reverse mode automatic differentiation of Kokkos-based codes

Derivative computation is a key component of optimization, sensitivity analysis, uncertainty quantification, and the solving of nonlinear problems. Automatic differentiation (AD) is a powerful technique for evaluating such derivatives, and in recent years, has been integrated into programming environments such as Jax, PyTorch, and TensorFlow to support derivative computations needed for training of machine learning models, facilitating wide-spread use of these technologies. The C++ language has become the de facto standard for scientific computing due to numerous factors, yet language complexity has made the wide-spread adoption of AD technologies for C++ difficult, hampering the incorporation of powerful differentiable programming approaches into C++ scientific simulations. This is exacerbated by the increasing emergence of architectures, such as GPUs, with limited memory capabilities and requiring massive thread-level concurrency. C++ AD tools must effectively use these environments to bring novel scientific simulations to next-generation DOE experimental and observational facilities. In this project, we investigated source transformation-based automatic differentiation using LLVM compiler infrastructure to automatically generate portable and efficient gradient computations of Kokkos-based code. We have demonstrated that our proposed strategy is feasible by investigating the usage of a prototype LLVM-based source transformation tool to generate gradients of simple functions made of sequences of simple Kokkos parallel regions. Speedups of up to 500x compared to Sacado were observed on NVIDIA V100 GPU.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Synthesis and characterization of zeolite sorbents from coal fly ash by a microwave-assisted hydrothermal method for removal of boron leachate from coal impoundments

This study developed promoted zeolite-based sorbents derived from coal fly ash to remove leachates (like boron) from ash impoundment or landfill to protect the environment and reuse legacy coal ash. The sorbents were synthesized using machine learning model results as guide to accelerate the sorbent development.

Wang, Ping↗
DOE OSTI2024

SQMS Quantum R&D in Machine Learning, Optimization and Sensing beyond Fundamental Physics Applications

This newly formed team at SQMS under the Ecosystem Thrust is looking to develop capabilities impacting societal advances outside the core domain of HEP and condensed matter physics. We explicitly leverage the experimental and algorithmic innovations developed across all groups as well as connect to broad-scope external projects of the diverse team of PIs. As the inaugural set of projects, we are studying numerically quantum machine learning models inspired by efficiently trainable echo-state and orthogonal neural networks and developing designs for related experiments to be performed on quantum processors based on SQMS SRF cQED technology and Rigetti s transmon arrays. Investigated models exploit ideas and lessons learned from multiple prior work by SQMS team members in a variety of internal and external activities [R1]. Target initial applications include noisy signal processing, potentially captured by quantum sensors or noisy QPUs, as well as simulation and classification of healthcare data. For instance, image reconstruction of the brain s electrical properties by solving the inverse Maxwell equation problem with uncertainty [R2] through a hybrid quantum-classical physics-informed architecture for time-dependent processes [R3]. The group is also investigating the application and development of novel quantum sensors based on magnetic levitation of a superconducting sphere coupled to a superconducting qubit. This coupling enables high-precision measurements of the position of the sphere, which can be used for sensitive detection of forces, enabling practical applications such as gravimetry for geophysics analysis, or accelerometry for GPS-denied navigation [R4] [R1] Rieffel, Eleanor G., Ata Akbari Asanjan, M. Sohaib Alam, Namit Anand, David E. Bernal Neira, Sophie Block, Lucas T. Brady et al. "Assessing and advancing the potential of quantum computing: A NASA case study." Future Generation Computer Systems (2024). [R2] Yu, X., Serrall s, J.E., Giannakopoulos, I.I., Liu, Z., Daniel, L., Lattanzi, R. and Zhang, Z., 2023. Pifon-ept: Mr-based electrical property tomography using physics-informed fourier networks. IEEE Journal on Multiscale and Multiphysics Computational Techniques. [R3] Wudarski, Filip, Daniel OConnor, Shaun Geaney, Ata Akbari Asanjan, Max Wilson, Elena Strbac, P. Aaron Lott, and Davide Venturelli. "Hybrid quantum-classical reservoir computing for simulating chaotic systems." arXiv preprint arXiv:2311.14105 (2023). [R4] Higgins, Gerard, Saarik Kalia, and Zhen Liu. "Maglev for dark matter: Dark-photon and axion dark matter sensing with levitated superconductors." Physical Review D 109.5 (2024): 055024.

Venturelli, Davide↗
DOE OSTI2024

Simulating the CMS High Granularity Calorimeter with ML

Detector simulation is a key component of physics analysis and related activities in CMS. In the upcoming High Luminosity LHC era, simulation will be required to use a smaller fraction of computing in order to satisfy resource constraints. At the same time, CMS will be upgraded with the new High Granularity Calorimeter (HGCal), which requires significantly more resources to simulate than the existing CMS calorimeters. This computing challenge motivates the use of generative machine learning models as surrogates to replace full physics-based simulation. We study the application of state-of-the-art diffusion models to simulate particle showers in the CMS HGCal. We will discuss methods to overcome the challenges posed by the high-dimensional, irregular geometry of the HGCal. The quality of the showers produced by the diffusion model will be assessed by comparison to the full GEANT4-based simulation. The increase in simulation throughput will be quantified and methods to accelerate the diffusion model inference will also be discussed.

Amram, Oz↗
DOE OSTI2024

A Novel 'Smart Microchip Proppants' Technology for Precision Diagnostics of Hydraulic Fracture Networks (Edited Final Report)

This project introduces innovative technology to improve subsurface characterization, visualization, and diagnostics of unconventional reservoirs (fossil resources). Through a collaborative effort involving the University of Kansas, UCLA, MicroSilicon Inc., and EOG Resources, the project aims to deliver precision diagnostics for hydraulic fractures using novel high-resolution imaging technology based on smart microchip proppants. Additionally, it seeks to enhance the accuracy and predictability of integrated numerical, and machine-learning modeling techniques for hydraulic fracture characterization and simulation. This groundbreaking technology addresses significant gaps in understanding unconventional and tight reservoir behavior and optimizing well-completion strategies, enabling more cost-efficient recovery of unconventional resources.

02 PETROLEUM↗
DOE OSTI2025

Synthetic Infrasound Data for Machine Learning Detectors

Synthetic data is a powerful tool to generate large amounts of training data for machine learning models. The methods outlined in this report will be used to retrain the deep learning classifier for increased accuracy. Synthetic data will be useful to address the natural class imbalance between the different categories in the original ML work. Additionally, these tools will be applied for a variety of signal analysis methods that would use signals with a known signal-to-noise ratio for validation and testing.

58 GEOSCIENCES↗
DOE OSTI2025

High Energy Density Physics of Inertial Confinement Fusion Ablator Materials

The historic December 5, 2022 experiment at Lawrence Livermore National Lab’s (LLNL) National Ignition Facility (NIF) reached fusion energy ignition for the first time. This is the most important scientific breakthrough of the 21st century paves the way to future clean inertial fusion energy (IFE). The diamond (high density carbon (HDC)) ablator material used in this experiment displays detrimental effects due to the development of hydrodynamic instabilities at the diamond/fuel interface under shock compression. New alternatives to diamond ablators are required to step up the energy yield in ICF experiments. The unique combination of mechanical strength (approaching that of diamond), the ability to accommodate high-Z dopants (in contrast to diamond), and the tunability of the properties (through synthesis material with varying sp 3 content) make amorphous carbon (a-C) a promising material for next-generation IFE ablative capsules. However, despite its critical importance to the IFE program, the behavior of a-C carbon at extreme temperatures and pressures remains largely unexplored. The primary goals of this project were to perform groundbreaking dynamic compression experiments and predictive simulations to uncover the fundamental high-energy-density physics of amorphous carbon. Our goals were (1) to uncover the metastability range of amorphous carbon and probe phase transitions to diamond or metastable supercooled liquid carbon; (2) to acquire high-quality equation of state (EOS) data and develop an experimentally validated EOS from machine-learning MD simulations of the complex states of carbon; and (3) to uncover the complex behavior of carbon liquid in both thermodynamically stable and metastable supercooled states by accessing large areas of carbon phase diagram with amorphous samples with variable sp 3 content. Our proposed experimental program included measurements of equation of state and diffraction measurements using the Omega EP laser at the Laboratory of Laser Energetics at the University of Rochester. The theoretical/simulation program involved the development of machine-learning models of the complex response of amorphous carbon under dynamic compression by performing molecular dynamics simulations at experimental time and length scales using leadership class DOE supercomputers. Simulations guided experiments to observe predicted phenomena and acquire critical experimental data in specific pressure-temperature domains to validate theoretical models. This research delivered fundamental properties of novel amorphous carbon IFE ablator material, including phase diagram and EOS. These results will aid in IFE target design and implosion experiments. A unique combination of predictive simulations and dynamic and static experiments provided a highly inspirational intellectual environment for graduate students and postdocs involved in this project.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Detector pixel calibration of time-of-flight neutron diffractometers accelerated by machine learning

Modern time-of-flight neutron diffractometers at spallation neutron source are equipped with two dimensional detectors with fine pixelations. The flight path of neutrons from the moderator to the sample and to the detector needs to be precisely calibrated at detector pixel level using standard powders so the diffraction data from all the detector pixels can be correctly time-focused to produce high resolution diffraction peaks. The number of pixels can reach to millions which makes a single-pixel calibration process time-consuming, or even impossible, with conventional fitting routine. Here we presented a machine learning aided calibration process via a “training and predict” process by training machine learning models with the relations between the individual pixel time-of-flight diffraction pattern and fitted diffraction constant. The training models take a portion of the available pixels to predict the diffraction constants precisely and rapidly for massive pixel diffraction patterns.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗