Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “generative machine learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

NREL Sustainable Mobility: The Transportation World Beyond Tomorrow – Is Here Today!

NREL’s sustainable mobility research is moving beyond vehicles and roads, investigating the best way to get people and goods where they need to go with maximum convenience, efficiency, and affordability while minimizing traffic congestion. Integrated research efforts span a variety of technologies—connected and autonomous vehicles and infrastructure; new materials and devices for top performance, efficiency, reliability, and durability; high-performance computing and machine learning; controls that integrate vehicles with energy, road, communication, building, and mass-transit systems; communities of the future, from rural to megacities; and consumer behavior and new models of car ownership.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Systems and methods for improved aircraft safety

Methods and system for improved aircraft safety are described herein. A machine learning model may be trained using historical flight data for a number of previously flown flights where an automation function autonomously disengaged. The trained machine learning model may be used to generate probabilistic alert rules. The probabilistic alert rules may be used by a computing device onboard an aircraft to provide contextual information to flight crew relating to engagement status for one or more automation functions of the aircraft.

Sherry, Lance↗

Lidar Mapping and Surveillance of Nuclear Infrastructure

Wear is unavoidable, whether it occurs in a nuclear facility or abridge on the highway its detection is crucial to preventing the failure of a system. While tools capable of detecting localized damage exist, industry lacks methods to evaluate the health of larger infrastructure. Routine inspection of nuclear facilities must be undertaken to ensure the safety of personnel and proper containment of nuclear materials. Most systems in a nuclear facility are designated as radioactive and confined spaces. To constantly monitor such systems in person would be hazardous but with a remote inspection tool it can be done in a safer and easier way. Lidar: Operates by emitting a laser pulse and looking for the reflected light. Allows user to gain 3D information of the environment. Project Objective: To develop an inspection tool for evaluating the health of large scale infrastructure using Lidar and machine learning. Autonomous Platform + Lidar + Data Fusion + Big Data. Use SLAM to build a 2D map of the environment. Point cloud created by transforming the points between reference frames. Point cloud to Surface: Inherent representation of surface geometry; Difficult to process with conventional techniques. Point cloud to Image: Easily processed by conventional machine learning algorithms. The quantity of data generated will necessitate a big data framework to manage the data for processing. Additional Sensors: Detecting the temperature (a) chemical makeup (b) and radiation emission (c) of a surface could assist in detecting problems. Human inspection can detect irregularities in both physical objects and their point-cloud representations. This is a good indication that mapping nuclear sites using Lidar will provide qualitative insight into the health of the facility. If deep learning can be used to automatically identify problem areas then the completed tool could become an invaluable asset.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Efficient Parallelization of Irregular Applications on GPU Architectures

With the enlarging computation capacity of general Graphics Processing Units (GPUs), leveraging GPUs to accelerate parallel applications has become a critical topic in academia and industry. However, a wide range of irregular applications with the computation-/memory-intensive nature cannot easily achieve high GPU utilization. The challenges mainly involve the following aspects: first, data dependence leads to coarse-grained kernel and inefficient parallelism; second, heavy GPU memory usage may cause frequent memory evictions and extra overhead of I/O; third, specific computation patterns produce memory redundancies; last, workload balance and data reusability conjunctly benefit the overall performance, but there may exist a dynamic trade-off between them. Targeting these challenges, this dissertation proposes multiple optimizations to accelerate two real-world applications: many-body correlation functions to simulate nuclear physics in a large-scale scientific system; the other is the eALS-based matrix factorization recommendation system. To accelerate the calculations of many-body correlation functions, this dissertation presents three frameworks in GPU memory management and multi-GPU scheduling. Firstly, an optimized systematic GPU memory management framework, MemHC, utilizes a series of new memory reduction designs in GPU memory allocation, CPU/GPU communications, and GPU memory oversubscription. Secondly, an enhanced multi-GPU scheduling framework, MICCO, particularly by taking both data dimension (e.g., data reuse and data eviction) and computation dimension into account. MICCO designs a heuristic scheduling algorithm and a machine learning-based regression model to generate the optimal settings of a proposed new concept to manage the trade-off. Thirdly, a locality-aware multi-GPU scheduling framework. This scheduler leverages pipeline batch generation with a looking-ahead strategy by building local dependency graphs for memory transfer reduction and better data reuse, achieving up to 79.92% memory cost reduction and 1.67x speedup. To parallelize the eALS-based recommendation system, this dissertation proposes an efficient CPU/GPU heterogeneous recommendation system, HEALS. HEALS employs newly designed architecture-adaptive data formats to achieve load balance and good data locality on CPU and GPU. To mitigate the data dependence, HEALS presents a CPU/GPU collaboration model for both task parallelism and data parallelism with multiple kernel computation optimizations. In summary, this dissertation efficiently accelerates two typical irregular applications on GPUs by building four frameworks, including CPU/GPU collaboration, GPU memory management, and multi-GPU scheduling.

Wang, Qihan↗

Accelerated CO2 Storage Optimization Using Multi-Resolution Fourier Neural Operator at the Illinois Basin Decatur Project (IBDP)

This paper presents a deep learning-based approach for optimizing CO2 injection in carbon capture and storage (CCS) operations. We developed a multi-resolution machine learning model to significantly reduce data generation costs. Utilizing this proxy model, we implemented a multi-objective genetic algorithm to optimize well control during the CO2 injection process. The proposed approach was applied to the Illinois Basin Decatur Project (IBDP), successfully optimizing the CO2 injection schedule based on three key objectives: maximizing the amount of CO2 stored, maximizing sweep efficiency, and minimizing pressure increase. The use of the proxy model accelerated the optimization workflow by two orders of magnitude, while the cost of data generation for the proxy model was reduced by 90% by utilizing a coarse-scale model.

accelerated CO2 storage optimization↗

Generation and evaluation of synthetic patient data

Background: Machine learning (ML) has made a significant impact in medicine and cancer research; however, its impact in these areas has been undeniably slower and more limited than in other application domains. A major reason for this has been the lack of availability of patient data to the broader ML research community, in large part due to patient privacy protection concerns. High-quality, realistic, synthetic datasets can be leveraged to accelerate methodological developments in medicine. By and large, medical data is high dimensional and often categorical. These characteristics pose multiple modeling challenges. Methods: In this paper, we evaluate three classes of synthetic data generation approaches; probabilistic models, classification-based imputation models, and generative adversarial neural networks. Metrics for evaluating the quality of the generated synthetic datasets are presented and discussed. Results: While the results and discussions are broadly applicable to medical data, for demonstration purposes we generate synthetic datasets for cancer based on the publicly available cancer registry data from the Surveillance Epidemiology and End Results (SEER) program. Specifically, our cohort consists of breast, respiratory, and non-solid cancer cases diagnosed between 2010 and 2015, which includes over 360,000 individual cases. Conclusions: We discuss the trade-offs of the different methods and metrics, providing guidance on considerations for the generation and usage of medical synthetic data.

59 BASIC BIOLOGICAL SCIENCES↗

Conceptual Design of Integrated Energy Systems with Market Interaction Surrogate Models

Most integrated energy system (IES) optimization frameworks employ the price-taker approximation, which ignores important interactions with the market and can result in overestimated economic values. In this work, we propose a machine learning surrogate-assisted optimization framework to quantify IES/market interactions and thus go beyond price-taker. We use time series clustering to generate representative IES operation profiles for the optimization problem and use machine learning surrogate models to predict the IES/market interaction. We quantify the accuracy of the time series clustering and surrogate models in a case study to optimally retrofit a nuclear power plant with a polymer electrolyte membrane electrolyzer to co-produce electricity and hydrogen.

Chen, Xinhe↗

Machine learned features from density of states for accurate adsorption energy prediction

Materials databases generated by high-throughput computational screening, typically using density functional theory (DFT), have become valuable resources for discovering new heterogeneous catalysts, though the computational cost associated with generating them presents a crucial roadblock. Hence there is a significant demand for developing descriptors or features, in lieu of DFT, to accurately predict catalytic properties, such as adsorption energies. Here, we demonstrate an approach to predict energies using a convolutional neural network-based machine learning model to automatically obtain key features from the electronic density of states (DOS). The model, DOSnet, is evaluated for a diverse set of adsorbates and surfaces, yielding a mean absolute error on the order of 0.1 eV. In addition, DOSnet can provide physically meaningful predictions and insights by predicting responses to external perturbations to the electronic structure without additional DFT calculations, paving the way for the accelerated discovery of materials and catalysts by exploration of the electronic space.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Sub-millisecond keyhole pore detection in laser powder bed fusion using sound and light sensors and machine learning

Laser powder bed fusion is a mainstream additive manufacturing technology widely used to manufacture complex parts in prominent sectors, including aerospace, biomedical, and automotive industries. However, during the printing process, the presence of an unstable vapor depression can lead to a type of defect called keyhole porosity, which is detrimental to the part quality. In this study, we developed an effective approach to locally detect the generation of keyhole pores during the printing process by leveraging machine learning and a suite of optical and acoustic sensors. Simultaneous synchrotron x-ray imaging allows the direct visualization of pore generation events inside the sample, offering high-fidelity ground truth. A neural network model adopting SqueezeNet architecture using single-sensor data was developed to evaluate the fidelity of each sensor for capturing keyhole pore generation events. Our comparative study shows that the near infrared images gave the highest prediction accuracy, followed by 100 kHz and 20 kHz microphones, and the photodiode sensitive to processing laser wavelength had the lowest accuracy. Using a single sensor, over 90% prediction accuracy can be achieved with a temporal resolution as short as 0.1 ms. A data fusion scheme was also developed with features extracted using SqueezeNet neural network architecture and classification using different machine learning algorithms. Our work demonstrates the correlation between the characteristic optical and acoustic emissions and the keyhole oscillation behavior, and thereby provides strong physics support for the machine learning approach.

36 MATERIALS SCIENCE↗

Machine-Learning-Based Monitoring of Laser Powder Bed Fusion

A two-step machine learning approach to monitoring Laser Powder Bed Fusion (LPBF) additive manufacturing is demonstrated that enables on-the-fly assessments of laser track welds. First, in situ video melt pool data acquired during LPBF is labeled according to the (1) average and (2) standard deviation of individual track width and also (3) whether or not the track is continuous, measured post-build through an ex situ height map analysis algorithm. This procedure generates three ground truth labeled datasets for supervised machine learning. Using a portion of the labeled 10-millisecond video clips, a single Convolutional Neural Network architecture is trained to generate three distinct networks. With the remaining in situ LPBF data, the trained neural networks are tested and evaluated and found to predict track width, standard deviation, and continuity without the need for ex situ measurements. This two-step approach should benefit any LPBF system – or any additive manufacturing technology – where height-map-derived properties can serve as useful labels for in situ sensor data.

42 ENGINEERING↗

Constructing a High‐Resolution Aftershock Catalog for the 2017 Mw 8.2 Tehuantepec Earthquake Sequence Using a Machine Learning–Based Workflow

The 8 September 2017 Mw 8.2 Tehuantepec earthquake was the largest instrumentally recorded normal‐faulting earthquake in Mexico. The mainshock occurred offshore within the Tehuantepec seismic gap, generating >30,000 aftershocks in the following year. We applied an open‐source, machine learning (ML)–assisted workflow to construct a high‐resolution aftershock catalog using data from temporary and permanent seismic networks in southern Mexico. The workflow integrates PhaseNet for phase detection; GaMMA for phase association; and VELEST, HypoInverse, and HypoDD for velocity modeling and relocation. We processed seven months of continuous waveform data from 29 broadband stations, including a temporary rapid‐response deployment that improved station coverage of the offshore rupture zone. To evaluate performance, we compared our results against analyst‐reviewed picks and event locations from the Servicio Sismológico Nacional catalog. The resulting catalog contains 11,374 relocated earthquakes and represents the most comprehensive published dataset for this sequence, incorporating the first full use of the temporary network. Relocated hypocenters show improved depth control and align well with the Slab2.0 subduction geometry, revealing clearer separation between offshore slab events and onshore crustal seismicity. This study demonstrates that combining ML‐based detection with established methods provides a scalable and reproducible approach for constructing high‐quality earthquake catalogs in tectonically complex environments and offers practical guidance for adapting similar workflows to other earthquake sequences.

Garcia, Marc [The University of Texas at El Paso, ↗

Adaptive Generation of Training Data for ML Reduced Model Creation

Machine learning proxy models are often used to speed up or completely replace complex computational models. The greatly reduced and deterministic computational costs enable new use cases such as digital twin control systems and global optimization. The challenge of building these proxy models is generating the training data. A naive uniform sampling of the input space can result in a non-uniform sampling of the output space of a model. This can cause gaps in the training data coverage that can miss finer scale details resulting in poor accuracy. While larger and larger data sets could eventually fill in these gaps, the computational burden of full-scale simulation codes can make this prohibitive. In this paper, we present an adaptive data generation method that utilizes uncertainty estimation to identify regions where training data should be augmented. By targeting data generation to areas of need, representative data sets can be generated efficiently. The effectiveness of this method will be demonstrated on a simple one-dimensional function and a complex multidimensional physics model.

Cianciosa, Mark↗

Hashed Binary Search Sampling for Convolutional Network Training with Large Overhead Image Patches

Very large overhead imagery associated with ground truth maps has the potential to generate billions of training image patches for machine learning algorithms. However, random sampling selection criteria often leads to redundant and noisy-image patches for model training. With minimal research efforts behind this challenge, the current status spells missed opportunities to develop supervised learning algorithms that generalize over wide geographical scenes. In addition, much of the computational cycles for large scale machine learning are poorly spent crunching through noisy and redundant image patches. We demonstrate a potential framework to address these challenges specifically, while evaluating a human settlement detection task. A novel binary search tree sampling scheme is fused with a kernel based hashing procedure that maps image patches into hash-buckets using binary codes generated from image content. The framework exploits inherent redundancy within billions of image patches to promote mostly high variance preserving samples for accelerating algorithmic training and increasing model generalization.

Lunga, Dalton↗

A New Modeling Framework for Geothermal Operational Optimization with Machine Learning (GOOML)

Geothermal power plants are excellent resources for providing low carbon electricity generation with high reliability. However, many geothermal power plants could realize significant improvements in operational efficiency from the application of improved modeling software. Increased integration of digital twins into geothermal operations will not only enable engineers to better understand the complex interplay of components in larger systems but will also enable enhanced exploration of the operational space with the recent advances in artificial intelligence (AI) and machine learning (ML) tools. Such innovations in geothermal operational analysis have been deterred by several challenges, most notably, the challenge in applying idealized thermodynamic models to imperfect as-built systems with constant degradation of nominal performance. This paper presents GOOML: a new framework for Geothermal Operational Optimization with Machine Learning. By taking a hybrid data-driven thermodynamics approach, GOOML is able to accurately model the real-world performance characteristics of as-built geothermal systems. Further, GOOML can be readily integrated into the larger AI and ML ecosystem for true state-of-the-art optimization. This modeling framework has already been applied to several geothermal power plants and has provided reasonably accurate results in all cases. Therefore, we expect that the GOOML framework can be applied to any geothermal power plant around the world.

15 GEOTHERMAL ENERGY↗

Cyber-Attack Detection and Accommodation for the Energy Delivery System

The goals of this project were to create a software system with a suite of key algorithms for cyber-attack detection and accommodation providing domain layer protection for critical power generation assets. Example assets included gas and steam turbines, heat recovery steam generators, and electrical generators. The aggressive algorithm goals were aimed at reducing the false positive rates in threat detection to <1% using learnings from many evolving disciplines (power turbine and generator physics, power system modeling, modern control theory, system identification, machine learning, deep learning, mathematics and data science). Additional goals for the algorithms involved localizing threats on-the-fly to know in which monitoring node the effects of attacks are present, and then providing accommodation to keep the system running uninterrupted much of the time in the presence of the attack. Accommodation had a performance goal of providing resiliency when up to 50% of monitoring nodes are in an attack state.

cybersecurity, cyber-physical↗

Computationally Accelerated Discovery and Experimental Demonstration of High-Performance Materials for Advanced Solar Thermochemical Hydrogen Production

This project achieved its overarching goal of accelerating the discovery and validation of solar thermochemical hydrogen (STCH) materials through a tightly integrated approach that combined high-throughput computational screening, advanced machine learning (ML), and experimental testing. Guided by the objectives outlined in the Statement of Project Objectives (SOPO), our work fulfilled all major milestones across four technical tasks and delivered scientific breakthroughs and practical tools that significantly exceeded the original scope of the project. We began by addressing the challenge of predicting material phase stability through machine learning. A novel Python module was developed to generate thousands of meaningful features from composition, structure, and electronic properties, enabling rapid and reproducible ML model development. Using these tools, we trained a model to predict temperature-dependent Gibbs energies (G(T)) for inorganic crystalline materials with near-chemical accuracy—roughly 40 meV/atom—marking the first such descriptor of its kind. We also introduced a new machine-learned tolerance factor, τ, that accurately predicted perovskite formability with over 90% success, outperforming traditional heuristic models, such as the Goldschmidt tolerance factor. These capabilities allowed for rapid and accurate predictions of phase stability across a vast oxide composition space, setting the stage for high-throughput thermodynamic screening. Building on this foundation, we conducted an extensive computational screening of candidate STCH oxide materials. Over 1.1 million perovskite compositions were evaluated using the τ descriptor, leading to the identification of more than 27,000 predicted stable structures. Using density functional theory (DFT), we refined over 68,000 multinary perovskite structures and computed oxygen vacancy formation energies for over 1,300 ternary and double perovskites. These calculations enabled us to isolate compounds with redox behavior consistent with STCH requirements and resulted in a public dataset now hosted on the Materials Project. Recognizing that thermodynamic screening alone is insufficient, we addressed kinetic limitations by developing a suite of tools to estimate transition state (TS) energies for key redox reactions. We implemented a novel bounding approach that provides lower and upper estimates of TS energies with dramatically reduced computational cost, requiring less than 10% of the CPU time of a full nudged elastic band (NEB) calculation while maintaining high accuracy. This enabled rapid evaluation of over 200 reaction pathways across 90 materials. To further accelerate screening, we developed a SISSO-based ML model to predict diffusion barriers with a 96.7% success rate in classifying fast vs. slow materials, supporting a robust, data-driven framework for assessing redox kinetics. Experimental validation was critical to confirming the predictive power of our models. We synthesized and tested a wide array of candidate materials, including Mn-doped hercynite and several Gd- and La-based perovskites. Notably, Sr 0.4 Gd 0.6 Mn 0.6 Al 0.4 O 3 (SGMA) and Gd 0.5 La 0.5 Co 0.5 Fe 0.5 O 3 (GLCF) emerged as leading STCH materials, exhibiting robust redox cycling and high hydrogen yields exceeding 150 µmol H 2 /g per cycle. These materials also retained over 50% of their hydrogen productivity under high-conversion conditions (H 2 O:H 2 = 1333:1), demonstrating strong thermodynamic favorability and promising performance under industrially relevant scenarios. Additional candidates, such as La 2 MnNiO 6 (L2MN), were found to produce even higher yields than ceria under standard STCH conditions. Our collaborators at Sandia National Laboratories confirmed these findings using high-temperature X-ray diffraction and thermogravimetric analysis, observing stable phase evolution and reversible redox activity. In several respects, the project went beyond the goals initially outlined in the SOPO. We published 17 peer-reviewed articles, including a large dataset of over 66,000 theoretical perovskites and a new structure prediction method (SPuDS-DFT) that accurately identifies ground-state structures at a fraction of the cost of traditional DFT. We demonstrated that our machine-learned G(T) model offers accuracy rivaling quasiharmonic calculations while being orders of magnitude faster. In partnership with the Materials Project, we made our datasets openly available, providing a powerful new resource for the broader materials science community. The combined computational and experimental advances of this project represent a significant advance in STCH materials discovery. By creating a robust, generalizable, and open workflow for thermodynamic and kinetic screening, and validating key findings through synthesis and reactor testing, we have provided a practical and scalable pathway for the rapid identification of new redox-active materials. The tools, data, and materials developed under this project are already supporting ongoing research and have laid the groundwork for the next generation of solar fuel technologies.

08 HYDROGEN↗

Advances in solar forecasting: Computer vision with deep learning

Renewable energy forecasting is crucial for integrating variable energy sources into the grid. It allows power systems to address the intermittency of the energy supply at different spatiotemporal scales. To anticipate the future impact of cloud displacements on the energy generated by solar facilities, conventional modeling methods rely on numerical weather prediction or physical models, which have difficulties in assimilating cloud information and learning systematic biases. Augmenting computer vision with machine learning overcomes some of these limitations by fusing real-time cloud cover observations with surface measurements acquired from multiple sources. This Review summarizes recent progress in solar forecasting from multisensor Earth observations with a focus on deep learning, which provides the necessary theoretical framework to develop architectures capable of extracting relevant information from data generated by ground-level sky cameras, satellites, weather stations, and sensor networks. Overall, machine learning has the potential to significantly improve the accuracy and robustness of solar energy meteorology; however, more research is necessary to realize this potential and address its limitations.

14 SOLAR ENERGY↗