Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “active machine learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Application of an automated machine learning-genetic algorithm (AutoML-GA) coupled with computational fluid dynamics simulations for rapid engine design optimization

In recent years, the use of machine learning-based surrogate models for computational fluid dynamics (CFD) simulations has emerged as a promising technique for reducing the computational cost associated with engine design optimization. However, such methods still suffer from drawbacks. One main disadvantage is that the default machine learning (ML) hyperparameters are often severely suboptimal for a given problem. This has often been addressed by manually trying out different hyperparameter settings, but this solution is ineffective in case of a high-dimensional hyperparameter space. Besides this problem, the amount of data needed for training is also not known a priori. In response to these issues that need to be addressed, the present work describes and validates an automated active learning approach, AutoML-GA, for surrogate-based optimization of internal combustion engines. In this approach, a Bayesian optimization technique is used to find the best machine learning hyperparameters based on an initial dataset obtained from a small number of CFD simulations. Subsequently, a genetic algorithm is employed to locate the design optimum on the ML surrogate surface. In the vicinity of the design optimum, the solution is refined by repeatedly running CFD simulations at the projected optima and adding the newly obtained data to the training dataset. It is demonstrated that AutoML-GA leads to a better optimum with a lower number of CFD simulations, compared to the use of default hyperparameters. The proposed framework offers the advantage of being a more hands-off approach that can be readily utilized by researchers and engineers in industry who do not have extensive machine learning expertise.

Owoyele, Opeoluwa↗
DOE OSTI2024

Sequence-Based Anomaly Detection in Critical Infrastructure Networks

United States critical infrastructure faces new cyber threats from adversarial nation-state actors in the form of malware-free attacks. Traditional cybersecurity techniques use rules-based methods to identify indicators of compromise on networks, often missing these sophisticated attacks. Our approach leverages multiple state of the art machine learning models in a pipeline to identify abnormal network events through sequential analysis. We combine both device and packet-level information into individual events to characterize anomalous network actions. The model is trained and tested on real network traffic from the Idaho National Lab High Performance Computing (HPC) with greater than 98% precision. It is capable of flagging malicious tactics used by adversaries in malware-free attacks, severe changes to the network, and abnormal user activity by network devices.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2023

Integrated Research Infrastructure Architecture Blueprint Activity (Final Report 2023)

The complexity of scientific pursuits is increasing rapidly with aspects that require dynamic integration of experiment, observation, theory, modeling, simulation, visualization, machine learning (ML), artificial intelligence (AI), and analysis. Research projects across the Department of Energy (DOE) are increasingly data and compute intensive. Innovative research teams are accelerating the pace of discovery by using high-performance computational and data tools in their research workflows and leveraging multiple research infrastructures. Additionally, several recent high-level U.S. government reports underscore the necessity of a new advanced computing ecosystem for international competitiveness and national security. International competitors are moving forward with major research infrastructure integration efforts that seek to capture a competitive advantage in the global innovation race. Owing to its unparalleled constellation of world-class experimental and observational facilities and high-performance and extreme-scale computational, data, and networking infrastructure, DOE is positioned to be a global leader in this new era of integrated science. However, this new integration paradigm will demand continuing evolution to ensure the U.S. remains a global leader in research and innovation. The DOE Office of Science (SC) has seized on the strategic importance of integration and has adopted a vision for Integrated Research Infrastructure (IRI): To empower researchers to meld DOE’s world-class research tools, infrastructure, and user facilities seamlessly and securely in novel ways to radically accelerate discovery and innovation. To respond to the evolving computational requirements of research and the competitive international innovation landscape, experimental facilities could be connected with high performance computing resources for near real-time analysis, and resources should be provided for merging enormous and diverse data for AI/ML techniques and analysis.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Electrochemical Characterization of Molten Salt Chemistry During Atmospheric Ingressions

This report describes the salt chemistry and sedimentation studies that were completed in FY23 as part of the Pyrochemical Fuel Cycles – ANL project. The primary objective of these activities was to employ electrochemical methods in order to quantify and gain insights into the reaction mechanisms associated with the interaction of O2 and moisture impurities with the molten chloride salts used for the pyrochemical processing of nuclear materials. If not monitored and controlled, the ingression of these atmospheric impurities can lead to changes in the salt redox conditions and initiate the formation of oxide particles, potentially resulting in operational and safeguards challenges. By elucidating the mechanisms underlying the formation of oxide particles, we can effectively monitor the conditions of the salt and design systems to mitigate the influence of atmospheric O2 and H2O. To achieve these goals, we designed a test system that allowed for precisely controlled gas ingressions into the molten salt vessel. This system included on-line monitoring provided by electrochemical probes that enable near real-time measurements of the salt conditions throughout the course of the experiment. Using this system, we systematically varied experimental conditions, including O2/Ar flow rates and O2 concentrations, to comprehensively understand their impact on solid particle formation. We also used a particle size and shape analyzer to characterize the particles that were generated. Tests in FY23 concentrated on the formation of CeO2 particles, but we also prepared a separate apparatus targeting UO2 particles for use in FY24. We additionally conducted extensive modeling activities in support of this work. This included multiphysics simulations of the gas ingressions along with the development of a machine learning workflow to enable accelerated molecular dynamics modeling of the molten salt chemistry of LiCl-KCl-UCl3. The combination of experimental and modeling tools has allowed us to begin to get a more complete understanding of the reactions that occur when atmospheric ingressions occur in pyroprocessing systems.

Guo, Jicheng↗
DOE OSTI2024

Accelerating Computational Materials Discovery with Machine Learning and Cloud High-Performance Computing: from Large-Scale Screening to Experimental Validation

High-throughput computational materials discovery has promised significant acceleration of the design and discovery of new materials for many years. Despite a surge in interest and activity, the constraints imposed by large-scale computational resources present a significant bottleneck. Furthermore, examples of large-scale computational discovery carried through experimental validation remain scarce, especially for materials with product applicability. In this paper, we demonstrate how this vision became reality by first combining state-of-the-art artificial intelligence (AI) models and traditional physics-based models on cloud high performance computing (HPC) resources to quickly navigate through more than 32 million candidates and predict around half a million potentially stable materials. Focusing on solid-state electrolytes for battery applications, our discovery pipeline further identified 18 promising candidates with new compositions and rediscovered a decade’s worth of collective knowledge in the field as a byproduct. By employing around one thousand virtual machines in the cloud, this process took less than 80 hours. We then synthesized and experimentally characterized the structures and conductivities of our top candidates, the Na x Li 3-x YCl 6 (0.5 ≤ x ≤ 2.5) series, demonstrating the potential of these compounds to serve as solid electrolytes. Additional candidate materials are currently under experimental investigation that could offer more examples of the computational discovery of new phases of Li- and Na-conducting solid electrolytes. We believe this unprecedented approach of synergistically integrating AI models and cloud HPC not only accelerates materials discovery but also showcases the potency of AI-guided experimentation in unlocking transformative scientific breakthroughs with real-world applications.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Using Machine Learning to Identify Optimum Prospects for Offshore Geologic CO 2 Storage and Enhanced Oil Recovery in the Gulf of Mexico

The SECARB Offshore Partnership is a government-industry partnership focused on assembling the knowledge base required for secure, long-term, large-scale CO 2 subsea storage in saline formations and mature oil reservoirs. The SECARB Offshore Partnership is evaluating potential storage opportunities in the Central and Eastern planning areas of the outer continental shelf (OCS) of the Gulf of Mexico. The evaluation focuses on active and depleted oil and gas fields and potentially associated CO 2 -enhanced oil recovery (CO 2 -EOR), as well as, deep saline storage resources. As part of Subtask 3.0 (Offshore Storage Resources Characterization) and Subtask 4.0 (Risk Assessment, Simulation, and Modeling), Oklahoma State University (OSU) is developing a machine learning system that employs the SAS Institute’s Viya platform with visual data mining and machine learning to identify and characterize optimum prospects for enhanced oil recovery and stacked storage in saline reservoirs. This report summarizes this effort to date and discusses the many variables that can be used to characterize these storage objectives, as well as, the design vision of the Viya machine learning system.

02 PETROLEUM↗
DOE OSTI2024

Potential applications of microbial genomics in nuclear non-proliferation

As nuclear technology evolves in response to increased demand for diversification and decarbonization of the energy sector, new and innovative approaches are needed to effectively identify and deter the proliferation of nuclear arms, while ensuring safe development of global nuclear energy resources. Preventing the use of nuclear material and technology for unsanctioned development of nuclear weapons has been a long-standing challenge for the International Atomic Energy Agency and signatories of the Treaty on the Non-Proliferation of Nuclear Weapons. Environmental swipe sampling has proven to be an effective technique for characterizing clandestine proliferation activities within and around known locations of nuclear facilities and sites. However, limited tools and techniques exist for detecting nuclear proliferation in unknown locations beyond the boundaries of declared nuclear fuel cycle facilities, representing a critical gap in non-proliferation safeguards. Microbiomes, defined as “characteristic communities of microorganisms” found in specific habitats with distinct physical and chemical properties, can provide valuable information about the conditions and activities occurring in the surrounding environment. Microorganisms are known to inhabit radionuclide-contaminated sites, spent nuclear fuel storage pools, and cooling systems of water-cooled nuclear reactors, where they can cause radionuclide migration and corrosion of critical structures. Microbial transformation of radionuclides is a well-established process that has been documented in numerous field and laboratory studies. These studies helped to identify key bacterial taxa and microbially-mediated processes that directly and indirectly control the transformation, mobility, and fate of radionuclides in the environment. Expanding on this work, other studies have used microbial genomics integrated with machine learning models to successfully monitor and predict the occurrence of heavy metals, radionuclides, and other process wastes in the environment, indicating the potential role of nuclear activities in shaping microbial community structure and function. Results of this previous body of work suggest fundamental geochemical-microbial interactions occurring at nuclear fuel cycle facilities could give rise to microbiomes that are characteristic of nuclear activities. These microbiomes could provide valuable information for monitoring nuclear fuel cycle facilities, planning environmental sampling campaigns, and developing biosensor technology for the detection of undisclosed fuel cycle activities and proliferation concerns.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

ET-AL: Entropy-targeted active learning for bias mitigation in materials data

Growing materials data and data-driven informatics drastically promote the discovery and design of materials. While there are significant advancements in data-driven models, the quality of data resources is less studied despite its huge impact on model performance. In this work, we focus on data bias arising from uneven coverage of materials families in existing knowledge. Observing different diversities among crystal systems in common materials databases, we propose an information entropy-based metric for measuring this bias. To mitigate the bias, we develop an entropy-targeted active learning (ET-AL) framework, which guides the acquisition of new data to improve the diversity of underrepresented crystal systems. We demonstrate the capability of ET-AL for bias mitigation and the resulting improvement in downstream machine learning models. This approach is broadly applicable to data-driven materials discovery, including autonomous data acquisition and dataset trimming to reduce bias, as well as data-driven informatics in other scientific domains.

36 MATERIALS SCIENCE↗
DOE OSTI2022

A Machine Learning Method for the Forensics Attribution of Separated Plutonium

Plutonium (Pu) source attribution would be a powerful tool to support nuclear nonproliferation efforts. This capability to find the source of a Pu sample would act as a deterrent to smuggling efforts, and also help regulatory agencies verify declared nuclear activities. Work at Texas A&M University yielded a nuclear forensics methodology, which is capable of determining separated Pu’s reactor of origin, fuel burnup, and the time since irradiation (TSI)—three parameters of interest. The methodology used a set of ten intra-element isotopic ratios found in separated Pu, which was compared to a library of isotopic ratio values produced using neutronics simulations for reactors of interest. By calculating the probability that unknown Pu sample’s isotopic ratio set matched a set in the library, the methodology could predict the three parameters of interest of the sample. One shortcoming of this methodology was an inability to correctly attribute spoofed Pu, where Pu sourced from two different reactors or two different fuel burnup levels are mixed. A new methodology to rectify this vulnerability using machine learning (ML) technique is developed, instead of the maximum likelihood calculation previously used and the results are satisfactory. The ML approach leverages the existing simulated data for training the algorithm, but use them efficiently by only using intra-element isotope ratios that contribute to the attribution one of the three parameters at a time. Previously, all isotope ratios were used to attribute all three parameters together. The new methodology attributes the Pu parameters in three steps, one for each parameter, rather than resolving all of the three parameters simultaneously like the previous maximum likelihood approach. First, a support vector machine classifier with a set of seven isotopic ratios finds the reactor of origin and a set of regression models trained using gaussian process predicts the burnup with a different set of seven isotopes. Finally, TSI is calculated analytically using decay equations. Thus far, the new methodology is capable of attributing pure Pu samples and has been validated using experimental data. The next step will to be augment the classifier training data set with spoofed Pu data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Battery aging mode identification across NMC compositions and designs using machine learning

A comprehensive understanding of lithium-ion battery (LiB) lifespan is the key to designing durable batteries and optimizing use protocols. Although battery lifetime prediction methods are flourishing, diagnosis of the root causes of aging and degradation have not yet been well developed nor studied for a broad mixture of designs and use cases. Here, we create a machine-learning (ML)-based framework that distinguishes aging modes using multiple electrochemical signatures recorded cycle-by-cycle. The predominant aging behaviors include a combination of loss of active materials in cathode (LAMPE) and a loss of Li inventory (LLI) in Li plating or solid electrolyte interphase (SEI) formation, manifested from 44 batteries representing two cathode chemistries, two electrode loadings, and five charging rates. Here, the aging mode classification accuracy is 86% using features within the first 50 cycles and increases to 88% beyond 225 cycles. The same features can quantify the percentage of end-of-life LAMPE with only 4.3% of error.

25 ENERGY STORAGE↗
DOE OSTI2024

An active learning framework for the rapid assessment of galvanic corrosion

The current present in a galvanic couple can define its resistance or susceptibility to corrosion. However, as the current is dependent upon environmental, material, and geometrical parameters it is experimentally costly to measure. To reduce these costs, Finite Element (FE) simulations can be used to assess the cathodic current but also require experimental inputs to define boundary conditions. Due to these challenges, it is crucial to accelerate predictions and accurately predict the current output for different environments and geometries representative of in-service conditions. Machine learned surrogate models provides a means to accelerate corrosion predictions. However, a one-time cost is incurred in procuring the simulation and experimental dataset necessary to calibrate the surrogate model. Therefore, an active learning protocol is developed through calibration of a low-cost surrogate model for the cathodic current of an exemplar galvanic couple (AA7075-SS304) as a function of environmental and geometric parameters. The surrogate model is calibrated on a dataset of FE simulations, and calculates an acquisition function that identifies specific additional inputs with the maximum potential to improve the current predictions. This is accomplished through a staggered workflow that not only improves and refines prediction, but identifies the points at which the most information is gained, thus enabling expansion to a larger parameter space. The protocols developed and demonstrated in this work provide a powerful tool for screening various forms of corrosion under in-service conditions.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Machine learning for slow-extraction uniformity at the Fermilab Delivery Ring

The Muon-to-Electron Conversion Experiment (Mu2e) requires uniform slow extraction from the Fermilab Delivery Ring during each 43 ms spill. This project analyzed 13,737 spills from seven parquet files collected during March and June 2026 commissioning. Each spill contained 430 samples at 0.1 ms resolution and was summarized by the Spill Duty Factor. Null Action and active proportional-integral-derivative conditions established operational baselines. Fixed-ramp sessions were segmented to evaluate reproducibility, drift, and spill-to-spill spread, while a deliberate quadrupole-ramp step identified the beam-response peak and trough. Median profiles were reproducible within fixed conditions but drifted over multi-hour periods. The resulting baselines and response features support future physics-based and machine-learning approaches to real-time spill regulation.

Prescott, Matthew J. [Purdue U., West Lafayette; F↗
DOE OSTI2025

Adaptive Algebraic Derivative Estimation for Battery Electric Buses Energy Consumption Forecasting

The limited service life of onboard batteries for EVs is a challenge, underscoring the need for real-time battery usage prediction. This paper proposes an adaptive Algebraic Derivative Estimation (ADE) approach for forecasting the energy consumption of battery electric buses. By dynamically adjusting the sliding window length, the adaptive ADE retains the fixed-length ADE’s key advantage—namely, operating online without reliance on extensive historical datasets—while substantially bolstering forecast accuracy by actively trading estimation bias off estimation variance. Comparative experiments against both the conventional ADE with a fixed length and a representative machine learning algorithm, XGBoost, were conducted, with performance evaluated via root mean square error, mean absolute error, and the coefficient of determination. The results demonstrate that the proposed approach significantly outperforms baseline methods.

Cui, Tianyang [The University of Texas at Dallas]↗
DOE OSTI2024

Dynamic Multiplexed Control and Modeling of Optogenetic Systems Using the High-Throughput Optogenetic Platform, Lustro

The ability to control cellular processes using optogenetics is inducer-limited, with most optogenetic systems responding to blue light. To address this limitation, we leverage an integrated framework combining Lustro, a powerful high-throughput optogenetics platform, and machine learning tools to enable multiplexed control over blue light-sensitive optogenetic systems. Specifically, we identify light induction conditions for sequential activation as well as preferential activation and switching between pairs of light-sensitive split transcription factors in the budding yeast, Saccharomyces cerevisiae. We use the high-throughput data generated from Lustro to build a Bayesian optimization framework that incorporates data-driven learning, uncertainty quantification, and experimental design to enable the prediction of system behavior and the identification of optimal conditions for multiplexed control. This work lays the foundation for designing more advanced synthetic biological circuits incorporating optogenetics, where multiple circuit components can be controlled using designer light induction programs, with broad implications for biotechnology and bioengineering.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Computational evolution of high-performing unfused non-fullerene acceptors for organic solar cells

Materials optimization for organic solar cells (OSCs) is a highly active field, with many approaches using empirical experimental synthesis, computational brute force to screen a subset of chemical space, or generative machine learning methods that often require significant training sets. While these methods may find high-performing materials, they can be inefficient and time-consuming. Genetic algorithms (GAs) are an alternative approach, allowing for the “virtual synthesis” of molecules and a prediction of their “fitness” for some property, with new candidates suggested based on good characteristics of previously generated molecules. In this work, a GA is used to discover high-performing unfused non-fullerene acceptors (NFAs) based on an empirical prediction of power conversion efficiency (PCE) and provides design rules for future work. The electron-withdrawing/donating strength, as well as the sequence and symmetry, of those units are examined. The utilization of a GA over a brute-force approach resulted in speedups up to 1.8 × 10 12 . New types of units, not frequently seen in OSCs, are suggested, and in total 5426 NFAs are discovered with the GA. Of these, 1087 NFAs are predicted to have a PCE greater than 18%, which is roughly the current record efficiency. While the symmetry of the sequence showed no correlation with PCE, analysis of the sequence arrangement revealed that higher performance can be achieved with a donor core and acceptor end groups. Future NFA designs should consider this strategy as an alternative to the current A-D-A'-D-A architecture.

14 SOLAR ENERGY↗
DOE OSTI2023

Seismic Characterization of the Blue Mountain Geothermal Field

Subsurface characterization is crucial for geothermal energy exploration and production. Yet hydrothermal reservoirs usually reside in highly fractured and faulted zones where accurate characterization is very challenging because of low signal-to-noise ratios of land seismic data and lack of coherent reflection signals. We perform an active-source seismic characterization for the Blue Mountain geothermal field in Nevada using active seismic data to reveal the elastic medium property complexity and fault distribution at this field. We first employ an unsupervised machine learning method to attenuate groundroll and near-surface guided-wave noise and enhance coherent reflection and scattering signals from noisy seismic data. We then build a smooth initial P-wave velocity model based on an existing magnetotellurics survey result, and use 3D first-arrival traveltime tomography to refine the initial velocity model. We then derive a set of elastic wave velocities and anisotropic parameters using elastic full-waveform inversion, and obtain PP and PS images using elastic reverse-time migration. We identify major faults by analyzing the variations of seismic velocities and anisotropy parameters, and reveal mid- to small-scale faults by applying a supervised machine learning method to the seismic migration images. Our characterization reveals complex velocity heterogeneities and anisotropies, as well as faults, with a high spatial resolution. These results can provide valuable information for optimal placement of future injection and production wells to increase geothermal energy production at the Blue Mountain geothermal power plant.

58 GEOSCIENCES↗
DOE OSTI2023

Improving Subsurface Stress Characterization for Carbon Dioxide Storage Projects by Incorporating Machine Learning Techniques

The overall objective of this project is to develop a framework for reliable characterization and prediction of the state of stress in the overburden and underburden (including the basement) in CO 2 storage reservoirs using machine learning and integrated geomechanics and geophysical methods. Specifically, we propose to develop workflow encompassing of technologies and/or methods to predict stress and pressure changes due to CO 2 injection in an active tertiary recovery site and their impacts on subtle fault activation, fractures and occurrence of microseismic events and compare responses to field observations. In this project, we anticipate using dataset from the Farnsworth field Unit (FWU) which is operated by Purdure Petroleum. A novel elastic-waveform VSP inversion technique will be used to estimate high-resolution spatial and temporal changes of elastic moduli in CO 2 storage reservoirs, which will be combined with velocity-stress relationship derived from laboratory tests to obtain subsurface pressure and stress. Clustered microseismic data will be jointly inverted for improved focal mechanisms. Least-squares reverse-time migration of microseismic waveform data will be performed to directly image fracture/fault zones. Additionally, a deep neural network machine learning technique with convolutional and recurrent layers will be used for learning the spectro-temporal structures in microseismic waveforms. The results of this geotechnical data analysis will be integrated to develop a high-resolution 3D mechanical earth model extending from the overburden sealing formations to the underburden including the basement. Mechanical properties will be derived through integration of mechanical logs, tests, available results from chemo-mechanical laboratory tests, and elastic inversion of seismic data using a combination of Bayesian and stochastic methods as well as machine learning technique. Failure features (faults/fractures) will be represented and/or modeled based on seismic and core data analysis. A transient hydrodynamic-geomechanical model will be developed through coupling with the calibrated FWU reservoir simulation model. The full physics coupled model will be used to train a reduced order proxy model using machine learning algorithm for estimating stress which will then be used with appropriate constitutive relationships and forward seismological models to simulate pressure changes and induced microseismicity. An advanced optimization framework will be developed to perform a history match to minimize error between field observations and simulated. The history matched proxy model will be verified against the full-physics equivalent. The field observations that will be used in the coupled model calibration process include pressure/stress inverted from VSP, moment magnitude from microseismic analysis, real time downhole pressure measurements, production and injection data. Parameter sensitivity and uncertainty analysis will be performed to characterize the impact of model parameter uncertainty on stress estimates. The proposed project will have significant impact on future field implementation of the proposed technology. Because the project field site is an ongoing CO 2 EOR development, the value of the new technology will be demonstrated in an operational context and evaluated as a viable risk mitigation strategy. Cost/benefit will be evaluated together with the various commercial incentives for CO 2 sequestration available to oil and gas operators. The extensive available dataset and ongoing data acquisition under the SWP Phase III work plan provides flexibility for investigation of multiple approaches and reduces technical risk.

58 GEOSCIENCES↗