Engineering PapersSearch

SEARCH · Engineering Papers

Results for “machine learning (ML)”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Machine Learning for Automated Weld Quality Monitoring and Control

Resistance Spot Welding (RSW) is a critical process in the automotive industry, valued for its cost-effectiveness, short cycle time, and robustness. However, achieving consistent high-quality joints remains challenging due to the complex interplay of various factors, like materials, processes, and manufacturing uncertainties, etc. Under the collaborative project between Oak Ridge National Laboratory (ORNL) and General Motors (GM), we have developed a robust and expansible machine learning (ML) framework aimed at enhancing quality control in RSW. By harnessing the power of machine learning, we have developed the ability to ensure every aspect of the welding process, from the initial process design stage to the final weld joint quality. The framework operates by analyzing a variety of data streams, including in-line process signals, process parameters, materials, and postprocessed weld joint data. Through this analysis, the models have been trained to detect deviations from optimal quality standards, leveraging their ability to identify signature data patterns and anomalies within in-line signals and construct complex correlations between these signals and weld quality parameters. Meanwhile, the machine learning framework is designed to adapt to a variety of materials, including high strength steels and aluminum alloys, etc. Its flexible architecture facilitates the incorporation of diverse data sources and features, enabling precise modeling and prediction across a broad range of material properties and weld quality variables. The expansible ML frameworks represent a promising transformation in weld quality monitoring and control, empowering industry to achieve high levels of efficiency, consistency, and reliability in manufacturing.

42 ENGINEERING

Jamming Detection for Low-Resolution SC-FDE Systems: A Machine Learning Approach

Jammers interfere with communication between base stations (BSs) and legitimate users, leading to degradation of wireless system performance. Our study focuses on jamming detection for wideband single-carrier frequency domain equalization (SC-FDE) systems with low-resolution analog-to digital converters (ADCs). In such systems, jamming detection is challenging because traditional analytical approaches cannot be directly applied due to the delay dispersion in wideband channels and the non-linearity induced by low-resolution ADCs. We propose a machine learning (ML)-based jamming detection method that directly uses the quantized receive signals. Significantly, our ML-based detector can be integrated into existing standard frameworks, such as unique word (UW)-based SC-FDE systems, as it uses existing pilots without requiring additional pilots for jamming detection. Through numerical simulations, we show that two or more bits provide satisfactory performance compared to unquantized scenarios. Additionally, we demonstrate that using more and well-separated pilot symbols improves performance.

99 GENERAL AND MISCELLANEOUS

Artificial Intelligence and Machine Learning Applications in Modern Power Systems

Machine learning (ML) and artificial intelligence (AI) algorithms offer valuable tools for the analysis and interpretation of large datasets. These tools have the capability to uncover insights that may not be readily apparent within these datasets. In recent years, the integration of ML and AI has become increasingly prevalent in various applications within the power system domain. One of the earliest instances of machine learning in power systems can be traced back to demand forecasting, where artificial neural networks were employed for short-term load forecasting. In contemporary power systems, an abundance of high-resolution geospatial and temporal data is generated at various time intervals, ranging from sub-seconds (Phasor Measurement Units or PMUs) to seconds (Supervisory Control and Data Acquisition or SCADA), minutes (Process Information or PI), and extending to days, months, and years. These datasets contain valuable information concerning system reliability and performance. This information holds the potential to offer critical insights into system operations, as well as solutions for predicting and mitigating contingencies to prevent cascading outages. Despite the immense power of machine learning tools, system operators, planners, and utilities often exhibit hesitancy in fully embracing AI-enabled system operations and planning. This cautious approach persists, even as numerous diverse applications of machine learning continue to emerge in the realm of power systems. In this chapter, our focus will delve deep into ML and AI applications tailored for power systems. These applications aim to furnish system operators with enhanced situational awareness and augment their decision-making capabilities, especially during challenging operating conditions. Specific areas of interest encompass root cause analyses of electricity market datasets and the strategic selection of representative samples from vast power system databases for training ML/AI models. Finally, the chapter will conclude with a short discussion on the future of ML/AI in power systems and possible directions that the industry is moving towards.

power system applications, machine learning (ML),

Machine Learned Empirical Numerical Integrator from Simulated Data

Recently, a number of state-of-the-art surrogate machine learning (ML) models have been designed for global weather and climate prediction, which have been trained using reanalysis data products. Reanalysis data products are constructed using numerical model simulations that combine numerical integration of partial differential equations and parameterization schemes. These products are typically only archived and made available using coarsened spatial and temporal resolutions. This study explores the impact of the numerical generation methods used to produce the training datasets and the temporal resolution of those datasets on machine learning surrogate models. Using the nonlinear vector autoregression (NVAR) machine as an explainable ML technique, simple dynamical systems are emulated with ML models trained on data produced by three classical numerical integration schemes. NVAR is validated as a skillful ML method, capable of producing accurate predictions and, more importantly, reconstructing both the underlying dynamics and the numerical integration scheme used to generate the training data. However, the machine fails to generalize predictions on unseen test data generated by different numerical integration schemes, despite the underlying dynamical system being the same. This result provides a word of caution for the growing field of machine learning emulation of weather and climate dynamics. Furthermore, we illustrate using NVAR that training on temporally coarsened data may increase the required complexity of ML models and potentially introduce new numerical challenges. Finally, we discover that empirical integration schemes with arbitrary time-stepping sizes can be constructed directly from the data, which implies a potential for the development of empirical numerical integration schemes.

54 ENVIRONMENTAL SCIENCES

Prediction of Solute Segregation at Metal/Oxide Interfaces Using Machine Learning Approaches

The atomic structure and chemistry at metal/oxide interfaces play a crucial role in determining their properties. However, studying semi-coherent metal/oxide interfaces that include misfit dislocations through density functional theory (DFT) is often computationally expensive due to the large number of atoms involved, ranging from hundreds to thousands. In this study, we explore solute segregation behavior at the Fe/Y 2 O 3 interface—an important model interface for cladding applications in nuclear fission reactors—by combining DFT calculations with a machine learning (ML) approach. ML models are trained using DFT-calculated segregation energies (𝐸 𝑆𝑒𝑔 ) to identify the key chemical and geometric factors influencing solute segregation at metal/oxide interfaces, revealing the competition between these features in determining 𝐸 𝑆𝑒𝑔 . Moreover, the segregation behavior at a specific Fe/Y 2 O 3 interface is predicted with high accuracy using ML models trained on data from this interface. Furthermore, it is found that the ML models could also predict solute segregation at a different Fe/Y 2 O 3 interface with a new orientation relationship (OR), at a computational cost of less than 1/45 of that required for similar DFT calculations.

36 - MATERIALS SCIENCE

Machine Learning-Based Extreme Data Reduction for Prompt Supernova Pointing at DUNE

One of the goals of the Deep Underground Neutrino Experiment (DUNE) is to use the massive underground liquid argon time projection chamber (LArTPC) detectors at its far site for multimessenger astronomy (MMA), in the detection of neutrinos from core-collapse supernovae (SNe). Its current baseline trigger strategy detects activity in the detector that is consistent with supernova (SN) neutrinos and saves the raw data for further offline analysis but provides no prompt pointing information crucial for optical follow-ups by other observatories. This approach is based on the assumption that prompt pointing determination using raw data is computationally prohibitive. In this article, we demonstrate a proof-of-concept based on applying extreme data reduction on the buffered SN data in the DUNE data acquisition (DAQ) system’s front-end computers using a machine learning (ML) workflow. This reduces the data by ~5 orders of magnitude, allowing a full track reconstruction to be carried out quickly on a single server. The total time to perform the ML-based data reduction and the full track reconstruction is less than the time to transfer the SN data back to Fermilab or a high-performance computing (HPC) center. This shows that prompt processing of raw SN data is possible and, in fact, trivial once the data have been reduced to reject radiological backgrounds, paving the way to a high-quality SN pointing trigger that is based on fully reconstructed data instead of trigger primitives (TPs).

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND

A CHIL Validation of Machine Learning-Assisted Methods for Real-Time Controls of Solar PV for Grid Services

Recent research has highlighted the potential for solar to act as a zero-marginal-cost and zero-emission flexibility resource on the bulk power system when operated with advanced control systems. To increase the performance of these systems, leading technologies, including machine learning (ML) and hierarchical inverter set point allocation, have been proposed; however, these technologies lack comprehensive validation under real-world application scenarios. This paper addresses this gap by designing and developing a controller-hardware-in-the-loop framework to evaluate the performance of different flexible solar technologies in responding to automatic generation control signals in a closed-loop fashion. Simulation results indicate the superior performance of an ML-based approach compared to the conventional reference-control grouping-based approach, showcasing its potential to support grid stability and operational efficiency.

14 SOLAR ENERGY

Non-destructive evaluation and machine learning methods for inspection of spent nuclear fuel canisters: A state-of-the-art review

Nuclear energy is among the cleanest and most efficient energy sources currently available. The operation of nuclear power plants (NPPs) produces large amounts of high-level radioactive waste known as spent nuclear fuel (SNF). Currently, large amounts of SNF is stored in dry cask storage systems (DCSSs) for extended interim storage until a permanent disposal solution becomes available. During the extended interim storage, the DCSS, particularly the SNF canisters, may degrade and abnormal conditions may occur. Therefore, non-destructive evaluation (NDE) and machine learning (ML) approaches are necessary for inspection of SNF canisters. This paper presents a state-of-the-art review of literature by summarizing recent progress made on the applications of NDE and ML for inspection of SNF canisters. Sixteen NDE methods are examined and compared: visual inspection, ultrasonic guided waves (UGWs), laser-based approaches, acoustic emission (AE), eddy current testing (ECT), non-invasive acoustic sensing, dynamic modal testing, cosmic ray muons tomography, neutron imaging, gamma rays detection, fiber optical sensors, through-wall communications, X-ray computed tomography (CT), vibrothermography, monoenergetic photon sources, and surface acoustic wave (SAW) sensors. The technology readiness level (TRL) for each method is assessed and compared. Recent publications on ML-enhanced visual inspection, AE, non-invasive acoustic sensing, dynamic modal testing, and neutron imaging for SNF canisters are summarized and future research needs are identified. In conclusion, this review article provides a convenient reference on the state-of-the-art applications of NDE and ML methods for inspection of SNF canisters.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W

Paired Neural Network for Matching Experimental and Predicted Infrared Spectra

Here, we present a novel machine learning (ML)-based scoring technique for determining the similarity between experimental and predicted infrared (IR) spectra for identification purposes. IR spectroscopy is a powerful technique used to identify the molecular structure and composition of a sample by measuring the unique vibrational frequency pattern of the molecule’s functional groups. Molecular identifications are often made by comparing experimental and reference spectra. However, the limited number of reference spectra available in spectral libraries can confound the identification process. Alternative identification procedures rely on in silico techniques to simulate spectra for a wide range of molecules. However, scoring spectral similarity between an experimental query and computationally predicted reference remains a significant challenge. Our proposed ML-based scoring technique overcomes these barriers by accurately and efficiently determining spectral similarity.

Neural Network

Optimizing Facility Operations by Applying Machine Learning to the Army Reserve Enterprise Building Control System (Final Report)

Thousands of U.S. Department of Defense (DoD) buildings have building automation systems (BASs) and/or advanced meters. Although these systems have a wealth of data, performance optimization requires time and expertise to review and act on that information. Machine learning (ML) can provide automated and actionable insights to controls operators. This demonstration implemented proven ML methods on the Army Reserve Enterprise Building Control System. ML refers to algorithms that “learn” from data and improve their performance on a given task over time. In the buildings domain these tasks range from predicting future energy consumption, to identifying operational issues before faults occur, to optimizing control decisions. To learn, ML requires input data, which – for buildings – typically consists of instrument data such as energy consumption data and subsystem controls information such as set-point temperatures, and context data consisting of information such as the physical location of the building, the area of the building, and the weather. ML models use the relationships learned from the input data to make predictions with new, previously unseen, data. The team was able to investigate and successfully implement the following ML use cases: labeling consumption data as anomalous or non-anomalous; baseline whole-building load prediction (unknown fault status); fault detection (validation not possible); and site prioritization for energy-related projects. Due to the constraints of the project, interventions were not able to be implemented during the demonstration; therefore, assessments of operational cost savings and maintenance avoided could not be performed. The project has been presented at two leading national building conferences and two additional publications to peer-reviewed journals are currently in preparation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI

Antiviral discovery using sparse datasets by integrating experiments, molecular simulations, and machine learning

Computational methods have demonstrated success in identifying virucidal agents, effectively contributing to the discovery of novel virucidal molecules. In this study, we developed a machine learning (ML) model, trained on a small dataset, to predict inhibitors of human enterovirus 71 (EV71), a pathological agent that causes severe disease in children and immunocompromised adults. Despite the dataset’s limitation, comprising of only 36 compounds tested, our ML framework demonstrated significant predictive capability. Notably, experimental validation revealed that five out of the eight compounds predicted by our model from the Chinese cosmetic material list exhibited virucidal activity. The inhibitor effects displayed by the main active compounds were further confirmed by molecular dynamics simulation. This underscores the potential of our AI-driven approach to bypass data constraints in identifying active molecules against viral pathogens.

60 APPLIED LIFE SCIENCES

Editorial: Predicting near-earth space environment: new perspective and capabilities in the AI age

Editorial on the Research Topic Predicting near-earth space environment: new perspective and capabilities in the AI age The near-Earth space environment is not only an operational hazard for space missions, but also a scientific laboratory for advancing our understanding and prediction of space plasma populations. This Research Topic is organized around three interconnected themes: observational datasets, machine-learning (ML) model development, and the discovery of new physical insights through those models. Its primary goal is to highlight the emerging capabilities in space environment prediction that are enabled, or will be enabled, by integrating advanced techniques—including AI/ML methods—with long-term curated datasets.

58 GEOSCIENCES

Low responsiveness of machine learning models to critical or deteriorating health conditions

Machine learning (ML) based mortality prediction models can be immensely useful in intensive care units. Such a model should generate warnings to alert physicians when a patient’s condition rapidly deteriorates, or their vitals are in highly abnormal ranges. Before clinical deployment, it is important to comprehensively assess a model’s ability to recognize critical patient conditions. We develop multiple medical ML testing approaches, including a gradient ascent method and neural activation map. We systematically assess these machine learning models’ ability to respond to serious medical conditions using additional test cases, some of which are time series. Guided by medical doctors, our evaluation involves multiple machine learning models, resampling techniques, and four datasets for two clinical prediction tasks. We identify serious deficiencies in the models’ responsiveness, with the models being unable to recognize severely impaired medical conditions or rapidly deteriorating health. For in-hospital mortality prediction, the models tested using our synthesized cases fail to recognize 66% of the injuries. In some instances, the models fail to generate adequate mortality risk scores for all test cases. Our study identifies similar kinds of deficiencies in the responsiveness of 5-year breast and lung cancer prediction models. Using generated test cases, we find that statistical machine-learning models trained solely from patient data are grossly insufficient and have many dangerous blind spots. Most of the ML models tested fail to respond adequately to critically ill patients. How to incorporate medical knowledge into clinical machine learning models is an important future research direction.

60 APPLIED LIFE SCIENCES

Machine Learning Airport Surface Model

Future needs of the National Airspace System require decision support tools to adopt a service-oriented architecture in alignment with the FAA’s vision for an Info-Centric NAS. To achieve this, many existing systems will need to undergo a digital transformation from a monolithic decision support tool to a service-oriented architecture where individual services are exposed through well defined Application Programming Interfaces (APIs). To enable this transformation, NASA has developed the Digital Information Platform as a cloud based foundation for development of aviation services with a special focus towards Artificial Intelligence and Machine Learning (ML) services. This paper describes the work required for the transformation of NASA’s legacy surface management system to a real-time ML based decision support system deployed in the cloud. Details of the Machine Learning Operations (MLOps) infrastructure and best practices are described which enabled the end-toend lifecycle management of ML within an integrated software system. Validation results are provided from an operational field evaluation where performance was benchmarked against the legacy approach.

Jeremy Coupe

Using Machine Learning to Predict Cloud Turbulent Entrainment–Mixing Processes

Different turbulent entrainment–mixing mechanisms between clouds and environment are essential to cloud–related processes; however, accurate representation of entrainment–mixing in weather/climate models still poses a challenge. This study exploits the use of machine learning (ML) to address this challenge. Four ML (Light Gradient Boosting Machine [LGB], eXtreme Gradient Boosting, Random Forest, and Support Vector Regression) are examined and compared. It is found that LGB performs best, and thus is selected to understand the impact of entrainment–mixing on microphysics using simulation data from Explicit Mixing Parcel Model. Compared with traditional parameterizations, the trained LGB provides more accurate microphysical properties (number concentration and cloud droplet spectral dispersion). The partial dependences of predicted microphysics on features exhibit a strong alignment with physical mechanisms and expectations, as determined by the interpreting method, thus overcoming the limitations of the “black box” scheme. The underlying mechanisms are that the smaller number concentration and larger spectral dispersion correspond to more inhomogeneous entrainment–mixing. Specifically, number concentration after entrainment–mixing is positively correlated with adiabatic number concentration and liquid water content affected by entrainment–mixing, and inversely correlated with adiabatic volume mean radius. Spectral dispersion after entrainment–mixing is negatively correlated with liquid water content affected by entrainment–mixing, turbulent dissipation rate and relative humidity of entrained air. Sensitivity analysis further suggests that number concentration is mainly determined by cloud microphysical properties whereas spectral dispersion is influenced by both cloud microphysical properties and environmental variables. The results indicate that the LGB scheme has the potential to enhance the representation of entrainment–mixing in weather/climate models.

54 ENVIRONMENTAL SCIENCES

Navigating the Noise: Bringing Clarity to ML Parameterization Design With O $\boldsymbol{\mathcal{O}}$(100) Ensembles

Abstract Machine‐learning (ML) parameterizations of subgrid processes (here of turbulence, convection, and radiation) may one day replace conventional parameterizations by emulating high‐resolution physics without the cost of explicit simulation. However, uncertainty about the relationship between offline and online performance (i.e., when integrated with a large‐scale general circulation model) hinders their development. Much of this uncertainty stems from limited sampling of the noisy, emergent effects of upstream ML design decisions on downstream online hybrid simulation. Our work rectifies the sampling issue via the construction of a semi‐automated, end‐to‐end pipeline for size ensembles of hybrid simulations, revealing important nuances in how systematic reductions in offline error manifest in changes to online error and online stability. For example, removing dropout and switching from a Mean Squared Error to a Mean Absolute Error loss both reduce offline error, but they have opposite effects on online error and online stability. Other design decisions, like incorporating memory, converting moisture input from specific humidity to relative humidity, using batch normalization, and training on multiple climates do not come with any such compromises. Finally, we show that ensemble sizes of may be necessary to reliably detect causally relevant differences online. By enabling rapid online experimentation at scale, we can empirically settle debates regarding subgrid ML parameterization design that would have otherwise remained unresolved in the noise.

Lin, Jerry [Department of Earth System Sciences Un

Crowdsourcing the Frontier: Advancing Hybrid Physics‐ML Climate Simulation via a $\$$50,000 Kaggle Competition

Subgrid machine-learning (machine learning [ML]) parameterizations have the potential to introduce a new generation of climate models that incorporate the effects of higher-resolution physics without incurring the prohibitive computational cost associated with more explicit physics-based simulations. However, important issues, ranging from online instability to inconsistent online performance, have limited their operational use for long-term climate projections. To more rapidly drive progress in solving these issues, domain scientists and ML researchers opened up the offline aspect of this problem to the broader ML and data science community with the release of ClimSim, a NeurIPS Data sets and Benchmarks publication, and an associated Kaggle competition. This paper reports on the downstream results of the Kaggle competition by coupling emulators inspired by the winning teams' architectures to an interactive climate model (including full cloud microphysics, a regime historically prone to online instability) and systematically evaluating their online performance. Our results demonstrate that online stability in the low-resolution real-geography setting is reproducible across multiple diverse architectures, which we consider a key milestone. All tested architectures exhibit strikingly similar offline and online biases, though their responses to architecture-agnostic design choices (e.g., expanding the list of input variables) can differ significantly. Multiple Kaggle-inspired architectures achieve state-of-the-art results on certain metrics such as zonal mean bias patterns and global Root Mean Squared Error, indicating that crowdsourcing the essence of the offline problem is one path to improving online performance in hybrid physics-AI climate simulation.

Environmental sciences

Machine Learning-Driven Optimization of Building Enclosures for Moisture Durability and Thermal Performance

The design of moisture-durable building enclosures with low embodied carbon often involves an iterative process of selecting the materials for the specific exposure conditions to meet the performance requirements. While hygrothermal simulations are commonly used to evaluate moisture durability, they often require advanced expertise for proper implementation. Machine learning (ML) provides a promising alternative by streamlining the design process and minimizing the reliance on complex simulations. This study presents a machine learning-based approach for predicting moisture durability in residential wall assemblies. The ML model was trained to estimate the mold index and maximum moisture content of various layers under typical exposure conditions. The model achieved a high predictive accuracy, with a coefficient of determination (R²) exceeding 0.90 when compared to traditional hygrothermal simulations on materials that were not part of training the ML model. Building on these results, the ML model was developed into a practical tool for optimizing wall assembly designs. This tool allows users to automatically optimize material selections based on energy, moisture, and carbon performance criteria. By incorporating multi-objective optimization, the tool identifies configurations that minimize embodied carbon while maintaining moisture safety and code-compliant thermal performance. Additionally, it provides insights into how material choices influence assembly durability, energy efficiency, and carbon reduction. The tool will be implemented in the Building Science Advisor (BSA) to enhance its performance and provide more granularity on the results. This research highlights the potential for ML-driven tools to simplify the design of high-performance building enclosures, offering architects and engineers a faster, more efficient way to balance critical performance factors.

Salonvaara, Mikael [ORNL] (ORCID:0000000318991554)