Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Training Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

FIND: A Synthetic weather generator to control drought Frequency, Intensity, and Duration

Water systems worldwide are experiencing climate change-induced shifts in drought properties like frequency, intensity, and duration, affecting water security and reliability. To develop and test effective drought preparedness plans, researchers often use synthetic weather generators to create hydrological scenarios that explore drought variability beyond historical records. Existing weather generators typically allow users to adjust streamflow statistics like percentiles or temporal correlation but do not directly control drought properties of frequency, intensity, and duration. To fill this gap, we propose FIND (Frequency, INtensity, and Duration) synthetic weather generator. FIND incorporates a standardized drought index to directly and in dependently control drought frequency, intensity, and duration in generated streamflow time series while preserving observed hydrological variability. Use cases for FIND include i) water systems analysis applications that seek to train and test drought strategies under historical and plausible future drought conditions, and ii) bottom-up vulnerability studies relating system vulnerability outcomes to specific changes in drought properties of frequency, intensity, and duration. Here, we demonstrate FIND’s versatility through three experiments: replicating historically observed drought properties, generating streamflow scenarios for multiple sites preserving correlation between their drought conditions, and generating a set of scenarios with direct and independent changes in drought properties. FIND source code is openly available for applications beyond the scope of this paper.

42 ENGINEERING↗

Training calibration-based counterfactual explainers for deep learning models in medical image analysis

The rapid adoption of artificial intelligence methods in healthcare is coupled with the critical need for techniques to rigorously introspect models and thereby ensure that they behave reliably. This has led to the design of explainable AI techniques that uncover the relationships between discernible data signatures and model predictions. In this context, counterfactual explanations that synthesize small, interpretable changes to a given query while producing desired changes in model predictions have become popular. This under-constrained, inverse problem is vulnerable to introducing irrelevant feature manipulations, particularly when the model’s predictions are not well-calibrated. Hence, in this paper, we propose the TraCE (training calibration-based explainers) technique, which utilizes a novel uncertainty-based interval calibration strategy for reliably synthesizing counterfactuals. Given the wide-spread adoption of machine-learned solutions in radiology, our study focuses on deep models used for identifying anomalies in chest X-ray images. Using rigorous empirical studies, we demonstrate the superiority of TraCE explanations over several state-of-the-art baseline approaches, in terms of several widely adopted evaluation metrics. Our findings show that TraCE can be used to obtain a holistic understanding of deep models by enabling progressive exploration of decision boundaries, to detect shortcuts, and to infer relationships between patient attributes and disease severity.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Data and scripts associated with the manuscript "Encoding Diel Hysteresis and the Birch Effect in Dryland Soil Respiration Models through Knowledge-Guided Deep Learning"

This package contains the data and scripts used in "Encoding Diel Hysteresis and the Birch Effect in Dryland Soil Respiration Models through Knowledge-Guided Deep Learning" (Jiang et al., 2022). The data.zip file contains the flux tower and automated chamber observations used for developing the deep learning model for modeling soil respiration. The scripts.zip file contains the Jupyter notebooks and python scripts for preprocessing the data, training the deep learning models, and postprocessing the results. The src.zip contains the source code for training the deep learning model, performing mutual information analysis, and plotting functions. The trained_models.zip contains multiple folders used for hosting the trained deep-learning models and the associated soil respiration predictions. The whole process is performed using python. We include the REAMD.md to document the python package requirements.Soil respiration in dryland ecosystems is challenging to model due to its complex interactions with environmental drivers. Knowledge-guided deep learning provides a much more effective means of accurately representing these complex interactions than traditional Q10-based models. Mutual information analysis revealed that future soil temperature shares more information with soil respiration than past soil temperature, consistent with their clockwise diel hysteresis. We explicitly encoded diel hysteresis, soil drying, and soil rewetting effects on soil respiration dynamics in a newly designed Long Short Term Memory (LSTM) model. The model takes both past and future environmental drivers as inputs to predict soil respiration. The new LSTM model substantially outperformed three Q10-based models and the Community Land Model when reproducing the observed soil respiration dynamics in a semi-arid ecosystem. The new LSTM model clearly demonstrated its superiority for temporally extrapolating soil respiration dynamics, such that the resulting correlation with observational data is up to 0.7 while the correlations of both Q10-based models and the Community Land Model (CLM) are less than 0.4. Our results underscore the high potential for knowledge-guided deep learning to replace Q10-based soil respiration modules in Earth system models.

54 ENVIRONMENTAL SCIENCES↗

CMLM (Co-Optimized Machine-Learned Manifolds) [SWR-23-41]

Co-optimized Machine-Learned Manifolds (CMLM) is a data-driven approach for developing reduced-order manifold models for high-dimensional chemically reacting systems. It involves a specially designed neural network, the training of which simultaneously optimizes linear combinations of species that define the manifold, nonlinear mapping to outputs of interest such as reaction rates, and (optionally) subfilter closure for large eddy simulation. This software package provides an implementation of the CMLM approach in Python using the PyTorch machine learning library. A few example cases are included, showing how the tool can be applied to different types of data from 0D and 1D reacting simulations performed using Cantera. The neural networks can be saved in a format that is readable by the Pele suite of combustion solvers for use in reacting computational fluid dynamics simulations. This software repository contains several python scripts to perform various tasks associated with the Co-optimized Machine Learned Manifolds (CMLM) model, which is described in Perry, Henry de Frahan, and Yellapantula, CNF, 2022 (https://doi.org/10.1016/j.combustflame.2022.112286). This includes not only the code that defines the CMLM model, but also scripts to generate suitable training data, scripts to pre-process the data, scripts to train the CMLM model, and scripts to plot the output, as well as various other helper files. The scripts depend on several commonly used python libraries for data analysis and chemical reaction computations. The trained models that result from this tool are designed to work with the an interface being implemented in the Pele suite of reacting flow solvers (https://github.com/AMReX-Combustion).

Perry, Bruce↗

Resistive Switching of Spinel Li 4 Ti 5 O 12 Lithium-Ion Battery Material for Neuromorphic Computing

The rapid rise of AI has exposed significant limitations in conventional Von Neumann computing architecture, particularly in regard to speed and energy efficiency. To address these challenges, researchers are exploring a brain-inspired neuromorphic architecture that mimics biological neural networks, enabling massive parallel processing with reduced power consumption for complex AI computational demands. Recent interest has focused on utilizing battery electrodes and solid electrolyte materials for their resistive switching properties in developing a neuromorphic architecture. These properties are precisely tuned through local- and bulk-level chemical composition modifications via voltage bias stimuli. In this study, we demonstrate fabricating a three-terminal lithium-ion electrochemical transistor based on lithium titanium oxide (Li 4 Ti 5 O 12 ), a popular lithium-ion battery anode material. We deposited and characterized LTO thin films using RF sputtering, demonstrating a 6 orders of magnitude increase in electronic conductivity upon lithiation, with conductivity plateauing after 20% lithiation. Density functional theory calculations revealed transformation from the insulating to conducting state, supported by experimental characterization through X-Ray Photoelectron Spectroscopy (XPS) and Direct Current (DC) polarization analyses. The fabricated transistor consisted of LTO as the channel layer, gold as source/drain terminals, lithium phosphorus oxynitride (LiPON) as the lithium-ion conductor, and copper as the gate terminal. The device exhibited clear hysteresis in transfer characteristics due to lithium insertion/extraction processes. Long-term potentiation (LTP) and long-term depression (LTD) measurements showed an asymmetric ratio of 1.425 and maximum/minimum conductance ratio of 7.83. When implemented in a deep neural network (DNN) for MNIST handwritten digit recognition, the device achieved 92.03% accuracy over 20 training epochs. Detailed transport mechanism analysis revealed the crucial role of oxygen vacancies and interface effects in device operation. Our preliminary findings establish LTO-based lithium-ion electrochemical transistors as promising candidates for energy-efficient neuromorphic computing applications, offering potential solutions to traditional Von Neumann architecture limitations.

25 ENERGY STORAGE↗

Designing Antifouling and Antimicrobial Interfaces: Structural Characterization using CryoEM, Automated Microscopy, and AI Image Segmentation

The design of functionalized surfaces for interactions with biological systems is critical across sectors such as healthcare, energy, and agriculture. Tailoring materials for specific applications, such as antifouling and antimicrobial surfaces, demands a comprehensive understanding of topology and chemistry across multiple length and time scales on both biological and materials systems. This work presents the development and characterization of nanostructured surfaces with controlled topographies and chemistries that enhance bacterial membrane disruption, reduce biofilm formation, and improve antimicrobial and antifouling capabilities. Two specific use cases will be presented - the use of cellulose nanocrystals (CNCs) for bacterial growth inhibition and the development of antifouling surfaces to prevent protein and bacterial adsorption [1-4]. By leveraging large language models (LLMs) for image segmentation and training [5], we enable automated analysis of terabyte-scale cryogenic electron microscopy (cryoEM) datasets. This analysis provides statistical insights into the biotic/abiotic interface and facilitates automated electron microscopy experiments to mitigate time and dose. The integration of cryogenic electron tomography (cryoET) and cryogenic focused ion beam (cryoFIB) milling enables high-resolution, near-native-state imaging and 3D reconstructions of bio/material interfaces [6]. Orthogonal characterization techniques and computational modeling further enhances our understanding, offering a robust platform for the design and optimization of next-generation functional surfaces [7].

Williams, Alexis [ORNL] (ORCID:0000000252835822)↗

Automated Registration of Vector Data to Overhead Imagery

The availability of open source, remote sensing-derived vector data has increased exponentially in recent years. Unfortunately, these vector data are rarely made available with the corresponding source images from which objects were extracted. As such, these derived datasets are commonly used in combination with target images which differ from the source. Satellite viewing geometry can cause objects, extracted from a source image, to appear shifted when overlaid with a target image. Whether for purely cartographic purposes, reusability of preexisting training labels, or any spatial analysis where spatial correspondence between vector and image are required, the following paragraphs outline a method to address this challenge through the automated registration of vector data to overhead imagery, including existing literature regarding this challenge, followed by a case study of Sioux Falls, South Dakota.

McKee, Jacob↗

A Transductive Graph Neural Network learning for Grid Resilience Analysis

Power grids are critical infrastructures that require robust resilience analysis to ensure reliable and uninterrupted electricity supply. Traditional simulation-based methods for grid resilience analysis suffer from computational complexity and limited ability to capture the full spectrum of potential disruptions. This paper presents a novel approach to enhance grid resilience by leveraging transductive graph neural network (GNN) learning to identify critical nodes and links. By leveraging the graph structure and system features, GNNs effectively learn resilience metrics and accurately identify critical nodes based on actual grid operational behavior. The efficacy of the proposed approach is demonstrated through case studies on node criticality scoring and critical node/line identification in cascading outage scenarios. The results highlight the advantages of learning-based methods over traditional simulation-based approaches and their potential to revolutionize grid resilience analysis. The contributions of this paper include a graph-based scalable approach for fast cascading analysis, an inductive formulation for training GNN models, and a transfer learning-based approach to scale the model to largescale power systems.

grid resilience, graph neural networks, transducti↗

Forecasting for ESCAPE: A Multi-Institution Hybrid Forecasting and Nowcasting Operation for Sea-Breeze Convection Supporting a Ground-Based and Airborne Field Campaign

The Experiment of Sea-Breeze Convection, Aerosols, Precipitation and Environment (ESCAPE) field project deployed two aircraft and ground-based assets in the vicinity of Houston, Texas, between 27 May and 2 July 2022, examining how meteorological conditions, dynamics, and aerosols control the initiation, early growth stage, and evolution of coastal convective clouds. To ensure that airborne- and ground-based assets were deployed appropriately, a forecasting and nowcasting team was formed. Daily forecasts guided real-time decision-making by assessing synoptic weather conditions, environmental aerosol, and a variety of atmospheric modeling data to assign a probability for meeting specific ESCAPE campaign objectives. During the research flights, a small team of forecasters provided “nowcasting” support by analyzing radar, satellite, and new model data in real time. The nowcasting team proved invaluable to the campaign operation, as sometimes changing environmental conditions affected, for example, the timing of convective initiation. In addition to the success of the forecasting and nowcasting teams, the ESCAPE campaign offered a unique “testbed” opportunity where in-person and virtual support both contributed to campaign objectives. The forecasting and nowcasting teams were each composed of new and experienced forecasters alike, where new forecasters were given invaluable experience that would otherwise be difficult to attain. Both teams received training on forecast models, map analysis, Hybrid Single-Particle Lagrangian Integrated Trajectory model (HYSPLIT), and thermodynamic sounding analysis before the beginning of the campaign. In this article, the ESCAPE forecasting and nowcasting teams reflect on these experiences, providing potentially useful advice for future field campaigns requiring forecasting and nowcasting support in a hybrid virtual/in-person framework.

54 ENVIRONMENTAL SCIENCES↗

Machine Learning for Automated Weld Quality Monitoring and Control

Resistance Spot Welding (RSW) is a critical process in the automotive industry, valued for its cost-effectiveness, short cycle time, and robustness. However, achieving consistent high-quality joints remains challenging due to the complex interplay of various factors, like materials, processes, and manufacturing uncertainties, etc. Under the collaborative project between Oak Ridge National Laboratory (ORNL) and General Motors (GM), we have developed a robust and expansible machine learning (ML) framework aimed at enhancing quality control in RSW. By harnessing the power of machine learning, we have developed the ability to ensure every aspect of the welding process, from the initial process design stage to the final weld joint quality. The framework operates by analyzing a variety of data streams, including in-line process signals, process parameters, materials, and postprocessed weld joint data. Through this analysis, the models have been trained to detect deviations from optimal quality standards, leveraging their ability to identify signature data patterns and anomalies within in-line signals and construct complex correlations between these signals and weld quality parameters. Meanwhile, the machine learning framework is designed to adapt to a variety of materials, including high strength steels and aluminum alloys, etc. Its flexible architecture facilitates the incorporation of diverse data sources and features, enabling precise modeling and prediction across a broad range of material properties and weld quality variables. The expansible ML frameworks represent a promising transformation in weld quality monitoring and control, empowering industry to achieve high levels of efficiency, consistency, and reliability in manufacturing.

99 GENERAL AND MISCELLANEOUS↗

Machine Learning for Automated Weld Quality Monitoring and Control

Resistance Spot Welding (RSW) is a critical process in the automotive industry, valued for its cost-effectiveness, short cycle time, and robustness. However, achieving consistent high-quality joints remains challenging due to the complex interplay of various factors, like materials, processes, and manufacturing uncertainties, etc. Under the collaborative project between Oak Ridge National Laboratory (ORNL) and General Motors (GM), we have developed a robust and expansible machine learning (ML) framework aimed at enhancing quality control in RSW. By harnessing the power of machine learning, we have developed the ability to ensure every aspect of the welding process, from the initial process design stage to the final weld joint quality. The framework operates by analyzing a variety of data streams, including in-line process signals, process parameters, materials, and postprocessed weld joint data. Through this analysis, the models have been trained to detect deviations from optimal quality standards, leveraging their ability to identify signature data patterns and anomalies within in-line signals and construct complex correlations between these signals and weld quality parameters. Meanwhile, the machine learning framework is designed to adapt to a variety of materials, including high strength steels and aluminum alloys, etc. Its flexible architecture facilitates the incorporation of diverse data sources and features, enabling precise modeling and prediction across a broad range of material properties and weld quality variables. The expansible ML frameworks represent a promising transformation in weld quality monitoring and control, empowering industry to achieve high levels of efficiency, consistency, and reliability in manufacturing.

42 ENGINEERING↗

Hardware-Based Emulator with Deep Learning Model for Building Energy Control and Prediction Based on Occupancy Sensors’ Data

Heating, ventilation, and air conditioning (HVAC) is the largest source of residential energy consumption. Occupancy sensors’ data can be used for HVAC control since it indicates the number of people in the building. HVAC and sensors form a typical cyber-physical system (CPS). In this paper, we aim to build a hardware-based emulation platform to study the occupancy data’s features, which can be further extracted by using machine learning models. In particular, we propose two hardware-based emulators to investigate the use of wired/wireless communication interfaces for occupancy sensor-based building CPS control, and the use of deep learning to predict the building energy consumption with the sensor data. We hypothesize is that the building energy consumption may be predicted by using the occupancy data collected by the sensors, and question what type of prediction model should be used to accurately predict the energy load. Another hypothesis is that an in-lab hardware/software platform could be built to emulate the occupancy sensing process. The machine learning algorithms can then be used to analyze the energy load based on the sensing data. To test the emulator, the occupancy data from the sensors is used to predict energy consumption. The synchronization scheme between sensors and the HVAC server will be discussed. We have built two hardware/software emulation platforms to investigate the sensor/HVAC integration strategies, and used an enhanced deep learning model—which has sequence-to-sequence long short-term memory (Seq2Seq LSTM)—with an attention model to predict the building energy consumption with the preservation of the intrinsic patterns. Because the long-range temporal dependencies are captured, the Seq2Seq models may provide a higher accuracy by using LSTM architectures with encoder and decoder. Meanwhile, LSTMs can capture the temporal and spatial patterns of time series data. The attention model can highlight the most relevant input information in the energy prediction by allocating the attention weights. The communication overhead between the sensors and the HVAC control server can also be alleviated via the attention mechanism, which can automatically ignore the irrelevant information and amplify the relevant information during CNN training. Our experiments and performance analysis show that, compared with the traditional LSTM neural network, the performance of the proposed method has a 30% higher prediction accuracy.

Ye, Zhijing↗

Digital Twin for Optimizing Real-time Economy of the Integrated Energy Systems

Economic and safe operation of integrated energy systems (IES) requires real-time optimization (RTO) of the control and actions conducted on each system component. In this regard, digital twins (DTs), which consist of a physical system, a virtual system, and the data communication that occurs between the two, are essential for effective RTO. Through the data warehouse, the virtual system is constantly updated with real-time data from the physical system, and functions as the model in the optimization framework. The reduced-order model of the dynamic process model in the virtual system is used in the optimization framework. The optimization results are then returned, via the data warehouse, as control actions to the physical system. This work demonstrates the software capabilities of DT assets for an IES in the context of preparing a DT for an experimental system comprised of Idaho National Laboratory (INL)’s Thermal Energy Delivery System and battery system. For the virtual demonstration, the DTs encompass (1) a physical system, including the Modelica models of the Thermal Energy Delivery System and the battery system; (2) virtual optimization via the Optimization of Real-Time Capacity Allocation (ORCA) platform; and (3) the open-source data warehouse software DeepLynx. This work assesses the performance of ORCA, which utilizes a reduced-order model built using the Risk Analysis Virtual Environment (RAVEN) and trained on the Modelica models and real-time data pipeline through the graph database hosted in DeepLynx. The proposed optimization workflow will be an RTO model based on DTs and the data they generate.

25 ENERGY STORAGE↗

Machine learning prediction of electron density and temperature from He I line ratios

We propose to utilize machine learning to predict the electron density, ne, and temperature, T e , from He I line intensity ratios. In this approach, training data consist of measured He I line ratios as input and ne and T e measured using other diagnostic(s) as desired output, which is a Langmuir probe in our study. Support vector machine regression analysis is, then, performed with the training data to develop a predictive model for n e and T e , separately. It is confirmed that n e and T e predicted using the developed models agree well with those from the Langmuir probe in the ranges of 0.28 × 10 18 ≤ n e (m -3 ) ≤ 3.8 × 10 18 and 3.2 ≤ T e (eV) ≤ 7.5. The developed models are, further, examined with an evaluation data, which are not included in the training data, and are found to well reproduce absolute values and radial profiles of probe-measured n e and T e .

47 OTHER INSTRUMENTATION↗

Materials characterization: Can artificial intelligence be used to address reproducibility challenges?

Material characterization techniques are widely used to characterize the physical and chemical properties of materials at the nanoscale and, thus, play central roles in material scientific discoveries. However, the large and complex datasets generated by these techniques often require significant human effort to interpret and extract meaningful physicochemical insights. Artificial intelligence (AI) techniques such as machine learning (ML) have the potential to improve the efficiency and accuracy of surface analysis by automating data analysis and interpretation. In this perspective paper, we review the current role of AI in surface analysis and discuss its future potential to accelerate discoveries in surface science, materials science, and interface science. We highlight several applications where AI has already been used to analyze surface analysis data, including the identification of crystal structures from XRD data, analysis of XPS spectra for surface composition, and the interpretation of TEM and SEM images for particle morphology and size. We also discuss the challenges and opportunities associated with the integration of AI into surface analysis workflows. These include the need for large and diverse datasets for training ML models, the importance of feature selection and representation, and the potential for ML to enable new insights and discoveries by identifying patterns and relationships in complex datasets. Most importantly, AI analyzed data must not just find the best mathematical description of the data, but it must find the most physical and chemically meaningful results. In addition, the need for reproducibility in scientific research has become increasingly important in recent years. The advancement of AI, including both conventional and the increasing popular deep learning, is showing promise in addressing those challenges by enabling the execution and verification of scientific progress. By training models on large experimental datasets and providing automated analysis and data interpretation, AI can help to ensure that scientific results are reproducible and reliable. Although integration of knowledge and AI models must be considered for the transparency and interpretability of models, the incorporation of AI into the data collection and processing workflow will significantly enhance the efficiency and accuracy of various surface analysis techniques and deepen our understanding at an accelerated pace.

Materials Science↗

Weatherization Updates From the National Renewable Energy Laboratory

The National Renewable Energy Laboratory (NREL) provides technical assistance and research to support high-quality work and highly qualified workers in the weatherization and home performance industry. NREL staff will provide updates on their work on the Standard Work Specifications, Home Energy Professional Certifications, Continuous Improvement Workshops, workforce training and research, and other topics.

continuous improvement↗

Temporal multi-omic analysis uncovers sex-biased molecular programs underlying skeletal muscle adaptation to endurance training

Background. Exercise training is known to benefit health and reduce disease risk. While adaptations in skeletal muscles are fundamental to many of the health benefits of exercise training, the common and sex-specific molecular regulators that mediate these adaptations remain to be fully elucidated. Methods. To this end, we leveraged skeletal muscle multi-omics data generated by the Molecular Transducers of Physical Activity Consortium (MoTrPAC), where 6 month-old male and female rats endurance trained for 1, 2, 4, or 8 weeks. Our objective was to identify shared and sex-specific multi-omic molecular responses to endurance training in skeletal muscle, and relate them to phenotypic adaptations. Results. We identified largely sexually-conserved transcriptomic and proteomic enrichments in the gastrocnemius, which correlated with skeletal muscle responses from a published exercise study in humans. We uncovered sex-consistent post-translational modifications, including decreased oxidation of MYH2 and deacetylation of the ß-oxidation enzyme HADHA. Pathway enrichment analyses revealed sex-specific remodeling across the acetylome, redox proteome, and phosphoproteome; females decreased mitochondrial protein oxidation and increased mitochondrial cristae proteins, indicative of enhanced redox buffering and mitochondrial efficiency. Despite observed decreases in the oxidation of key mitochondrial proteins, females displayed increases in the oxidation of proteins involved in glucose catabolism relative to males after 8 weeks of training, suggestive of sex-biased subcellular reactive oxygen species generation. Conclusions. This work shows a large portion of the adaptive response to endurance training in skeletal muscle is shared between females and males, while there are distinct and nuanced sex-specific adaptations that are evident, particularly at the level of post-translational regulation.

Many, Gina M.↗

Disentangling multiple scattering with deep learning: application to strain mapping from electron diffraction patterns

Abstract A fast, robust pipeline for strain mapping of crystalline materials is important for many technological applications. Scanning electron nanodiffraction allows us to calculate strain maps with high accuracy and spatial resolutions, but this technique is limited when the electron beam undergoes multiple scattering. Deep-learning methods have the potential to invert these complex signals, but require a large number of training examples. We implement a Fourier space, complex-valued deep-neural network, FCU-Net, to invert highly nonlinear electron diffraction patterns into the corresponding quantitative structure factor images. FCU-Net was trained using over 200,000 unique simulated dynamical diffraction patterns from different combinations of crystal structures, orientations, thicknesses, and microscope parameters, which are augmented with experimental artifacts. We evaluated FCU-Net against simulated and experimental datasets, where it substantially outperforms conventional analysis methods. Our code, models, and training library are open-source and may be adapted to different diffraction measurement problems.

36 MATERIALS SCIENCE↗