Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Training Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

NEUROSPF: A Tool For the Symbolic Analysis of Neural Networks

This paper presents NEUROSPF, a tool for the symbolic analysis of neural networks. Given a trained neural network model, the tool extracts the architecture and model parameters and translates them into a Java representation that is amenable for analysis using the Symbolic PathFinder symbolic execution tool. Notably, NEUROSPF encodes specialized peer classes for parsing the model’s parameters, thereby enabling efficient analysis. With NEUROSPF the user has the flexibility to specify either the inputs or the network internal parameters as symbolic, promoting the application of program analysis and testing approaches from software engineering to the field of machine learning. For instance, NEUROSPF can be used for coverage-based testing and test generation, finding adversarial examples and also constraint-based repair of neural networks, thus improving the reliability of neural networks and of the applications that use them.

neural networks↗

Isolator Shock Train Response to Dual-Mode Scramjet Throttling-Like Forcing

Typical dual-mode scramjet designs employ an isolator component situated between the inlet and combustor. The isolator fluidically buffers the inlet from the combustor via the formation of a shock train, an interconnected series of shock-boundary layer interactions. The isolator is required during ramjet-engine operation and at the lower edges of the scramjet operational envelope. In an operational engine, transient behavior imposes fluidic dynamics due to attitude adjustments, combustor throttling, aberrant resonances within the combustor, etc. To accommodate these transients, the shock train adjusts on both temporal and spatial scales. Sufficiently large downstream pressure increases in the combustor play a critical role during unstart, whereby strong compression waves propagate upstream in the isolator to ultimately force the shock train out the inlet, if it cannot stabilize to the pressure increase. This critically reduces the engine mass flow rate, potentially causing a catastrophic reduction in thrust and loss of the vehicle. A nearly instantaneous unstart can, in principle, be predicted by a ratio of the normal shock pressure jump in an inviscid isolator. However, lower-magnitude perturbations, below this bound, also induce unstarts. Understanding the transient behavior inherent in unsteady isolator operation is critical to reducing safety margin in isolator length and refining engine control algorithms to improve engine performance. The Isolator Dynamics Research Lab (IDRL) is a cold-flow, direct-connect isolator facility ideal for assessing the fundamental fluid dynamics of shock trains. The internal flow of a scramjet isolator is modeled using a 2D, symmetric Mach 2.5 nozzle followed by a 695 mm long, 25.4x50.8 mm rectangular isolator test section. A blockage cone on a high-speed ball screw actuator downstream of the isolator is pulsed to simulate the throttling behavior in an operational combustor. Wall flush high-speed static pressure transducers detect the streamwise shock train within the isolator. Time delays between the onset of the throttling and the response motion of the shock train are analyzed to assess the controlling scales and parameters. From this analysis, the response time of the isolator shock train system is found to depend primarily on the isolator back pressure time-rate-of-change but quickly saturates to a maximum propagation speed along the isolator. These results inform dual-mode scramjet engine designers of the critical parameters and limits of an unstart resistant engine.

scramjet↗

Test and validation for robot arm control dynamics simulation

The Flight Telerobotic Servicer (FTS) program will require an ability to develop, in a cost effective manner, many simulation models for design, analysis, performance evaluation, and crew training. Computational speed and the degree of modeling fidelity associated with each simulation must be commensurate with problem objectives. To demonstrate evolving state-of-the-art general purpose multibody modeling capabilities, to validate these by laboratory testing, and to expose their modeling shortcomings, two focus problems at the opposite ends of the simulation spectrum are defined: (1) Coarse Acquisition Control Dynamics. Create a real time man-in-the-control-loop simulator. Provide animated graphical display of robot arm dynamics and tactile feedback sufficient for cueing the operator. Interface simulator software with human operated tactile feedback controller; i.e., the Kraft mini-master. (2) Fine, Precision Mode Control Dynamics. Create a high speed, high fidelity simulation model for the design, analysis, and performance evaluation of autonomous 7 degree-of-freedom (DOF) trajectory control algorithms. This model must contain detail dynamic models for all significant dynamics elements within the robot arm, such as joint drive mechanisms.

Yae, K. Harold↗

Measurement and Analysis of Atmospheric Spectral Optical Depths with NASA Ames Airborne Sunphotometers During TARFOX and ACE-2

In accordance with the scope of work of this contract, the following tasks were undertaken and completed during the course of the contract: (1) Participation in the design and development of the 14-channel Ames Airborne Tracking Sunphotometer (AATS-14), including the development and implementation of Visual Basic software for real-time data processing and display and post-acquisition data reduction and analysis. (2) Operation of the six-channel Ames Airborne Tracking Sunphotometer (AATS-6) aboard the University of Washington C-131A during TARFOX and in-field analysis and presentation of data acquired with the AATS-6. (3) Post-mission analysis of data acquired during TARFOX with the AATS-6 and the AATS-14. (4) Pre-TARFOX calibration of the AATS-6 at Mauna Loa Observatory in May 1996, and post-TARFOX calibration of the AATS-6 and AATS- 14 at Zugspitze, Germany in October 1996, including analyses of all data sets. (5) Analysis of AATS-14 airborne calibration data acquired on 17 November 1996 during a late afternoon Pelican flight over the central California coast. (6) Operational training, instrument preparation, field coordination, and analysis of shipboard measurements of aerosol optical depth with the AATS-6 during ACE-2. (7) Coordination of data acquisition with the AATS-14 aboard the Pelican during ACE-2 and in-field preliminary data analysis and presentation. (8) Calibration of the AATS-6 and AATS-14 in April/May 1997 at Mauna Loa prior to ACE-2, and post-mission calibration of the AATS-6 at Mauna Loa in August 1997.

Livingston, John M.↗

FIND: A Synthetic weather generator to control drought Frequency, Intensity, and Duration

Water systems worldwide are experiencing climate change-induced shifts in drought properties like frequency, intensity, and duration, affecting water security and reliability. To develop and test effective drought preparedness plans, researchers often use synthetic weather generators to create hydrological scenarios that explore drought variability beyond historical records. Existing weather generators typically allow users to adjust streamflow statistics like percentiles or temporal correlation but do not directly control drought properties of frequency, intensity, and duration. To fill this gap, we propose FIND (Frequency, INtensity, and Duration) synthetic weather generator. FIND incorporates a standardized drought index to directly and in dependently control drought frequency, intensity, and duration in generated streamflow time series while preserving observed hydrological variability. Use cases for FIND include i) water systems analysis applications that seek to train and test drought strategies under historical and plausible future drought conditions, and ii) bottom-up vulnerability studies relating system vulnerability outcomes to specific changes in drought properties of frequency, intensity, and duration. Here, we demonstrate FIND’s versatility through three experiments: replicating historically observed drought properties, generating streamflow scenarios for multiple sites preserving correlation between their drought conditions, and generating a set of scenarios with direct and independent changes in drought properties. FIND source code is openly available for applications beyond the scope of this paper.

42 ENGINEERING↗

Training calibration-based counterfactual explainers for deep learning models in medical image analysis

The rapid adoption of artificial intelligence methods in healthcare is coupled with the critical need for techniques to rigorously introspect models and thereby ensure that they behave reliably. This has led to the design of explainable AI techniques that uncover the relationships between discernible data signatures and model predictions. In this context, counterfactual explanations that synthesize small, interpretable changes to a given query while producing desired changes in model predictions have become popular. This under-constrained, inverse problem is vulnerable to introducing irrelevant feature manipulations, particularly when the model’s predictions are not well-calibrated. Hence, in this paper, we propose the TraCE (training calibration-based explainers) technique, which utilizes a novel uncertainty-based interval calibration strategy for reliably synthesizing counterfactuals. Given the wide-spread adoption of machine-learned solutions in radiology, our study focuses on deep models used for identifying anomalies in chest X-ray images. Using rigorous empirical studies, we demonstrate the superiority of TraCE explanations over several state-of-the-art baseline approaches, in terms of several widely adopted evaluation metrics. Our findings show that TraCE can be used to obtain a holistic understanding of deep models by enabling progressive exploration of decision boundaries, to detect shortcuts, and to infer relationships between patient attributes and disease severity.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Data and scripts associated with the manuscript "Encoding Diel Hysteresis and the Birch Effect in Dryland Soil Respiration Models through Knowledge-Guided Deep Learning"

This package contains the data and scripts used in "Encoding Diel Hysteresis and the Birch Effect in Dryland Soil Respiration Models through Knowledge-Guided Deep Learning" (Jiang et al., 2022). The data.zip file contains the flux tower and automated chamber observations used for developing the deep learning model for modeling soil respiration. The scripts.zip file contains the Jupyter notebooks and python scripts for preprocessing the data, training the deep learning models, and postprocessing the results. The src.zip contains the source code for training the deep learning model, performing mutual information analysis, and plotting functions. The trained_models.zip contains multiple folders used for hosting the trained deep-learning models and the associated soil respiration predictions. The whole process is performed using python. We include the REAMD.md to document the python package requirements.Soil respiration in dryland ecosystems is challenging to model due to its complex interactions with environmental drivers. Knowledge-guided deep learning provides a much more effective means of accurately representing these complex interactions than traditional Q10-based models. Mutual information analysis revealed that future soil temperature shares more information with soil respiration than past soil temperature, consistent with their clockwise diel hysteresis. We explicitly encoded diel hysteresis, soil drying, and soil rewetting effects on soil respiration dynamics in a newly designed Long Short Term Memory (LSTM) model. The model takes both past and future environmental drivers as inputs to predict soil respiration. The new LSTM model substantially outperformed three Q10-based models and the Community Land Model when reproducing the observed soil respiration dynamics in a semi-arid ecosystem. The new LSTM model clearly demonstrated its superiority for temporally extrapolating soil respiration dynamics, such that the resulting correlation with observational data is up to 0.7 while the correlations of both Q10-based models and the Community Land Model (CLM) are less than 0.4. Our results underscore the high potential for knowledge-guided deep learning to replace Q10-based soil respiration modules in Earth system models.

54 ENVIRONMENTAL SCIENCES↗

CMLM (Co-Optimized Machine-Learned Manifolds) [SWR-23-41]

Co-optimized Machine-Learned Manifolds (CMLM) is a data-driven approach for developing reduced-order manifold models for high-dimensional chemically reacting systems. It involves a specially designed neural network, the training of which simultaneously optimizes linear combinations of species that define the manifold, nonlinear mapping to outputs of interest such as reaction rates, and (optionally) subfilter closure for large eddy simulation. This software package provides an implementation of the CMLM approach in Python using the PyTorch machine learning library. A few example cases are included, showing how the tool can be applied to different types of data from 0D and 1D reacting simulations performed using Cantera. The neural networks can be saved in a format that is readable by the Pele suite of combustion solvers for use in reacting computational fluid dynamics simulations. This software repository contains several python scripts to perform various tasks associated with the Co-optimized Machine Learned Manifolds (CMLM) model, which is described in Perry, Henry de Frahan, and Yellapantula, CNF, 2022 (https://doi.org/10.1016/j.combustflame.2022.112286). This includes not only the code that defines the CMLM model, but also scripts to generate suitable training data, scripts to pre-process the data, scripts to train the CMLM model, and scripts to plot the output, as well as various other helper files. The scripts depend on several commonly used python libraries for data analysis and chemical reaction computations. The trained models that result from this tool are designed to work with the an interface being implemented in the Pele suite of reacting flow solvers (https://github.com/AMReX-Combustion).

Perry, Bruce↗

Comparative study of career development and training programs

Improvement of human capital has been identified as the key to any further increase of productivity for any country engaged in the global economic competition. The same can be said of any organization seeking to enhance its overall performance. This study is aimed at: (1) surveying the current practices of career development and training programs at major corporations and government research organizations; (2) presenting the distributions of various program features among survey respondents; (3) identifying the profile of the training program of a typical research organization, against which each organization can check and identify its relative strengths as well as areas needing further strengthening; (4) conducting an economic analysis of the effectiveness of the training programs at Langley Research Center; and (5) making recommendations as to how to enhance existing training programs.

Tsao, Alan↗

Single Bimodular Sensor for Differentiated Detection of Multiple Oxidative Gases

Semiconductive metal-oxide sensors suffer from cross-sensitivities under mixed chemical condition, specifically upon mixture of multiple oxidative or reductive gases. Herein, a single bimodular sensor is demonstrated for smart differentiation of multiple oxidative analytes by relating the resistance-metric mode to impedance-metric mode. The sensor construct based on ZnO nanorods readily outputs three response datasets upon exposure of oxidative-gas mixture including O 2 , SO 2 , and NO 2 , the resistance, real part impedance, and imaginary part impedance. The differentiative and correlated nature between these response signals allows such a single sensor platform to differentiate these oxidative gases accurately and robustly. Linear and non-linear decision boundaries are established over a large gas-concentration range from 2 ppm to 3% through a combination of principal component analysis and artificial neural network training. A facile user interface is demonstrated for recognition and measurement of unknown gas analytes, with the error of the predicted analyte-concentration as low as 2%.

36 MATERIALS SCIENCE↗

Resistive Switching of Spinel Li 4 Ti 5 O 12 Lithium-Ion Battery Material for Neuromorphic Computing

The rapid rise of AI has exposed significant limitations in conventional Von Neumann computing architecture, particularly in regard to speed and energy efficiency. To address these challenges, researchers are exploring a brain-inspired neuromorphic architecture that mimics biological neural networks, enabling massive parallel processing with reduced power consumption for complex AI computational demands. Recent interest has focused on utilizing battery electrodes and solid electrolyte materials for their resistive switching properties in developing a neuromorphic architecture. These properties are precisely tuned through local- and bulk-level chemical composition modifications via voltage bias stimuli. In this study, we demonstrate fabricating a three-terminal lithium-ion electrochemical transistor based on lithium titanium oxide (Li 4 Ti 5 O 12 ), a popular lithium-ion battery anode material. We deposited and characterized LTO thin films using RF sputtering, demonstrating a 6 orders of magnitude increase in electronic conductivity upon lithiation, with conductivity plateauing after 20% lithiation. Density functional theory calculations revealed transformation from the insulating to conducting state, supported by experimental characterization through X-Ray Photoelectron Spectroscopy (XPS) and Direct Current (DC) polarization analyses. The fabricated transistor consisted of LTO as the channel layer, gold as source/drain terminals, lithium phosphorus oxynitride (LiPON) as the lithium-ion conductor, and copper as the gate terminal. The device exhibited clear hysteresis in transfer characteristics due to lithium insertion/extraction processes. Long-term potentiation (LTP) and long-term depression (LTD) measurements showed an asymmetric ratio of 1.425 and maximum/minimum conductance ratio of 7.83. When implemented in a deep neural network (DNN) for MNIST handwritten digit recognition, the device achieved 92.03% accuracy over 20 training epochs. Detailed transport mechanism analysis revealed the crucial role of oxygen vacancies and interface effects in device operation. Our preliminary findings establish LTO-based lithium-ion electrochemical transistors as promising candidates for energy-efficient neuromorphic computing applications, offering potential solutions to traditional Von Neumann architecture limitations.

25 ENERGY STORAGE↗

Generation of ultrafast electron bunch trains via trapping into multiple periods of plasma wakefields

We demonstrate a novel approach to the generation of femtosecond electron bunch trains via laser-driven wakefield acceleration. We use two independent high-intensity laser pulses, a drive, and an injector, each creating their own plasma wakes. The interaction of the laser pulses and their wakes results in a periodic injection of free electrons in the drive plasma wake via several mechanisms, including ponderomotive drift, wake-wake interference, and pre-acceleration of electrons directly by strong laser fields. Electron trains were generated with up to four quasi-monoenergetic bunches, each separated in time by a plasma period. In conclusion, the time profile of the generated trains is deduced from an analysis of beam loading and confirmed using 2D particle-in-cell simulations

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Designing Antifouling and Antimicrobial Interfaces: Structural Characterization using CryoEM, Automated Microscopy, and AI Image Segmentation

The design of functionalized surfaces for interactions with biological systems is critical across sectors such as healthcare, energy, and agriculture. Tailoring materials for specific applications, such as antifouling and antimicrobial surfaces, demands a comprehensive understanding of topology and chemistry across multiple length and time scales on both biological and materials systems. This work presents the development and characterization of nanostructured surfaces with controlled topographies and chemistries that enhance bacterial membrane disruption, reduce biofilm formation, and improve antimicrobial and antifouling capabilities. Two specific use cases will be presented - the use of cellulose nanocrystals (CNCs) for bacterial growth inhibition and the development of antifouling surfaces to prevent protein and bacterial adsorption [1-4]. By leveraging large language models (LLMs) for image segmentation and training [5], we enable automated analysis of terabyte-scale cryogenic electron microscopy (cryoEM) datasets. This analysis provides statistical insights into the biotic/abiotic interface and facilitates automated electron microscopy experiments to mitigate time and dose. The integration of cryogenic electron tomography (cryoET) and cryogenic focused ion beam (cryoFIB) milling enables high-resolution, near-native-state imaging and 3D reconstructions of bio/material interfaces [6]. Orthogonal characterization techniques and computational modeling further enhances our understanding, offering a robust platform for the design and optimization of next-generation functional surfaces [7].

Williams, Alexis [ORNL] (ORCID:0000000252835822)↗

Automated Registration of Vector Data to Overhead Imagery

The availability of open source, remote sensing-derived vector data has increased exponentially in recent years. Unfortunately, these vector data are rarely made available with the corresponding source images from which objects were extracted. As such, these derived datasets are commonly used in combination with target images which differ from the source. Satellite viewing geometry can cause objects, extracted from a source image, to appear shifted when overlaid with a target image. Whether for purely cartographic purposes, reusability of preexisting training labels, or any spatial analysis where spatial correspondence between vector and image are required, the following paragraphs outline a method to address this challenge through the automated registration of vector data to overhead imagery, including existing literature regarding this challenge, followed by a case study of Sioux Falls, South Dakota.

McKee, Jacob↗

A Transductive Graph Neural Network learning for Grid Resilience Analysis

Power grids are critical infrastructures that require robust resilience analysis to ensure reliable and uninterrupted electricity supply. Traditional simulation-based methods for grid resilience analysis suffer from computational complexity and limited ability to capture the full spectrum of potential disruptions. This paper presents a novel approach to enhance grid resilience by leveraging transductive graph neural network (GNN) learning to identify critical nodes and links. By leveraging the graph structure and system features, GNNs effectively learn resilience metrics and accurately identify critical nodes based on actual grid operational behavior. The efficacy of the proposed approach is demonstrated through case studies on node criticality scoring and critical node/line identification in cascading outage scenarios. The results highlight the advantages of learning-based methods over traditional simulation-based approaches and their potential to revolutionize grid resilience analysis. The contributions of this paper include a graph-based scalable approach for fast cascading analysis, an inductive formulation for training GNN models, and a transfer learning-based approach to scale the model to largescale power systems.

grid resilience, graph neural networks, transducti↗

Forecasting for ESCAPE: A Multi-Institution Hybrid Forecasting and Nowcasting Operation for Sea-Breeze Convection Supporting a Ground-Based and Airborne Field Campaign

The Experiment of Sea-Breeze Convection, Aerosols, Precipitation and Environment (ESCAPE) field project deployed two aircraft and ground-based assets in the vicinity of Houston, Texas, between 27 May and 2 July 2022, examining how meteorological conditions, dynamics, and aerosols control the initiation, early growth stage, and evolution of coastal convective clouds. To ensure that airborne- and ground-based assets were deployed appropriately, a forecasting and nowcasting team was formed. Daily forecasts guided real-time decision-making by assessing synoptic weather conditions, environmental aerosol, and a variety of atmospheric modeling data to assign a probability for meeting specific ESCAPE campaign objectives. During the research flights, a small team of forecasters provided “nowcasting” support by analyzing radar, satellite, and new model data in real time. The nowcasting team proved invaluable to the campaign operation, as sometimes changing environmental conditions affected, for example, the timing of convective initiation. In addition to the success of the forecasting and nowcasting teams, the ESCAPE campaign offered a unique “testbed” opportunity where in-person and virtual support both contributed to campaign objectives. The forecasting and nowcasting teams were each composed of new and experienced forecasters alike, where new forecasters were given invaluable experience that would otherwise be difficult to attain. Both teams received training on forecast models, map analysis, Hybrid Single-Particle Lagrangian Integrated Trajectory model (HYSPLIT), and thermodynamic sounding analysis before the beginning of the campaign. In this article, the ESCAPE forecasting and nowcasting teams reflect on these experiences, providing potentially useful advice for future field campaigns requiring forecasting and nowcasting support in a hybrid virtual/in-person framework.

54 ENVIRONMENTAL SCIENCES↗

Machine Learning for Automated Weld Quality Monitoring and Control

Resistance Spot Welding (RSW) is a critical process in the automotive industry, valued for its cost-effectiveness, short cycle time, and robustness. However, achieving consistent high-quality joints remains challenging due to the complex interplay of various factors, like materials, processes, and manufacturing uncertainties, etc. Under the collaborative project between Oak Ridge National Laboratory (ORNL) and General Motors (GM), we have developed a robust and expansible machine learning (ML) framework aimed at enhancing quality control in RSW. By harnessing the power of machine learning, we have developed the ability to ensure every aspect of the welding process, from the initial process design stage to the final weld joint quality. The framework operates by analyzing a variety of data streams, including in-line process signals, process parameters, materials, and postprocessed weld joint data. Through this analysis, the models have been trained to detect deviations from optimal quality standards, leveraging their ability to identify signature data patterns and anomalies within in-line signals and construct complex correlations between these signals and weld quality parameters. Meanwhile, the machine learning framework is designed to adapt to a variety of materials, including high strength steels and aluminum alloys, etc. Its flexible architecture facilitates the incorporation of diverse data sources and features, enabling precise modeling and prediction across a broad range of material properties and weld quality variables. The expansible ML frameworks represent a promising transformation in weld quality monitoring and control, empowering industry to achieve high levels of efficiency, consistency, and reliability in manufacturing.

99 GENERAL AND MISCELLANEOUS↗

Machine Learning for Automated Weld Quality Monitoring and Control

Resistance Spot Welding (RSW) is a critical process in the automotive industry, valued for its cost-effectiveness, short cycle time, and robustness. However, achieving consistent high-quality joints remains challenging due to the complex interplay of various factors, like materials, processes, and manufacturing uncertainties, etc. Under the collaborative project between Oak Ridge National Laboratory (ORNL) and General Motors (GM), we have developed a robust and expansible machine learning (ML) framework aimed at enhancing quality control in RSW. By harnessing the power of machine learning, we have developed the ability to ensure every aspect of the welding process, from the initial process design stage to the final weld joint quality. The framework operates by analyzing a variety of data streams, including in-line process signals, process parameters, materials, and postprocessed weld joint data. Through this analysis, the models have been trained to detect deviations from optimal quality standards, leveraging their ability to identify signature data patterns and anomalies within in-line signals and construct complex correlations between these signals and weld quality parameters. Meanwhile, the machine learning framework is designed to adapt to a variety of materials, including high strength steels and aluminum alloys, etc. Its flexible architecture facilitates the incorporation of diverse data sources and features, enabling precise modeling and prediction across a broad range of material properties and weld quality variables. The expansible ML frameworks represent a promising transformation in weld quality monitoring and control, empowering industry to achieve high levels of efficiency, consistency, and reliability in manufacturing.

42 ENGINEERING↗