Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Training Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Machine learning methods for weather forecasting

SAND2025-14466O This repository contains code for developing, training, and evaluating machine learning models for weather and climate forecasting, including forecast skill assessment, feature importance analysis, and reproducible workflows for model comparison. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Holthuijzen, Maike [Sandia National Lab. (SNL-CA),↗
DOE OSTI2022

Dataset for 'Stream Temperature Predictions for River Basin Management in the Pacific Northwest and Mid-Atlantic Regions Using Machine Learning', Water 2022

This data package presents forcing data, model code, and model output for classical machine learning models that predict monthly stream water temperature as presented in the manuscript ‘Stream Temperature Predictions for River Basin Management in the Pacific Northwest and Mid-Atlantic Regions Using Machine Learning’, Water (Weierbach et al., 2022). Specifically, for input forcing datasets we include two files each generated using the BASIN-3D data integration tool (Varadharajan et al., 2022) for stations in the Pacific Northwest and Mid Atlantic Hydrologic regions. Model code (written in python with the use of jupyter notebooks) includes codes for data preprocessing, training Multiple Linear Regression, Support Vector Regression, and Extreme Gradient Boosted Tree models, and additional notebooks for analysis of model output. We include specific model output files which represent modeling configurations presented in the manuscript also presented in an hdf5 format. Together, these data make up the workflow for predictions across three scenarios (single station, regional, and predictions in unmonitored basins) presented in the manuscript and allow for reproducibility of modeling procedures.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Cooperative Research and Development Agreement between National Energy Technology Laboratory and University of Texas at Austin [Abstract]

The project is a collaboration in the area of water filtration, including for produced waters from subsurface formations. The collaboration will provide University of Texas at Austin access to the J200 LIBS measurement machine, as well as training, facilities, and experts at NETL. NETL will gain access to UTA’s proprietary membrane samples and analysis results. The goal of this project is to determine the effects of ion depth penetration as a function of exposure on the face of the membrane samples and how this exposure may affect overall filtration efficiency. This work could help bring understanding to improved water filtration for contaminated produced waters. During this project the two parties will work together to generate and analyze experimental data from the novel filter samples to develop a journal paper co-authored by both parties.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Evolving Competitive Markets in SAPP: Leveraging Competitive Wholesale Electricity Markets to Drive Renewable Generation Capacity in the Southern African Power Pool (SAPP)

The SADC region has significant natural resource potential to increase renewable energy generation, improve electricity reliability, and support economic development. This research finds an apparent lack of confidence from electricity infrastructure investors in SAPP wholesale electricity markets, which increases risk perception and lowers the likelihood of capital deployment. With respect to free market fundamentals, competitive market obstacles and renewable energy development obstacles are characterized. Stakeholders identified the top obstacles to well-functioning competitive markets as insufficient transmission infrastructure for interconnection and regional movement of electricity, dominance of national single-buyer markets, and lack of or weak nation-state regulatory frameworks. Stakeholders prioritized the top three obstacles for renewable energy development as a lack of viable commercial arrangements for variable renewable energy (VRE) balancing, lack of functional and consistent nation-level regulations, and higher project costs related to reliance on imported equipment. With respect to potential solution options, stakeholders prioritized the development of new cost allocation and finance methods to facilitate new transmission expansion, training to educate new or potential new market entrants on SAPP processes, as well as modeling and analysis of regional SAPP participation benefits disaggregated to the nation-state level. From these perspectives, this research identified strategy options for consideration including transitioning SAPP to a regional transmission operator (RTO) for operation and planning of cross-border transmission facilities and market administration, shifting operations of SAPP member transmission systems to Independent System Operators (ISOs), establishing a regional regulatory authority and enhancing market data transparency. Implementing these reforms is expected to be challenging, but not insurmountable, given the domestic political, legal, and jurisdictional complexities of the SADC region.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Refining Fast Simulation Using Machine Learning

A growing reliance on the fast Monte Carlo (FastSim) will accompany the high luminosity and detector granularity expected in Phase 2. FastSim is roughly 10 times faster than equivalent GEANT4-based full simulation (FullSim). However, reduced accuracy of the FastSim affects some analysis variables and collections. To improve its accuracy, FastSim is refined using regression-based neural networks trained with ML. The status of FastSim refinement is presented. The results show improved agreement with the FullSim output and an improvement in correlations among output observables and external parameters.

Güngördü, Acelya Deniz↗
DOE OSTI2023

DGaaS: GPU as a Service on Distributed Computing System

In the rapidly evolving landscape of scientific computing, Graphics Processing Units (GPUs) have become indispensable for their unparalleled ability to handle parallel tasks in complex calculations, simulations, and data analysis. Their utility is further magnified in machine learning and AI applications, where they significantly accelerate model training and predictive analytics. Within this context, the Triton Inference Server emerges as a pivotal open-source tool, specializing in AI inferencing and optimizing GPU utilization across various platforms and frameworks. This paper presents an in-depth study on distributed High Throughput Computing (HTC), specifically focusing on the HTCondor framework and its resource provisioning tools, GlideinWMS and HEPCloud. These systems enable large-scale scientific experiments like CMS and DUNE to efficiently access and utilize vast computational resources. The paper explores the core architectural components of GlideinWMS, including jobs, user pools, and worker nodes, and discusses their integration with GPUs and the Triton server. The primary aim of this research is to develop a solution that optimizes GPU utilization by leveraging Glideins and containers. This approach allows computational jobs, particularly those involving AI models, to use GPUs only when essential, thereby facilitating efficient sharing of limited GPU resources. To validate this architecture, the study conducted three key tests involving custom scripts, container-based servers, and Triton server deployments. However, the study faces challenges, notably in locating the Triton server and ensuring secure remote access. To address these issues, future work will focus on developing a proxy mechanism and enhancing security protocols. In conclusion, this study offers a comprehensive roadmap for effective and efficient GPU utilization in distributed High Throughput Computing. It aims to contribute significantly to the scientific community by solving pressing problems and implementing robust solutions in collaboration with the GlideinWMS and HEPCloud teams. The research sets the stage for a more efficient, scalable, and cost-effective paradigm in scientific computing.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Intracardiac Electrical Imaging using the 12-lead ECG: A Machine Learning Approach using Synthetic Data

Current state-of-the-art techniques for non-invasive imaging of cardiac electrical phenomena require voltage recordings from dozens of different torso locations and anatomical models built from expensive medical diagnostic imaging procedures. Here this study aimed to assess if recent machine learning advances could alternatively reconstruct electroanatomical maps at clinically relevant resolutions using only the standard 12-lead electrocardiogram (ECG) as input. To that end, a computational study was conducted to generate a dataset of over 16000 detailed cardiac simulations, which was then used to train neural network (NN) architectures designed to exploit both spatial and temporal correlations in the ECG signal. Analysis over a validation set showed average errors in activation map reconstruction below 1.7 msec over 75 intracardiac locations. Furthermore, phenotypical patterns of activation and the morphology of the activation potential were correctly reconstructed. The approach offers opportunities to stratify patients non-invasively, both retrospectively and prospectively, using metrics otherwise only available through invasive clinical procedures.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Automated Fire Detection for Industrial Settings with Pretrained Convolutional Networks

Early fire detection in industrial environments is critical to preventing equipment damage, personal injury, and operational disruptions. Traditional smoke detectors, while effective, often experience delays due to the time required for smoke to reach sensors, allowing fires to spread. Manual fire watch operations and human surveillance of camera feeds are resource-intensive and prone to human error. To address these challenges, this paper explores the application of convolutional neural networks for automated fire detection, specifically in industrial settings. By leveraging 11 different pre-trained machine vision models from TensorFlow and enhancing them with transfer learning on a custom-built industrial fire dataset, we optimized fire detection performance. Here, we analyzed each machine vision model architecture in terms of its depth, width, and input image resolution, considering both resource requirements and detection accuracy. We further explored the option of combining multiple models into an ensemble classifier to evaluate whether the performance improvements could justify the much greater computational complexity and other practical impacts. A cost-benefit analysis is presented to evaluate the trade-offs between performance and computational expense. Our findings identify that EfficientNetV2L, specifically tailored for industrial applications, provides the optimal balance between costs involved in training and using the model versus the overall fire detection performance. Additionally, we present a qualitative analysis of model performance using the technique of gradient-based class activation mapping to provide explainability by visualizing model decisions.

artificial intelligence↗
DOE OSTI2022

SDSS-IV MaStar: Data-driven Parameter Derivation for the MaStar Stellar Library

The Mapping Nearby Galaxies at Apache Point Observatory (MaNGA) Stellar Library (MaStar) is a large collection of high-quality empirical stellar spectra designed to cover all spectral types and ideal for use in the stellar population analysis of galaxies observed in the MaNGA survey. The library contains 59,266 spectra of 24,130 unique stars with spectral resolution R ~ 1800 and covering a wavelength range of 3622–10,354 Å. In this work, we derive five physical parameters for each spectrum in the library: effective temperature (T eff ), surface gravity ($\mathrm{log} g$), metallicity ([Fe/H]), microturbulent velocity ($\mathrm{log}({v}_{\mathrm{micro}})$), and alpha-element abundance ([α/Fe]). These parameters are derived with a flexible data-driven algorithm that uses a neural network model. We train a neural network using the subset of 1675 MaStar targets that have also been observed in the Apache Point Observatory Galactic Evolution Experiment (APOGEE), adopting the independently-derived APOGEE Stellar Parameter and Chemical Abundance Pipeline parameters for this reference set. For the regions of parameter space not well represented by the APOGEE training set (7000 ≤ T ≤ 30,000 K), we supplement with theoretical model spectra. We present our derived parameters along with an analysis of the uncertainties and comparisons to other analyses from the literature.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Enhancing segmentation fairness through curriculum learning and progressive loss: a centralized and federated perspective on radiograph analysis

Bias in medical image segmentation can lead to unequal performance across demographic subgroups, raising concerns about fairness and reliability in clinical AI systems. While deep learning models have achieved high segmentation accuracy, ensuring equitable performance across race and gender remains a significant challenge, particularly in privacy-sensitive healthcare environments. This study investigates fairness-aware medical image segmentation for hip and knee radiographs using deep learning models evaluated in both centralized and Federated Learning (FL) settings. We introduce Curriculum Learning (CL) strategies and Progressive Loss (PL) functions to regulate sample difficulty during training. In addition, we propose two novel fairness-oriented federated learning algorithms, Federated Intersection over Union (FedIoU) and Federated Intersection over Union with Outlier Analysis (FedIoUoutlier). Experiments are conducted using multiple segmentation backbones and simulated multi-site data partitions derived from the Osteoarthritis Initiative dataset. Model performance is evaluated using Intersection over Union (IoU), IoU standard deviation, Skewed Error Ratio (SER), and Min-Max Disparity across race and gender subgroups. Statistical significance was verified using paired t-tests to compare per-sample IoU performance against baseline configurations. Across both hip and knee segmentation tasks, curriculum learning and progressive loss strategies consistently improved segmentation accuracy and reduced demographic performance disparities in centralized training. In federated settings, fairness-aware aggregation further enhanced performance. Notably, FedIoUoutlier combined with balanced curriculum learning and tiered progressive loss achieved the highest mean IoU while yielding the lowest SER and Min-Max Disparity, indicating improved fairness without sacrificing accuracy. In several configurations, federated models matched or exceeded the performance of optimized centralized models, with statistically significant improvements in per-sample IoU over baseline configurations. The results demonstrate that structured training strategies and fairness-aware federated aggregation can jointly improve accuracy, stability, and demographic fairness in medical image segmentation. By integrating curriculum learning, progressive loss, and novel FL algorithms, this work provides a practical pathway toward equitable and privacy-preserving AI systems for medical imaging.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

A two-stage optical fusion framework for wildfire severity mapping across the conterminous United States

Accurate wildfire severity mapping (WSM) is essential for post-fire recovery planning, erosion risk assessment, ecosystem monitoring, and disaster risk reduction. Although Landsat and Sentinel optical imagery have been widely used for burn severity assessment, the added value of fusing multiple optical sensors has not been sufficiently quantified across diverse fire events, particularly since the launch of Landsat-9. This study evaluates whether multisensor optical fusion improves wildfire severity mapping relative to single-sensor baselines using Sentinel-2, Landsat-8, and Landsat-9 imagery across 40 wildfire events in the conterminous United States. We tested a two-stage fusion framework that combines feature-level fusion with pixel-level dimensionality reduction. First, feature-level fused datasets were created through early fusion by combining standardized post-fire bands from each sensor into a single predictor stack. Both raw reflectance bands and pairwise spectral transforms were retained to capture within- and cross-sensor spectral interactions. Second, Linear Discriminant Analysis was applied to both single-sensor and fused datasets to produce comparable low-dimensional feature spaces. Six machine-learning classifiers were then used to benchmark model performance with repeated spatially buffered train–test splits. Results show that Landsat-9 was the strongest single-sensor baseline. Among the fusion strategies, Sentinel-2 + Landsat-9 produced the most consistent improvement and reduced performance variability. Landscape-condition analysis further showed that this fusion was most beneficial in shrubland-dominated and high-terrain fires, where it achieved the highest overall mean accuracy and the fewest failures. In contrast, its benefits were less reliable in evergreen forests, mixed vegetation, and low- to moderate-elevation terrain. In operational settings, the Sentinel-2 + Landsat-9 configuration offers a practical solution for post-fire recovery planning, erosion-risk assessment, watershed management, and ecological monitoring when field observations are available and timely satellite-based information is needed.

Landsat↗
DOE OSTI2023

Using deep machine learning to interpret proton radiography data from a pulsed power experiment

Deep machine learning is used to analyze a proton radiograph from a tin pulsed power experiment and determine density values for each pixel in the image. Two promising convolutional neural network architectures that have proven to be effective for image analysis in other applications are applied to analyze a proton radiograph and find density values. The process of creating a suitable training dataset is described, involving the Lagrangian hydrodynamic model used for simulations of the experiment, the proton radiography forward model to make synthetic images for training, and the manner in which data augmentation is used to expand the resulting image dataset. It is shown that machine learning not only produces a reasonable density field but is also able to predict features in the density field that are suggested by the proton radiograph but not captured by simulations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

WaterTAP: Tool for analysis of water treatment systems

This presentation describes the Water treatment Technoeconomic Assessment Platform (WaterTAP), an open-source software tool to analyze water treatment trains. The presentation was provided to the NAWI Alliance Fall Meeting on November 29th 2023 and it includes an overview of the tool and a couple of analyses demonstrating its capabilities. The analyses include a technoeconomic assessment of a novel membrane-based technology called low salt rejection reverse osmosis and a brackish water desalination train with pretreatment.

Dudchenko, Alexander↗
DOE OSTI2024

Automated 3D cytoplasm segmentation in soft X-ray tomography

Cells’ structure is key to understanding cellular function, diagnostics, and therapy development. Soft X-ray tomography (SXT) is a unique tool to image cellular structure without fixation or labeling at high spatial resolution and throughput. Fast acquisition times increase demand for accelerated image analysis, like segmentation. Currently, segmenting cellular structures is done manually and is a major bottleneck in the SXT data analysis. This paper introduces ACSeg, an automated 3D cytoplasm segmentation model. ACSeg is generated using semi-automated labels and 3D U-Net and is trained on 43 SXT tomograms of immune T cells, rapidly converging to high-accuracy segmentation, therefore reducing time and labor. Furthermore, adding only 6 SXT tomograms of other cell types diversifies the model, showing potential for optimal experimental design. ACSeg successfully segmented unseen tomograms and is published on Biomedisa, enabling high-throughput analysis of cell volume and structure of cytoplasm in diverse cell types.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Z-Contrast Enhancement in Au–Pt Nanocatalysts by Correlative X-ray Absorption Spectroscopy and Electron Microscopy: Implications for Composition Determination

The properties of bimetallic nanoparticles (BNPs) vary widely as a function of their composition and size distributions. X-ray absorption fine structure analysis is commonly used to characterize their structure, but its application to elements that are close to each other in the periodic table is hampered by poor Z-contrast. For this study, we trained an artificial neural network to recognize the partial coordination numbers in AuPt NPs synthesized via peptide templating using their X-ray absorption near-edge structure spectra. This approach, combined with scanning transmission electron microscopy analysis, revealed unique details of this prototype catalytic system that has different forms of heterogeneities at both the intra- and inter-particle levels. Our method based on the enhancement of Z-contrast of metal species will have implications for compositional studies of BNPs.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Subsurface Characterization and Machine Learning Predictions at Brady Hot Springs: Preprint

Subsurface data analysis, reservoir modeling, and machine learning (ML) techniques have been applied to the Brady Hot Springs (BHS) geothermal field in Nevada, USA to further characterize the subsurface and assist with optimizing reservoir management. Hundreds of reservoir simulations have been conducted in TETRAD-G and CMG STARS to explore different injection and production fluid flow rates and allocations and to develop a training data set for ML. This process included simulating the historical injection and production since 1979 and prediction of future performance through 2040. ML networks were created and trained using TensorFlow based on multilayer perceptron (MLP), long short-term memory (LSTM), and convolutional neural network (CNN) architectures. These networks took as input selected flow rates, injection temperatures, and historical field operation data and produced estimates of future production temperatures. This approach was first successfully tested on a simplified single fracture doublet system, followed by the application to the BHS reservoir. Using an initial BHS dataset with 37 simulated scenarios, the trained and validated network predicted the production temperature for 6 production wells with the mean absolute percentage error of less than 8%. In a complementary analysis effort, the principal component analysis applied to 13 BHS geological parameters revealed that vertical fracture permeability shows the strongest correlation with fault density and fault intersection density. A new BHS reservoir model was developed considering the fault intersection density as proxy for permeability. This new reservoir model helps to explore under-exploited zones in the reservoir. A data gathering plan to obtain additional subsurface data was developed; it includes temperature surveying for three idle injection wells, at which the reservoir simulations indicate high bottom-hole temperatures. The collected data assist with calibrating the reservoir model and may lead to converting these wells to producers to access under-exploited zones in the reservoir. Data gathering activities are planned for the first quarter of 2021.

40 EE - Geothermal Technologies Office (EE-4G)↗
DOE OSTI2025

Liquid-liquid phase transition of hydrogen and its critical point: Analysis from ab initio simulation and a machine-learned potential

We simulate high-pressure hydrogen in its liquid phase close to molecular dissociation using a machine-learned interatomic potential. The model is trained with density functional theory (DFT) forces and energies, with the Perdew-Burke-Ernzerhof (PBE) exchange-correlation functional. We show that an accurate NequIP model, an E(3)-equivariant neural network potential, accurately reproduces the phase transition present in PBE. Moreover, the computational efficiency of this model allows for substantially longer molecular dynamics trajectories, enabling us to perform a finite-size scaling (FSS) analysis to distinguish between a crossover and a true first-order phase transition. Here, we locate the critical point of this transition, the liquid-liquid phase transition (LLPT), at 1200-1300 K and 155-160 GPa, a temperature lower than most previous estimates and close to the melting transition.

08 HYDROGEN↗
DOE OSTI2024

Quarterly Research Performance Progress Report (Q8)

As part of Task 1, we have started by testing our modeling capabilities by reproducing isothermal DFIT simulations presented in the literature. Once satisfied with the results we have started by targeting the modeling of the DFITs at conducted at well 58-32. We have a identified a specific test (cycle 4 in zone 2) as the most interesting to be model with GEOS hydraulic fracturing module. Thus, we have first produced results with an isothermal model and adjusted model parameters to get a satisfying match with field pressure data. The, we have added thermal effects and compared the modeling results with and without thermal effects to estimate how thermal effects may influence test interpretation. Models seem to suggest that, for small volumes of fluid, thermal effects are moderate. In Task 2, we have adapted GEOS phase-field formulation to be able to simulate near-wellbore hydraulic fracture nucleation and propagation. We have devised a novel formulation that, compared to other existing ones, incorporates rock strengths. We have submitted a journal publication about our work. We are currently employing this phase-field formulation to model the experiments taking place at U Pitt and help us understand the effect of various parameters. In Task 3, we have built a model of the region surround well 16A and have started modeling stage 3 stimulation because of its simpler planar geometry. After calibrating simulation parameters using known analytical solutions, we have simulated the stage 3 stimulation using our isothermal hydraulic fracturing module, varying the permeability field, the stress conditions including different physics to get a better understanding of the numerical challenges and of the effects of varying these parameters on the simulation results. In Task 4 laboratory experimentation, a set of specialized drilling and injection tools has been customized and constructed to accommodate an inclined well with an orientation of up to 30 degrees relative to material anisotropy or principal stress axes. These inclined samples have also undergone thermal stress and hydraulic fracturing at a temperature of 190 degrees Celsius. Furthermore, both vertical and deviated sampling testing setups enable an extended analysis of post-peak pressure behaviors, facilitating post-test pressure analyses such as the G-function, step rate, and fracture reopening measurements. Thus, the key components of in-situ stress estimation can be extracted and validated through our experiment, providing a solid foundation for validating existing in-situ stress estimation theories or proposing new ones. Simultaneously, we are integrating computer vision techniques with traditional experimental fracture observation methods such as multi-overcore/slicing and water-penetration fracture observation. This combination will prove beneficial in populating the hydraulic fracture patterns database, generated under challenging EGS conditions. This approach aims to deepen our understanding of the complexities in EGS reservoirs and pave the way for future data-driven investigations. Additionally, PITT has also equipped the ELE International compression machine, which is now prepared for conducting indirect tensile and fracture toughness tests. These tests will aid in characterizing how rock fabrics influence the resulting fracture patterns. Additionally, we have completed the required personnel training and gained access to Scanning Electron Microscopy (SEM) and Energy Dispersive Spectroscopy (EDS) for conducting more detailed characterization and analysis of rock fabrics, as well as the examination of thermal and hydraulically induced fracture patterns. Thus, the PITT team has effectively demonstrated the capabilities of our experimental apparatuses in exploring the thermal effects, well deviation angles, material anisotropy, and operational choices (such as circulation rate, injection fluid viscosity, and injection rate) and their impact on pressure responses and fracture trajectories under the Utah FORGE conditions.

15 GEOTHERMAL ENERGY↗