Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Training Time”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,369 records · Page 76
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

TPCpp-10M: Simulated proton-proton collisions in a time projection chamber for AI foundation models

Scientific foundation models hold great promise for advancing nuclear and particle physics by improving analysis precision and accelerating discovery. Yet, progress in this field is often limited by the lack of openly available large scale datasets, as well as standardized evaluation tasks and metrics. Furthermore, the specialized knowledge and software typically required to process particle physics data pose significant barriers to interdisciplinary collaboration with the broader machine learning community. This work introduces a large, openly accessible dataset of 10 million simulated proton-proton collisions, designed to support self-supervised training of foundation models. To facilitate ease of use, the dataset is provided in a common NumPy format. In addition, it includes 70,000 labeled examples spanning three well defined downstream tasks: track finding, particle identification, and noise tagging, to enable systematic evaluation of the foundation model's adaptability. The simulated data are generated using the Pythia Monte Carlo event generator at a center of mass energy of $\sqrt{s}$ = 200 GeV and processed with Geant4 to include realistic detector conditions and signal emulation in the sPHENIX Time Projection Chamber at the Relativistic Heavy Ion Collider, located at Brookhaven National Laboratory. This dataset resource establishes a common ground for interdisciplinary research, enabling machine learning scientists and physicists alike to explore scaling behaviors, assess transferability, and accelerate progress toward foundation models in nuclear and high energy physics. The complete simulation and reconstruction chain is reproducible with the sPHENIX software stack. All data and code locations are provided under Data Accessibility.

Data Analysis, Statistics and Probability (physics↗
DOE OSTI2025

Enhancing Unknown Waveform Detection by Learning Intra and Inter-domain Dependencies with Advanced Attention Fusion Mechanisms

Detection of unknown waveforms in mission-critical communications is a crucial area of interest for the Department of Energy (DoE). Traditional methods and recent deep learning-based approaches often assume that the training set includes all possible classes, which is impractical for detecting new waveforms. This limitation gives rise to the problem of open-set recognition (OSR), which involves correctly identifying known classes while detecting and rejecting unknown or unseen classes. To address this limitation, we propose a novel dual-domain complex-valued neural architecture that jointly processes time-domain and frequency-domain signal representations using transformer mechanisms. A transformer model is a deep learning architecture that uses self-attention mechanisms to process and learn relationships in sequential data. Our model employs a cosine similarity loss to extract domain-specific features and incorporates a transformer architecture in the latent space to weigh the importance of different features from the time and frequency domains. The transformer layer includes stacked self-attention and cross-attention modules to learn intra-domain and inter-domain dependencies, creating a more holistic signal representation. An attention-based fusion module intelligently combines the time and frequency-domain features using multi-head attention, enabling the network to learn the optimal feature for each domain in each input signal. Quantitative results demonstrate the impact of these architectural choices on overall performance, showing significant improvement after incorporating self and cross-attention modules and using complex attention fusion over simple weighted fusion. Our ongoing work will focus on addressing the limitations of threshold-based OSR methods by developing a novel generative framework that integrates a conditional diffusion probabilistic model (DPM). DPM is a generative framework that learns to synthesize complex data by reversing a gradual noising process using a neural network trained to denoise step-by-step. Our goal is to leverage the inherent strengths of DPMs for identifying unknown signals more robustly. One primary advantage of using a DPM is its ability to provide a more reliable anomaly score based on the model's reconstruction error, rather than relying solely on classifier confidence. Additionally, the iterative denoising process of DPMs makes this approach naturally resilient to low Signal-to-Noise Ratio (SNR) conditions, where traditional methods often fail. By implementing this generative framework, we aim to enhance the model's capability to accurately detect unknown waveforms and maintain performance in challenging environments.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2020

Comparison of time-frequency-analysis techniques applied in building energy data noise cancellation for building load forecasting: A real-building case study

Time-frequency analysis that disaggregates a signal in both time and frequency domain is an important supporting technique for building energy analysis such as noise cancellation in data-driven building load forecasting. There is a gap in the literature related to comparing various time–frequency-analysis techniques, especially discrete wavelet transform (DWT) and empirical mode decomposition (EMD), to guide the selection and tuning of time–frequency-analysis techniques in data-driven building load forecasting. This article provides a framework to conduct a comprehensive comparison among thirteen DWT/EMD techniques with various parameters in a load forecasting modeling task. A real campus building is used as a case study for illustration. The DWT and EMD techniques are also compared under various data-driven modeling algorithms for building load forecasting. The results in the case study show that the load forecasting models trained with noise-cancelled energy data have increased their accuracy to 9.6% on average tested under unseen data. This study also shows that the effectiveness of DWT/EMD techniques depends on the data-driven algorithms used for load forecasting modeling and the training data. Hence, DWT/EMD-based noise cancellation needs customized selection and tuning to optimize their performance for data-driven building load forecasting modeling.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Performance Evaluation of Vertical Federated Machine Learning Against Adversarial Threats on Wide-Area Control System: Preprint

Federated machine learning (FL) is gaining significant popularity to develop cybersecurity solutions in power grids because of its advanced capability to support decentralized data handing at local devices, its privacy preservation, and its low-bandwidth requirement. However, the evolving adversarial machine learning (AML) threats raise significant concerns for the cybersecurity of FL architectures. The FL-based split neural network (SplitNN) achieves high performance through the decentralized training of local neural network models while preserving data privacy across multiple entities. In this paper, we propose a methodology for evaluating the performance of a vertical FLbased anomaly detector against different types of AML attacks, including denial-of-service attacks, adversarial data injection attacks, and replay attacks on the trained local models deployed in the grid network. For a case study, we consider the modified IEEE 13-bus system, and we develop SplitNN-based binary and multiclass classification models to detect, locate, and identify different types of data integrity attacks on the volt-watt control with two pooling layers: maximum pooling and AvgPool. Our experimental results, computed through performance metrics, reveal that the severity of these AML attacks varies with the integrated pooling mechanism, the type of classification model, and the nature of the cyberattack. Further, the AML attacks negatively impacted the prediction time per sample for the pretrained SplitNN during the online testing.

adversarial threats↗
DOE OSTI2023

Molecular Simulation of Lithium Carbonate Reactive Vapor–Liquid Equilibria Using a Deep Potential Model

We developed a first-principles machine learning model for the reactive vapor–liquid phase behavior of molten Li 2 CO 3 . The model was trained on ab initio electronic density functional theory data using the Deep Potential (DP) methodology, and its accuracy was evaluated by comparing model predictions of density and viscosity to experimental measurements. Direct coexistence simulations with the DP model over time scales of tens of nanoseconds were used to observe equilibrium dissociation of Li 2 CO 3 into CO 2 residing primarily in the vapor phase and Li 2 O which remains dissolved in the liquid. The simulations covered a range of temperatures, overall system sizes, and vapor-to-liquid volume ratios. Results were analyzed in terms of the observed chemical composition of the liquid and vapor phases, product structure, and CO 2 partial pressures. In addition, we calculated equilibrium constants for the dissociation reaction by assuming ideal-solution behavior for the liquid. As expected on the basis of thermodynamic arguments and prior experiments for this system, the observed partial pressure of CO 2 in the gas phase depends on both the temperature and the ratio of vapor to liquid volumes, while the calculated equilibrium constants only depend on temperature. DP model predictions for the equilibrium constant of the reaction are generally consistent with the available experimental measurements. Furthermore, the present study establishes the validity of the DP methodology for the description of reactive, multiphase equilibria from first principles, with possible applications to many other systems of scientific and technological interest even in the absence of relevant experimental measurements.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Innovative dead-time correction and background subtraction for neutron multiplicity measurements using neural networks

Abstract The number of neutrons emitted from a nuclear reaction plays a crucial role in various fields, including nuclear theory, nuclear nonproliferation, nuclear energy and nuclear criticality safety. Accurate determination of neutron multiplicities requires the application of several corrections, with dead-time correction and background subtraction being particularly significant. These corrections become more challenging for neutron detectors with time-dependent neutron capture. In this work, we perform a comprehensive study of three existing methods used for dead-time correction and background subtraction in neutron detectors with time-dependent neutron capture. The methods were tested for dead-times in the range from 0 to 1 μs using a Monte Carlo model simulating the dead-time and background effects in the standard neutron multiplicity probability distribution of $$^{252}$$ 252 Cf. The previous methods showed larger than desired uncertainty or systematic trade off. Those uncertainties prompted the development of a novel approach using neural networks trained with data from Monte Carlo simulations. The Neural Network method enabled the correction of neutron multiplicity probabilities more accurately than the other methods with fractional errors smaller than 3% for multiplicities around the peak of $$^{252}$$ 252 Cf. A similar approach using neural networks could be applied to problems where the system being studied can be accurately simulated without having an accurate analytical description available. The neural network method presented in this paper can be easily expanded if multiplicities greater than 10 are expected.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

EpitopeVec: linear epitope prediction using deep protein sequence embeddings

Motivation: B-cell epitopes (BCEs) play a pivotal role in the development of peptide vaccines, immuno-diagnostic reagents and antibody production, and thus in infectious disease prevention and diagnostics in general. Experimental methods used to determine BCEs are costly and time-consuming. Therefore, it is essential to develop computational methods for the rapid identification of BCEs. Although several computational methods have been developed for this task, generalizability is still a major concern, where cross-testing of the classifiers trained and tested on different datasets has revealed accuracies of 51–53%. Results: We describe a new method called EpitopeVec, which uses a combination of residue properties, modified antigenicity scales, and protein language model-based representations (protein vectors) as features of peptides for linear BCE predictions. Extensive benchmarking of EpitopeVec and other state-of-the-art methods for linear BCE prediction on several large and small datasets, as well as cross-testing, demonstrated an improvement in the performance of EpitopeVec over other methods in terms of accuracy and area under the curve. As the predictive performance depended on the species origin of the respective antigens (viral, bacterial and eukaryotic), we also trained our method on a large viral dataset to create a dedicated linear viral BCE predictor with improved cross-testing performance.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

The edge-on Galaxies in the Pan-STARRS survey (EGIPS)

ABSTRACT We present a catalogue of 16 551 edge-on galaxies created using the public DR2 data of the Pan-STARRS survey. The catalogue covers the three quarters of the sky above Dec. = −30°. The galaxies were selected using a convolutional neural network, trained on a sample of edge-on galaxies identified earlier in the SDSS survey. This approach allows us to dramatically improve the quality of the candidate selection and perform a thorough visual inspection in a reasonable amount of time. The catalogue provides homogeneous information on astrometry, SExtractor photometry, and non-parametric morphological statistics of the galaxies. The photometry is reliably for objects in the 13.8–17.4 r-band magnitude range. According to the HyperLeda data base, redshifts are known for about 63 per cent of the galaxies in the catalogue. Our sample is well separated into the red sequence and blue cloud galaxy populations. The edge-on galaxies of the red sequence are systematically Δ(g − i) ≈ 0.1 mag redder than galaxies oriented at an arbitrary angle to the observer. We found a variation of the galaxy thickness with the galaxy colour. The red sequence galaxies are thicker than the galaxies of the blue cloud. In the blue cloud, on average, thinner galaxies turn out to be bluer. In the future, based on this catalogue it is intended to explore the three-dimensional structure of galaxies of different morphologies, as well as to study the scaling relations for discs and bulges.

Makarov, D. (ORCID:0000000191103221)↗
DOE OSTI2026

Temporal Convolutional Network Using Empirical Mode Decomposition to Detect Faults in Grid Connected Systems

Grid-connected power electronic systems require timely and reliable fault detection to prevent equipment damage and reduce downtime. This paper presents a forecasting-based anomaly detection pipeline that decomposes voltage and current measurements into intrinsic mode functions (IMFs) using empirical mode decomposition (EMD), then trains a causal temporal convolutional network (TCN) on normal-operation IMF data to predict short-horizon future dynamics. Deviations between forecasts and observations are summarized as reliability-weighted residual scores and thresholded per sensor using robust statistics with temporal persistence constraints to suppress false positives. To reduce runtime, EMD is performed on downsampled signals for detection, while raw-rate EMD is applied only within a short region of interest for high-frequency interpretability near detected events. Results on a simulated grid-connected converter system demonstrate that IMF-domain forecasting improves anomaly separability relative to raw-signal forecasting and provides interpretable evidence of faults across decomposition channels.

Sutton, Elizabeth [ORNL] (ORCID:0009000078885935)↗
DOE OSTI2022

Separating Sensor Anomalies From Process Anomalies in Data-Driven Anomaly Detection

Data-driven anomaly detection over time series data is studied from the perspective of separating data anomalies—corresponding to sensor failures—from process anomalies—that arise from equipment or operational failures. Herein, a semi-supervised approach is proposed that utilizes two predictive models trained on non-anomalous data using two different sensor groups as inputs, and a nested hypothesis test to reliably classify data or process anomalies. Conditions are derived on choice of sensor groups to guarantee reliable detection, and a case study is presented to demonstrate the proposed classification approach.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

CoordNet: Data Generation and Visualization Generation for Time-Varying Volumes via a Coordinate-Based Neural Network

Although deep learning has demonstrated its capability in solving diverse scientific visualization problems, it still lacks generalization power across different tasks. To address this challenge, we propose CoordNet, a single coordinate-based framework that tackles various tasks relevant to time-varying volumetric data visualization without modifying the network architecture. The core idea of our approach is to decompose diverse task inputs and outputs into a unified representation (i.e., coordinates and values) and learn a function from coordinates to their corresponding values. We achieve this goal using a residual block-based implicit neural representation architecture with periodic activation functions. We evaluate CoordNet on data generation (i.e., temporal super-resolution and spatial super-resolution) and visualization generation (i.e., view synthesis and ambient occlusion prediction) tasks using time-varying volumetric data sets of various characteristics. Here, the experimental results indicate that CoordNet achieves better quantitative and qualitative results than the state-of-the-art approaches across all the evaluated tasks. Source code and pre-trained models are available at https://github.com/stevenhan1991/CoordNet.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Surrogate Modeling of Nonlinear Dynamic Systems: A Comparative Study

Surrogate models play a vital role in overcoming the computational challenge in designing and analyzing nonlinear dynamic systems, especially in the presence of uncertainty. This paper presents a comparative study of different surrogate modeling techniques for nonlinear dynamic systems. Four surrogate modeling methods, namely, Gaussian process (GP) regression, a long short-term memory (LSTM) network, a convolutional neural network (CNN) with LSTM (CNN-LSTM), and a CNN with bidirectional LSTM (CNN-BLSTM), are studied and compared. All these model types can predict the future behavior of dynamic systems over long periods based on training data from relatively short periods. The multi-dimensional inputs of surrogate models are organized in a nonlinear autoregressive exogenous model (NARX) scheme to enable recursive prediction over long periods, where current predictions replace inputs from the previous time window. Three numerical examples, including one mathematical example and two nonlinear engineering analysis models, are used to compare the performance of the four surrogate modeling techniques. The results show that the GP-NARX surrogate model tends to have more stable performance than the other three deep learning (DL)-based methods for the three particular examples studied. The tuning effort of GP-NARX is also much lower than its deep learning-based counterparts.

42 ENGINEERING↗
DOE OSTI2021

Temperature Effects on Droplet Oscillation Decay with Application to Fuel Property Measurement

Observation of oscillation decay in droplets has been shown to be an effective approach in determining physical properties such as viscosity and surface tension for emerging biofuels using μl quantities. Herein this work extends the approach to higher temperatures relevant to fuel injection conditions for internal combustion engines. Experiments are conducted that use high-resolution strobed imaging of moving, heated, μm-sized, fuel droplets to capture shape oscillation decay through image processing and analysis. Two fuels are investigated, iso-butanol and a primary reference fuel (PRF 84), which is a mixture of iso-octane and n-heptane. A piezoelectric droplet generator is used to generate a continuous train of single droplets, which are given an initial perturbation and subsequently undergo damped oscillations, captured using strobed imaging. Surface tension and viscosity calculated at four different temperatures ranging from 30°C-55°C using the frequency and decay time associated with the fundamental mode are found to be within ~ 10% of reference values obtained from the literature. Complementary numerical simulations are performed that utilize a volume-of-fluid approach to track transient droplet oscillation phenomena along with heat and mass transfer in a 2D axisymmetric domain. Simulations, where droplet size and temperature can be independently varied, capture an expected decrease in oscillation frequency and increase in decay time, with increase in fuel temperature. The simulations are further used to study the relative contribution to deviations in surface tension and viscosity predictions due to heat and mass transfer from the droplet, as well as viscous effects violating the inviscid flow assumption in the droplet oscillation theory. Mass loss effects are found to be negligible. Temperature change due to heat transfer is found to have the next highest sensitivity, particularly for the more volatile PRF 84, which has a lower viscosity and associated Ohnesorge number. For isobutanol, which has a higher viscosity and Ohnesorge number, viscous effects contribute the most to deviation in fuel property predictions.

09 BIOMASS FUELS↗
DOE OSTI2021

Deep Learning Denoising Applied to Regional Distance Seismic Data in Utah

Seismic waveform data are generally contaminated by noise from various sources. Suppressing this noise effectively so that the remaining signal of interest can be successfully exploited remains a fundamental problem for the seismological community. To date, the most common noise suppression methods have been based on frequency filtering. These methods, however, are less effective when the signal of interest and noise share similar frequency bands. Inspired by source separation studies in the field of music information retrieval (Jansson et al., 2017) and a recent study in seismology (Zhu et al., 2019), we implemented a seismic denoising method that uses a trained deep convolutional neural network (CNN) model to decompose an input waveform into a signal of interest and noise. In our approach, the CNN provides a signal mask and a noise mask for an input signal. The short-time Fourier transform (STFT) of the estimated signal is obtained by multiplying the signal mask with the STFT of the input signal. To build and test the denoiser, we used carefully compiled signal and noise datasets of seismograms recorded by the University of Utah Seismograph Stations network. Results of test runs involving more than 9000 constructed waveforms suggest that on average the denoiser improves the signal-to-noise ratios (SNRs) by ~5 db, and that most of the recovered signal waveforms have high similarity with respect to the target waveforms (average correlation coefficient of ~0.80) and suffer little distortion. Application to real data suggests that our denoiser achieves on average a factor of up to ~2-5 improvement in SNR over band-pass filtering and can suppress many types of noise that band-pass filtering cannot. For individual waveforms, the improvement can be as high as ~15 db.

58 GEOSCIENCES↗
DOE OSTI2022

Evaluating Image Classification Deep Convolutional Neural Network Architectures for Remaining Useful Life Estimation of Turbofan Engines

Accurate estimation of the remaining useful life (RUL) is a key component of condition-based maintenance (CBM) and prognosis and health management (PHM). Data-based models for the estimation of RUL are of particular interest because expert knowledge of systems is not always available, and physical modeling is often not feasible. Additionally, using data-based models, which make decisions based on raw sensor data, allow features to be learned instead of manually determined. In this work, deep convolutional neural network (CNN) architectures are investigated for their ability to estimate the RUL of turbofan engines. To improve the accuracy of the models, CNN architectures, which have proven successful in image classification, are implemented and tested. Specifically, the blocks used in the Visual Geometry Group (VGG) architecture, inception modules used in the GoogLeNet architecture, and residual blocks used in the ResNet architecture are incorporated. To account for varying flight lengths, the input to the models is a window of time series data collected from the engine under test. Window locations at the climb, cruise, and descent stages are considered. To further improve the RUL estimations, multiple overlapping windows at each location are used. This increases the amount of training data available and is found to increase the accuracy of the resulting RUL estimations by averaging the estimates from all overlapping segments. The model is trained and tested using the new Commercial Modular Aero-Propulsion System Simulation (N-CMAPSS) data set, and high prognosis accuracy was achieved. Furthermore, this work expands on the model developed and used in the 2021 PHM Society Data Challenge, which received second place.

convolutional neural networks↗
DOE OSTI2020

Characterizing Acoustic Signals in the Buildup to a Magnet Quench

In superconducting magnets, the irreversible transition of a portion of the coils to the resistivestate is called a quench. Repeated quenches are very costly, but there is currently no way ofanticipating quenches before they arrive, and relatively little is understood theoretically about thebuildup to a quench. In this study, we examine the relationship between the energy of acoustic eventsin the magnet during training and the minimum quench energy (MQE), an analytical formula forthe minimum possible energy needed to sustain a quench. We nd a tendency for the ratio ofevent energy to MQE (henceforth known as the "energy ratio") to increase over time in some rampsbut not others. Moreover, there are occasional outlier events that are unusually strong, and thereappears to be no consistent threshold for a quench. We further uncover concerns about the validityof the acoustic data, including signicant variations in the relative strengths of an event in dierentsensors and a few inconsistencies between sensors concerning the arrival times of acoustic events. Weultimately conclude that, while the energy ratio does often increase over time, any further researchendeavors will require the data to be improved in many ways.

43 PARTICLE ACCELERATORS↗
DOE OSTI2023

Mitigating Extremist Maritime Threats to Radiological Material Transport Vessels

The 21st century has experienced a rise in the threat of global radicalism and extremist organizations, and there has been oft-reported interest from these groups in obtaining or exploiting radiological materials. The threat of extremists acquiring radiological materials while in transit or sabotaging a transport vessel carrying materials at sea is one that requires increased attention. Transport is already one of the most vulnerable times for any cargo but including the difficulties in securing a large ship on the open ocean makes oceanic transport of radiological materials a space of elevated vulnerability for sabotage, theft, or other attacks. The risks of violent extremist attacks on trade ships and trading routes are serious, as shipping routes sustain the global economy, but an attack on a radiological transport vessel could be a magnitude worse, impacting national and international security. While radicalists have largely remained on land in the past due to minimal maritime expertise or inability to project power out of their immediate vicinity, the world has witnessed past attacks on ships such as the USS Cole and the MV Limburg and it is likely only a matter of time before groups extend further into the sea and engage in more maritime campaigns against material transport vessels. This paper suggests methods for increasing safety and security on oceanic transport voyages through behavioral science principles and insider threat recognition training, as well as a better understanding of adversarial and extremist psychology. By providing transport personnel with the knowledge and support to identify and respond to unique maritime threats by extremists, these principles and training suggestions should advance and increase security on the high seas.

Kinney, Justin↗
DOE OSTI2023

Multifidelity Active Learning for Failure Estimation of TRISO Nuclear Fuel

The Tristructural isotropic (TRISO)-coated particle fuel is a robust nuclear fuel proposed to be used for multiple modern nuclear technologies. Therefore, characterizing its safety is vital for the reliable operation of nuclear technologies. However, the TRISO fuel failure probabilities are small and the computational model is time consuming to evaluate them using traditional Monte Carlo-type approaches. In the paper, we present a multifidelity active learning approach to efficiently estimate small failure probabilities given an expensive computational model. Active learning suggests the next best training set for optimal subsequent predictive performance and multifidelity modeling uses cheaper low-fidelity models to approximate the high-fidelity model output. After presenting the multifidelity active learning approach, we apply it to efficiently predict TRISO failure probability and make comparisons to the reference results.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗