Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Distance learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Directional response of several geometries for reactor-neutrino detectors

Here we have modeled six abstracted detector designs, with the goal of determining their ability to resolve the direction to an antineutrino source, including two for which we have operational data for validating our computer modeling and analytical processes. We have found that the most promising options, regardless of scale and range, have angular resolutions on the order of a few degrees, which is better than any yet achieved in practice by a factor of at least two. We examine and compare several approaches to detector geometry for their ability not only to detect the inverse beta decay (IBD) reaction, but also to determine the source direction of incident antineutrinos. The information from these detectors provides insight into reactor power and burning profile, which is especially useful in constraining the clandestine production of weapons material. In a live deployment, a nonproliferation detector must be able to isolate the subject reactor, possibly from a field of much-larger power reactors; directional sensitivity can help greatly with this task. We also discuss implications for using such detectors in longer-distance observation of reactors, from a few kilometers to hundreds of kilometers.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Delivering Effective Virtual Energy-Focused Trainings: Successful Strategies and Lessons Learned from the Virtual Cohort In-Plant Training Pilot

While there are always barriers to energy efficiency efforts, few challenges have been as severe as the global COVID-19 pandemic. Many manufacturers throughout the United States and the world have been trying to determine how to safely open and operate their plants. To minimize the number of people working within facilities and maximize the physical distance between workers, only essential facility engineers are allowed into plants to ensure proper operations. The Department of Energy’s Better Plants Program created In-Plant Trainings (INPLTs) to help partners develop in-house expertise in energy efficiency. Delivering INPLTs in the traditional in-person fashion is infeasible under these circumstances. To continue providing INPLTs during this difficult time, the Better Plants Program piloted Virtual Cohort In-Plant Trainings (VINPLTs) on wastewater treatment and ammonia industrial refrigeration systems from October 27 to November 19, 2020. This paper provides an overview of the pilot, then discusses successful strategies and lessons learned from this pilot for delivering effective virtual energy-focused trainings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Nuclear Safeguards: Feature Extraction for Machine Learning Enrichment Analysis of UF 6 Cylinders

With the increasing international interest in using nuclear material as sources of energy, comes the growing concern that we may see an increase in proliferation threats. Uranium hexafluoride (UF 6 ) is used in the nuclear fuel cycle for uranium enrichment. Inspectors from the International Atomic Energy Agency (IAEA) monitor the enrichment levels of UF 6 stored in transportation cylinders, to ensure the enrichments match that of a facility operator’s declarations. However, only a characteristic subset of UF 6 cylinders can be measured by inspectors from the IAEA during these inspections. In turn, the inspector may not identify a cylinder whose enrichment levels do not match the facility declarations. Therefore, our team attempts to develop a machine learning network that could determine the enrichment percentage of cylinders as they enter and exit facilities. The machine learning model must be robust against spectral variations due to factors that are internal and external to the UF 6 cylinder. Such factors include but are not limited to the speed and distance of the moving vehicle, cylinder type, cylinder orientation, and fill level. Many features in the spectral continuum can be used to identify and correct for some of these variations. As a consequence, the model must extract numerous features in the continuum. We investigate new approaches in continuum subtraction to verify enrichment percentage: interpolation and extrapolation of lines at the notable characteristic spectral peaks. It was determined that there was no clear answer on which method proved superior, therefore the decision was made to implement both new methods into the current codebase. We currently rely on synthetic training and testing data to analyze the results and fine tune our models but hope to test the system on measured data soon.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2025

Multiscale Characterization of Additive Manufacturing Components with Computed Tomography, 3D X-ray Microscopy, and Deep Learning

Additive manufacturing (AM) facilitates the creation of complex-geometry parts, driving advancements in lightweight aerospace components, high-efficiency engine cooling channels, and customized medical implants. However, ensuring the quality and reliability of AM parts remains challenging due to internal defects, surface irregularities, porosity, and residual trapped powder, which are often inaccessible to traditional inspection methods. Recent developments in X-ray computed tomography (XCT) and 3D X-ray microscopy (XRM), particularly systems equipped with resolution-at-a-distance (RaaD™) capabilities, enable high-resolution, non-destructive evaluation of AM components across multiple scales, from sub-micrometer to macroscopic levels. This paper explores modern XCT and XRM techniques for multiscale characterization of AM parts, focusing on their ability to detect and analyze defects such as porosity, cracks, inclusions, and surface roughness, while offering insights into defect formation mechanisms, material properties, and process-induced variations. The integration of deep learning (DL) frameworks, including Simurgh, DeepRecon, and DeepScout, enhances XCT/XRM workflows by reducing scan times, improving resolution recovery, and enabling accurate defect detection even with limited projection data. These DL-based methods overcome limitations of traditional reconstruction techniques, enabling faster, more reliable characterization of dense materials like Inconel 718 and novel alloys such as AlCe. Applications include process parameter optimization, high-throughput quality control, and multistage AM process evaluation, with DL-enhanced workflows accelerating analysis times from weeks to days. Correlative imaging approaches further validate XCT and XRM data against scanning electron microscopy (SEM) images of physically sectioned samples, confirming the accuracy of DL-based reconstructions and enabling comprehensive defect analysis. While challenges remain in generalizing DL models to diverse materials and imaging conditions, improvements in resolution, noise reduction, and defect detection highlight the transformative potential of these methods. This multiscale and correlative approach enables precise identification and correlation of microstructural features with the overall performance of AM components. By integrating advanced XCT, XRM, and DL techniques, this paper demonstrates a significant leap forward in AM characterization, offering valuable insights into the relationships between processing parameters, microstructure, and part performance, and driving innovations that enhance the quality and reliability of AM products for demanding industrial applications.

Additive manufacturing↗
DOE OSTI2025

LTAU-FF: Loss Trajectory Analysis for Uncertainty in atomistic Force Fields

Model ensembles are effective tools for estimating prediction uncertainty in deep learning atomistic force fields. However, their widespread adoption is hindered by high computational costs and overconfident error estimates. In this work, we address these challenges by leveraging distributions of per-sample errors obtained during training and employing a distance-based similarity search in the model latent space. Our method, which we call LTAU (Loss Trajectory Analysis for Uncertainty), efficiently estimates the full probability distribution function of errors for any test point using the logged training errors, achieving speeds that are 2–3 orders of magnitudes faster than typical ensemble methods and allowing it to be used for tasks where training or evaluating multiple models would be infeasible. We apply LTAU towards estimating parametric uncertainty in atomistic force fields (LTAU-FF), demonstrating that it produces well-calibrated confidence intervals and predicts errors that correlate strongly with the true errors for data near the training domain. Furthermore, we show that the errors predicted by LTAU-FF can be used in practical applications for detecting out-of-domain data, tuning model performance, and predicting failure during simulations. We believe that LTAU will be a valuable tool for uncertainty quantification in atomistic force fields and is a promising method that should be further explored in other domains of machine learning.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Gradient-Based Novelty Detection Boosted by Self-Supervised Binary Classification

Novelty detection aims to automatically identify out-of-distribution (OOD) data, without any prior knowledge of them. It is a critical step in data monitoring, behavior analysis and other applications, helping enable continual learning in the field. Conventional methods of OOD detection perform multi-variate analysis on an ensemble of data or features, and usually resort to the supervision with OOD data to improve the accuracy. In reality, such supervision is impractical as one cannot anticipate the anomalous data. In this paper, we propose a novel, self-supervised approach that does not rely on any pre-defined OOD data: (1) The new method evaluates the Mahalanobis distance of the gradients between the in-distribution and OOD data. (2) It is assisted by a self-supervised binary classifier to guide the label selection to generate the gradients, and maximize the Mahalanobis distance. In the evaluation with multiple datasets, such as CIFAR-10, CIFAR-100, SVHN and TinyImageNet, the proposed approach consistently outperforms state-of-the-art supervised and unsupervised methods in the area under the receiver operating characteristic (AUROC) and area under the precision-recall curve (AUPR) metrics. We further demonstrate that this detector is able to accurately learn one OOD class in continual learning.

Sun, Jingbo↗
DOE OSTI2023

Lightweight and effective tensor sensitivity for atomistic neural networks

Atomistic machine learning focuses on the creation of models that obey fundamental symmetries of atomistic configurations, such as permutation, translation, and rotation invariances. In many of these schemes, translation and rotation invariance are achieved by building on scalar invariants, e.g., distances between atom pairs. There is growing interest in molecular representations that work internally with higher rank rotational tensors, e.g., vector displacements between atoms, and tensor products thereof. Here, we present a framework for extending the Hierarchically Interacting Particle Neural Network (HIP-NN) with Tensor Sensitivity information (HIP-NN-TS) from each local atomic environment. Crucially, the method employs a weight tying strategy that allows direct incorporation of many-body information while adding very few model parameters. We show that HIP-NN-TS is more accurate than HIP-NN, with negligible increase in parameter count, for several datasets and network sizes. As the dataset becomes more complex, tensor sensitivities provide greater improvements to model accuracy. In particular, HIP-NN-TS achieves a record mean absolute error of 0.927 $\frac{\text{kcal}}{\text{mol}}$ for conformational energy variation on the challenging COMP6 benchmark, which includes a broad set of organic molecules. We also compare the computational performance of HIP-NN-TS to HIP-NN and other models in the literature.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Via Machinae 2.0 : Full-sky, model-agnostic search for stellar streams in Gaia DR2

ABSTRACT We present an update to Via Machinae, an automated stellar stream-finding algorithm based on the deep learning anomaly detector ANODE. Via Machinae identifies stellar streams within Gaia, using only angular positions, proper motions, and photometry, without reference to a model of the Milky Way potential for orbit integration or stellar distances. This new version, Via Machinae 2.0, includes many improvements and refinements to nearly every step of the algorithm, that altogether result in more robust and visually distinct stream candidates than our original formulation. In this work, we also provide a quantitative estimate of the false positive rate of Via Machinae 2.0 by applying it to a simulated Gaia-mock catalogue based on galaxia, a smooth model of the Milky Way that does not contain substructure or stellar streams. Finally, we perform the first full-sky search for stellar streams with Via Machinae 2.0, identifying 102 streams at high significance within the Gaia Data Release 2, of which only 10 have been previously identified. While follow-up observations for further confirmation are required, taking into account the false positive rate presented in this work, we expect approximately 90 of these stream candidates to correspond to real stellar structures.

Astronomy & Astrophysics↗
DOE OSTI2025

Enhancing Gaussian Process Surrogates for Optimization and Posterior Approximation via Random Exploration

This paper proposes novel noise-free Bayesian optimization strategies that rely on a random exploration step to enhance the accuracy of Gaussian process surrogate models. The new algorithms retain the ease of implementation of the classical GP-UCB algorithm, but the additional random exploration step accelerates their convergence, nearly achieving the optimal convergence rate. Furthermore, to facilitate Bayesian inference with intractable likelihoods, we propose to utilize optimization iterates for maximum a posteriori estimation to build a Gaussian process surrogate model for the unnormalized log-posterior density. We provide bounds for the Hellinger distance between the true and the approximate posterior distributions in terms of the number of design points. We demonstrate the effectiveness of our Bayesian optimization algorithms in nonconvex benchmark objective functions, in a machine learning hyperparameter tuning problem, and in a black-box engineering design problem. The effectiveness of our posterior approximation approach is demonstrated in two Bayesian inference problems for parameters of dynamical systems.

Bayesian inference↗
DOE OSTI2021

Evaluation of the PhaseNet Model Applied to the IMS Seismic Network

Producing a complete and accurate set of signal detections is essential for automatically building and characterizing seismic events of interest for nuclear explosion monitoring. Signal detection algorithms have been an area of research for decades, but still produce large quantities of false detections and misidentify real signals that must be detected to produce a complete global catalog of events of interest. Deep learning methods have shown promising capabilities in effectively characterizing seismic signals for complex tasks such as identifying phase arrival times. We use the PhaseNet model, a UNet-based Neural Network, trained on local distance data from northern California to predict seismic arrivals on data from the International Monitoring System (IMS) global network. We use an analyst-curated bulletin generated from this data set to compare the performance of PhaseNet to that of the Short-Term Average/Long-Term Average (STA/LTA) algorithm. We find that PhaseNet has the potential of outperforming traditional processing methods and recommend the training of a new model with the IMS data to achieve optimal performance.

58 GEOSCIENCES↗
DOE OSTI2022

Uncertainty Aware Deep Learning for Particle Accelerators

Standard deep learning models for classification and regression applications are ideal for capturing complex system dynamics. However, their predictions can be arbitrarily inaccurate when the input samples are not similar to the training data. Implementation of distance aware uncertainty estimation can be used to detect these scenarios and provide a level of confidence associated with their predictions. In this paper, we present results from using Deep Gaussian Process Approximation (DGPA) methods for errant beam prediction at Spallation Neutron Source (SNS) accelerator (classification) and we provide an uncertainty aware surrogate model for the Fermi National Accelerator Lab (FNAL) Booster Accelerator Complex (regression).

Rajput, Kishansingh↗
DOE OSTI2023

Exploring the Effects of Population and Employment Characteristics on Truck Flows: An Analysis of NextGen NHTS Origin-Destination Data

Truck transportation remains the dominant mode of US freight transportation because of its advantages, such as the flexibility of accessing pickup and drop-off points and faster delivery. Because of the massive freight volume transported by trucks, understanding the effects of population and employment characteristics on truck flows is critical for better transportation planning and investment decisions. The US Federal Highway Administration published a truck travel origin-destination data set as part of the Next Generation National Household Travel Survey program. This data set contains the total number of truck trips in 2020 within and between 583 predefined zones encompassing metropolitan and nonmetropolitan statistical areas within each state and Washington, DC. In this study, origin-destination-level truck trip flow data was augmented to include zone-level population and employment characteristics from the US Census Bureau. Census population and County Business Patterns data were included. The final data set was used to train a machine learning algorithm-based model, Extreme Gradient Boosting (XGBoost), where the target variable is the number of total truck trips. Shapley Additive ExPlanation (SHAP) was adopted to explain the model results. Results showed that the distance between the zones was the most important variable and had a nonlinear relationship with truck flows.

Uddin, Majbah↗
DOE OSTI2025

WaveDenoiser

We developed a robust deep learning model to effectively reduce background noise in the time domain from seismic waveforms. The deep learning model processes a 57-second three-component seismogram to predict and generate a denoised seismogram. The training was conducted using the benchmark STEAD dataset, which comprises globally distributed earthquake signals recorded at local distances ranging from 0 to 350 kilometers.

Chai, Chengping [Oak Ridge National Laboratory (OR↗
DOE OSTI2025

Predicting Dynamic-to-Static Correction Factor from Petrophysical Data and Chemostratigraphy using Unsupervised Machine Learning

Estimating static mechanical properties of stratigraphic layers is critical for optimizing subsurface engineering applications. To estimate dynamic-to-static correction factor F ds (static-to-dynamic Young’s modulus ratio) across the Caney shale interval in Oklahoma, USA, we integrated triaxial test measurements and petrophysical data, including well logs and X-ray fluorescence (XRF) using unsupervised machine learning (ML). We used a novel workflow that includes principal component analysis (PCA) to reduce data set dimensionality of well logs and XRF data sets—both separately and combined—creating three scenarios, and later applied inverse distance weighting (IDW) to derive F ds profiles for these scenarios. Furthermore, we applied K-means clustering on each scenario to predict depositional facies, and built a stiffness zonation profile through chemostratigraphic analysis of the terrigenous elements to validate the predicted F ds . The predicted F ds profile from each scenario using the PCA-IDW method was compared with the constant F ds approach from our previous study by calculating the root mean square error (RMSE). The combined data sets scenario yielded the lowest RMSE value of 0.113, while the RMSE values for the well logs and XRF scenarios were 0.131 and 0.129, respectively. In addition, the predicted F ds from the XRF scenario well-matched the stiffness zonation from the chemostratigraphic analysis that was built using the optimized K-means clustering of nine clusters for that scenario. These methods and findings offer a valuable tool for refining lithological classification and improving the F ds profile, potentially enhancing drilling and stimulation strategies for subsurface energy engineering applications.

clastic rock↗
DOE OSTI2023

Experimental Observations of the Topology of Convolutional Neural Network Activations

Topological data analysis (TDA) is a branch of computational mathematics, bridging algebraic topology and data science, that provides compact, noise-robust representations of complex structures. Deep neural networks (DNNs) learn millions of parameters associated with a series of transformations defined by the model architecture resulting in high-dimensional, difficult to interpret internal representations of input data. As DNNs become more ubiquitous across multiple sectors of our society, there is increasing recognition that mathematical methods are needed to aid analysts, researchers, and practitioners in understanding and interpreting how these models' internal representations relate to the final classification. In this paper we apply cutting edge techniques from TDA with the goal of gaining insight towards interpretability of convolutional neural networks used for image classification. We use two common TDA approaches to explore several methods for modeling hidden layer activations as high-dimensional point clouds, and provide experimental evidence that these point clouds capture valuable structural information about the model's process. First, we demonstrate that a distance metric based on persistent homology can be used to quantify meaningful differences between layers and discuss these distances in the broader context of existing representational similarity metrics for neural network interpretability. Second, we show that a mapper graph can provide semantic insight as to how these models organize hierarchical class knowledge at each layer. These observations demonstrate that TDA is a useful tool to help deep learning practitioners unlock the hidden structures of their models.

topological data analysis, deep learning↗
DOE OSTI2022

A machine learning approach to photometric metallicities of giant stars

ABSTRACT Despite the advances provided by large-scale photometric surveys, stellar features – such as metallicity – generally remain limited to spectroscopic observations often of bright, nearby low-extinction stars. To rectify this, we present a neural network approach for estimating the metallicities and distances of red giant stars with 8-band photometry and parallaxes from Gaia EDR3 and the 2MASS and WISE surveys. The algorithm accounts for uncertainties in the predictions arising from the range of possible outputs at each input and from the range of models compatible with the training set (through drop-out). A two-stage procedure is adopted where an initial network to estimate photoastrometric parallaxes is trained using a large sample of noisy parallax data from Gaia EDR3 and then a secondary network is trained using spectroscopic metallicities from the APOGEE and LAMOST surveys and an augmented feature space utilizing the first-stage parallax estimates. The algorithm produces metallicity predictions with an average uncertainty of $\pm 0.19\, \mathrm{dex}$. The methodology is applied to stars within the Galactic bar/bulge with particular focus on a sample of 1.69 million objects with Gaia radial velocities. We demonstrate the use and validity of our approach by inspecting both spatial and kinematic gradients with metallicity in the Galactic bar/bulge recovering previous results on the vertical metallicity gradient (−0.528 ± 0.002 dex kpc−1) and the vertex deviation of the bar ($-21.29\pm 2.74\, \mathrm{deg}$).

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

A safe reinforcement learning algorithm for supervisory control of power plants

Traditional control theory-based methods require tailored engineering for each system and constant fine-tuning. In power plant control, one often needs to obtain a precise representation of the system dynamics and carefully design the control scheme accordingly. Model-free Reinforcement learning (RL) has emerged as a promising solution for control tasks due to its ability to learn from trial-and-error interactions with the environment. It eliminates the need for explicitly modeling the environment’s dynamics, which is potentially inaccurate. However, the direct imposition of state constraints in power plant control raises challenges for standard RL methods. To address this, we propose a chance-constrained RL algorithm based on Proximal Policy Optimization for supervisory control. Our method employs Lagrangian relaxation to convert the constrained optimization problem into an unconstrained objective, where trainable Lagrange multipliers enforce the state constraints. In conclusion, our approach achieves the smallest distance of violation and violation rate in a load-follow maneuver for an advanced Nuclear Power Plant design.

constrained optimization↗