Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Machine Learning in Network Science”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Keeping LAMMPS cutting edge

Since its inception 30 years ago, LAMMPS has grown to be a world-class molecular dynamics code and a cornerstone of computational materials science research. This project aimed to keep LAMMPS at the forefront of molecular dynamics simulations by adapting LAMMPS to the latest developments in machine learning technology and hardware. Initially, the project set out to provide a unified implementation of active learning for efficient training data generation in LAMMPS, but the research trajectory pivoted to address more immediate and impactful opportunities. On the hardware side, recent record-breaking molecular dynamics simulations were developed on the Cerebras wafer-scale AI chip, and this project has developed an interface between LAMMPS and the hardware-specific molecular dynamics code to accelerate and simplify development and user adoption. On the software side, PyTorch’s Ahead-of-Time (AOT) compilation features promised increased performance for state-of-the-art equivariant neural network potentials, and this project laid the groundwork for their adoption in LAMMPS, resulting in a nearly 20x acceleration in extreme cases. Combined with a comprehensive benchmark study of LAMMPS across all current exascale systems, this project has reinforced LAMMPS’s role as a versatile, high-performance tool for current and future materials science applications.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Machine Learning Training for HOM reduction and Emittance Preservation in a TESLA-type Cryomodule at FAST

Low emittance electron beams are of high importance at facilities like the LCLS-II at SLAC. Emittance dilution effects due to off-axis beam transport for a TESLA-type cryomodule (CM) have been shown at the Fermilab Accelerator Science and Technology facility. The results showed the correlation between the electron beam-induced cavity high-order modes (HOMs) and submacropulse centroid slewing and oscillation downstream of the CM. Mitigation of emittance dilution can be achieved by reducing the HOM signals and the variances in the submacropulse beam positions downstream of the CM. Here we present a Machine Learning based optimization and model construction for HOM signal level reduction using Neural Networks and Gaussian Processes. To gather training data we performed experiments using single bunch and 50 bunch electron beams with charges up to 125 pC/b. We measured HOM signals of all cavities and beam position with a set of BPMs downstream of the CM. The beam trajectory was changed using V/H125 corrector set located upstream of the CM. The results presented here will inform the LCLS-II injector commissioning and will serve as a prototype for HOM reduction and emittance preservation.

43 PARTICLE ACCELERATORS↗
DOE OSTI2025

Improved loss functions for machine-learned atomic potentials

Machine learning (ML) has become an invaluable tool across a wide array of domains in science as researchers find new ways to leverage its predictive power. This is especially true in chemistry, where ML is used to fit chemical properties or desirable attributes to the local structure of molecules and materials. In the pursuit of greater accuracy, it is relatively simple to increase the size or complexity of such models, although this often requires simultaneously seeking larger datasets in order to both fit and interpret the larger number of parameters. However, it is equally important to assess the quality and relative importance of the data and how these factors impact the training process. We, therefore, investigate the impact of using different loss functions for training neural network potentials (NNPs), as the loss function defines the error and parameter gradients used to train the NNP. In particular, we test the mean-squared error and Huber loss functions and, using insight from these functions, derive a new loss function based on the Asinh function, which yields significant improvement in the accuracy and generality of NNPs. We show that by discounting/minimizing errors and anomalies in the optimization process, both the Huber and Asinh loss functions improve the training of NNPs, leading to a final potential with a greater effective dimensionality.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Cluster characterization in atom probe tomography: Machine learning using multiple summary functions

In this work, we develop a machine learning-based method to characterize intracluster concentration (ρ c ), background concentration (ρ b ), clustering radius (r̄), and radius dispersity (δ r ) in simulated atom probe tomography data using multiple spatial statistics summary functions to train a Bayesian regularized neural network. Here, we build upon previous work that utilized Ripley’s K-function by incorporating additional features from nearest-neighbor spatial statistics summary functions to better characterize concentration-based metrics. The addition of nearest-neighbor based features allows for highly accurate estimates of ρ c and ρ b , both with 90% of the predictions within 4.0% of the real value; the root-mean-square errors are reduced by 81.5% and 92.8% from predictions using only K-function based features, respectively. Additionally, including these nearest-neighbor based features improves the ability to differentiate between r̄ and δ r .

36 MATERIALS SCIENCE↗
DOE OSTI2022

Machine learning analysis reveals relationship between pomacentrid calls and environmental cues

Sound production rates of fishes can be used as an indicator for coral reef health, providing an opportunity to utilize long-term acoustic recordings to assess environmental change. As acoustic datasets become more common, computational techniques need to be developed to facilitate analysis of the massive data files produced by long-term monitoring. Machine learning techniques demonstrate an advantage in the identification of fish sounds over manual sampling approaches. Here we evaluated the ability of convolutional neural networks to identify and monitor call patterns for pomacentrids (damselfishes) in a tropical reef region of the western Pacific. A stationary hydrophone was deployed for 39 mo (2014-2018) in the National Park of American Samoa to continuously record the local marine acoustic environment. A neural network was trained—achieving 94% identification accuracy of pomacentrids—to demonstrate the applicability of machine learning in fish acoustics and ecology. The distribution of sound production was found to vary on diel and interannual timescales. Additionally, the distribution of sound production was correlated with wind speed, water temperature, tidal amplitude, and sound pressure level. This research has broad implications for state-of-the-art acoustic analysis and promises to be an efficient, scalable asset for ecological research, environmental monitoring, and conservation planning.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Throughput Estimation of Data Transport Networks From Digital Twin Measurements

Digital twins of networked infrastructures, known as Virtual Infrastructure Twins (VITs), are increasingly used for software development, pre-deployment testing, and design space exploration. While VITs avoid the costs and potential disruptions associated with experiments on operational networks, their throughput measurements are typically not sufficiently accurate for performance profiling of wide-area networks that they emulate. Here, machine learning (ML) methods are developed to transform these inaccurate VIT network throughput measurements to closely match in peak and overall profile of those from a physical testbed or production network. First, a micro kernel network reflecting a physical network is utilized to collect one-time measurements on a host to support this ML transformation. Then, a generic multi-modal ML method is developed to learn a map that transforms measurements from subsequent VITs on the same host to match past, current and follow-on testbed and cloud networks. ML generalization equations are derived to establish its correctness and probabilistically guarantee its generalization accuracy. Experimental results are presented for a variety of VIT hosts with target testbed and cloud networks; they include a case study of a four-site science ecosystem wherein inaccurate convex VIT measurement profiles are transformed into accurate concave profiles of target networks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Learning Coagulation Processes With Combinatorial Neural Networks

Abstract Simulating the evolution of a coagulating aerosol or cloud of droplets in a key problem in atmospheric science. We present a proof of concept for modeling coagulation processes using a novel combinatorial neural network (CombNN) architecture. Using two types of data from a high‐detail particle‐resolved aerosol simulation, we show that CombNN models outperform standard neural networks and are competitive in accuracy with traditional state‐of‐the‐art sectional models. These CombNN models could have application in learning coarse‐grained coagulation models for multi‐species aerosols and for learning coagulation models from observed size‐distribution data.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Size-Dependent Nucleation in Crystal Phase Transition from Machine Learning Metadynamics

In this Letter, we present a framework that combines machine learning potential (MLP) and metadynamics to investigate solid-solid phase transition. Here, based on the spectral descriptors and neural networks regression, we develop a scalable MLP model to warrant an accurate interpolation of the energy surface where two phases coexist. Applying it to the simulation of B4–B1 phase transition of GaN under 50 GPa with different model sizes, we observe sequential change of the phase transition mechanism from collective modes to nucleation and growths. When the size is at or below 128 000 atoms, the nucleation and growth appear to follow a preferred direction. At larger sizes, the nuclei occur at multiple sites simultaneously and grow to microstructures by passing the critical size. The observed change of the atomistic mechanism manifests the importance of statistical sampling with large system size in phase transition modeling.

36 MATERIALS SCIENCE↗
DOE OSTI2022

High-precision inversion of dynamic radiography using hydrodynamic features

While radiography is routinely used to probe complex, evolving density fields in research areas ranging from materials science to shock physics to inertial confinement fusion and other national security applications, complications resulting from noise, scatter, complex beam dynamics, etc. prevent current methods of reconstructing density from being accurate enough to identify the underlying physics with sufficient confidence. In this work, we show that using only features that are robustly identifiable in radiographs and combining them with the underlying hydrodynamic equations of motion using a machine learning approach of a conditional generative adversarial network (cGAN) provides a new and effective approach to determine density fields from a dynamic sequence of radiographs. In particular, we demonstrate the ability of this method to outperform a traditional, direct radiograph to density reconstruction in the presence of scatter, even when relatively small amounts of scatter are present. Our experiments on synthetic data show that the approach can produce high quality, robust reconstructions. We also show that the distance (in feature space) between a testing radiograph and the training set can serve as a diagnostic of the accuracy of the reconstruction.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2026

ZENN: A thermodynamics-inspired computational framework for heterogeneous data–driven modeling

Traditional entropy-based methods—such as cross-entropy loss in classification problems—have long been essential tools for representing the information uncertainty and physical disorder in data and for developing artificial intelligence algorithms. However, the rapid growth of data across various domains has introduced new challenges, particularly the integration of heterogeneous datasets with intrinsic disparities. To address this, we introduce a zentropy-enhanced neural network (ZENN), extending zentropy theory into the data science domain via intrinsic entropy, enabling more effective learning from heterogeneous data sources. ZENN simultaneously learns both energy and intrinsic entropy components, capturing the underlying structure of multisource data. To support this, we redesign the neural network architecture to better reflect the intrinsic properties and variability inherent in diverse datasets. We demonstrate the effectiveness of ZENN on classification tasks and energy landscape reconstructions, showing its superior generalization capabilities and robustness-particularly in predicting high-order derivatives. In image and text classification tasks, ZENN demonstrates superior generalization by introducing a learnable temperature variable that models latent multisource heterogeneity, allowing it to surpass state-of-the-art models on CIFAR-10/100, BBC News, and AG News. As a practical application in materials science, we employ ZENN to reconstruct the Helmholtz energy landscape of Fe3Pt using data generated from density functional theory and capture key material behaviors, including negative thermal expansion and the critical point in the temperature–pressure space. Overall, this work presents a zentropy-grounded framework for data-driven machine learning, positioning ZENN as a versatile and robust approach for scientific problems involving complex, heterogeneous datasets.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Single Bimodular Sensor for Differentiated Detection of Multiple Oxidative Gases

Semiconductive metal-oxide sensors suffer from cross-sensitivities under mixed chemical condition, specifically upon mixture of multiple oxidative or reductive gases. Herein, a single bimodular sensor is demonstrated for smart differentiation of multiple oxidative analytes by relating the resistance-metric mode to impedance-metric mode. The sensor construct based on ZnO nanorods readily outputs three response datasets upon exposure of oxidative-gas mixture including O 2 , SO 2 , and NO 2 , the resistance, real part impedance, and imaginary part impedance. The differentiative and correlated nature between these response signals allows such a single sensor platform to differentiate these oxidative gases accurately and robustly. Linear and non-linear decision boundaries are established over a large gas-concentration range from 2 ppm to 3% through a combination of principal component analysis and artificial neural network training. A facile user interface is demonstrated for recognition and measurement of unknown gas analytes, with the error of the predicted analyte-concentration as low as 2%.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Near‐Cloud Aerosol Retrieval Using Machine Learning Techniques, and Implied Direct Radiative Effects

Abstract There is a lack of satellite‐based aerosol retrievals in the vicinity of low‐topped clouds, mainly because reflectance from aerosols is overwhelmed by three‐dimensional cloud radiative effects. To account for cloud radiative effects on reflectance observations, we develop a Convolutional Neural Network and retrieve aerosol optical depth (AOD) with 100–500 m horizontal resolution for all cloud‐free regions regardless of their distances to clouds. The retrieval uncertainty is 0.01 + 5%AOD, and the mean bias is approximately −2%. In an application to satellite observations, aerosol hygroscopic growth due to humidification near clouds enhances AOD by 100% in regions within 1 km of cloud edges. The humidification effect leads to an overall 55% increase in the clear‐sky aerosol direct radiative effect. Although this increase is based on a case study, it highlights the importance of aerosol retrievals in near‐cloud regions, and the need to incorporate the humidification effect in radiative forcing estimates.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Physics-guided Machine Learning: from Supervised Deep Networks to Unsupervised Lightweight Models [Slides]

Machine learning yields great potentials in improving imaging performance (i.e., accuracy and efficiency). The incorporation of governing equation will improve generalization and alleviate label scarcity. Employ physical properties can reduce model complexity and significantly save training cost without compromising accuracy. Combining SciML imaging and edge computing would allow broader applications in energy, medicine, and other domains.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Spectral Data Fusion From Handheld Laser-Induced Breakdown Spectroscopy (LIBS) and X-ray Fluorescence (XRF) Analyzers for Improved Detection of Cerium in a Simulated Dispersal Accident

Here, this work implements a mid-level data fusion methodology on spectral data from handheld X-ray fluorescence and laser-induced breakdown spectroscopy analyzers to quantify plutonium surrogate (CeO 2 ) contamination in soil samples for the first time. Spectral data from each analyzer were used independently to train supervised machine learning regressions to predict Ce concentration. Fused features from both data sets were then used to train the same models, comparing prediction performance by evaluating model precision and sensitivity. Fusing principal component scores from the two sensors yielded an order of magnitude improvement in precision and sensitivity of predictions made with an artificial neural network, compared to predictions made by models trained on independent sensor data. As a result, a boosted ensemble trained on the fused spectral features yielded an ideal predictor with root-mean-squared error on the order of 10 –6 and calculated limit of detection order 10 –5 wt %.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

The structure and migration of twin boundaries in tetragonal β -Sn: An application of machine learning based interatomic potentials

Although atomistic simulations have contributed significantly to our understanding of twin boundary structure and migration in metals and alloys with hexagonal close packed (HCP) crystal structures, few direct atomistic studies of twinning have been conducted for other types of low symmetry materials, in large part due to a lack of reliable interatomic potentials. In this work, we examine twin boundary structure and migration in a tetragonal material, β-Sn, comparing high resolution Transmission Electron Microscopy (TEM) images of deformation twins in β-Sn to the results of direct atomistic simulations using multiple interatomic potentials. ML-based potentials developed in this work are found to give results consistent with our experimental data, revealing faceted twin boundary structures formed by the nucleation and motion of twinning disconnections. We use bicrystallographic methods in combination with atomistic simulations to analyze the structure, energy and shear coupled migration of observed twin facets in β-Sn. In analogy to Prismatic-Basal (PB/BP) interfaces in HCP metals, we discover low energy asymmetric Prismatic-A-plane (PA/AP) interfaces important to twin growth in β-Sn. Finally, a Moment Tensor Potential (MTP) and Rapid Artificial Neural Network (RANN) interatomic potential suitable for studying twinning and phase transformations in Sn are made publicly available as part of this work.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Confusion-Driven Machine Learning of Structural Phases of a Flexible, Magnetic Stockmayer Polymer

We use a semisupervised, neural-network-based machine learning technique, the confusion method, to investigate structural transitions in magnetic polymers, which we model as chains of magnetic colloidal nanoparticles characterized by dipole–dipole and Lennard-Jones interactions. As input for the neural network, we use the particle positions and magnetic dipole moments of equilibrium polymer configurations, which we generate via replica-exchange Wang–Landau simulations. We demonstrate that by measuring the classification accuracy of neural networks, we can effectively identify transition points between multiple structural phases without any prior knowledge of their existence or location. We corroborate our findings by investigating relevant conventional order parameters. Our study furthermore examines previously unexplored low-temperature regions of the phase diagram, where we find new structural transitions between highly ordered helicoidal polymer configurations.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Advancing the Limits of InSAR to Detect Crustal Displacement from Low-Magnitude Earthquakes through Deep Learning

Detecting surface deformation associated with low-magnitude (M w ≤ 5) seismicity using interferometric synthetic aperture radar (InSAR) is challenging due to the subtlety of the signal and the often challenging imaging environments. However, low-magnitude earthquakes are potential precursors to larger seismic events, and thus characterizing the crustal displacement associated with them is crucial for regional seismic hazard assessment. We combine InSAR time-series techniques with a Deep Learning (DL) autoencoder denoiser to detect the magnitude and extent of crustal deformation from the M w = 3.4 Gallina, New Mexico earthquake that occurred on 30 July 2020. Although InSAR alone cannot detect event-related deformation from such a low-magnitude seismic event, application of the DL method reveals maximum displacements as small as (±2.5 mm) in the vicinity of both the fault and earthquake epicenter without prior knowledge of the fault system. This finding improves small-scale displacement discernment with InSAR by an order of magnitude relative to previous studies. We additionally estimate best-fitting fault parameters associated with the observed deformation. The application of the DL technique unlocks the potential for low-magnitude earthquake studies, providing new insights into local fault geometries and potential risks from higher-magnitude earthquakes. This technique also permits low-magnitude event monitoring in areas where seismic networks are sparse, allowing for the possibility of global fault deformation monitoring.

58 GEOSCIENCES↗
DOE OSTI2021

DeepShadows: Separating low surface brightness galaxies from artifacts using deep learning

Searches for low-surface-brightness galaxies (LSBGs) in galaxy surveys are plagued by the presence of a large number of artifacts (e.g., objects blended in the diffuse light from stars and galaxies, Galactic cirrus, star-forming regions in the arms of spiral galaxies, etc.) that have to be rejected through time consuming visual inspection. In future surveys, which are expected to collect hundreds of petabytes of data and detect billions of objects, such an approach will not be feasible. We investigate the use of convolutional neural networks (CNNs) for the problem of separating LSBGs from artifacts in survey images. We take advantage of the fact that we have available a large number of labeled LSBGs and artifacts from the Dark Energy Survey, that we use to train, validate, and test a CNN model. That model, which we call DeepShadows , achieves a test accuracy of 92.0%, a significant improvement relative to feature-based machine learning models. We also study the ability to use transfer learning to adapt this model to classify objects from the deeper Hyper-Suprime-Cam survey, and we show that after the model is retrained on a very small sample from the new survey, it can reach an accuracy of 87.6%. Finally, these results demonstrate that CNNs offer a very promising path in the quest to study the low-surface-brightness universe.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗