Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Machine learning in physics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,297 records · Page 72
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Simulations of Hypervelocity Impact Plasmas

The space environment is fraught with complex plasmas spanning a wide range of densities and temperatures. Much of space plasma research has focused on large-scale changes in the ambient plasma and fields from the Sun to the Earth’s atmosphere, driven primarily by the solar wind. Yet one particular type of space plasma, which forms from a hypervelocity impact (HVI), remains poorly understood. Hypervelocity impactors include both meteoroids and space debris. Meteoroids are naturally occurring objects in space that travel between 11 and 72.8 km/s and originate primarily from comets and asteroids. In contrast, space debris are human-made objects with speeds typically < 11 km/s. Hypervelocity impactors routinely hit spacecraft, yet the physics behind the formation of the plasma and the dynamics of its expansion remain largely unknown. The complexity of this phenomenon necessitates a research approach that includes both experimental studies and numerical simulation in order to understand the underlying physical processes that occur upon formation and expansion of the impact plasma. Our research has focused on providing a comprehensive understanding of plasma generated by hypervelocity impacts by meteoroids and space debris on spacecraft in order to characterize the behavior of the expanding plasma and its interactions with the ambient environment. Previously. we conducted experimental campaigns at a dust accelerator facility that can accelerate particles up to 60 km/s, which is representative of meteoroid speeds, and at a light gas gun facility that can accelerate larger projectiles up to 7 km/s, which is representative of orbital debris. The experiments included plasma, optical and radio frequency (RF) sensors in order to understand the dynamics and associated RF emission resulting from hypervelocity plasmas. For this research, we developed and applied machine learning algorithms to identify which type of impactor would produce RF and physics-based models to determine the source of the RF. This was a one-year research program that resulted in 2 refereed journal publications (uploaded separately).

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Machine learning feature analysis illuminates disparity between E3SM climate models and observed climate change

In September of 2020, Arctic sea ice extent was the second-lowest on record. State of the art climate prediction uses Earth system models (ESMs), driven by systems of differential equations representing the laws of physics. Previously, these models have tended to underestimate Arctic sea ice loss. The issue is grave because accurate modeling is critical for economic, ecological, and geopolitical planning. We use machine learning techniques, including random forest regression and Gini importance, to show that the Energy Exascale Earth System Model (E3SM) relies too heavily on just one of the ten chosen climatological quantities to predict September sea ice averages. Furthermore, E3SM gives too much importance to six of those quantities when compared to observed data. Finally, identifying the features that climate models incorrectly rely on should allow climatologists to improve prediction accuracy.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Machine learning accelerated discrete element modeling of granular flows

Granular flows are widely encountered in many industrial processes and natural phenomena. Discrete Element Modeling (DEM) is a useful tool for understanding and troubleshooting devices, which handle granular materials. However, its applicability is significantly limited by the huge computational cost associated with detecting and computing collisions. In this research, the computation speed of DEM was accelerated by orders of magnitude using a convolutional neural network to replace the direct calculation of particle-particle and particle-boundary collisions. The MFiX software was used to generate the training and testing dataset. Additionally, a GPU accelerated TensorFlow model was used to train the neural network and test the results. The model fluctuations caused by different training steps were reduced with a multi-scale loss function. The accuracy was improved with more frames within one training step. The modeling of a rotating drum and a hopper demonstrated the accuracy and efficiency of this machine learning accelerated DEM in the simulation of granular flows.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Detecting depinning and nonequilibrium transitions with unsupervised machine learning

Using numerical simulations of a model disk system, we demonstrate that a machine learning generated order-parameter-like measure can detect depinning transitions and different dynamic flow phases in systems driven far from equilibrium. Furthermore, we specifically consider monodisperse passive disks with short range interactions undergoing a depinning phase transition when driven over quenched disorder. The machine learning derived order-parameter-like measure identifies the depinning transition as well as different dynamical regimes, such as the transition from a flowing liquid to a phase separated liquid-solid state that is not readily distinguished with traditional measures such as velocity-force curves or Voronoi tessellation. The order-parameter-like measure also shows markedly distinct behavior in the limit of high density where jamming effects occur. Our results should be general to the broad class of particle-based systems that exhibit depinning transitions and nonequilibrium phase transitions.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2023

KamNet: An integrated spatiotemporal deep neural network for rare event searches in KamLAND-Zen

Rare event searches allow us to search for new physics at energy scales inaccessible with other means by leveraging specialized large-mass detectors. Machine learning provides a new tool to maximize the information provided by these detectors. The information is sparse, which forces these algorithms to start from the lowest level data and exploit all symmetries in the detector to produce results. In this work we present KamNet, which harnesses breakthroughs in geometric deep learning and spatiotemporal data analysis to maximize the physics reach of KamLAND-Zen, a kiloton scale spherical liquid scintillator detector searching for 0⁢νβ⁢β. Using a simplified background model for KamLAND, we show that KamNet outperforms a conventional convolutional neural network (CNN) on benchmarking Monte Carlo simulations with an increasing level of robustness. Using simulated data, we then demonstrate KamNet's ability to increase KamLAND-Zen's sensitivity to 0ν⁢ββ and 2⁢ν⁢β⁢β decay to excited states. A key component of this work is the addition of an attention mechanism to elucidate the underlying physics KamNet is using for the background rejection.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Deep learning symmetries and their Lie groups, algebras, and subalgebras from first principles

Abstract We design a deep-learning algorithm for the discovery and identification of the continuous group of symmetries present in a labeled dataset. We use fully connected neural networks to model the symmetry transformations and the corresponding generators. The constructed loss functions ensure that the applied transformations are symmetries and the corresponding set of generators forms a closed (sub)algebra. Our procedure is validated with several examples illustrating different types of conserved quantities preserved by symmetry. In the process of deriving the full set of symmetries, we analyze the complete subgroup structure of the rotation groups SO (2), SO (3), and SO (4), and of the Lorentz group S O ( 1 , 3 ) . Other examples include squeeze mapping, piecewise discontinuous labels, and SO (10), demonstrating that our method is completely general, with many possible applications in physics and data science. Our study also opens the door for using a machine learning approach in the mathematical study of Lie groups and their properties.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Accelerating accurate simulations of calorimeter showers with normalizing flows and probability density distillation

Recently, we introduced caloflow, a high-fidelity generative model for GEANT4 calorimeter shower emulation based on normalizing flows. Here, we present caloflow v2, an improvement on our original framework that speeds up shower generation by a further factor of 500 relative to the original. The improvement is based on a technique called probability density distillation, originally developed for speech synthesis in the machine learning literature, and which we develop further by introducing a set of powerful new loss terms. We demonstrate that caloflow v2 preserves the same high fidelity as the original using qualitative (average images, histograms of high-level features) and quantitative (classifier metric between geant4 and generated samples) measures. The result is a generative model for calorimeter showers that matches the state of the art in speed (a factor of 10 4 faster than GEANT4) and greatly surpasses the previous state of the art in fidelity.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2026

Machine learning-enhanced MPC for demand flexibility in small commercial buildings: An experimental study

Small- and medium-sized commercial buildings (SMCBs) represent the majority of U.S. commercial building stock and a significant share of peak electricity demand, yet they often lack centralized building automation systems, representing a significant untapped resource for urban energy management. This infrastructure gap makes advanced control implementation challenging, limiting the potential for widespread demand flexibility. Model Predictive Control (MPC) has shown strong potential for load shifting, peak demand reduction, and cost savings, but its effectiveness is hindered by unmeasured disturbances such as internal heat gains. This paper presents a Hybrid MPC framework that integrates a physics-based gray-box building thermal model, identified using a lumped disturbance (LD) approach, with a machine learning (ML) model for forecasting unmeasured disturbances. The hybrid approach is designed for buildings with multiple individually controlled heat pump and thermostat pairs, common in SMCBs, and aims to optimize coordinated scheduling of multiple heat pumps under dynamic electricity pricing while respecting comfort constraints. The methodology is validated through both simulations of case study buildings and experimental studies at a highly-instrumented test facility. Simulation results show that the Hybrid MPC achieves substantial load shifting and peak demand reduction, approaching the performance of an ideal MPC with perfect disturbance knowledge, and outperforming a conventional MPC without disturbance forecasting. In experiments, the Hybrid MPC reduced daily HVAC energy costs by 8.7%, peak-price time load (load shifting) by 41.7%, and peak demand by 29.2% compared to baseline control, demonstrating comparable benefits to the 11.6% cost savings, 42.9% load shifting, and 23.2% peak reduction of the ideal MPC. These results demonstrate that the proposed hybrid modeling approach can significantly improve MPC performance in real-world SMCB applications without requiring additional disturbance measurements.

Demand Flexibility↗
DOE OSTI2024

Machine learning aided line intensity ratio method for helium–hydrogen mixed recombining plasmas

The helium line intensity ratio (LIR) with the help of a collisional radiative (CR) model has long been used to measure the electron density, n e , and temperature, T e , and its potential and limitations for fusion applications have been discussed. However, it has been reported that the CR model approach leads to deviations in helium–hydrogen mixed plasmas and/or recombining plasmas. In this study, a machine learning (ML) aided LIR method is used to measure n e and T e from spectroscopic data of helium–hydrogen mixed recombining plasmas in the divertor simulator Magnum-PSI. To analyze mixed plasmas, which have more complex spectral shapes, the spectroscopy data were used directly for training instead of separating the intensities of each line. Finally, it is shown that the ML approach can provide a robust and simpler analysis method to deduce n e and T e from the visible emissions in helium–hydrogen mixed plasmas.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

An implementation of neural simulation-based inference for parameter estimation in ATLAS

Neural simulation-based inference (NSBI) is a powerful class of machine-learning-based methods for statistical inference that naturally handles high-dimensional parameter estimation without the need to bin data into low-dimensional summary histograms. Such methods are promising for a range of measurements, including at the Large Hadron Collider, where no single observable may be optimal to scan over the entire theoretical phase space under consideration, or where binning data into histograms could result in a loss of sensitivity. This work develops a NSBI framework for statistical inference, using neural networks to estimate probability density ratios, which enables the application to a full-scale analysis. It incorporates a large number of systematic uncertainties, quantifies the uncertainty due to the finite number of events in training samples, develops a method to construct confidence intervals, and demonstrates a series of intermediate diagnostic checks that can be performed to validate the robustness of the method. As an example, the power and feasibility of the method are assessed on simulated data for a simplified version of an off-shell Higgs boson couplings measurement in the four-lepton final states. This approach represents an extension to the standard statistical methodology used by the experiments at the Large Hadron Collider, and can benefit many physics analyses.

frequentist statistics↗
DOE OSTI2025

Inferring the Isotropic-Nematic Phase Transition with Generative Machine Learning

Generative machine learning models are capable of learning the phase behavior in condensed matter systems such as the Ising model. We utilize a score-based modeling procedure called thermodynamic maps to describe the isotropic-nematic phase transition in a melt of Gay-Berne ellipsoids. When trained on samples from a single temperature on either side of the phase transition, this generative machine learning approach infers effectively the nematic order parameter at intermediate temperatures. Furthermore, these results demonstrate score-based models’ ability to learn the physics of a nontrivial liquid crystal phase transition.

Critical exponents↗
DOE OSTI2022

Observational process data analytics using causal inference

Voluminous process data are available with the paradigm shift toward smart manufacturing. However, most historical data are observational, containing noncausal correlations due to confounders and mediators. Estimating causal effects from observational data remains a bottleneck in leveraging them for active applications such as optimization and control. Further, this work aims to introduce a causal modeling framework for analyzing observational process data and extracting quantitative causal information. We demonstrate a real-world application in steel manufacturing where causal inference is used to analyze observational production data and improve the steelmaking process. Additionally, we propose a novel formulation for identifying critical process parameters from observational data, where causal inference is combined with variance-based methods to estimate corresponding risks of interventions to the manufacturing system. The proposed methods are compared with statistical ones to illustrate that causally interpreting statistical correlation leads to problematic results, while the provided workflow generates satisfactory strategies for process improvement.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Risk-Aware Framework Development for Disruption Prediction: Alcator C-Mod and DIII-D Survival Analysis

Abstract Survival regression models can achieve longer warning times at similar receiver operating characteristic performance than previously investigated models. Survival regression models are also shown to predict the time until a disruption will occur with lower error than other predictors. Time-to-event predictions from time-series data can be obtained with a survival analysis statistical framework, and there have been many tools developed for this task which we aim to apply to disruption prediction. Using the open-source Auton-Survival package we have implemented disruption predictors with the survival regression models Cox Proportional Hazards, Deep Cox Proportional Hazards, and Deep Survival Machines. To compare with previous work, we also include predictors using a Random Forest binary classifier, and a conditional Kaplan-Meier formalism. We benchmarked the performance of these five predictors using experimental data from the Alcator C-Mod and DIII-D tokamaks by simulating alarms on each individual shot. We find that developing machine-relevant metrics to evaluate models is an important area for future work. While this study finds cases where disruptive conditions are not predicted, there are instances where the desired outcome is produced. Giving the plasma control system the expected time-to-disruption will allow it to determine the optimal actuator response in real time to minimize risk of damage to the device.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Converting sWeights to probabilities with density ratios

The use of machine learning approaches continues to have many benefits in experimental nuclear and particle physics. One common issue is generating training data which is sufficiently realistic to give reliable results. Here we advocate using real experimental data as the source of training data and demonstrate how one might subtract background contributions through the use of probabilistic weights which can be readily applied to training data. The sPlot formalism is a common tool used to isolate distributions from different sources. However, the negative sWeights produced by the sPlot technique can cause training problems and poor predictive power. This article demonstrates how density ratio estimation can be applied to convert sWeights to event probabilities, which we call drWeights. The drWeights can then be applied to produce the distributions of interest and are consistent with direct use of the sWeights. This article will also show how decision trees are particularly well suited to convert sWeights, with the benefit of fast prediction rates and adaptability to aspects of experimental data such as the data sample size and proportions of different event sources. We also show that a density ratio product approach in which the initial drWeights are reweighted by an additional converter gives substantially better results.

Glazier, Derek I. [Univ. of Glasgow, Scotland (Uni↗
DOE OSTI2022

Z-Contrast Enhancement in Au–Pt Nanocatalysts by Correlative X-ray Absorption Spectroscopy and Electron Microscopy: Implications for Composition Determination

The properties of bimetallic nanoparticles (BNPs) vary widely as a function of their composition and size distributions. X-ray absorption fine structure analysis is commonly used to characterize their structure, but its application to elements that are close to each other in the periodic table is hampered by poor Z-contrast. For this study, we trained an artificial neural network to recognize the partial coordination numbers in AuPt NPs synthesized via peptide templating using their X-ray absorption near-edge structure spectra. This approach, combined with scanning transmission electron microscopy analysis, revealed unique details of this prototype catalytic system that has different forms of heterogeneities at both the intra- and inter-particle levels. Our method based on the enhancement of Z-contrast of metal species will have implications for compositional studies of BNPs.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Methanol at Water–TiO 2 Interfaces: Free Energies of Water and Methanol Dissociation

Methanol adsorption on TiO 2 surfaces has long been studied due to its role in enhancing photocatalytic hydrogen evolution, yet how it modulates surface chemistry under aqueous conditions remains little understood. Using molecular dynamics with an ab initio-based deep neural network potential, we find that methanol adsorption induces markedly different effects on the aqueous surfaces of anatase and rutile, the two common phases of TiO 2 . In anatase, methanol adsorption significantly enhances water dissociation, which is otherwise rare at the neat water interface. This enhancement arises from an alternative dissociation pathway mediated by surface-bound methoxyl groups. In contrast, methanol adsorption tends to suppress water dissociation on rutile, replacing it with thermodynamically favored methanol dissociation. Overall, methanol adsorption in an aqueous environment alters not only the availability of key reactive intermediates involved in hydrogen evolution but also the hydrogen source, which turns out to be primarily methanol on rutile, whereas both water and methanol are consumed on anatase. These results provide mechanistic insights into the coupled roles of organic adsorbates and water at photocatalytic interfaces, with implications on how methanol enhances the activity of H 2 evolution.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Dynamic Metal–Support Interaction Dictates Cu Nanoparticle Sintering on Al 2 O 3 Surfaces

Nanoparticle sintering remains a critical challenge in heterogeneous catalysis. In this work, we present a unified deep potential (DP) model based on the Perdew–Burke–Ernzerhof approximation of density functional theory for Cu nanoparticles on three Al 2 O 3 surfaces (γ-Al 2 O 3 (100), γ-Al 2 O 3 (110), and α-Al 2 O 3 (0001)). Using DP-accelerated simulations, we reveal that the nanoparticle size-mobility relationship strongly depends on the supporting surface. The diffusion of nanoparticles on the two γ-Al 2 O 3 surfaces is almost independent of the size of the nanoparticle, while the diffusion on α-Al 2 O 3 (0001) decreases rapidly with increasing size. Interestingly, nanoparticles with fewer than 55 atoms diffuse several times faster on α-Al 2 O 3 (0001) than on γ-Al 2 O 3 (100) at 800 K while expected to be more sluggish based on their larger binding energy at 0 K. The diffusion on α-Al 2 O 3 (0001) is facilitated by dynamic metal–support interaction (MSI), where Al atoms move out of the surface plane to optimize contact with the nanoparticle and relax back to the plane as the nanoparticle moves away. In contrast, the MSI on γ-Al 2 O 3 (100) and on γ-Al 2 O 3 (110) is dominated by more stable and directional Cu–O bonds, consistent with the limited diffusion observed on these surfaces. Our extended MD simulations provide insight into the sintering processes, showing that the dispersity of the nanoparticles strongly influences the coalescence driven by nanoparticle diffusion. We observed that the coalescence of Cu 13 nanoparticles on α-Al 2 O 3 (0001) can occur in a short time (10 ns) at 800 K even with an initial internanoparticle distance increased to 3 nm, while the coalescence on the two γ-Al 2 O 3 surfaces are inhibited significantly by increasing the initial internanoparticle distance. These findings demonstrate that the dynamics of the supporting surface is crucial to understanding the sintering mechanism and offer guidance for designing sinter-resistant catalysts by engineering the support morphology.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗