SEARCH · Engineering Papers
Results for “Machine learning in physics”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Improving Non-Destructive Detection Technology Through SAVY Feature Detection
Surveillance of special nuclear material (SNM) storage containers is required by the DOE to assess their integrity across the Complex. This work aims to improve the task of container inspections by leveraging automation through machine learning (ML) tools to reduce the human-intensive effort and expert-level knowledge needed to assess container status. A field-deployable, non-destructive technology was designed using off-the-shelf components to collect multiple images from different perspectives of containers in storage to detect both spatial features of interest and anomalies of concern. Nine ML models were generated using unique training datasets and parameters. Learned features include SAVY surface regions including the body side wall, collar, lid, filter, and printed/etched information. Average Precision (AP) is used to calculate detection performance when both viewing previously seen environments and previously unseen environments. The application of image transformations and resolution scaling while training greatly improved the detection performance in unseen environments, and significantly increasing the number of computation iterations improved detection performance on previously seen environments. Additional capabilities were developed including the novel detection of procedural non-compliance and the ability to localize anomalies relative to SAVY surface features.
Condition monitoring and anomaly detection in cyber-physical systems
The modern industrial environment is equipping myriads of smart manufacturing machines where the state of each device can be monitored continuously. Such monitoring can help identify possible future failures and develop a cost-effective maintenance plan. However, it is a daunting task to perform early detection with low false positives and negatives from the huge volume of collected data. This requires developing a holistic machine learning framework to address the issues in condition monitoring of high priority components and develop efficient techniques to detect anomalies that can detect and possibly localize the faulty components. This paper presents a comparative analysis of recent machine learning approaches for robust, cost-effective anomaly detection in cyber-physical systems. While detection has been extensively studied, very few researchers have analyzed the localization of the anomalies. We show that supervised learning outperforms unsupervised algorithms. For supervised cases, we achieve near-perfect accuracy of 98% (specifically for tree-based algorithms). In contrast, the best-case accuracy in the unsupervised cases was 63%—the area under the receiver operating characteristic curve (AUC) exhibits similar outcomes as an additional metric.
A Machine Learning Approach for the Prediction of Formability and Thermodynamic Stability of Single and Double Perovskite Oxides
Perovskite oxides continue to attract huge interest due to their fascinating and wide-ranging properties for diverse applications. The tunability of these properties may be further enhanced by increasing their compositional complexity via double perovskite-ordered configurations containing multiple cations. In this work, we focus on an exhaustive chemical space of single and double oxide perovskites and optimally explore this space to identify novel compositions that are likely to form stable compounds. Critically, we examine the relationship between formability, the practical ability to synthesize a compound, and stability, the thermodynamic preference to form the structure. Our formability and stability training data sets were enumerated from the available experimental literature and in-house density functional theory computations and contained 1505 and 3469 examples, respectively, representing state-of-the-art in the current open literature in perovskite and double perovskite compounds. Subsequently, cross-validated and highly accurate machine learning classification models are built using these training data sets and employed to screen for novel stable oxide perovskites. The study identifies (1) atomic features relevant to prediction of formability and stability in perovskite and double perovskite compounds, (2) the importance of including energy contributions due to local structural relaxations going beyond the high symmetry perovskite phase, and (3) 437,828 double perovskite compounds that are likely to be stable and 891,188 compounds that are likely to be formable. From the intersection of this large chemical space of formable and stable oxide perovskites, 414 compositions are identified as the most promising candidates for future experimental synthesis of novel oxide perovskites. The developed models may be generalized and have implications beyond perovskite discovery if applied to other families of compounds.
Trainability of Dissipative Perceptron-Based Quantum Neural Networks
Several architectures have been proposed for quantum neural networks (QNNs), with the goal of efficiently performing machine learning tasks on quantum data. Rigorous scaling results are urgently needed for specific QNN constructions to understand which, if any, will be trainable at a large scale. Here, we analyze the gradient scaling (and hence the trainability) for a recently proposed architecture that we call dissipative QNNs (DQNNs), where the input qubits of each layer are discarded at the layer’s output. We find that DQNNs can exhibit barren plateaus, i.e., gradients that vanish exponentially in the number of qubits. Moreover, we provide quantitative bounds on the scaling of the gradient for DQNNs under different conditions, such as different cost functions and circuit depths, and show that trainability is not always guaranteed. Here our work represents the first rigorous analysis of the scalability of a perceptron-based QNN.
From predicting to learning dissipation from pair correlations of active liquids
Active systems, which are driven out of equilibrium by local non-conservative forces, can adopt unique behaviors and configurations. Towards designing such materials, an important challenge is to precisely connect the static structure of active systems to the dissipation of energy induced by the local driving. Here, we use tools from liquid-state theories and machine learning to take on these challenges. We first demonstrate analytically for an isotropic active matter system that dissipation and pair correlations are closely related when driving forces behave like an active temperature. We then extend a nonequilibrium mean-field framework for predicting these pair correlations which, unlike most existing approaches, is applicable even for strongly interacting particles and far from equilibrium, to predict dissipation in these systems. Based on this theory, we reveal analytically a robust relation between dissipation and structure which holds even as the system approaches a nonequilibrium phase transition. Finally, we construct a neural network which maps static configurations of particles to their dissipation rate without any prior knowledge of the underlying dynamics. Furthermore, our results open novel perspectives on the interplay between dissipation and organization out-of-equilibrium.
Fast Machine Learning [Slides]
Explore the source record for details and available documents.
Advancing Quantum Simulations with Machine Learning and Graph Theory
Explore the source record for details and available documents.
Intuitive Machine Learning for Chemistry
Explore the source record for details and available documents.
Monitoring Fracture Saturation With Internal Seismic Sources and Twin Neural Networks
Seismic coda-wave analysis is a well-developed method for detecting subtle physical changes in complex media by measuring arrival times in the late-arriving energy from multiply scattered or reflected waves. However, a challenge arises when multiply scattered waves are not sufficiently separated in time from the direct arrivals to provide a clear coda wave train. Additional complications for monitoring changes in fracture systems arise when the signals originate from unsynchronized internal sources, such as natural or induced seismicity, from acoustic emission, or from transportable intra-fracture sources (chattering dust), that generate uncontrolled signals that vary in arrival time, amplitude and frequency content. Here, we use a twin neural network (TNN also known as a Siamese neural network) for dimensionality reduction to analyze signals from chattering dust to classify the fluid saturation state of a synthetic fracture system. The TNN with shared weights generates a low-dimensional representation of the data input by minimizing contrastive loss, serving as the input to a multiclass classifier that accurately classifies whether multiple fractures in a fracture system are fully saturated or partially saturated, or whether a change in saturation has occurred in different fractures in the system. Furthermore, these results show that information buried in unresolved codas from uncontrolled sources can be extracted using machine learning to monitor the evolution of fracture systems caused by physical and chemical processes even when the scattered and direct wave fields overlap.
Size-Dependent Nucleation in Crystal Phase Transition from Machine Learning Metadynamics
In this Letter, we present a framework that combines machine learning potential (MLP) and metadynamics to investigate solid-solid phase transition. Here, based on the spectral descriptors and neural networks regression, we develop a scalable MLP model to warrant an accurate interpolation of the energy surface where two phases coexist. Applying it to the simulation of B4–B1 phase transition of GaN under 50 GPa with different model sizes, we observe sequential change of the phase transition mechanism from collective modes to nucleation and growths. When the size is at or below 128 000 atoms, the nucleation and growth appear to follow a preferred direction. At larger sizes, the nuclei occur at multiple sites simultaneously and grow to microstructures by passing the critical size. The observed change of the atomistic mechanism manifests the importance of statistical sampling with large system size in phase transition modeling.
Phase Diagram of a Deep Potential Water Model
Using the Deep Potential methodology, we construct a model that reproduces accurately the potential energy surface of the SCAN approximation of density functional theory for water, from low temperature and pressure to about 2400 K and 50 GPa, excluding the vapor stability region. The computational efficiency of the model makes it possible to predict its phase diagram using molecular dynamics. Satisfactory overall agreement with experimental results is obtained. Here, the fluid phases, molecular and ionic, and all the stable ice polymorphs, ordered and disordered, are predicted correctly, with the exception of ice III and XV that are stable in experiments, but metastable in the model. The evolution of the atomic dynamics upon heating, as ice VII transforms first into ice VII" and then into an ionic fluid, reveals that molecular dissociation and breaking of the ice rules coexist with strong covalent fluctuations, explaining why only partial ionization was inferred in experiments.
Complex Structure of Molten FLiBe (2 Li F – Be F 2 ) Examined by Experimental Neutron Scattering, X-Ray Scattering, and Deep-Neural-Network Based Molecular Dynamics
The use of molten salts as coolants, fuels, and tritium breeding blankets in the next generation of fission and fusion nuclear reactors benefits from furthering the characterization of the molecular structure of molten halide salts, paving the way to predictive capability of the chemical and thermophysical properties of molten salts. Due to its neutronic, chemical, and thermochemical properties, 2 Li F - Be F 2 is a candidate molten salt for several fusion- and fission-reactor designs. We performed neutron and x-ray total-scattering measurements to determine the atomic structure of liquid 2 Li F - Be F 2 . We also performed and neural-network molecular-dynamics simulations to predict the structure obtained by neutron- and x-ray-diffraction experiments. The use of machine learning provides improvements to the efficiency in predicting the structure at a longer length scales than is achievable with simulations at significantly lower computational expense while retaining near accuracy. We found that the NNMD simulations accurately predicted the Be F 4 2 − oligomer formations seen in the experimental first-structure-factor peak. Our combination of high-resolution measurements with large-scale molecular dynamics provided an avenue to explore and experimentally verify the intermediate-range ordering beyond the first-nearest neighbor that has posed too many experimental and computational challenges in previous works. With a deeper understanding of the salt structure and ion ordering, the evolution of salt chemistry over the lifetime of a reactor can be better predicted, which is crucial to the licensing and operation of advanced fission and fusion reactors that employ molten salts. To this end, this work will serve as a reference for future studies of salt structure and macroscopic properties with and without the addition of solutes. Published by the American Physical Society 2024
Intelliquench: An Adaptive Machine Learning System for Detection of Superconducting Magnet Quenches
In superconducting magnets, the irreversible transition of a portion of the conductor to resistive state is called a “quench.” Having large stored energy, magnets can be damaged by quenches due to localized heating, high voltage, or large force transients. Unfortunately, current quench protection systems can only detect a quench after it happens, and mitigating risks in Low Temperature Superconducting (LTS) accelerator magnets often requires fast response (down to ms). Additionally, protection of High Temperature Superconducting (HTS) magnets is still suffering from prohibitively slow quench detection. In this study, we lay the groundwork for a quench prediction system using an auto-encoder fully-connected deep neural network. After dynamically trained with data features extracted from acoustic sensors around the magnet, the system detects anomalous events seconds before the quench in most of our data. While the exact nature of the events is under investigation, we show that the system can “forecast” a quench before it happens under magnet training conditions through a randomized experiment. This opens up the way of integrated data processing, potentially leading to faster and better diagnostics and detection of magnet quenches
Toward Robust Autotuning of Noisy Quantum dot Devices
The current autotuning approaches for quantum dot (QD) devices, while showing some success, lack an assessment of data reliability. This leads to unexpected failures when noisy or otherwise low-quality data is processed by an autonomous system. In this work, we propose a framework for robust autotuning of QD devices that combines a machine learning (ML) state classifier with a data quality control module. The data quality control module acts as a “gatekeeper” system, ensuring that only reliable data are processed by the state classifier. Lower data quality results in either device recalibration or termination. To train both ML systems, we enhance the QD simulation by incorporating synthetic noise typical of QD experiments. We confirm that the inclusion of synthetic noise in the training of the state classifier significantly improves the performance, resulting in an accuracy of 95.0(9)% when tested on experimental data. We then validate the functionality of the data quality control module by showing that the state classifier performance deteriorates with decreasing data quality, as expected. Our results establish a robust and flexible ML framework for autonomous tuning of noisy QD devices.
Data for Monitoring Fracture Saturation with Internal Transportable Seismic Sources and Twin Neural Networks
Seismic coda-wave analysis is a well-developed method for detecting subtle physical changes in complex media by measuring arrival times in the late-arriving energy from multiply-scattered or reflected waves. However, a challenge arises when multiply-scattered waves are not sufficiently separated in time from the direct arrivals to provide a clear coda wave train. Additional complications for monitoring changes in fracture systems arise when the signals originate from unsynchronized internal sources, such as natural induced seismicity, from acoustic emission, or from transportable intra-fracture sources (chattering dust), that generate uncontrolled signals that vary in arrival time, amplitude and frequency content. Here, we use a twin neural network (also known as a Siamese neural network) for dimensionality reduction to analyze signals from chattering dust to classify the fluid saturation state of a synthetic fracture system. The twin neural network with shared weights generates a low-dimensional representation of the data input by minimizing contrastive loss, serving as the input to a multiclass classifier that accurately classifies whether multiple fractures in a fracture system are fully saturated or partially saturated, or whether a change in saturation has occurred in different fractures in the system. These results show that information buried in unresolved codas from uncontrolled sources can be extracted using machine learning to monitor the evolution of fracture systems caused by physical and chemical processes even when the scattered and direct wave fields overlap.
Stochastic economic dispatch of wind power under uncertainty using clustering-based extreme scenarios
Operation of power systems with high penetrations of renewable energy sources requires tools for robust decision making under uncertainty. Stochastic economic dispatch and stochastic unit commitment are effective techniques for planning and operation under uncertainty, whose effectiveness depends on the cardinality and quality of the scenario set. Here, this article proposes a machine learning method using -means clustering for capturing relevant physical information from a large population of analog scenarios. Extreme scenario samples drawn from the clusters are used in a two-stage stochastic economic dispatch computation. The effectiveness of the proposed approach is assessed on a synthetic 200-bus system with a geographic footprint over Illinois, USA for four months from each season of WIND Toolkit data. The combination of -means clustering with importance sampling is shown to reduce the total operational cost by over 43% compared to sampling from populations based on heuristic clustering-based methods. Additionally, the variability in the mean cost is about 56% lower than the variability using Monte Carlo sampling. Moreover, the operational cost with the presented approach is shown to be close to the cost calculated based on a hindsight exact wind profile, signifying a highly accurate quantification of wind uncertainty by the presented -means clustering based sampling method.
Calibrating Bayesian generative machine learning for Bayesiamplification
Recently, combinations of generative and Bayesian deep learning have been introduced in particle physics for both fast detector simulation and inference tasks. These neural networks aim to quantify the uncertainty on the generated distribution originating from limited training statistics. The interpretation of a distribution-wide uncertainty however remains ill-defined. We show a clear scheme for quantifying the calibration of Bayesian generative machine learning models. For a Continuous Normalizing Flow applied to a low-dimensional toy example, we evaluate the calibration of Bayesian uncertainties from either a mean-field Gaussian weight posterior, or Monte Carlo sampling network weights, to gauge their behaviour on unsteady distribution edges. Well calibrated uncertainties can then be used to roughly estimate the number of uncorrelated truth samples that are equivalent to the generated sample and clearly indicate data amplification for smooth features of the distribution.