Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Machine learning in physics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,783 records · Page 99

Interpretation of autoencoder-learned collective variables using Morse–Smale complex and sublevelset persistent homology: An application on molecular trajectories

Dimensionality reduction often serves as the first step toward a minimalist understanding of physical systems as well as the accelerated simulations of them. In particular, neural network-based nonlinear dimensionality reduction methods, such as autoencoders, have shown promising outcomes in uncovering collective variables (CVs). However, the physical meaning of these CVs remains largely elusive. In this work, we constructed a framework that (1) determines the optimal number of CVs needed to capture the essential molecular motions using an ensemble of hierarchical autoencoders and (2) provides topology-based interpretations to the autoencoder-learned CVs with Morse–Smale complex and sublevelset persistent homology. Furthermore, this approach was exemplified using a series of n-alkanes and can be regarded as a general, explainable nonlinear dimensionality reduction method.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Data-driven Quasi-static Surrogate Models for Nuclear-powered Integrated Energy Systems

The integration of nuclear power into energy systems presents a promising avenue to address the growing global energy demands while minimizing greenhouse gas emissions. In this paper, we introduce a data-driven quasi-static surrogate model for nuclear-powered Integrated Energy Systems (IES) that comprises various components, including a small modular reactor (SMR), steam manifold, balance of plant (BOP), high-temperature steam electrolysis (HTSE), and district heating (DH) system. Traditional physics-based models for these components often entail significant computational resource and time consumption, necessitating the development of efficient surrogate models. The development of a complete surrogate model for the IES involves the creation of individual surrogate models for each component, leveraging machine learning techniques and simulated data. These isolated surrogate models are subsequently integrated, enabling a holistic view of the IES and reducing the computational burden associated with detailed physics-based simulations. This paper outlines the development process, validation, and the performance evaluation of the surrogate models. The exceptional performance, with low root-mean-squared errors and R-squared scores of at least 99.8% across all individual surrogate models, underscores their accuracy and practical applicability. These results demonstrate the potential of these models to expedite the analysis of nuclear-powered IES, offering insights that can shape future research and development efforts.

08 HYDROGEN↗

Emergent symmetries in atomic nuclei: Probing nuclear dynamics and physics beyond the standard model

Dominant shapes naturally emerge in atomic nuclei from first principles, thereby establishing the shape-preserving symplectic Sp(3, \mathbb{R} ℝ ) symmetry as remarkably ubiquitous and almost perfect symmetry in nuclei. We discuss the critical role of this emergent symmetry in enabling machine-learning descriptions of heavy nuclei, ab initio modeling of \alpha α clustering and collectivity, as well as tests of beyond-the-standard-model physics. In addition, the Sp(3, \mathbb{R} ℝ ) and SU(3) symmetries provide relevant degrees of freedom that underpin the ab initio symmetry-adapted no-core shell model with the remarkable capability of reaching nuclei and reaction fragments beyond the lightest and close-to-spherical species.

Launey, Kristina D.↗

Machine Learning-Assisted Recovery of Delicate Kinetic Information from Transient Reactor Experiments

Identifying active sites and their roles in chemical reaction steps remains a vital challenge in heterogeneous catalysis. Transient experiments offer a unique way to probe active sites and distinguish subtle kinetic features. Although physics-based analysis methods may be well-developed, they can be highly susceptible to experimental noise, and smoothing methods may erase or even distort important features; a smooth curve is not always the best curve. We demonstrate a new workflow for the direct interpretation of intrinsic kinetic information from exit flux curves measured in transient reactor experiments. This workflow contains three artificial neural networks (ANNs), including a noise reducer, a concentration predictor, and a rate predictor to analyze experimental data, followed by the virtual TAP (VTAP) physics-based reactor model and density functional theory (DFT) calculations of adsorption energies on specific sites. We use this workflow to analyze the data from experiments titrating Pt/Al 2 O 3 and Pt/SiO 2 catalysts with carbon monoxide (CO) in the temporal analysis of products (TAP) reactor. Our workflow separates the time-evolving chemical reaction and mass transfer information contained in the TAP pulse response. The existence of strong- and weak-binding sites on the Pt/Al 2 O 3 catalyst is observed in the catalyst titration experiment in the transient reactor. The structures of the strong- and weak-binding sites are then identified by using DFT calculations. We find that the Pt/SiO 2 catalyst has only strong-binding sites, which aligns with the inactive support effect of SiO 2 . We demonstrate how machine learning methods provide unique insights with high-resolution data analysis that cannot be achieved by using state-of-the-art physics-based methods.

Adsorption↗

Machine Learning for Real-time Fusion Plasma Behavior Prediction and Manipulation

This project set out with an ambitious goal: to develop and apply machine learning-based methods of discovering new controllers and operating regimes for achieving better performing plasmas in tokamaks. As summarized in the dozens of papers below, the project was a huge success. It developed several machine learning components and integrated them into a single ML system that was added to the DIII-D PCS. That functionality was demonstrated over a series of experiments on DIII-D. A summary of these results is given here with the details in the published papers below.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Multi-Physics Simulations for Molten Salt Reactor Evaluation: Chemistry Modeling and Database Development

To aid in design and licensing of molten salt reactors, a framework integrating the complex interaction of reactor neutronics, thermal hydraulics, and chemistry is being developed within the Department of Energy Advanced Reactor Technology Program’s Molten Salt Reactor (MSR) campaign. The challenges of integrating thermochemical and thermophysical behavior into a multi-physics reactor simulations include the following: (1) population of data needed for refinement of current models and development of nonexistent models through experimental measurements, first principles calculations, and development of a machine learning approach (2) thermochemical and thermophysical model development, (3) further development of Thermochimica, an open-source efficient equilibrium solver used to link thermochemical models to the multi-physics code, (4) a framework for integrating kinetic phenomena: nucleation, precipitation, mass/heat transport, and corrosion models, and (5) a computational environment to efficiently utilize the data and models within a multi-physics modeling tool. These challenges are being addressed through a collaboration among Oak Ridge National Laboratory, Argonne National Laboratory, the University of South Carolina, and the University of Ontario Institute of Technology.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Defect Healing in Layered Materials: A Machine Learning-Assisted Characterization of MoS2 Crystal Phases

Monolayer MoS2 is an outstanding candidate for a next-generation semiconducting material because of its exceptional physical, chemical, and mechanical properties. To make this promising layered material applicable to nanostructured electronic applications, synthesis of a highly crystalline MoS2 monolayer is vitally important. Among different types of synthesis methods, chemical vapor deposition (CVD) is the most practical way to synthesize few- or mono-layer MoS2 on the target substrate owing to its simplicity and scalability. However, synthesis of a highly crystalline MoS2 layer remains elusive. This is because of the number of grains and defects unavoidably generated during CVD synthesis. Here, we perform multimillion-atom reactive molecular dynamics (RMD) simulations to identify an origin of the grain growth, migration, and defect healing process on a CVD-grown MoS2 monolayer. RMD results reveal that grain boundaries could be successfully repaired by multiple heat treatments. Our work proposes a new way of controlling the grain growth and migration on a CVD-grown MoS2 monolayer.

Hong, Sungwook↗

Investigating resource-efficient neutron/gamma classification ML models targeting eFPGAs

There has been considerable interest and resulting progress in implementing machine learning (ML) models in hardware over the last several years from the particle and nuclear physics communities. A big driver has been the release of the Python package, hls4ml, which has enabled porting models specified and trained using Python ML libraries to register transfer level (RTL) code. So far, the primary end targets have been commercial field-programmable gate arrays (FPGAs) or synthesized custom blocks on application specific integrated circuits (ASICs). However, recent developments in open-source embedded FPGA (eFPGA) frameworks now provide an alternate, more flexible pathway for implementing ML models in hardware. These customized eFPGA fabrics can be integrated as part of an overall chip design. In general, the decision between a fully custom, eFPGA, or commercial FPGA ML implementation will depend on the details of the end-use application. In this work, we explored the parameter space for eFPGA implementations of fully-connected neural network (fcNN) and boosted decision tree (BDT) models using the task of neutron/gamma classification with a specific focus on resource efficiency. We used data collected using an AmBe sealed source incident on Stilbene, which was optically coupled to an OnSemi J-series silicon photomultiplier (SiPM) to generate training and test data for this study. We investigated relevant input features and the effects of bit-resolution and sampling rate as well as trade-offs in hyperparameters for both ML architectures while tracking total resource usage. The performance metric used to track model performance was the calculated neutron efficiency at a gamma leakage of 10 -3 . The results of the study will be used to aid the specification of an eFPGA fabric, which will be integrated as part of a test chip.

47 OTHER INSTRUMENTATION↗

Improving materials property predictions for graph neural networks with minimal feature engineering *

Graph neural networks (GNNs) have been employed in materials research to predict physical and functional properties, and have achieved superior performance in several application domains over prior machine learning approaches. Recent studies incorporate features of increasing complexity such as Gaussian radial functions, plane wave functions, and angular terms to augment the neural network models, with the expectation that these features are critical for achieving a high performance. Here, we propose a GNN that adopts edge convolution where hidden edge features evolve during training and extensive attention mechanisms, and operates on simple graphs with atoms as nodes and distances between them as edges. As a result, the same model can be used for very different tasks as no other domain-specific features are used. With a model that uses no feature engineering, we achieve performance comparable with state-of-the-art models with elaborate features for formation energy and band gap prediction with standard benchmarks; we achieve even better performance when the dataset size increases. Although some domain-specific datasets still require hand-crafted features to achieve state-of-the-art results, our selected architecture choices greatly reduce the need for elaborate feature engineering and still maintain predictive power in comparison.

42 ENGINEERING↗

PECAN2

PECAN2, Pose Classification with 3D Atomic Network 2, presents an innovative approach to pose classification in computational modeling, particularly in the context of molecular docking. Traditional methods like docking, which rely on physics-based calculations, are prone to inaccuracies in predicting binding poses during experimental testing. While machine learning (ML) approaches, such as ML-driven pose classification, have been introduced to address these issues, they often depend on the availability of crystal structure data. In contrast, PECAN2 introduces a novel pose classification method that operates independently of crystal structures. Instead, it utilizes a 3D atomic neural network with Point Cloud Network (PCN) to establish correlations between docking scores and experimental data. This approach marks a departure from previous studies that heavily relied on crystal structures for labeling. The key innovation lies in the ability of PECAN2 to enhance the performance of molecular docking by filtering out false positives and false negatives through the correlation between docking scores and experimental data.

Shim, Heesung↗

Sandia National Laboratories Early Career University Faculty Mentoring Program in International Safeguards

Recent years have seen a significantly increased focus in the areas of knowledge retention and mentoring of junior staff within the U.S. national laboratory complex. In order to involve the university community in this process, as well, an international safeguards mentoring program was established by Sandia National Laboratories (SNL) for early career university faculty. After a successful experience during 2019, the program continued into 2020 to include two new faculty members who were paired with SNL subject matter experts based on the topic of their individual projects: one to work on advanced laboratory work for physics, technology, and policy of nuclear safeguards and nonproliferation, and the other to look at machine learning applied to international safeguards and nonproliferation. There is a two-pronged purpose to the program: fostering the development of educational resources available for international safeguards and exploring new research topics stemming from the exchange of mentor and mentee. Further, the program as a whole allows for junior faculty members to establish and expand a relationship network within international safeguards. In addition, programs such as this build stronger connections between the academic and the national laboratory community. Thanks to the junior faculty members that now have new connections into the laboratory community and potential for collaboration projects with the laboratories in the future, safeguards knowledge can actually increase far beyond just individually engaging students using this new and efficient avenue.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Digital Platform Informed Certification of Components Derived from Advanced Manufacturing Technologies

The Transformational Challenge Reactor is being designed at Oak Ridge National Laboratory to demonstrate the feasibility of constructing a reactor core using advanced manufacturing technology. This technology includes additive manufacturing combined with machine learning, materials science, and data science technologies in an effort to facilitate the expansion of additive manufacturing into advanced nuclear energy systems and other applications requiring a high level of quality assurance. The Transformational Challenge Reactor is employing additive manufacturing and artificial intelligence to deliver a new approach. Beginning in FY21, the focus of the program has shifted away from demonstrating a reactor, and instead, towards delivering on four key thrust areas: (1) artificial intelligence-informed design, (2) advanced materials, (3) integrated sensing and control, and (4) the digital platform. Of these four thrust areas, the most pertinent to this report is the digital platform. The digital platform has the potential to be a key enabler for a paradigm shift in how components, those derived from advanced manufacturing technologies, are certified for use in nuclear applications. This is achieved primarily using machine learning to discover correlations from the abundance of data produced through additive manufacturing and those physical properties critical to the performance of the component.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗