Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Computational Physics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,117 records · Page 62

A Comprehensive Analysis of PINNs for Power System Transient Stability

The integration of machine learning in power systems, particularly in stability and dynamics, addresses the challenges brought by the integration of renewable energies and distributed energy resources (DERs). Traditional methods for power system transient stability, involving solving differential equations with computational techniques, face limitations due to their time-consuming and computationally demanding nature. This paper introduces physics-informed Neural Networks (PINNs) as a promising solution for these challenges, especially in scenarios with limited data availability and the need for high computational speed. PINNs offer a novel approach for complex power systems by incorporating additional equations and adapting to various system scales, from a single bus to multi-bus networks. Our study presents the first comprehensive evaluation of physics-informed Neural Networks (PINNs) in the context of power system transient stability, addressing various grid complexities. Additionally, we introduce a novel approach for adjusting loss weights to improve the adaptability of PINNs to diverse systems. Our experimental findings reveal that PINNs can be efficiently scaled while maintaining high accuracy. Furthermore, these results suggest that PINNs significantly outperform the traditional ode45 method in terms of efficiency, especially as the system size increases, showcasing a progressive speed advantage over ode45.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Improving Bond Dissociations of Reactive Machine Learning Potentials through Physics-Constrained Data Augmentation

In the field of computational chemistry, predicting bond dissociation energies (BDEs) presents well-known challenges, particularly due to the multireference character of reactive systems. Many chemical reactions involve configurations where single-reference methods fall short, as the electronic structure can significantly change during bond breaking. As generating training data for partially broken bonds is a challenging task, even state-of-the-art reactive machine learning interatomic potentials (MLIPs) often fail to predict reliable BDEs and smooth dissociation curves. By contrast, simple and inexpensive physics-based models, such as the well-established Morse potential, do not suffer from any such limitations. This work leverages the Morse potential to improve reactive MLIPs by augmenting the training data set with inexpensive Morse data along the dissociation pathways. Further, this physics-constrained data augmentation (PCDA) approach results in MLIPs with smooth bond dissociation curves as well as near coupled-cluster level BDEs, all without requiring any expensive multireference quantum mechanical calculations. A case study for methane combustion demonstrates how the PCDA approach can improve an existing reactive MLIP, namely, ANI-1xnr. In conclusion, not only are the BDEs and bond dissociation curves for all radicals and molecules significantly improved compared to ANI-1xnr but the PCDA-trained MLIP retains the reliability of ANI-1xnr when performing reactive molecular dynamics simulations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Hybrid Quantum-Classical Neural Networks

Deep learning is one of the most successful and far-reaching strategies used in machine learning today. However, the scale and utility of neural networks is still greatly limited by the current hardware used to train them. These concerns have become increasingly pressing as conventional computers are soon expected to approach the physical limitations that will slow their performance improvements in the near future. For these reasons, scientists have begun to explore alternative computing platforms, like quantum computers, for training neural networks. In recent years, variational quantum circuits have emerged as one of the most successful approaches to quantum deep learning on noisy intermediate scale quantum devices. We propose a hybrid quantum-classical neural network architecture where each neuron is a variational quantum circuit. We empirically analyze the performance of this hybrid neural network on a series of binary classification data sets using a simulated IBM universal quantum computer and a state-of-the-art IBM universal quantum computer. On the simulated hardware, we observe that the hybrid neural network achieves around 10% higher classification accuracy and 20% better minimization of the cost function than an individual variational quantum circuit. On the quantum hardware, we observe that each model only performs well when the qubit and gate count is sufficiently small.

Arthur, Davis↗

Preface to the Proceedings of the 23rd Topical Conference on High-Temperature Plasma Diagnostics

Measurements of phenomena advance our understanding of the physical universe. As our understanding grows, more precise measurements are required, as are measurements of new quantities. Diagnosis of a plasma requires developing new instruments, also called diagnostics, as well as new ways to analyze, interpret, synthesize, and correlate their measurements. Further, as computing power increases and multi-physics codes improve their accuracy, more precise measurements are needed to guide future code developments and to validate predictions of these simulation codes. The Topical Conference on High-Temperature Plasma Diagnostics is focused on presenting and documenting the most recent advances in these instrumentation areas for plasmas. The 23rd occurrence of this biennial conference took place on December 14–17, 2020, and was hosted by Los Alamos National Laboratory. Originally scheduled for June 2020 in Santa Fe, New Mexico, the conference was postponed and then held virtually due to the global COVID-19 pandemic. Conference times were adjusted and presentations were scheduled to meet the needs of attendees in Europe, the USA, and Asia.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Using an Explainable Machine Learning Approach to Characterize Earth System Model Errors: Application of SHAP Analysis to Modeling Lightning Flash Occurrence

Abstract Computational models of the Earth System are critical tools for modern scientific inquiry. Efforts toward evaluating and improving errors in representations of physical and chemical processes in these large computational systems are commonly stymied by highly nonlinear and complex error behavior. Recent work has shown that these errors can be effectively predicted using modern Artificial Intelligence (A.I.) techniques. In this work, we go beyond these previous studies to apply an explainable A.I. technique to not only predict model errors but also move toward understanding the underlying reasons for successful error prediction. We use XGBoost classification trees and SHapley Additive exPlanations analysis to explore the errors in the prediction of lightning occurrence in the NASA Goddard Earth Observing System model, a widely used Earth System Model. This explainable error prediction system can effectively predict the model error and indicates that the errors are strongly related to convective processes and the characteristics of the land surface.

54 ENVIRONMENTAL SCIENCES↗

Enhancing Docking Accuracy with PECAN2, a 3D Atomic Neural Network Trained without Co-Complex Crystal Structures

Decades of drug development research have explored a vast chemical space for highly active compounds. The exponential growth of virtual libraries enables easy access to billions of synthesizable molecules. Computational modeling, particularly molecular docking, utilizes physics-based calculations to prioritize molecules for synthesis and testing. Nevertheless, the molecular docking process often yields docking poses with favorable scores that prove to be inaccurate with experimental testing. To address these issues, several approaches using machine learning (ML) have been proposed to filter incorrect poses based on the crystal structures. However, most of the methods are limited by the availability of structure data. Here, we propose a new pose classification approach, PECAN2 (Pose Classification with 3D Atomic Network 2), without the need for crystal structures, based on a 3D atomic neural network with Point Cloud Network (PCN). The new approach uses the correlation between docking scores and experimental data to assign labels, instead of relying on the crystal structures. We validate the proposed classifier on multiple datasets including human mu, delta, and kappa opioid receptors and SARS-CoV-2 Mpro. Our results demonstrate that leveraging the correlation between docking scores and experimental data alone enhances molecular docking performance by filtering out false positives and false negatives.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

COLUMBUS─An Efficient and General Program Package for Ground and Excited State Computations Including Spin–Orbit Couplings and Dynamics

The COLUMBUS program system provides the tools for performing high-level multireference (MR) computations, including the multireference configuration interaction (MRCI) method and its multireference averaged quadratic coupled cluster (MR-AQCC) extension, allowing computations on a wide range of fascinating atomic and molecular systems, including the treatment of open-shells and complicated excited state phenomena. The inclusion of spin−orbit coupling (SOC) directly within the MRCI step enables the description of systems containing heavy elements, such as lanthanides and actinides, whose properties are strongly influenced by SOC. Analytic energy gradients and nonadiabatic couplings at the correlated MRCI level provide the foundation for a variety of dynamics studies, giving insight into ultrafast photochemistry. New and ongoing method developments in COLUMBUS include the computation of spin densities, improved descriptions of ionic states, enhancements to the AQCC method, and the porting of COLUMBUS to graphical processing units (GPUs). New external interfaces enable an enhanced description of electronic resonances and molecules in strong laser fields. This work highlights these new developments while providing a detailed account of the diverse applications of COLUMBUS in recent years.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

GPU coprocessors as a service for deep learning inference in high energy physics

In the next decade, the demands for computing in large scientific experiments are expected to grow tremendously. During the same time period, CPU performance increases will be limited. At the CERN Large Hadron Collider (LHC), these two issues will confront one another as the collider is upgraded for high luminosity running. Alternative processors such as graphics processing units (GPUs) can resolve this confrontation provided that algorithms can be sufficiently accelerated. In many cases, algorithmic speedups are found to be largest through the adoption of deep learning algorithms. We present a comprehensive exploration of the use of GPU-based hardware acceleration for deep learning inference within the data reconstruction workflow of high energy physics. We present several realistic examples and discuss a strategy for the seamless integration of coprocessors so that the LHC can maintain, if not exceed, its current performance throughout its running.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Energy Frontier Research Centers: Center for the Computational Design of Functional Layered Materials (CCDM) August 1, 2014 - July 31, 2018; Center for Complex Materials from First Principles (CCM) August 1, 2018 - July 31, 2021 (Final Report)

The mission of the DOE Energy Frontier Research Centers CCDM (2014-2018) and CCM (2018-2021) was to theoretically develop, computationally apply, and experimentally validate electronic structure methods for all materials, with a focus on the complex materials, especially layered and two-dimensional materials, strongly-correlated materials, and liquid water. This was achieved by over 200 published journal articles authored by about 17 senior investigators from physics and chemistry and from theory, computation, and experiment, plus their collaborators. In particular, the Centers confirmed the predictive power of the SCAN (strongly constrained and appropriately normed) density functional, which was constructed to satisfy 17 known exact constraints and several appropriate norms. Without being fitted to real bonded systems, and at a modest computational cost, SCAN correctly predicted covalent, ionic, metallic, hydrogen, and van der Waals bonds in many challenging materials. SCAN gave an improved description of defects in semiconductors, surface properties of metals, seven phases of ice, liquid water, liquid and supercooled silicon, subtle structural distortions in ferroelectrics, formation energies and structural predictions for solids, and critical pressures for structural phase transitions. Perhaps most remarkably, SCAN correctly described some strongly-correlated materials that were previously believed to be beyond the reach of density-functional approximations. SCAN is the only density functional that correctly predicts the band gap closing under chemical doping of the cuprate high-temperature superconducting materials. SCAN also predicts a landscape of competing stripe and magnetic phases in the cuprates. For some materials with some codes, SCAN has convergence problems that are greatly reduced by the CCM-developed r 2 SCAN, without loss of accuracy or rigor. SCAN and r 2 SCAN still make some self-interaction error, which is greatly reduced by the CCDM/ CCM-developed local orbital scaling correction (LOSC). These Centers further proved that the fundamental energy gaps of a solid from an orbital energy difference and from total energy differences are the same for a large class of generalized Kohn-Sham (GKS) functionals, including SCAN and standard hybrid functionals, and that symmetry breaking arises when a dynamic density fluctuation drops to zero frequency. The Centers identified new mechanisms for catalysis in layered materials with ions intercalated between the layers, investigated charge density waves both in model systems and in real layered materials, studied changes of band gap with the number of layers, and explored topological ultrathin films, bent nanoribbons, and defects.

08 HYDROGEN↗

Fundamental Studies of Soiling and Cementation of PV Cover Glass Materials: Addressing Reliability with Advanced X-ray Scattering/Spectroscopy and First Principles Modeling (Final Technical Report)

Accumulation of soils and other particulate matter on the front cover glass of solar photovoltaic (PV) modules results in transmission losses that detrimentally affect the power output of PV installations. The conventional solution to this problem is manual abrasive scrubbing of modules, which entails significant water usage and manpower. To further combat this issue, there is a concerted effort within the PV industry to develop anti-soiling (AS) coatings to mitigate power losses due to soiling of PV modules, which can exceed 35% in some cases. However, relatively little is known about the fundamental physical and chemical mechanisms that enable anti-soiling behavior. In this project, a combination of advanced X-ray analysis tools and first principles computational modeling has employed to understand the physical and chemical interactions between environmental soils and PV cover glass materials. The specific objectives were: 1) investigate soiling interactions and cementation behavior of relevant PV materials, including bare glass, conventional antireflective (AR) coatings, and a commercial AS coating, using a library of representative particulate soils, and 2) utilize first principles computational spectroscopy modeling to interpret the experimental X-ray spectroscopy measurements and determine the detailed surface chemistry changes that occur on these surfaces in the presence of soiling and cementation.

14 SOLAR ENERGY↗

DPM: A deep learning PDE augmentation method with application to large-eddy simulation

A framework is introduced that leverages known physics to reduce overfitting in machine learning for scientific applications. The partial differential equation (PDE) that expresses the physics is augmented with a neural network that uses available data to learn a description of the corresponding unknown or unrepresented physics. Training within this combined system corrects for missing, unknown, or erroneously represented physics, including discretization errors associated with the PDE's numerical solution. For optimization of the network within the PDE, an adjoint PDE is solved to provide high-dimensional gradients, and a stochastic adjoint method (SAM) further accelerates training. Additionally, the approach is demonstrated for large-eddy simulation (LES) of turbulence. High-fidelity direct numerical simulations (DNS) of decaying isotropic turbulence provide the training data used to learn sub-filter-scale closures for the filtered Navier–Stokes equations. Out-of-sample comparisons show that the deep learning PDE method outperforms widely-used models, even for filter sizes so large that they become qualitatively incorrect. It also significantly outperforms the same neural network when a priori trained based on simple data mismatch, not accounting for the full PDE. Measures of discretization errors, which are well-known to be consequential in LES, point to the importance of the unified training formulation's design, which without modification corrects for them. For comparable accuracy, simulation runtime is significantly reduced. A relaxation of the typical discrete enforcement of the divergence-free constraint in the solver is also successful, instead allowing the DPM to approximately enforce incompressibility physics. Since the training loss function is not restricted to correspond directly to the closure to be learned, training can incorporate diverse data, including experimental data.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

When and why PINNs fail to train: A neural tangent kernel perspective

Physics-informed neural networks (PINNs) have lately received great attention thanks to their flexibility in tackling a wide range of forward and inverse problems involving partial differential equations. However, despite their noticeable empirical success, little is known about how such constrained neural networks behave during their training via gradient descent. More importantly, even less is known about why such models sometimes fail to train at all. Here in this work, we aim to investigate these questions through the lens of the Neural Tangent Kernel (NTK); a kernel that captures the behavior of fully-connected neural networks in the infinite width limit during training via gradient descent. Specifically, we derive the NTK of PINNs and prove that, under appropriate conditions, it converges to a deterministic kernel that stays constant during training in the infinite-width limit. This allows us to analyze the training dynamics of PINNs through the lens of their limiting NTK and find a remarkable discrepancy in the convergence rate of the different loss components contributing to the total training error. To address this fundamental pathology, we propose a novel gradient descent algorithm that utilizes the eigenvalues of the NTK to adaptively calibrate the convergence rate of the total training error. Finally, we perform a series of numerical experiments to verify the correctness of our theory and the practical effectiveness of the proposed algorithms.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

SympNets: Intrinsic structure-preserving symplectic networks for identifying Hamiltonian systems

Here, we propose new symplectic networks (SympNets) for identifying Hamiltonian systems from data based on a composition of linear, activation and gradient modules. In particular, we define two classes of SympNets: the LA-SympNets composed of linear and activation modules, and the G-SympNets composed of gradient modules. Correspondingly, we prove two new universal approximation theorems that demonstrate that SympNets can approximate arbitrary symplectic maps based on appropriate activation functions. We then perform several experiments including the pendulum, double pendulum and three-body problems to investigate the expressivity and the generalization ability of SympNets. The simulation results show that even very small size SympNets can generalize well, and are able to handle both separable and non-separable Hamiltonian systems with data points resulting from short or long time steps. In all the test cases, SympNets outperform the baseline models, and are much faster in training and prediction. We also develop an extended version of SympNets to learn the dynamics from irregularly sampled data. This extended version of SympNets can be thought of as a universal model representing the solution to an arbitrary Hamiltonian system.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Nonadiabatic Excited-State Molecular Dynamics for Open-Shell Systems

Nonadiabatic Molecular Dynamics (NAMD) of excited states has been widely used in the simulation of photoinduced phenomena. However, the inability to treat bond breaking and forming processes with single-reference electronic structure methods limits their application in photochemistry for extended molecular systems. In this work, the extension of excited-state NAMD for open-shell systems is developed and implemented in the NEXMD software. We present the spin-unrestricted CIS and TDSCF formalism for the ground and excited states, analytical derivatives, and nonadiabatic derivative couplings for the respective potential energy surfaces. Next, this methodology is employed to study the photochemical reaction of three model molecules. The results demonstrate the advantage of the open-shell approach in modeling photochemical reactions, especially involving bond breaking processes. We find that the open-shell method lowers the reaction barrier at the bond-breaking limits resulting in larger calculated photochemical quantum yields compared to the respective closed-shell results. We also address problems related to spin contamination in the open-shell method, especially when molecular geometries are far from equilibrium.

36 MATERIALS SCIENCE↗

Theory of edge localized mode suppression by static resonant magnetic perturbations in the DIII-D tokamak

According to a recent paper [Hu et al ., Phys. Plasmas 26, 120702 (2019)], mode penetration at the top of the pedestal is a necessary and sufficient condition for the suppression of edge localized modes (ELMs) by a resonant magnetic perturbation (RMPs) in an H-mode tokamak discharge. This paper employs asymptotic matching theory to model a particular DIII-D discharge in which ELMs were suppressed by an externally generated, static, n ¼ 2, RMP whose amplitude was modulated at a frequency of 1 Hz. It is demonstrated that the response of the plasma to the applied RMP, in the immediate vicinities of the rational (i.e., resonant) surfaces, is governed by nonlinear, rather than by linear, physics. This is the case because the magnetic island widths associated with driven reconnection exceed the linear layer widths, even in cases where driven reconnection is strongly suppressed by plasma rotation. The natural frequency at a given rational surface (i.e., the helical frequency at which the locally resonant component of the RMP would need to propagate in order to maximize driven reconnection) is found to be offset from the local E B frame in the ion diamagnetic direction. The size of the offset is mostly determined by neoclassical poloidal rotation. Finally, the predictions of a fully nonlinear plasma response model are found to be broadly consistent with the DIII-D experimental data.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Benchmarking third-order cluster perturbation theory for electronically excited states

In this study, we investigate the reliability of cluster perturbation (CP) theory applied to the calculation of electronically excited states through a comprehensive benchmark. In CP theory, perturbative corrections are added to the properties of a parent excitation space, which converge toward the properties of a target excitation space. For the CPS(D-n) model, perturbative corrections through order n are added to the coupled cluster singles (CCS) excitation energies to target the coupled cluster singles and doubles (CCSD) excitation energies. Through a comparative analysis of excitation energy calculations across a diverse set of molecules and wavefunction methods, we present a comprehensive evaluation of the accuracy of the third-order CPS(D) model, CPS(D-3), in calculating excitation energies. Further, our findings demonstrate that CPS(D-3) is a reliable alternative to established methods, particularly CCSD, while systematically overestimating the excitation energies compared to high-level coupled cluster methods such as CC3. These results highlight the strengths and limitations of CPS(D-3), as well as the promising directions for its future development.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗