Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Differentiable physics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

On the Symmetry of Blast Waves

This paper presents a brief historical review of G. I. Taylor’s solution of the point blast wave problem which was applied to the Trinity test of the first atomic bomb. Lie group symmetry techniques (also referred to throughout this paper as geometric techniques) are used to derive Taylor’s famous two-fifths law that relates the position of a blast wave to the time after the explosion and the total energy released. The theory of exterior differential systems is combined with the method of characteristics to demonstrate that the solution of the blast wave problem is directly related to the basic relationships that exist between the symmetry (or geometry) and the physics of wave propagation through the equations of motion. The point blast wave model is cast in terms of two exterior differential systems, and both systems are shown to be integrable with local solutions for the velocity, pressure, and density along curves in space and time behind the blast wave. This work is dedicated to the memory of Professor Roy Axford, who introduced many of his students to the topic of symmetry analysis of differential equations.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Differentiable Multiphysics Codes: A Breakthrough Technology for Simulation and Computing

This document summarizes the findings of a strategic planning exercise commissioned by the Weapons Simulation and Computing, Computational Physics (WSC/CP) program at the Lawrence Livermore National Laboratory (LLNL) in FY24. During the year, the committee met with multiple stakeholder communities to gather input, opinions, suggestions and concerns which have been incorporated throughout this document. The key findings from this exercise are summarized: • The development of multiphysics modelling and simulation (mod/sim) codes and software technologies, their deployment on exascale compute platforms, and their broad adoption across the NNSA is a major success of the Advanced Simulation and Computing (ASC) program and the Exascale Computing Project (ECP). Sustained investment in these core technologies is essential. • Today’s state of the art involves running ensembles of O(100K) simulations to perform uncertainty quantification (UQ) and design studies using multiple statistical methods such as Bayesian optimization to understand sensitivities of our models and explore parameterized design spaces. Even with exascale computing, we are practically limited to O(10) parameters in these studies since the number of simulations required to sample the space scales exponentially with the number of design parameters. • The data from these simulation ensembles is increasingly being used to train machine learned (ML) surrogates (or reduced order models, ROMs) which can then be used for optimization or real time design exploration. However, the trained surrogates are still limited in the number of parameters they can represent due to the sampling limitations previously noted. • Augmenting our suite of integrated multiphysics simulation codes, both current and emerging, with the ability to compute gradients (solution derivatives) of arbitrary simulation outputs with respect to (some or all) simulation inputs would be a breakthrough technology, opening the door to a new era of efficient and automated inverse design based on verified and validated mod/sim capabilities. • This capability, which we refer to as differentiable multiphysics codes (DMCs), would revolutionize both UQ and optimization studies by breaking the curse of dimensionality that presently limits our “gradient-free” ensemble based computing approach. A similar breakthrough occurred in the AI/ML community once the ability to compute gradients of arbitrary loss functions using back-propagation became commonplace. Gradient information from the multiphysics codes can also be used to dramatically improve the efficiency and scale of training of ML/ROM surrogates for rapid assessments. • Achieving this in our suite of codes will be a grand challenge, similar to the amount of effort that was required to transition from CPU to GPU computing. It will require buy-in from the entire WSC/CP program and beyond, including all integrated codes, physics and engineering models, third-party library dependencies and performance portability abstractions. It will also require investment in research and development of numerical methods for computing adjoints of coupled physics across multiple adaptively refined moving meshes and of stochastic (Monte Carlo) and mesh free (SPH) methods. • New software and numerical techniques, largely pioneered by the AI/ML community, make this feasible. Chief among these is automatic differentiation (AD), the ability to employ AD at point-wise locations in a physics calculation (instead of traditional black-box approaches) and the ability to perform “back-propagation in time” (or reverse mode AD) for non-linear partial differential equations (PDEs). Fundamentally, the conclusion of this strategic planning exercise is that the time is right to undertake a large scale effort in WSC, centered on the existing integrated codes, to continue the natural evolution of mod/sim in the age of AI/ML. Instead of attempting to replace mod/sim with purely data driven AI/ML models, we believe the key to success is to integrate AI/ML by building on top of the decades of hard-won knowledge and the verified/validated multiphysics modelling capability that is the hallmark of the ASC program.

97 MATHEMATICS AND COMPUTING↗

Benchmark calculations of electron impact electronic excitation of the hydrogen molecule

We present benchmark integrated and differential cross-sections for electron collisions with H 2 using two different theoretical approaches, namely, the R-matrix and molecular convergent close-coupling. This is similar to comparative studies conducted on electron–atom collisions for H, He and Mg. Electron impact excitation to the ${\mathrm{b}}^{3}{{\Sigma}}_{\mathrm{u}}^{+}$, ${\mathrm{a}}^{3}{{\Sigma}}_{\mathrm{g}}^{+}$, ${\mathrm{B}}^{1}{{\Sigma}}_{\mathrm{u}}^{+}$, c3Πu, ${\mathrm{E}\mathrm{F}}^{1}{{\Sigma}}_{\mathrm{g}}^{+}$, C1Πu, ${\mathrm{e}}^{3}{{\Sigma}}_{\mathrm{u}}^{+}$, ${\mathrm{h}}^{3}{{\Sigma}}_{\mathrm{g}}^{+}$, ${\mathrm{B}}^{\prime 1}{{\Sigma}}_{\mathrm{u}}^{+}$ and d3Πu excited electronic states are considered. Calculations are presented in both the fixed nuclei and adiabatic nuclei approximations, where the latter is shown only for the ${\mathrm{b}}^{3}{{\Sigma}}_{\mathrm{u}}^{+}$ state. Good agreement is found for all transitions presented. Where available, we compare with existing experimental and recommended data.

74 ATOMIC AND MOLECULAR PHYSICS↗

vdisquants: Video Distrometer derived radar equivalent quantities. Retrievals from the VDIS instrument providing radar equivalent quantities, including dual polarization radar quantities (e.g., Z, Differential Reflectivity ZDR).

1. Provide cleaned and filtered data stream from multiple ARM disdrometers; 2. Estimate commonly-used physical parameters of the Drop Size Distribution (DSD). 3. Calculate radar equivalent quantities such as the Radar Reflectivity Factor Z.

54 ENVIRONMENTAL SCIENCES↗

Exact enforcement of temporal continuity in sequential physics-informed neural networks

The use of deep learning methods in scientific computing represents a potential paradigm shift in engineering problem solving. One of the most prominent developments is Physics-Informed Neural Networks (PINNs), in which neural networks are trained to satisfy partial differential equations (PDEs). While this method shows promise, the standard version has been shown to struggle in accurately predicting the dynamic behavior of time-dependent problems. To address this challenge, methods have been proposed that decompose the time domain into multiple segments, employing a distinct neural network in each segment and directly incorporating continuity between them in the loss function of the minimization problem. In this work we introduce a method to exactly enforce continuity between successive time segments via a solution ansatz. This hard constrained sequential PINN (HCS-PINN) method is simple to implement and eliminates the need for any loss terms associated with temporal continuity. The method is tested for a number of benchmark problems involving both linear and non-linear PDEs. Examples include various first order time dependent problems in which traditional PINNs struggle, namely advection, Allen–Cahn, and Korteweg–de Vries equations. Furthermore, second and third order time-dependent problems are demonstrated via wave and Jerky dynamics examples, respectively. Notably, the Jerky dynamics problem is chaotic, making the problem especially sensitive to temporal accuracy. Finally, the numerical experiments conducted with the proposed method demonstrated superior convergence and accuracy over both traditional PINNs and the soft-constrained counterparts.

42 ENGINEERING↗

Latent Stochastic Differential Equations for Modeling Quasar Variability and Inferring Black Hole Properties

Quasars are bright and unobscured active galactic nuclei (AGN) thought to be powered by the accretion of matter around supermassive black holes at the centers of galaxies. The temporal variability of a quasar’s brightness contains valuable information about its physical properties. The UV/optical variability is thought to be a stochastic process, often represented as a damped random walk described by a stochastic differential equation (SDE). Upcoming wide-field telescopes such as the Rubin Observatory Legacy Survey of Space and Time (LSST) are expected to observe tens of millions of AGN in multiple filters over a ten year period, so there is a need for efficient and automated modeling techniques that can handle the large volume of data. Latent SDEs are machine learning models well suited for modeling quasar variability, as they can explicitly capture the underlying stochastic dynamics. In this work, we adapt latent SDEs to jointly reconstruct multivariate quasar light curves and infer their physical properties such as the black hole mass, inclination angle, and temperature slope. Our model is trained on realistic simulations of LSST ten year quasar light curves, and we demonstrate its ability to reconstruct quasar light curves even in the presence of long seasonal gaps and irregular sampling across different bands, outperforming a multioutput Gaussian process regression baseline. Our method has the potential to provide a deeper understanding of the physical properties of quasars and is applicable to a wide range of other multivariate time series with missing data and irregular sampling.

79 ASTRONOMY AND ASTROPHYSICS↗

First Differential Measurement of the Single 𝜋 + Production Cross Section in Neutrino Neutral-Current Scattering

Since its first observation in the 1970s, neutrino-induced neutral-current single positive pion production (NC⁢1⁢𝜋 + ) has remained an elusive and poorly understood interaction channel. This process is a significant background in neutrino oscillation experiments and studying it further is critical for the physics program of next-generation accelerator-based neutrino oscillation experiments. In this Letter, we present the first double-differential cross-section measurement of NC⁢1⁢𝜋 + interactions using data from the ND280 detector of the T2K experiment collected in 𝜈-beam mode. The measured flux-averaged integrated cross section is 𝜎 = (6.07 ± 1.22) × 10 −41 cm 2 /nucleon. We compare the results on a hydrocarbon target to the predictions of several neutrino interaction generators and final-state-interaction models. While model predictions agree with the differential results, the data show a weak preference for a cross-section normalization approximately 30% higher than predicted by most models studied in this Letter.

Neutrino detection↗

Data-driven, multi-moment fluid modeling of Landau damping

Deriving governing equations of complex physical systems based on first principles can be quite challenging when there are certain unknown terms and hidden physical mechanisms in the systems. In this work, we apply a deep learning architecture to learn fluid partial differential equations (PDEs) of a plasma system based on the data acquired from a fully kinetic model. Here, the learned multi-moment fluid PDEs are demonstrated to incorporate kinetic effect such as Landau damping. Based on the learned fluid closure, the data-driven, multi-moment fluid modeling can well reproduce all the physical quantities derived from the fully kinetic model. The calculated damping rate of Landau damping is consistent with both the fully kinetic simulation and the linear theory. The data-driven fluid modeling of PDEs for complex physical systems may be applied to improve the fluid closure and reduce the computational cost of multi-scale modeling of global systems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

First Measurement of $𝜈_𝑒$ and $\bar{𝜈}_𝑒$ Charged-Current Single Charged-Pion Production Differential Cross Sections on Argon Using the MicroBooNE Detector

Understanding electron neutrino interactions is crucial for measurements of neutrino oscillations and searches for new physics in neutrino experiments. We present the first measurement of the flux-averaged $𝜈_𝑒$ + $\bar{𝜈}_𝑒$ charged-current single charged-pion production cross section on argon using the MicroBooNE detector and data from the NuMI neutrino beam. The total cross section is measured to be [0.93 ± 0.13⁢(stat) ± 0.27⁢(syst)] × 10 −39 cm 2 /nucleon at a mean $𝜈_𝑒$ + $\bar{𝜈}_𝑒$ energy of 730 MeV. Differential cross sections are also reported in electron energy, electron and pion angles, and electron-pion opening angle.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Field Work Proposal ERKJ358: Black-box training for scientific machine learning models (Final Report)

The overarching goal of this project is to develop a scalable black-box training capability for scientific machine learning (SciML) problems that are non-trainable with existing automatic differentiation (AD)-based algorithms. AD assumes that a loss function can be decomposed into a sequence of elementary operations whose derivatives are known. This assumption is violated when the loss function includes a black-box physical model (e.g., a legacy simulator). The current strategy, converting a black-box simulator to an AD-enabled code via differential programming, is inflexible and time-, labor-consuming. Thus, black-box optimization is a main workhorse for training SciML models, e.g., in scientific reinforcement learning, hyper-parameter fine tuning, designing SciML models with adversarial robustness, etc.

97 MATHEMATICS AND COMPUTING↗

Differentiable modeling and optimization of non-aqueous Li-based battery electrolyte solutions using geometric deep learning

Electrolytes play a critical role in designing next-generation battery systems, by allowing efficient ion transfer, preventing charge transfer, and stabilizing electrode-electrolyte interfaces. In this work, we develop a differentiable geometric deep learning (GDL) model for chemical mixtures, DiffMix, which is applied in guiding robotic experimentation and optimization towards fast charging battery electrolytes. In particular, we extend mixture thermodynamic and transport laws by creating GDL-learnable physical coefficients. We evaluate our model with mixture thermodynamics and ion transport properties, where we show improved prediction accuracy and model robustness of Diff-Mix than its purely data-driven variants. Furthermore, with a robotic experimentation setup, Clio, we improve ionic conductivity of electrolytes by over 18.8% within 10 experimental steps, via differentiable optimization built on DiffMix gradients. By combining GDL, mixture physics laws, and robotic experimentation, DiffMix expands the predictive modeling methods for chemical mixtures and enables efficient optimization in large chemical spaces.

25 - ENERGY STORAGE↗

Massive right-handed neutrinos in $\bar{B} \to D^* τ\bar X$ decay

We explore signatures of a massive right-handed neutrino (RHN) in angular distributions of $\bar{B} \to D^* (\to D π) τ(\to πν_τ) \bar X$ decays, where $X$ is an invisible state. We assume the new physics is described by the standard model effective field theory extended with an RHN in the MeV-GeV mass range. We calculate for the first time the full differential distributions in terms of the visible final states, including the decay of the $τ$ lepton. We evaluate the sensitivity of various distributions to the new physics operators.

FOS: Physical sciences↗

Differential analysis of incompressibility in neutron-rich nuclei

Both the incompressibility K A of a finite nucleus of mass A and that (K ∞ ) of infinite nuclear matter are fundamentally important for many critical issues in nuclear physics and astrophysics. While some consensus has been reached about K ∞ , accurate theoretical predictions and experimental extractions of K τ characterizing the isospin dependence of K A have been very difficult. We propose a differential approach to extract K τ and K ∞ independently from the K A data of any two nuclei in a given isotope chain. Applying this method to the K A data from isoscalar giant monopole resonances (ISGMR) in even-even Pb, Sn, Cd, and Ca isotopes taken by Garg et al. at the Research Center for Nuclear Physics (RCNP), Osaka University, Japan, we find that the 106 Cd– 116 Cd and 112 Sn– 124 Sn pairs having the largest differences in isospin asymmetries in their respective isotope chains measured so far provide consistently the most accurate up-to-date K τ value of K τ = –616 ± 59 MeV and K τ =–623 ± 86 MeV, respectively, largely independent of the remaining uncertainties of the surface and Coulomb terms in expanding K A , while the K ∞ values extracted from different isotopes chains are all well within the current uncertainty range of the community consensus for K ∞ . Moreover, the size and origin of the “soft Sn puzzle” is studied with respect to the “stiff Pb phenomenon.” Furthermore, it is found that the latter is favored due to a much larger (by ≈ 380 MeV) K τ for Pb isotopes than for Sn isotopes, while K ∞ from analyzing the K A data of Sn isotopes is only about 5 MeV less than that from analyzing the Pb data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Modeling In-Reactor Temperature Gradients in Lithium Aluminate Ceramic Pellets

In reactor thermal performance of lithium aluminate ceramic pellets are calculated to determine operating temperatures if internal components shift during irradiation. A 2D conduction model was setup to model this scenario with additional physics, including thermal expansion of components to reactor temperatures, creep down of the cladding due to differential pressure between the inside of the rod and reactor coolant system, and net radiation exchange between components. The non-linear coupling of the governing equations presented convergence challenges due to the very different effects from a small temperature change on the radiation vs radial and circumferential conduction equations. Initial temperature guesses for the multidimensional solution were provided from conservative 1D models simulating bounding scenarios. Convergence was greatly improved by taking small steps towards the root solutions and averaging with initial guesses. The final method robustly converged all 132 points at an axial plane after a few dozen iterations. The temperature results show that the additional physics have a secondary effect as the dominant heat transfer mechanism is radial conduction across the gas gap followed by circumferential conduction around components. Circumferential conduction in the lithium aluminate pellets is enhanced by the relatively high thermal conductivity of this ceramic.

Carstens, Nathan A.↗

Crossing beyond scattering amplitudes

We find that different asymptotic measurements in quantum field theory can be related to one another through new versions of crossing symmetry. Assuming analyticity, we conjecture generalized crossing relations for multi-particle processes and the corresponding paths of analytic continuation. We prove them to all multiplicity at tree-level in quantum field theory and string theory. We illustrate how to practically perform analytic continuations on loop-level examples using different methods, including unitarity cuts and differential equations. We study the extent to which anomalous thresholds away from the usual physical region can cause an analytic obstruction to crossing when massless particles are involved. In an appendix, we review and streamline historical proofs of four-particle crossing symmetry in gapped theories.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Fermion geometry and the renormalization of the Standard Model Effective Field Theory

The geometry of field space governs on-shell scattering amplitudes. We formulate a geometric description of effective field theories which extends previous results for scalars and gauge fields to fermions. The field-space geometry reorganizes and simplifies the computation of quantum loop corrections. Using this geometric framework, we calculate the fermion loop contributions to the renormalization group equations for bosonic operators in the Standard Model Effective Field Theory up to mass dimension eight.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗