Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Differentiable physics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Using Differential Forms to Find Symmetries in the Noh Problem for an Ideal Gas in a Spherical System

The Euler equations describe inviscid, compressible gas flow and are derived using the laws of conservation of mass, momentum, and energy. From these equations a common test problem, the Noh problem, can be solved for invariant solutions in planar, cylindrical, and spherical geometries. Using Lie group analysis methods, we will solve the Noh Problem for an ideal gas in a spherical system.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Uncovering turbulent plasma dynamics via deep learning from partial observations

One of the most intensely studied aspects of magnetic confinement fusion is edge plasma turbulence which is critical to reactor performance and operation. Drift-reduced Braginskii two-fluid theory has for decades been widely applied to model boundary plasmas with varying success. Towards better understanding edge turbulence in both theory and experiment, we demonstrate that a novel multi-network physics-informed deep learning framework constrained by partial differential equations can accurately learn turbulent fields consistent with the two-fluid theory from partial observations of electron pressure which is not otherwise possible using conventional equilibrium models. Furthermore, this technique presents a novel paradigm for the advanced design of plasma diagnostics and validation of magnetized plasma turbulence theories in challenging thermonuclear environments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A new framework for higher loop Witten diagrams

The differential representation is a novel formalism for studying boundary correlators in (d + 1)-dimensional anti-de Sitter space. In this letter, we generalize the differential representation beyond tree level using the notion of operator-valued integrals. We use the differential representation to compute three-point bubble and triangle Witten diagrams with external states of conformal dimension ∆ = d. We compare the former to a position space computation.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Convolutional double copy in (anti) de Sitter space

The double copy is a remarkable relationship between gauge theory and gravity that has been explored in a number of contexts, most notably scattering amplitudes and classical solutions. The convolutional double copy provides a straightforward method to bridge the two theories via a precise map for the fields and symmetries at the linearised level. This method has been thoroughly investigated in flat space, offering a comprehensive dictionary both with and without fixing the gauge degrees of freedom. In this paper, we extend this to curved space with an (anti) de Sitter background metric. We work in the temporal gauge, and employ a modified convolution that involves the Mellin transformation in the time direction. As an example, we show that the point-like charge in gauge theory double copies to the (dS-) Schwarzschild black hole solution.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

nPINNs: Nonlocal physics-informed neural networks for a parametrized nonlocal universal Laplacian operator. Algorithms and applications

Physics-informed neural networks (PINNs) are effective in solving inverse problems based on differential and integro-differential equations with sparse, noisy, unstructured, and multifidelity data. PINNs incorporate all available information, including governing equations (reflecting physical laws), initial-boundary conditions, and observations of quantities of interest, into a loss function to be minimized, thus recasting the original problem into an optimization problem. In this paper, we extend PINNs to parameter and function inference for integral equations such as nonlocal Poisson and nonlocal turbulence models, and we refer to them as nonlocal PINNs (nPINNs). The contribution of the paper is three-fold. First, we propose a unified nonlocal Laplace operator, which converges to the classical Laplacian as one of the operator parameters, the nonlocal interaction radius $\delta$ goes to zero, and to the fractional Laplacian as $\delta$ goes to infinity. This universal operator forms a super-set of classical Laplacian and fractional Laplacian operators and, thus, has the potential to fit a broad spectrum of data sets. We also provide theoretical convergence rates with respect to $\delta$ and verify them via numerical experiments. Second, we use nPINNs to estimate the two parameters, $\delta$ and $\alpha$, characterizing the kernel of the unified operator. The strong non-convexity of the loss function yielding multiple (good) local minima reveals the occurrence of the operator mimicking phenomenon, that is, different pairs of estimated parameters could produce multiple solutions of comparable accuracy. Third, we propose another nonlocal operator with spatially variable order $\alpha(y)$, which is more suitable for modeling turbulent Couette flow. Our results show that nPINNs can jointly infer this function as well as $\delta$. More importantly, these parameters exhibit a universal behavior with respect to the Reynolds number, a finding that contributes to our understanding of nonlocal interactions in wall-bounded turbulence.

97 MATHEMATICS AND COMPUTING↗

Exogeological inferences from white dwarf pollutants: the impact of stellar physics

Many white dwarfs have accreted material from their own planetary systems. These objects can be used to infer the composition of exoplanetary material and identify evidence for key geological processes. However, the white dwarf atmospheric physics distorts the inferred material composition away from the true composition, mainly through differential atomic diffusion of the accreted metals. Correcting for this effect is essential, but is dependent on various physical assumptions associated with the white dwarf itself. We first focus on the effect of assumptions related to convective overshoot and thermohaline mixing on the atomic diffusion time-scales. For white dwarfs with H-dominated atmospheres between 12000 K and 18000 K⁠, we find that including a complete treatment of convective overshoot decreases the inferred Fe and O abundances in accreted material. For these white dwarfs, we also find that including thermohaline mixing decreases Fe and O abundances. For He-dominated systems, the effect of convective overshoot is comparatively minor. We then explore the overall effect of other physical assumptions by comparing publicly available grids of diffusion time-scales. We find that the choice of model grid can have a large impact for white dwarfs with He-dominated atmospheres, notably on the inferred core to mantle ratio of accreted material. We identify several systems for which the geological interpretation is robust against these systematics. We also present a ‘discrepancy metric’ which can be used to estimate the potential impact of changing the stellar physics without requiring detailed modelling.

Astronomy and AstroPhysics↗

nPINNs: nonlocal Physics-Informed Neural Networks for a parametrized nonlocal universal Laplacian operator. Algorithms and Applications

Physics-informed neural networks (PINNs) are effective in solving inverse problems based on differential and integro-differential equations with sparse, noisy, unstructured, and multifidelity data. PINNs incorporate all available information, including governing equations (reflecting physical laws), initial-boundary conditions, and observations of quantities of interest, into a loss function to be minimized, thus recasting the original problem into an optimization problem. In this paper, we extend PINNs to parameter and function inference for integral equations such as nonlocal Poisson and nonlocal turbulence models, and we refer to them as nonlocal PINNs (nPINNs). The contribution of the paper is three-fold. First, we propose a unified nonlocal Laplace operator, which converges to the classical Laplacian as one of the operator parameters, the nonlocal interaction radius δ goes to zero, and to the fractional Laplacian as δ goes to infinity. This universal operator forms a super-set of classical Laplacian and fractional Laplacian operators and, thus, has the potential to fit a broad spectrum of data sets. We provide theoretical convergence rates with respect to δ and verify them via numerical experiments. Second, we use nPINNs to estimate the two parameters, δ and α, characterizing the kernel of the unified operator. The strong non-convexity of the loss function yielding multiple (good) local minima reveals the occurrence of the operator mimicking phenomenon, that is, different pairs of estimated parameters could produce multiple solutions of comparable accuracy. Third, we propose another nonlocal operator with spatially variable order α(γ), which is more suitable for modeling turbulent Couette flow. Our results show that nPINNs can jointly infer this function as well as δ. More importantly, these parameters exhibit a universal behavior with respect to the Reynolds number, a finding that contributes to our understanding of nonlocal interactions in wall-bounded turbulence.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Differentiable vertex fitting for jet flavor tagging

This work explores the use of differentiable programming to integrate domain knowledge, in the form of domain specific software, into neural networks to develop scientific machine learning systems. We propose a differentiable vertex fitting algorithm that estimates the crossing point of multiple curves. In the high energy physics setting, these curves are defined by particle equations of motion and the crossing point represents the origin of particle production. This differentiable vertex fitting algorithm can be seamlessly integrated into neural networks, and we show its utility and efficacy in the high energy physics application of the classification of jets, i.e., collimated streams of particles in particle detectors whose originating parent particle we aim to classify. We demonstrate how differentiable vertex fitting can be integrated into larger transformer-based models for jet flavor tagging and show improvements in heavy flavor jet classification when compared to baseline models. Published by the American Physical Society 2024

Smith, Rachel E. C. (ORCID:0000000335851262)↗

Two-Scale Neural Networks for Partial Differential Equations with Small Parameters

We propose a two-scale neural network method for solving partial differential equations (PDEs) with small parameters using physics-informed neural networks (PINNs). We directly incorporate the small parameters into the architecture of neural networks. The proposed method enables solving PDEs with small parameters in a simple fashion, without adding Fourier features or other computationally taxing searches of truncation parameters. Various numerical examples demonstrate reasonable accuracy in capturing features of large derivatives in the solutions caused by small parameters.

97 MATHEMATICS AND COMPUTING↗

Handling Iterative Solvers in an Algorithmic Differentiation Framework Using Implicit Methods

Differentiable programming is a powerful concept as it enables the seemly propagation of gradients through functions, algorithms, and/or whole physics simulations. These gradients are useful for a wide variety of applications, including sensitivity studies and machine learning, but one of particular interest is optimization. Gradient-based optimization, enabled through automatic/algorithmic differentiation (AD), can be used on predictive physical models to efficiently optimize a set of design variables. AD methods are a particularly promising approach to complex physics simulations because they can be shown to scale well with an increasing number of design variables; however, care must be taken when coupling between different models or different states of a single model.

algorithmic differentiation↗

SU(n) and Quantum SU(n) Symmetries in Physical Systems [Slides]

Presence of SU(n) or other Lie group symmetry in a physical system is its powerful, usually underutilized property. In many cases it allows for finding analytical solutions to nonlinear differential equations describing this system. Power of the method is presented on diversified examples from mathematical physics: Lie-group symmetries in finding solutions of generalized, multidimensional theory of gravity; analytical Dirac–equation solutions for description of conducting polymers; stability of qubit states in quantum computers; spatial defects in condensed matter; reconstruction of 3D object from its 2D tomographic image; significant improvement of numerical solutions stability for Euler equations. The next question after obtaining such Lie group symmetric solution is: does a generalized solution with appropriate quantum group symmetry exists for the given physical system, and if yes what is the physical meaning of the deformation parameter q introduced by such solution. In many cases it can be identified. Any SU(n) solution is by its nature singular, assuming a perfect symmetry of the physical system discussed. Such solution gives a powerful insight to theoretical physics, yet the assumption may be too demanding for experimental applications. Deformation parameter q from a quantum group symmetry allows for a continuum of solutions, more applicable to experiments.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Infrared Signatures for Phase Identification in Hafnium Oxide Thin Films

Phase identification in HfO 2 -based thin films is a prerequisite to understanding the mechanisms stabilizing the ferroelectric phase in these materials, which hold great promise in next-generation non-volatile memory and computing technology. While grazing-incidence X-ray diffraction is commonly employed for this purpose, it has difficulty unambiguously differentiating between the ferroelectric phase and other metastable phases that may exist due to similarities in the d-spacings, their low intensities, and the overlapping of reflections. Infrared signatures provide an alternative route. However, their use in phase identification remains limited because phase control has overwhelmingly been accomplished via substituents, thereby convoluting infrared signatures between the substituent and the phase changes they induce. Herein, we report the infrared optical responses of three undoped hafnium oxide films where annealing conditions have been used to create films consisting primarily of the ferroelectric polar orthorhombic Pca2 1 , antipolar orthorhombic Pbca, and monoclinic P2 1 /c phases, as was confirmed via transmission electron microscopy (TEM), UVvisible optical properties, and electrical property measurements. Vibrational signatures acquired from synchrotron nano-Fourier transform infrared spectroscopy (nano-FTIR) are shown to be capable of differentiating between the phases in a non-destructive, rapid, and nanoscale manner. The utility of nano-FTIR is illustrated for a film exhibiting an antiferroelectric polarization response. In this sample, it is proven that this behavior results from the Pbca phase rather than the often-cited tetragonal phase. Here, by demonstrating that IRspectroscopy can unambiguously distinguish phases in this material, this work establishes a tool needed to isolate the factors dictating ferroelectric phase stability in HfO 2 -based materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Computing Nonequilibrium Responses with Score-Shifted Stochastic Differential Equations

Using equilibrium fluctuations to understand the response of a physical system to an externally imposed perturbation is the basis for linear response theory, which is widely used to interpret experiments and shed light on microscopic dynamics. For nonequilibrium systems, perturbations cannot be interpreted simply by monitoring fluctuations in a conjugate observable and general response results rely on path ensemble averaging. Furthermore, these techniques do not apply to perturbations that affect the diffusion tensor in a stochastic system. Here, we introduce an “effective” physical process that represents the diffusion perturbed dynamics and enables accurate calculations of responses to a change in the diffusion. Interestingly, the effective dynamics contain an additional drift involving the instantaneous “score” of the system, and we leverage score matching algorithms to carry out nonequilibrium response calculations on systems for which the exact stationary distribution is unknown.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Assessment of MOOSE-Based Tools for Calculating Radial Core Expansion

Radial core expansion in liquid-metal cooled fast reactor systems is a well-known phenomenon that produces strong reactivity feedback effects. An inherently safe reactor design takes advantage of negative reactivity feedback in accident scenarios by utilizing a core restraint system which produces a bowed shape that allows for radial expansion of the fuel regions. Detailed modeling and simulation of core radial expansion itself as well as subsequent reactivity feedback is a challenging task involving contact of many fuel assembly elements and physics feedback from neutronics, thermal hydraulics, and thermal mechanical response. A variety of physics codes have been developed to model aspects of radial core expansion but in general invoke geometrical or physics approximations. No code system currently exists which tightly and robustly couples these physics with enough detail to fully resolve the complex core radial expansion reactivity feedback effects. The future availability of such a code system is of vital importance to fully understanding the reactivity feedback effects that occur due to radial expansion, and consequently to optimizing the design of the core restraint system. A high-fidelity code will also be used to benchmark existing lower fidelity, faster running models to understand their benefits, limitations, and range of applications. A code development path using MOOSE-based tools is proposed in order to leverage the detailed geometry capabilities and natural tight coupling and robustness of MOOSE-based applications for modeling this complex phenomena. While simulation of the full phenomenon involves several physics, an assessment has been initiated on the capabilities and readiness of the currently available Tensor Mechanics module within MOOSE for calculation of the structural mechanical responses which occur within the reactor core. This report focuses on modeling the force-deformation response which mimics the physics of a duct contact deformation, as well as differential thermal expansion which produces a thermal bowed shaped for the fuel assemblies in a core. Simple examples were initially performed such as simple supported beam bending under load. The complexity of examples was progressively increased to better mimic the duct behavior by including a differential thermal example and inclusion of hexagonal cross-sections in the geometry. Further assessment of the structural mechanical response simulation capability is still required for modeling duct contact interactions and irradiation creep and swelling. Companion thermal hydraulic and neutronics assessments will also be required; these activities are planned for future years. Finally, integration of the multiple physics components through MOOSE is required to predict the core radial expansion and subsequent feedback effects.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

The obligate intracellular bacterium Orientia tsutsugamushi differentiates into a developmentally distinct extracellular state

Orientia tsutsugamushi (Ot) is an obligate intracellular bacterium in the family Rickettsiaceae that causes scrub typhus, a severe mite-borne human disease. Its mechanism of cell exit is unusual amongst Rickettsiaceae, as Ot buds off the surface of infected cells enveloped in plasma membrane. Here, we show that Ot bacteria that have budded out of host cells are in a distinct developmental stage compared with intracellular bacteria. We refer to these two stages as intracellular and extracellular bacteria (IB and EB, respectively). These two forms differ in physical properties: IB is both round and elongated, and EB is round. Additionally, IB has higher levels of peptidoglycan and is physically robust compared with EB. The two bacterial forms differentially express proteins involved in bacterial physiology and host-pathogen interactions, specifically those involved in bacterial dormancy and stress response, and outer membrane autotransporter proteins ScaA and ScaC. Whilst both populations are infectious, entry of IB Ot is sensitive to inhibitors of both clathrin-mediated endocytosis and macropinocytosis, whereas entry of EB Ot is only sensitive to a macropinocytosis inhibitor. Our identification and detailed characterization of two developmental forms of Ot significantly advances our understanding of the intracellular lifecycle of an important human pathogen.

59 BASIC BIOLOGICAL SCIENCES↗

Calabi-Yau CFTs and random matrices

Using numerical methods for finding Ricci-flat metrics, we explore the spectrum of local operators in two-dimensional conformal field theories defined by sigma models on Calabi-Yau targets at large volume. Focusing on the examples of K3 and the quintic, we show that the spectrum, averaged over a region in complex structure moduli space, possesses the same statistical properties as the Gaussian orthogonal ensemble of random matrix theory.

superstring vacua↗

The stratification of rigidity

We show that a master integrand basis exists for all planar, two-loop amplitudes in massless four-dimensional theories which is fully stratified by rigidity — with each integrand being either pure and strictly polylogarithmic or (pure and) strictly elliptic-polylogarithmic, with each of the later involving a single elliptic curve. Such integrands can be said to have definite rigidity.

1/N Expansion↗

Respecting causality for training physics-informed neural networks

While the popularity of physics-informed neural networks (PINNs) is steadily rising, to this date PINNs have not been successful in simulating dynamical systems whose solution exhibits multi-scale, chaotic or turbulent behavior. In this work we attribute this shortcoming to the inability of existing PINNs formulations to respect the spatio-temporal causal structure that is inherent to the evolution of physical systems. We argue that this is a fundamental limitation and a key source of error that can ultimately steer PINN models to converge towards erroneous solutions. We address this pathology by proposing a simple re-formulation of PINNs loss functions that can explicitly account for physical causality during model training. We demonstrate that this simple modification alone is enough to introduce significant accuracy improvements, as well as a practical quantitative mechanism for assessing the convergence of a PINNs model. Here we provide state-of-the-art numerical results across a series of benchmarks for which existing PINNs formulations fail, including the chaotic Lorenz system, the Kuramoto–Sivashinsky equation in the chaotic regime, and the Navier–Stokes equations. To the best of our knowledge, this is the first time that PINNs have been successful in simulating such systems, introducing new opportunities for their applicability to problems of industrial complexity.

97 MATHEMATICS AND COMPUTING↗