Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Differentiable physics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Neural lumped parameter differential equations with application in friction-stir processing

Lumped parameter methods aim to simplify the evolution of spatially-extended or continuous physical systems to that of a “lumped” element representative of the physical scales of the modeled system. For systems where the definition of a lumped element or its associated physics may be unknown, modeling tasks may be restricted to full-fidelity physics simulations. Here, in this work, we consider data-driven modeling tasks with limited point-wise measurements of otherwise continuous systems. We build upon the notion of the Universal Differential Equation (UDE) to construct data-driven models for reducing dynamics to that of a lumped parameter and inferring its properties. The flexibility of UDEs allow for composing various known physical priors suitable for application-specific modeling tasks, including lumped parameter methods. The motivating example for this work is the plunge and dwell stages for friction-stir welding; specifically, (i) mapping power input into the tool to a point-measurement of temperature and (ii) using this learned mapping for process control.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Practical Considerations for Understanding Surface Reaction Mechanisms Involved in Heterogeneous Catalysis

Acquiring useful knowledge about the active site(s) of a catalyst, nature of reactant–catalyst interactions, nature of reactive intermediates, rate-determining step, reaction rate orders that affect various process parameters, and reaction mechanism as a whole is exceedingly challenging. This is especially true in the case of heterogeneous catalysts due to the complexity of the nature of surface active sites and their nonstatic behavior. Here, we present our perspective on differentiating between various surface reaction mechanisms in light of pioneering studies by leaders in the field, with the aim of clarifying some of the confusion associated with these complex mechanisms, especially the Eley–Rideal mechanism. Using bibliometric analysis, we identify and discuss the following four reactions that most commonly invoke the Eley– Rideal mechanism: H 2 activation, CO oxidation, esterification of alcohols by acids, and selective catalytic reduction (SCR) of NO x with NH 3 . Our analysis of studies utilizing well-suited experimental and computational methodologies for differentiating surface reaction mechanisms suggests that the above-mentioned four reactions do not occur via the Eley–Rideal mechanism. Instead, each reaction occurs via the Langmuir–Hinshelwood mechanism with nonidealities present. Lastly, we highlight practical considerations regarding select experimental (characterization methods and differential kinetics) and computational modeling that we believe can provide useful insights to accurately discern between the various possible reaction mechanisms in heterogeneous catalysis.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Physics-informed machine learning

Despite great progress in simulating multiphysics problems using the numerical discretization of partial differential equations (PDEs), one still cannot seamlessly incorporate noisy data into existing algorithms, mesh generation remains complex, and high-dimensional problems governed by parameterized PDEs cannot be tackled. Moreover, solving inverse problems with hidden physics is often prohibitively expensive and requires different formulations and elaborate computer codes. Machine learning has emerged as a promising alternative, but training deep neural networks requires big data, not always available for scientific problems. Instead, such networks can be trained from additional information obtained by enforcing the physical laws (for example, at random points in the continuous space-time domain). Such physics-informed learning integrates (noisy) data and mathematical models, and implements them through neural networks or other kernel-based regression networks. Moreover, it may be possible to design specialized network architectures that automatically satisfy some of the physical invariants for better accuracy, faster training and improved generalization. Furthermore, we review some of the prevailing trends in embedding physics into machine learning, present some of the current capabilities and limitations and discuss diverse applications of physics-informed learning both for forward and inverse problems, including discovering hidden physics and tackling high-dimensional problems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Enhancing Drinking Water Quality Modeling: Leveraging Physics Informed Neural Networks for Learning with Imperfect Reaction Models and Partial Data

Chemical kinetics models, typically formulated as systems of ordinary or partial differential equations, are valuable tools for simulating drinking water quality. However, these models often face inaccuracies due to discrepancies between the laboratory and the real-world conditions, as well as limitations in experimental analytical methods, hindering the accurate representation of the true underlying chemical mechanisms. In this study, we propose a Physics Informed Neural Network (PINN), using the eXtreme Theory of Functional Connections, to improve the prediction of chemical concentrations over time. The PINN method accounts for imperfect chemical models and incorporates partial data to improve predictions. Focusing on reactions describing water disinfection residual and disinfectant byproduct formation, which are crucial for public health and regulatory compliance, we demonstrate that the PINN model is able to accurately predict the concentrations of chemical species across various pH values. Notably, the model extends its accuracy to predict concentrations of chemical species not originally included in its training data. The developed method can be extended to a variety of chemical systems, offering a wide array of potential applications.

13 HYDRO ENERGY↗
DOE OSTI2025

Optimizing the optimizer for physics-informed neural networks and Kolmogorov-Arnold networks

Physics-Informed Neural Networks (PINNs) have revolutionized the computation of PDE solutions by integrating partial differential equations (PDEs) into the neural network’s training process as soft constraints, becoming an important component of the scientific machine learning (SciML) ecosystem. More recently, physics-informed Kolmogorv-Arnold networks (PIKANs) have also shown to be effective and comparable in accuracy with PINNs. In their current implementation, both PINNs and PIKANs are mainly optimized using first-order methods like Adam, as well as quasi-Newton methods such as BFGS and its low-memory variant, L-BFGS. However, these optimizers often struggle with highly nonlinear and non-convex loss landscapes, leading to challenges such as slow convergence, local minima entrapment, and (non)degenerate saddle points. In this study, we investigate the performance of Self- Scaled BFGS (SSBFGS), Self-Scaled Broyden (SSBroyden) methods and other advanced quasi-Newton schemes, including BFGS and L-BFGS with different line search strategies. These methods dynamically rescale updates based on historical gradient information, thus enhancing training efficiency and accuracy. We systematically compare these optimizers – using both PINNs and PIKANs – on key challenging PDEs, including the Burgers, Allen-Cahn, Kuramoto-Sivashinsky, Ginzburg-Landau, and Stokes equations. Additionally, we evaluate the performance of SSBFGS and SSBroyden for Deep Operator Network (DeepONet) architectures, demonstrating their effectiveness for data-driven operator learning. Our findings provide state-of-the-art results with orders-of-magnitude accuracy improvements without the use of adaptive weights or any other enhancements typically employed in PINNs. More broadly, our work reveal insights into the effectiveness of quasi-Newton optimization strategies in significantly improving the convergence and accurate generalization of PINNs and PIKANs.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1994

Modeling jets in cross flow

Various approaches to the modeling of jets in cross flow are reviewed. These are grouped into four classes, namely: empirical models, integral models, perturbation models, and numerical models. Empirical models depend largely on the correlation of experimental data and are mostly useful for first-order estimates of global properties such as jet trajectory and velocity and temperature decay rates. Integral models are based on some ordinary-differential form of the conservation laws, but require substantial empirical calibration. They allow more details of the flow field to be obtained; simpler versions have to assume similarity of velocity and temperature profiles, but more sophisticated ones can actually calculate these profiles. Perturbation models require little empirical input, but the need for small parameters to ensure convergent expansions limits their application to either the near-field or the far-field. Therefore, they are mostly useful for the study of flow physics. Numerical models are based on conservation laws in partial-differential form. They require little empirical input and have the widest range of applicability. They also require the most computational resources. Although many qualitative and quantitative features of jets in cross flow have been predicted with numerical models, many issues affecting accuracy such as grid resolution and turbulence model are not completely resolved.

Demuren, A. O.↗
DOE OSTI2020

A model for radiative heating of a high-Z pusher

Several approaches to Inertial Confinement Fusion (ICF), including double-shell, pushered-single-shell, and the Revolver designs, have fuel surrounded by pushers made from high-Z materials. An advantage of these designs is that radiation emitted by the hot fuel will be absorbed and re-radiated into the fuel to reduce cooling. This process is referred to as radiation-trapping, and it lowers the fuel temperature required for ignition. To elucidate the physics of radiation trapping, a simplified model comprising a set of coupled differential equations has been developed to model the arbitrary time-dependent wall temperature from the Hammer and Rosen solution [J. H. Hammer and M. D. Rosen, Phys. Plasmas 10, 1829 (2003)] to a Marshak wave. The derivation of the model and a set of analytical power-law solutions will be presented. A discussion on numerical implementation of the differential equations into a model for burn in ICF capsules is also included.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
NASA NTRS1975

Precision Selenodesy via Differential Very-Long-Baseline Interferometry

The technique of differential very-long baseline interferometry was used to measure the relative positions of the ALSEP transmitters at the Apollo 12, 14, 15, 16, and 17 lunar landing sites with uncertainties less than 0.005 of geocentric arc. These measurements yielded improved determinations of the selenodetic coordinates of the Apollo landing sites, and of the physical libration of the moon. By means of a new device, the differential Doppler receiver (DDR), instrumental errors were reduced to less than the equivalent of 0.001. DDRs were installed in six stations of the NASA spaceflight tracking and data network and used in an extensive program of observations beginning in March 1973.

King, R. W., Jr.↗
DOE OSTI2021

First Muon Neutrino on Argon Cross Section Measurements With an Off-Axis Beam

While over ninety years have passed since neutrinos were first predicted in 1930 by Wolfgang Pauli, much about them is still unknown [20]. How many types of neutrinos there are, how precisely neutrinos change flavor, and how neutrinos interact with various types of matter are largely unanswered questions that have implications for fields beyond particle physics, such as cosmology and astrophysics. The final question can be answered partially by differential cross section measurements, two of which constitute the primary result of this thesis. The NeUtrinos at the Main Injector (NuMI) Beam at Fermilab in Batavia, IL provides a source of muon neutrinos and muon antineutrinos to the MicroBooNE experiment, an 85 ton liquid argon time projection chamber (LArTPC). The technology allows for high precision particle tracking and energy reconstruction that can be used to make cross section measurements. Necessary work for making these measurements for which the author of this thesis made an essential contribution is presented in detail in References [21] [22] [11] [23]. The measurement presented in this thesis is made with 2.187e20 Protons on Target (POT), the standard metric for an amount of beam exposure, of data when the beam was in forward horn current mode. Single-differential cross section measurements in terms of muon candidate kinetic energy and direction are made, and their statistical fits with simulation are 5.8 (12 d.o.f.) and 11.4 (10 d.o.f.), respectively. This indicates that the muon kinematics for muon neutrino and muon antineutrino charged-current (CC) events primarily in the energy range [0-3] GeV can be trusted for oscillation experiments, including DUNE, because of the agreement to within the associated systematic and statistical uncertainties between the measurement and the model in every bin of both single-differential cross sections. This result adds to the corresponding result for the Booster Neutrino Beam (BNB) because it covers a completely different energy region than that measurement, a double-differential cross section in terms of muon momentum and direction [14]. This result contributes to reducing the uncertainty in near-far event rate comparisons in long baseline neutrino experiments and also adds to existing knowledge of the neutrino-nucleus interaction by describing the outgoing muon kinematics in interactions of muon neutrinos and muon antineutrinos. This result is the first-ever measurement of differential cross sections of muon neutrinos and muon antineutrinos in liquid argon made with an off-axis beam.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Optimization using pathwise algorithmic derivatives of electromagnetic shower simulations

Among the well-known methods to approximate derivatives of expectancies computed by Monte-Carlo simulations, averages of pathwise derivatives are often the easiest one to apply. Computing them via algorithmic differentiation typically does not require major manual analysis and rewriting of the code, even for very complex programs like simulations of particle-detector interactions in high-energy physics. However, the pathwise derivative estimator can be biased if there are discontinuities in the program, which may diminish its value for applications. This work integrates algorithmic differentiation into the electromagnetic shower simulation code HepEmShow based on G4HepEm, allowing us to study how well pathwise derivatives approximate derivatives of energy depositions in a sampling calorimeter with respect to parameters of the beam and geometry. We found that when multiple scattering is disabled in the simulation, means of pathwise derivatives converge quickly to their expected values, and these are close to the actual derivatives of the energy deposition. Additionally, we demonstrate the applicability of this novel gradient estimator for stochastic gradient-based optimization in a model example.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Multi-resolution partial differential equations preserved learning framework for spatiotemporal dynamics

Traditional data-driven deep learning models often struggle with high training costs, error accumulation, and poor generalizability in complex physical processes. Physics-informed deep learning (PiDL) addresses these challenges by incorporating physical principles into the model. Most PiDL approaches regularize training by embedding governing equations into the loss function, yet this depends heavily on extensive hyperparameter tuning to weigh each loss term. To this end, we propose to leverage physics prior knowledge by “baking” the discretized governing equations into the neural network architecture via the connection between the partial differential equations (PDE) operators and network structures, resulting in a PDE-preserved neural network (PPNN). This method, embedding discretized PDEs through convolutional residual networks in a multi-resolution setting, largely improves the generalizability and long-term prediction accuracy, outperforming conventional black-box models. The effectiveness and merit of the proposed methods have been demonstrated across various spatiotemporal dynamical systems governed by spatiotemporal PDEs, including reaction-diffusion, Burgers’, and Navier-Stokes equations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Dualities among massive, partially massless and shift symmetric fields on (A)dS

We catalog all the electromagnetic-like dualities that exist between free dynamical bosonic fields of arbitrary symmetry type and mass on (anti-) de Sitter space in all dimensions, including dualities among the partially massless and shift symmetric fields. This generalizes to all these field types the well known fact that a massless p-form is dual to a massless (D − p − 2)-form in D spacetime dimensions. In the process, we describe the structure of the Weyl modules (the spaces of local operators linear in the fields and their derivative relations) for all the massive, partially massless and shift symmetric fields.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Effective field theories as Lagrange spaces

We present a formulation of scalar effective field theories in terms of the geometry of Lagrange spaces. The horizontal geometry of the Lagrange space generalizes the Riemannian geometry on the scalar field manifold, inducing a broad class of affine connections that can be used to covariantly express and simplify tree-level scattering amplitudes. Meanwhile, the vertical geometry of the Lagrange space characterizes the physical validity of the effective field theory, as a torsion component comprises strictly higher-point Wilson coefficients. Imposing analyticity, unitarity, and symmetry on the theory then constrains the signs and sizes of derivatives of the torsion component, implying that physical theories correspond to a special class of vertical geometry.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Measurement of the J/ψ photoproduction cross section over the full near-threshold kinematic region

Here, we report the total and differential cross sections for $J/\psi$ photoproduction with the large acceptance GlueX spectrometer for photon beam energies from the threshold at 8.2 GeV up to 11.44 GeV and over the full kinematic range of momentum transfer squared, $t$. Such coverage facilitates the extrapolation of the differential cross sections to the forward ($t = 0$) point beyond the physical region. The forward cross section is used by many theoretical models and plays an important role in understanding $J/\psi$ photoproduction and its relation to the $J/\psi$-proton interaction. These measurements of $J/\psi$ photoproduction near threshold are also crucial inputs to theoretical models that are used to study important aspects of the gluon structure of the proton, such as the gluon Generalized Parton Distribution (GPD) of the proton, the mass radius of the proton, and the trace anomaly contribution to the proton mass. We observe possible structures in the total cross section energy dependence and find evidence for contributions beyond gluon exchange in the differential cross section close to threshold, both of which are consistent with contributions from open-charm intermediate states.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1998

Overview of Sensitivity Analysis and Shape Optimization for Complex Aerodynamic Configurations

This paper presents a brief overview of some of the more recent advances in steady aerodynamic shape-design sensitivity analysis and optimization, based on advanced computational fluid dynamics. The focus here is on those methods particularly well- suited to the study of geometrically complex configurations and their potentially complex associated flow physics. When nonlinear state equations are considered in the optimization process, difficulties are found in the application of sensitivity analysis. Some techniques for circumventing such difficulties are currently being explored and are included here. Attention is directed to methods that utilize automatic differentiation to obtain aerodynamic sensitivity derivatives for both complex configurations and complex flow physics. Various examples of shape-design sensitivity analysis for unstructured-grid computational fluid dynamics algorithms are demonstrated for different formulations of the sensitivity equations. Finally, the use of advanced, unstructured-grid computational fluid dynamics in multidisciplinary analyses and multidisciplinary sensitivity analyses within future optimization processes is recommended and encouraged.

Newman, Perry A.↗
NASA NTRS1999

Overview of Sensitivity Analysis and Shape Optimization for Complex Aerodynamic Configurations

This paper presents a brief overview of some of the more recent advances in steady aerodynamic shape-design sensitivity analysis and optimization, based on advanced computational fluid dynamics (CFD). The focus here is on those methods particularly well-suited to the study of geometrically complex configurations and their potentially complex associated flow physics. When nonlinear state equations are considered in the optimization process, difficulties are found in the application of sensitivity analysis. Some techniques for circumventing such difficulties are currently being explored and are included here. Attention is directed to methods that utilize automatic differentiation to obtain aerodynamic sensitivity derivatives for both complex configurations and complex flow physics. Various examples of shape-design sensitivity analysis for unstructured-grid CFD algorithms are demonstrated for different formulations of the sensitivity equations. Finally, the use of advanced, unstructured-grid CFDs in multidisciplinary analyses and multidisciplinary sensitivity analyses within future optimization processes is recommended and encouraged.

Newman, James C., III↗
NASA NTRS1969

Analysis of urban residential environments using color infrared aerial photography: An examination of socioeconomic variables and physical characteristics of selected areas in the Los Angeles basin, with addendum: An application of the concepts of the Los Angeles residential environment study to the Ontario-Upland region of California

Aerial photographs taken with color infrared film were used to differentiate various types of residential areas in the Los Angeles basin, using characteristics of the physical environment which vary from one type of residential area to another. Residential areas of varying quality were classified based on these characteristics. Features of the physical environment, identifiable on CIR aerial photography were examined to determine which of these are the best indicators of quality of residential areas or social areas, as determined by the socioeconomic characteristics of the inhabitants of the selected areas. Association between several physical features and the socioeconomic variables was found to exist.

Mullens, R. H., Jr.↗
NASA NTRS1977

Boundary-fitted curvilinear coordinate systems for solution of partial differential equations on fields containing any number of arbitrary two-dimensional bodies

A method is presented for automatic numerical generation of a general curvilinear coordinate system with coordinate lines coincident with all boundaries of a general multi-connected two-dimensional region containing any number of arbitrarily shaped bodies. No restrictions are placed on the shape of the boundaries, which may even be time-dependent, and the approach is not restricted in principle to two dimensions. With this procedure the numerical solution of a partial differential system may be done on a fixed rectangular field with a square mesh with no interpolation required regardless of the shape of the physical boundaries, regardless of the spacing of the curvilinear coordinate lines in the physical field, and regardless of the movement of the coordinate system in the physical plane. A number of examples of coordinate systems and application thereof to the solution of partial differential equations are given. The FORTRAN computer program and instructions for use are included.

Thompson, J. F.↗