Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Differentiable physics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Extending the Takagi-Taupin equations for x-ray nanobeam Bragg coherent diffraction

We present an approach for simulating x-ray nanobeam Bragg coherent diffraction patterns based on the Takagi-Taupin equations. Compared to conventional methods, the current approach can be universally applied to any weakly strained system including semi-infinite crystals that diffract dynamically. It addresses issues such as the curved wave front and redivergence of the focused incident beam. In conclusion, we show excellent agreement with experimental data for a strained La 0.7 ⁢Sr 0.3⁢ MnO 3 thin film on a SrTiO 3 substrate and a path to extracting physical information using automatic differentiation.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2026

Physics vs structure: A systematic benchmark of learning strategies for multi-zone building thermal dynamics

Recent advances in physics-informed and data-driven machine learning promise improved thermal models for advanced building control, yet there is limited quantitative evidence on when added physics structure and architectural complexity are beneficial. Here, this work presents a systematic benchmark of five representative system identification methods for modeling multi-zone building thermal dynamics: linear state-space models, multi-layer perceptrons, neural state-space models, neural ordinary differential equations, and physically-consistent neural networks. The methods are evaluated across multiple data regimes and zone coupling strategies. Using a high-fidelity multi-zone commercial building emulator, we examine short-term and long-term prediction accuracy, computational efficiency, and ease of development. Our results reveal critical trade-offs between prediction performance, model complexity, and physical consistency. We demonstrate that decoupled, nonlinear black-box models consistently outperform coupled physics-constrained architectures in both predictive accuracy and out-of-distribution robustness in majority of the test cases for the building type considered in the study. Our findings quantify the cost of complexity in building thermal modeling and provide concrete, actionable, scenario-based guidelines for selecting model classes for control-oriented applications.

Building thermal modeling↗
DOE OSTI2022

Physics-based compact modeling of electro-thermal memristors: Negative differential resistance, local activity, and non-local dynamical bifurcations

Leon Chua's Local Activity theory quantitatively relates the compact model of an isolated nonlinear circuit element, such as a memristor, to its potential for desired dynamical behaviors when externally coupled to passive elements in a circuit. However, the theory's use has often been limited to potentially unphysical toy models and analyses of small-signal linear circuits containing pseudo-elements (resistors, capacitors, and inductors), which provide little insight into required physical, material, and device properties. Furthermore, the Local Activity concept relies on a local analysis and must be complemented by examining dynamical behavior far away from the steady-states of a circuit. In this work, we review and study a class of generic and extended one-dimensional electro-thermal memristors (i.e., temperature is the sole state variable), re-framing the analysis in terms of physically motivated definitions and visualizations to derive intuitive compact models and simulate their dynamical behavior in terms of experimentally measurable properties, such as electrical and thermal conductance and capacitance and their derivatives with respect to voltage and temperature. Within this unified framework, we connect steady-state phenomena, such as negative differential resistance, and dynamical behaviors, such as instability, oscillations, and bifurcations, through a set of dimensionless nonlinearity parameters. In particular, we reveal that the reactance associated with electro-thermal memristors is the result of a phase shift between oscillating current and voltage induced by the dynamical delay and coupling between the electrical and thermal variables. We thus, demonstrate both the utility and limitations of local analyses to understand non-local dynamical behavior. Critically for future experimentation, the analyses show that external coupling of a memristor to impedances within modern sourcing and measurement instruments can dominate the response of the total circuit, making it impossible to characterize the response of an uncoupled circuit element for which a compact model is desired. However, these effects can be minimized by proper understanding of the Local Activity theory to design and utilize purpose-built instruments.

Brown, Timothy D. (ORCID:0000000347068355)↗
DOE OSTI2023

Recipes for when physics fails: recovering robust learning of physics informed neural networks

Abstract Physics-informed neural networks (PINNs) have been shown to be effective in solving partial differential equations by capturing the physics induced constraints as a part of the training loss function. This paper shows that a PINN can be sensitive to errors in training data and overfit itself in dynamically propagating these errors over the domain of the solution of the PDE. It also shows how physical regularizations based on continuity criteria and conservation laws fail to address this issue and rather introduce problems of their own causing the deep network to converge to a physics-obeying local minimum instead of the global minimum. We introduce Gaussian process (GP) based smoothing that recovers the performance of a PINN and promises a robust architecture against noise/errors in measurements. Additionally, we illustrate an inexpensive method of quantifying the evolution of uncertainty based on the variance estimation of GPs on boundary data. Robust PINN performance is also shown to be achievable by choice of sparse sets of inducing points based on sparsely induced GPs. We demonstrate the performance of our proposed methods and compare the results from existing benchmark models in literature for time-dependent Schrödinger and Burgers’ equations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Hidden fluid mechanics: Learning velocity and pressure fields from flow visualizations

For centuries, flow visualization has been the art of making fluid motion visible in physical and biological systems. Although such flow patterns can be, in principle, described by the Navier-Stokes equations, extracting the velocity and pressure fields directly from the images is challenging. We addressed this problem by developing hidden fluid mechanics (HFM), a physics-informed deep-learning framework capable of encoding the Navier-Stokes equations into the neural networks while being agnostic to the geometry or the initial and boundary conditions. We demonstrate HFM for several physical and biomedical problems by extracting quantitative information for which direct measurements may not be possible.

Raissi, Maziar↗
DOE OSTI2022

A hybrid adaptive multiresolution approach for the efficient simulation of reactive flows

Computational studies that use block-structured adaptive mesh refinement (AMR) approaches suffer from unnecessarily high mesh resolution in regions adjacent to important solution features. This deficiency limits the performance of AMR codes. In this work a novel hybrid adaptive multiresolution (HAMR) approach to AMR-based calculations is introduced to address this issue. The multiresolution (MR) smoothness indicators are used to identify regions of smoothness on the mesh where the computational cost of individual physics solvers may be decreased by replacing direct calculations with interpolation. We suggest an approach to balance the errors due to the adaptive discretization and the interpolation of physics quantities such that the overall accuracy of the HAMR solution is consistent with that of the MR-driven AMR solution. The performance of the HAMR scheme is evaluated for a range of test problems, from pure hydrodynamics to turbulent combustion.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

The Princess Project: From Differential to Integral Experiments

Following the shutdown of the CEA Valduc experimental facilities, where, for more than 50 years, IRSN used to perform experiments related to criticality safety, IRSN initiated a new project named PRINCESS (PRoject for IRSN Neutron physics and Criticality Experimental data Supporting Safety). The objective is to continue collecting experimental data necessary for the IRSN missions in nuclear safety. For this purpose, collaborations with various national and international laboratories have been established. The PRINCESS project covers various nuclear physics fields from nuclear data to criticality-safety and reactor physics providing information to both differential and integral data improvements.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Improved Creep Testing Approach for Bentonite EBS

In the United States, the nuclear reactor contributes 18.7 percent of the nation’s total electricity generation and produces a significant amount of spent nuclear fuel (SNF) and high-level waste. Because SNF is being stored for longer periods than initially envisioned, the U.S. Department of Energy Office of Nuclear Energy, Office of Spent Fuel and Waste Science and Technology is assessing the technical performance of the SNF storage systems after extended durations. The concept of a sustainable geologic repository for SNF disposal relies heavily on the safety provided by multiple barriers, such as repository host rock, overlying rock formation, and human-made engineered barrier systems (EBS). One of the major components of EBS is bentonite-based buffer materials that isolate the nuclear-waste canisters from the host rock and fill the void left in the horizontally drilled boreholes. The resaturated bentonite has a swelling characteristic, which is useful for self-sealing the microcracks in the host rock and supporting the canister’s heavy weight. However, factors such as nonuniformity in the saturation, swelling pressure of bentonite, and the high temperature at the canister-bentonite interface may lead to instability of the waste canister inside the borehole. Therefore, evaluating the long-term deformation of bentonite-based material is necessary. RESPEC Company, LLC recently completed a preliminary study for the U.S. Department of Energy (DE SC0022804) that is attempting to understand the time-dependent deformation in the consolidated sand/bentonite (SB) specimens through triaxial creep experiments and improve the understanding of EBS performance under anticipated repository conditions. The project included developing a standard testing procedure for preparing the consolidated core specimen from a mixture of sand and bentonite in a 50:50 ratio by weight, fabricating a new pressure vessel in-house, modifying existing creep equipment to perform triaxial creep experiments on consolidated SB specimens, and performing six long-term triaxial creep experiments under low-deviatoric stress at two different temperature conditions, which is representative of hypothetical conditions that might be encountered in a geologic repository within a reasonable rate of success in completing creep experiments. The consolidated SB specimen was prepared using the novel specimen preparation procedure and had physical characteristics (e.g., moisture content and bulk density) reasonably comparable with the properties of bentonite-based buffer, which is proposed to be used in the EBS in the Swedish KBS-3H design and the Swiss design of SNF disposal in the horizontal drifts. The newly fabricated pressure vessel could withstand the confining pressure of up to 15 megapascals (MPa) while maintaining the test temperature of up to 90 degrees Celsius (°C) for long-term creep experiments. The preliminary results from the triaxial creep experiments suggested that the consolidated SB specimen may experience time-dependent deformation at a low-deviatoric stress state and room temperature condition. Based on the deformation recorded in the SB specimen from axial and radial linear variable differential transformers (LVDTs) and physical characteristic changes, it is apparent that the time-dependent deformation is a combination of consolidation and creep, which is influenced by the level of deviatoric stresses and temperature. The systematic creep testing of bentonite-based specimens helped develop a standard testing procedure applicable for analyzing the similar characteristics of shale or clay-like materials in different geologic conditions outside repository science, including in civil engineering and infrastructure projects, underground and open pit mining, and deep drilling.

58 GEOSCIENCES↗
DOE OSTI2025

Understanding latent timescales in neural ordinary differential equation models of advection-dominated dynamical systems

The neural ordinary differential equation (ODE) framework has shown considerable promise in recent years in developing highly accelerated surrogate models for complex physical systems characterized by partial differential equations (PDEs). For PDE-based systems, state-of-the-art neural ODE strategies leverage a two-step procedure to achieve this acceleration: a nonlinear dimensionality reduction step provided by an autoencoder, and a time integration step provided by a neural-network based model for the resultant latent space dynamics (the neural ODE). This work explores the applicability of such autoencoder-based neural ODE strategies for PDEs in which advection terms play a critical role. More specifically, alongside predictive demonstrations, physical insight into the sources of model acceleration (i.e., how the neural ODE achieves its acceleration) is the scope of the current study. Such investigations are performed by quantifying the effects of both autoencoder and neural ODE components on latent system time-scales using eigenvalue analysis of dynamical system Jacobians. To this end, the sensitivity of various critical training parameters – de-coupled versus end-to-end training, latent space dimensionality, and the role of training trajectory length, for example – to both model accuracy and the discovered latent system timescales is quantified. Furthermore, this work specifically uncovers the key role played by the training trajectory length (the number of rollout steps in the loss function during training) on the latent system timescales: larger trajectory lengths correlate with an increase in limiting neural ODE time-scales, and optimal neural ODEs are found to recover the largest time-scales of the full-order (ground-truth) system. Demonstrations are performed across fundamentally different unsteady fluid dynamics configurations influenced by advection: (1) the Kuramoto–Sivashinsky equations (2) Hydrogen-Air channel detonations (the compressible reacting Navier–Stokes equations with detailed chemistry), and (3) 2D Atmospheric flow.

Advection-dominated dynamical systems↗
DOE OSTI2022

NH-PINN: Neural homogenization-based physics-informed neural network for multiscale problems

Physics-informed neural network (PINN) is a data-driven approach to solving equations. It is successful in many applications; however, the accuracy of the PINN is not satisfactory when it is used to solve multiscale equations. Homogenization approximates a multiscale equation by a homogenized equation without multiscale property; it includes solving cell problems and the homogenized equation. The cell problems are periodic, and we propose an oversampling strategy that significantly improves the PINN accuracy on periodic problems. The homogenized equation has a constant or slow dependency coefficient and can also be solved by PINN accurately. We hence proposed a 3-step method, neural homogenization based PINN (NH-PINN), to improve the PINN accuracy for solving multiscale problems with the help of homogenization.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

HFBTHO-AD: Differentiation of a nuclear energy density functional code

The HFBTHO code implements a nuclear energy density functional solver to model the structure of atomic nuclei. HFBTHO has previously been used to calibrate energy functionals and perform sensitivity analysis by using derivative-free methods. To enable derivative-based optimization and uncertainty quantification approaches, we must compute the derivatives of HFBTHO outputs with respect to the parameters of the energy functional, which are a subset of all input parameters of the code. Here, we use the algorithmic/automatic differentiation (AD) tool Tapenade to differentiate HFBTHO. We compare the derivatives obtained using AD against finite-difference approximation and examine the performance of the derivative computation.

Algorithmic differentiation↗
DOE OSTI2020

DPM: A deep learning PDE augmentation method with application to large-eddy simulation

A framework is introduced that leverages known physics to reduce overfitting in machine learning for scientific applications. The partial differential equation (PDE) that expresses the physics is augmented with a neural network that uses available data to learn a description of the corresponding unknown or unrepresented physics. Training within this combined system corrects for missing, unknown, or erroneously represented physics, including discretization errors associated with the PDE's numerical solution. For optimization of the network within the PDE, an adjoint PDE is solved to provide high-dimensional gradients, and a stochastic adjoint method (SAM) further accelerates training. Additionally, the approach is demonstrated for large-eddy simulation (LES) of turbulence. High-fidelity direct numerical simulations (DNS) of decaying isotropic turbulence provide the training data used to learn sub-filter-scale closures for the filtered Navier–Stokes equations. Out-of-sample comparisons show that the deep learning PDE method outperforms widely-used models, even for filter sizes so large that they become qualitatively incorrect. It also significantly outperforms the same neural network when a priori trained based on simple data mismatch, not accounting for the full PDE. Measures of discretization errors, which are well-known to be consequential in LES, point to the importance of the unified training formulation's design, which without modification corrects for them. For comparable accuracy, simulation runtime is significantly reduced. A relaxation of the typical discrete enforcement of the divergence-free constraint in the solver is also successful, instead allowing the DPM to approximately enforce incompressibility physics. Since the training loss function is not restricted to correspond directly to the closure to be learned, training can incorporate diverse data, including experimental data.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Residual-based error correction for neural operator accelerated infinite-dimensional Bayesian inverse problems

We explore using neural operators, or neural network representations of nonlinear maps between function spaces, to accelerate infinite-dimensional Bayesian inverse problems (BIPs) with models governed by nonlinear parametric partial differential equations (PDEs). Neural operators have gained significant attention in recent years for their ability to approximate the parameter-to-solution maps defined by PDEs using as training data solutions of PDEs at a limited number of parameter samples. The computational cost of BIPs can be drastically reduced if the large number of PDE solves required for posterior characterization are replaced with evaluations of trained neural operators. However, reducing error in the resulting BIP solutions via reducing the approximation error of the neural operators in training can be challenging and unreliable. We provide an a priori error bound result that implies certain BIPs can be ill-conditioned to the approximation error of neural operators, thus leading to inaccessible accuracy requirements in training. To reliably deploy neural operators in BIPs, we consider a strategy for enhancing the performance of neural operators: correcting the prediction of a trained neural operator by solving a linear variational problem based on the PDE residual. We show that a trained neural operator with error correction can achieve a quadratic reduction of its approximation error, all while retaining substantial computational speedups of posterior sampling when models are governed by highly nonlinear PDEs. The strategy is applied to two numerical examples of BIPs based on a nonlinear reaction–diffusion problem and deformation of hyperelastic materials. We demonstrate that posterior representations of the two BIPs produced using trained neural operators are greatly and consistently enhanced by error correction.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Dynamics of electrified liquid metal surface using shallow water model

A shallow water model that incorporates surface tension and electric field effects is developed to investigate the dynamics of an electrified liquid surface. The computational model is verified against the Zakharov–Kuznetsov equation and is applied to study the growth and damping of the electrified liquid surface. A linear wave analysis is performed under a shallow water theory assuming an analytic solution of the electric field, similar to the Tonks–Frenkel instability. The electrified liquid surface grows or dampens based on the balance of the electric field, surface tension, and gravitational forces. As a result, the numerical results obtained from the electrified shallow water solver are in good agreement with the theoretical analysis.

Computational models↗
DOE OSTI2022

Multiple ferroelectric nematic phases of a highly polar liquid crystal compound

Ferroelectric nematic liquid crystals represent not only fascinating, fundamental science, but they also hold promise for new technologies including high-density power storage or sub-millisecond switching information displays. In this work, we describe the synthesis and measurements of the physical properties of a new compound, 4-nitrophenyl 4-[(2,4-dimethoxylbenzoyl)oxy]-2-fluorobenzoate (RT11001). This material exhibits multiple, highly polar, ferroelectric nematic phases that have not been previously reported. Here we employ a wide range of physical characterisation methods including differential scanning calorimetry (DSC), mass density measurement, optical birefringence, polarising optical microscopy (POM), dielectric spectroscopy, electric current analysis, electro-optical switching, small-angle and wide-angle x-ray scattering measurements to show that RT11001 has multiple, distinct ferroelectric phases. We argue that the highest temperature phase is a polar nematic fluid with non-polar smectic clusters. Directly below appears to be a transition to another polar nematic phase containing polar positionally ordered clusters. Lastly, there are indications of an additional, polar biaxial liquid crystal phase at lower temperatures.

36 MATERIALS SCIENCE↗
DOE OSTI2025

An infrasound source analysis of the OSIRIS-REx sample return capsule hypersonic re-entry

The OSIRIS-REx sample return capsule's hypersonic re-entry into the atmosphere is a rare opportunity to test a variety of sonic boom source models since the projectile dimensions are well characterized. While the as-flown flight path is unknown, the predicted flight path enables a rough approximation of the source Mach number and location. Six infrasound microphones deployed in the boom carpet along the predicted flight path recorded impulsive signals from the OSIRIS-REx re-entry. Using a suite of atmosphere profiles and the geometric acoustics approximation, we estimate locations with uncertainty estimates along the flight path from which the signals were emitted. Acoustic overpressure and signal duration predictions from Whitham's far field theory, Carlson's simplified sonic boom prediction method, and a drag-dominated hypersonic model are analyzed with uncertainty estimates from the location estimate. While the Carlson simplified sonic boom prediction method could be accurate, our preference is for the drag-dominated source model. Using this source model with an inviscid Burgers's equation solver for propagation, we obtained an excellent match to the recorded data. In conclusion, these results will help better inform future sample return capsule re-entry observation campaigns as well as contribute to a better understanding of high altitude infrasonic sources.

58 GEOSCIENCES↗