SEARCH · Engineering Papers

Results for “Differentiable physics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

All sources NASA NTRS DOE OSTI

DOE OSTI2022

A gradient-based deep neural network model for simulating multiphase flow in porous media

We report simulation of multiphase flow in porous media is crucial for the effective management of subsurface energy and environment-related activities. The numerical simulators used for modeling such processes rely on spatial and temporal discretization of the governing mass and energy balance partial-differential equations (PDEs) into algebraic systems via finite-difference/volume/element methods. These simulators usually require dedicated software development and maintenance, and suffer low efficiency from a runtime and memory standpoint for problems with multi-scale heterogeneity, coupled-physics processes or fluids with complex phase behavior. Therefore, developing cost-effective, data-driven models can become a practical choice, and in this work, we choose deep learning approaches as they can handle high dimensional data and accurately predict state variables with strong nonlinearity. In this paper, we describe a gradient-based deep neural network (GDNN) constrained by the physics related to multiphase flow in porous media. We tackle the nonlinearity of flow in porous media induced by rock heterogeneity, fluid properties, and fluid-rock interactions by decomposing the nonlinear PDEs into a dictionary of elementary differential operators. We use a combination of operators to handle rock spatial heterogeneity and fluid flow by advection. Since the augmented differential operators are inherently related to the physics of fluid flow, we treat them as first principles prior knowledge to regularize the GDNN training. We use the example of pressure management at geologic CO 2 storage sites, where CO 2 is injected in saline aquifers and brine is produced, and apply GDNN to construct a predictive model that is trained with physics-based simulation data and emulates the physics process. We demonstrate that GDNN can effectively predict the nonlinear patterns of subsurface responses, including the temporal and spatial evolution of the pressure and saturation plumes. We also successfully extend the GDNN to convolutional neural network (CNN), namely gradient-based CNN (GCNN), and validate its capability to improve the prediction accuracy. GDNN has great potential to tackle challenging problems that are governed by highly nonlinear physics and enable the development of data-driven models with higher fidelity.

42 ENGINEERING↗

DOE OSTI2020

Adaptive Activation Functions Accelerate Convergence in Deep and Physics-informed Neural Networks

We employ adaptive activation functions for regression in deep and physics-informed neural networks (PINNs) to approximate smooth and discontinuous functions as well as solutions of linear and nonlinear partial differential equations. In particular, we solve the nonlinear Klein-Gordon equation, which has smooth solutions, the nonlinear Burgers equation, which can admit high gradient solutions, and the Helmholtz equation. We introduce a scalable hyper-parameter in the activation function, which can be optimized to achieve best performance of the network as it changes dynamically the topology of the loss function involved in the optimization process. The adaptive activation function has better learning capabilities than the traditional one (fixed activation) as it improves greatly the convergence rate, especially at early training, as well as the solution accuracy. To better understand the learning process, we plot the neural network solution in the frequency domain to examine how the network captures successively different frequency bands present in the solution. We consider both forward problems, where the approximate solutions are obtained, as well as inverse problems, where parameters involved in the governing equation are identified. Our simulation results show that the proposed method is a very simple and effective approach to increase the efficiency, robustness and accuracy of the neural network approximation of nonlinear functions as well as solutions of partial differential equations, especially for forward problems. We theoretically prove that in the proposed method, gradient descent algorithms are not attracted to suboptimal critical points or local minima.

machine leaning, Bad minima, Inverse problems, Phy↗

DOE OSTI2021

Validation of the HyRAM+ physics models for use with propane

The Hydrogen Risk Assessment Model Plus (HyRAM+) toolkit combines quantitative risk assessment with simulations of unignited dispersion, ignited turbulent diffusion flames, and indoor accumulation with delayed ignition of fuels. HyRAM+ is differentiated from HyRAM in that it includes models and leak data for other alternate fuels. The models of the physical phenomena need to be validated for each of the fuels in the toolkit. This report shows the validation for propane which is being used as a surrogate for autogas, which is a mixture of propane and butane and used in internal combustion engines in vehicles. For flame length comparisons, five previously published experiments from peer reviewed journals were used to validate our models. The validation looked at flame lengths and flame widths with respect to different leak diameters, mass flow rates, and source pressures. Most of the sources included more than one set of experimental data, which were collected using different methods (CCD cameras, IR visualization etc.). In general, HyRAM+ overpredicts the flame lengths by around 65%. For heat and radiation models, we compared the heat flux and radiation data reported from two different sources to the values calculated by HyRAM+. For higher mass flow rates, the HyRAM+ calculated flame length results gave a better estimate of what is found in the experiments (65% error), but a higher error (85%) is observed between the HyRAM+ calculated lengths and the experimental flame lengthsfor lower mass flows. Some differences can be attributed to outdoor environmental effects (i.e. wind speed) and uncertainties in jet flame shapes. The propane flame trajectory is predicted for a high Reynolds number case with Re = 12,500 and a low Reynolds number case where Re = 2,000. The Re=12,500 case which is momentum dominated matches well with the experimental flame trajectory, but the agreement for the bouancy driven low Reynolds number case is not as good. Dispersion modeling for unignited propane was also analyzed. We compared the mole fraction, mixture fraction, mean velocity, concentration half width, and inverse mass concentration over an axial distance from different credible journals to the values calculated by HyRAM+. The results display good agreement but generally, HyRAM+ predicts a wider profile for mole fraction and mixture fraction experiments. Overall, HyRAM+’s results are reasonable for predicting the flame length, heat flux, flame trajectory, and dispersion for propane and can be used in risk analyses

08 HYDROGEN↗

NASA NTRS2003

Tensegrity II. How structural networks influence cellular information processing networks

The major challenge in biology today is biocomplexity: the need to explain how cell and tissue behaviors emerge from collective interactions within complex molecular networks. Part I of this two-part article, described a mechanical model of cell structure based on tensegrity architecture that explains how the mechanical behavior of the cell emerges from physical interactions among the different molecular filament systems that form the cytoskeleton. Recent work shows that the cytoskeleton also orients much of the cell's metabolic and signal transduction machinery and that mechanical distortion of cells and the cytoskeleton through cell surface integrin receptors can profoundly affect cell behavior. In particular, gradual variations in this single physical control parameter (cell shape distortion) can switch cells between distinct gene programs (e.g. growth, differentiation and apoptosis), and this process can be viewed as a biological phase transition. Part II of this article covers how combined use of tensegrity and solid-state mechanochemistry by cells may mediate mechanotransduction and facilitate integration of chemical and physical signals that are responsible for control of cell behavior. In addition, it examines how cell structural networks affect gene and protein signaling networks to produce characteristic phenotypes and cell fate transitions during tissue development.

Review↗

DOE OSTI2021

Neutron thermalization in nuclear graphite: A modern story of a classic moderator

Graphite has been of great interest since the dawn of the nuclear era. In this work, we will focus on the thermal neutron scattering of two types of nuclear graphite that have different microstructures, namely, the historic PGA which has a very anisotropic medium-grained needle coke, and the new G347A which is a near-isotropic fine-grained graphite. We report the results of room temperature inelastic neutron scattering measurements for the scattering function, double differential scattering cross-section, and phonon density of states. The obtained results are discussed in conjunction with results extracted from first-principles lattice dynamics simulations of crystalline graphite, using the incoherent approximation and by also including the coherent-one phonon contribution. Excellent agreements have been found between the measured and calculated scattering functions and phonon densities of states. The inclusion of the coherent-one phonon scattering shows a significant improvement of the calculated scattering functions, double differentials, and inelastic scattering cross-sections. We also highlight the physical concerns about the current thermal neutron scattering ENDF/B-VIII of nuclear graphite library and its corresponding phonon density of states. This work aims to provide a new presentation of neutron thermalization by graphite and offers a new set of high quality experimental and computational data for consideration.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2021

Monolithic Multigrid Methods for Magnetohydrodynamics

The magnetohydrodynamics equations model a wide range of plasma physics applications and are characterized by a nonlinear system of partial differential equations that strongly couples a charged fluid with the evolution of electromagnetic fields. After discretization and linearization, the resulting system of equations is generally difficult to solve due to the coupling between variables and the heterogeneous coefficients induced by the linearization process. In this paper, we investigate multigrid preconditioners for this system based on specialized relaxation schemes that properly address the system structure and coupling. Here, three extensions of Vanka relaxation are proposed and applied to problems with up to 170 million degrees of freedom and fluid and magnetic Reynolds numbers up to 400 for stationary problems and up to 20,000 for time-dependent problems.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Data-Driven Closures and Assimilation for Stiff Multiscale Random Dynamics

Here, we introduce a data-driven and physics-informed framework for propagating uncertainty in stiff, multiscale random ordinary differential equations (RODEs) driven by correlated (colored) noise. Unlike systems subjected to Gaussian white noise, a deterministic equation for the joint probability density function (PDF) of RODE state variables does not exist in closed form. Moreover, such an equation would require as many phase-space variables as there are states in the RODE system. To alleviate this curse of dimensionality, we instead derive exact, albeit unclosed, reduced-order PDF (RoPDF) equations for low-dimensional observables/quantities of interest. The unclosed terms take the form of state-dependent conditional expectations, which are directly estimated from data at sparse observation times. However, for systems exhibiting stiff, multiscale dynamics, data sparsity introduces regression discrepancies that compound during RoPDF evolution. This is overcome by introducing a kinetic-like defect term to the RoPDF equation, which is learned by assimilating in sparse, low-fidelity RoPDF estimates. Two assimilation methods are considered, namely nudging and deep neural networks, which are successfully tested against Monte Carlo simulations.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Stability and Conservation properties of Hermite-based approximations of the Vlasov-Poisson System

Spectral approximation based on Hermite-Fourier expansion of the Vlasov-Poisson model for a collisionless plasma in the electro-static limit is provided by adding high-order artificial collision operators of Lenard-Bernstein type. These differential operators are suitably designed in order to preserve the physically-meaningful invariants (number of particles, momentum, energy). In view of time-discretization, stability results in appropriate norms are presented. In this study, necessary conditions link the magnitude of the artificial collision term, the number of spectral modes of the discretization, as well as the time-step. The analysis, carried out in full for the Hermite discretization of a simple linear problem in one-dimension, is then partly extended to cover the complete nonlinear Vlasov-Poisson model.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

2024 Shot Request - MultiPuck + HT Mix Time [Slides]

As part of LDRD ER project, 2x OMEGA shot day have been projected to demonstrate the technique. Later this FY23 will be the first demonstration of the diagnostic. A second day, requested for FY24, will explore the extent the diagnostic can differentiate between different evolving temperatures – a vital metric that defines the physics landscape that the diagnostic can explore. The shot day would scan capsule types across a range of ion temperature slopes on an improved multi-puck design. Success would define the capability of the diagnostic technique, would successfully complete the goals of the LDRD and be published in a high impact journal.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2021

Deep Learning Approaches to Surrogates for Solving the Diffusion Equation for Mechanistic Real-World Simulations

In many mechanistic medical, biological, physical, and engineered spatiotemporal dynamic models the numerical solution of partial differential equations (PDEs), especially for diffusion, fluid flow and mechanical relaxation, can make simulations impractically slow. Biological models of tissues and organs often require the simultaneous calculation of the spatial variation of concentration of dozens of diffusing chemical species. One clinical example where rapid calculation of a diffusing field is of use is the estimation of oxygen gradients in the retina, based on imaging of the retinal vasculature, to guide surgical interventions in diabetic retinopathy. Furthermore, the ability to predict blood perfusion and oxygenation may one day guide clinical interventions in diverse settings, i.e., from stent placement in treating heart disease to BOLD fMRI interpretation in evaluating cognitive function (Xie et al., 2019; Lee et al., 2020). Since the quasi-steady-state solutions required for fast-diffusing chemical species like oxygen are particularly computationally costly, we consider the use of a neural network to provide an approximate solution to the steady-state diffusion equation. Machine learning surrogates, neural networks trained to provide approximate solutions to such complicated numerical problems, can often provide speed-ups of several orders of magnitude compared to direct calculation. Surrogates of PDEs could enable use of larger and more detailed models than are possible with direct calculation and can make including such simulations in real-time or near-real time workflows practical. Creating a surrogate requires running the direct calculation tens of thousands of times to generate training data and then training the neural network, both of which are computationally expensive. Often the practical applications of such models require thousands to millions of replica simulations, for example for parameter identification and uncertainty quantification, each of which gains speed from surrogate use and rapidly recovers the up-front costs of surrogate generation. We use a Convolutional Neural Network to approximate the stationary solution to the diffusion equation in the case of two equal-diameter, circular, constant-value sources located at random positions in a two-dimensional square domain with absorbing boundary conditions. Such a configuration caricatures the chemical concentration field of a fast-diffusing species like oxygen in a tissue with two parallel blood vessels in a cross section perpendicular to the two blood vessels. To improve convergence during training, we apply a training approach that uses roll-back to reject stochastic changes to the network that increase the loss function. The trained neural network approximation is about 1000 times faster than the direct calculation for individual replicas. Because different applications will have different criteria for acceptable approximation accuracy, we discuss a variety of loss functions and accuracy estimators that can help select the best network for a particular application. We briefly discuss some of the issues we encountered with overfitting, mismapping of the field values and the geometrical conditions that lead to large absolute and relative errors in the approximate solution.

60 APPLIED LIFE SCIENCES↗

NASA NTRS1978

Fracture and crack growth in orthotropic laminates

Goree, J. G.↗

NASA NTRS1980

Development and validation of a hybrid-computer simulator for a transonic cryogenic wind tunnel

A study was undertaken to model the cryogenic wind tunnel process, to validate the model by the use of experimental data from the Langley 0.3 Meter Transonic Cryogenic Tunnel, and to construct an interactive simulator of the cryogenic tunnel using the validated model. Additionally, this model was used for designing closed loop feedback control laws for regulation of temperature and pressure in the 0.3 meter cryogenic tunnel. The global mathematical model of the cryogenic tunnel that were developed consists of coupled, nonlinear differential governing equations based on an energy state concept of the physical cryogenic phenomena. Process equations and comparisons between actual tunnel responses and computer simulation predictions were examined. Also included are the control laws and simulator responses obtained using the feedback schemes for closed loop control of temperature and pressure were also included.

Thibodeaux, J. J.↗

NASA NTRS1980

Stresses in a three-dimensional unidirectional composite containing broken fibers

An approximate solution is developed for the determination of the interlaminar normal and shear stresses in the vicinity of a crack in a three dimensional composite containing unidirectional linearly elastic fibers in an infinite linearly elastic matrix. In order to reduce the complexity of the formulation, certain assumptions are made as to the physically significant stresses to be retained. These simplifications reduce the partial differential equations of elasticity to differential-difference equations which are tractable using Fourier transform techniques. This 'material modeling' approach is in contrast with solutions developed by considering each lamina as a homogeneous, orthotropic layer. The resulting solution does not contain the classical singular stress field for the fibers and the influence of broken fibers on unbroken fibers is felt by a change in stress concentration factors. The matrix stresses however, are unbounded as the fiber spacing vanishes and an equivalent fiber-matrix geometry is proposed which gives the correct singular behavior. The numerical solution is considered in detail and several specific examples are presented. The potential for damaged or debonded zones to be generated by an embedded crack is discussed, and stress concentration factors for fibers near the crack are given. Detailed comparisons are made between the present solution, the analogous two-dimensional problem, and corresponding shear-lag models.

Goree, J. G.↗

NASA NTRS1984

Fire-retardant decorative inks for aircraft interiors

Commercial and experimental fire retardants were screened for possible use wiith acrylic printing inks on aircraft interior sandwich panels. The fire retardants were selected according to their physical properties and thermostabilities. Thermostabilities were determined by thermogravimetric analysis and differential scanning calorimetry. A criterion was then established for selecting the more stable agent. Results show that some of the bromine-containing fire retardants are more thermostable than the acrylic ink, alone, used as a control. Also, the bromine-containing fire retardants yield even better limiting oxygen index values when tested after adding carboxy-terminated butadiene acrylonitrile (CTBN) rubber.

Nir, Z.↗

NASA NTRS1984

The influence of wind-tunnel walls on discrete frequency noise

This paper describes an analytical model that can be used to examine the effects of wind-tunnel walls on discrete frequency noise. First, a complete physical model of an acoustic source in a wind tunnel is described, and a simplified version is then developed. This simplified model retains the important physical processes involved, yet it is more amenable to analysis. Second, the simplified physical model is formulated as a mathematical problem. An inhomogeneous partial differential equation with mixed boundary conditions is set up and then transformed into an integral equation. The integral equation has been solved with a panel program on a computer. Preliminary results from a simple model problem will be shown and compared with the approximate analytic solution.

Mosher, M.↗

NASA NTRS1992

A multiple scales approach to sound generation by vibrating bodies

The problem of determining the acoustic field in an inviscid, isentropic fluid generated by a solid body whose surface executes prescribed vibrations is formulated and solved as a multiple scales perturbation problem, using the Mach number M based on the maximum surface velocity as the perturbation parameter. Following the idea of multiple scales, new 'slow' spacial scales are introduced, which are defined as the usual physical spacial scale multiplied by powers of M. The governing nonlinear differential equations lead to a sequence of linear problems for the perturbation coefficient functions. However, it is shown that the higher order perturbation functions obtained in this manner will dominate the lower order solutions unless their dependence on the slow spacial scales is chosen in a certain manner. In particular, it is shown that the perturbation functions must satisfy an equation similar to Burgers' equation, with a slow spacial scale playing the role of the time-like variable. The method is illustrated by a simple one-dimenstional example, as well as by three different cases of a vibrating sphere. The results are compared with solutions obtained by purely numerical methods and some insights provided by the perturbation approach are discussed.

Geer, James F.↗

NASA NTRS1996

Nonstandard Finite Difference Schemes: Relations Between Time and Space Step-Sizes in Numerical Schemes for PDE's That Follow from Positivity Condition

A large class of physical phenomena can be modeled by evolution and wave type Partial Differential Equations (PDE). Few of these equations have known explicit exact solutions. Finite-difference techniques are a popular method for constructing discrete representations of these equations for the purpose of numerical integration. However, the solutions to the difference equations often contain so called numerical instabilities; these are solutions to the difference equations that do not correspond to any solution of the PDE's. For explicit schemes, the elimination of this behavior requires functional relations to exist between the time and space steps-sizes. We show that such functional relations can be obtained for certain PDE's by use of a positivity condition. The PDE's studied are the Burgers, Fisher, and linearized Euler equations.

Mickens, Ronald E.↗

NASA NTRS1994

Postinstability Models in Dynamics

This paper is devoted to the concept of instability in dynamical systems with the main emphasis on orbital, Hadamard, and Reynolds instabilities. It demonstrates that the requirement about differentiability in dynamics in some cases is not consistent with the physical nature of motions, and may lead to unrealistic solutions. Special attention is paid to the fact that instability is not an invariant of motion: it depends upon frames of reference, the metric of configuration space, and classes of functions selected for mathematical models of physical phenomena. This leads to the possibility of elimination of certain types of instabilities (in particular, those which lead to chaos and turbulence) by enlarging the class of functions using the Reynolds-type transformation in combination with the stabilization principle: the additional terms (the so-called Reynolds stresses) are found from the conditions that they suppress the original instability. Based upon these ideas, a new approach to chaos and turbulence as well as a new mathematical formalism for nonlinear dynamics are discussed.

Zak, Michail↗