Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Differential”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Ground vehicle lane-keeping assistance system via differential flatness output feedback control and algebraic derivative estimation

Vehicle run-off-road is one of the most frequent and fatal traffic accidents in the United States. Various lane-keeping assistance (LKA) systems have been developed in the last decade to help drivers stay on the road. Most of them are built upon linear driver–vehicle–road (DVR) models and treat road curvature as a disturbance. Albeit effective, their control performance would degrade if road curvature varies rapidly. Here, this paper proposes a novel nonlinear DVR model by integrating a driver steering model into vehicle–road kinematics, which explicitly considers road curvature. Particularly, this nonlinear DVR system has been proven to be differentially flat, and a flatness-based LKA system is designed. Additionally, Model-Free Control is introduced to compensate for system modeling errors. Hardware-in-the-loop simulations and diver-in-the-loop experiments validate the proposed control framework and demonstrate the performance enhancement with respect to a representative linear robust LKA system.

42 ENGINEERING↗
DOE OSTI2024

MITgcm-AD v2: Open source tangent linear and adjoint modeling framework for the oceans and atmosphere enabled by the Automatic Differentiation tool Tapenade

The Massachusetts Institute of Technology General Circulation Model (MITgcm) is widely used by the climate science community to simulate planetary atmosphere and ocean circulations. A defining feature of the MITgcm is that it has been developed to be compatible with an algorithmic differentiation (AD) tool, TAF, enabling the generation of tangent-linear and adjoint models. These provide gradient information which enables dynamics-based sensitivity and attribution studies, state and parameter estimation, and rigorous uncertainty quantification. Importantly, gradient information is essential for computing comprehensive sensitivities and performing efficient large-scale data assimilation, ensuring that observations collected from satellites and in-situ measuring instruments can be effectively used to optimize a large uncertain control space. As a result, the MITgcm forms the dynamical core of a key data assimilation product employed by the physical oceanography research community: Estimating the Circulation and Climate of the Ocean (ECCO) state estimate. Although MITgcm and ECCO are used extensively within the research community, the AD tool TAF is proprietary and hence inaccessible to a large proportion of these users. The new version 2 (MITgcm-AD v2) framework introduced here is based on the source-to-source AD tool Tapenade, which has recently been open-sourced. Another feature of Tapenade is that it stores required variables by default (instead of recomputing them) which simplifies the implementation of efficient, AD-compatible code. The framework has been integrated with the MITgcm model’s main branch and is now freely available.

Adjoints↗
DOE OSTI2020

Solving differential equations using deep neural networks

Recent work on solving partial differential equations (PDEs) with deep neural networks (DNNs) is presented. The paper reviews and extends some of these methods while carefully analyzing a fundamental feature in numerical PDEs and nonlinear analysis: irregular solutions. First, the Sod shock tube solution to the compressible Euler equations is discussed and analyzed. This analysis includes a comparison of a DNN-based approach with conventional finite element and finite volume methods, and demonstrates that the DNN is competitive in terms of degrees of freedom required for a given accuracy. Further, the DNN-based approach is extended to consider performance improvements and simultaneous parameter space exploration. Next, a shock solution to compressible magnetohydrodynamics (MHD) is solved for, and used in a scenario where experimental data is utilized to enhance a PDE system that is a priori insufficient to validate against the observed/experimental data. This is accomplished by enriching the model PDE system with source terms that are then inferred via supervised training with synthetic experimental data. The resulting DNN framework for PDEs enables straightforward system prototyping and natural integration of large data sets (be they synthetic or experimental), all while simultaneously enabling single-pass exploration of an entire parameter space.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Prediction of curing kinetics of resorcinol‐added resole phenolic resins using differential scanning calorimetry for the fabrication of carbon/carbon composites

Phenolic resins are commonly used as carbon precursors for the fabrication of carbon/carbon composites due to their high carbon yield and aromatic nature. To decrease curing times, acid catalysts are generally used, but the addition of resorcinol was found to have a similar effect while being incorporated into the resin matrix with no contamination or corrosion issues. In this work, the curing kinetics of pure, 10, 20, and 30 wt% resorcinol-added phenolic resins were investigated through differential scanning calorimetry. Heating rates of 0.5, 1, 2.5, and 5°C min -1 were used with several curing models to predict isothermal curing. Averaged mean absolute error (MAE) for the isoconversional mathematical approaches namely Kissinger–Akahira–Sunose (MAE = 12.9 min), Flynn–Wall–Ozawa (15.8 min), and Vyazovkin (14 min) show that these methods provide the best predictions, attributed to their adoption of an activation energy that depends on the extent of cure (E a (α)). The Kissinger method (MAE = 36 min), which depends only on peak temperature with a constant activation energy assumption, and the data noise sensitive Friedman model (MAE = 1144.7 min) provide the least accurate results. Thermogravimetric analysis revealed that resorcinol decreases the curing times by up to 71% without lowering carbon yield.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Quantifying Uncertainties in Heat Capacity Measurements of Molten Salts Determined Using Differential Scanning Calorimetry

Uncertainty in specific heat capacity values of a molten salt determined by using differential scanning calorimetry (DSC) was assessed based on the precision of replicate measurements of heat flows used in the calculation and effects of corrections that are commonly made to heat flow measurements. The ratio method of determining heat capacity was applied using the results of replicate heat flow measurements made with two empty cells, a sapphire reference material, and three samples of a doped NaCl-UCl 3 salt mixture. Replicate measurements with empty cells were used to quantify the effects of system instabilities and sensitivities on the measured heat flows of sapphire and salt. The combined effects of uncertainties in individual heat flow measurements made with blank cells using this system were quantified to be 2.6 μV based on isothermal holds before and after the scan, with cell placement adding the greatest uncertainty. This value was used as the tolerance for accepting background-corrected heat flows measured with sapphire and salt to calculate the specific heat capacity. The acceptable heat flows measured for sapphire and salt over the temperature range of 540 to 725 °C resulted in calculated specific heat capacity values ranging from 0.53 to 0.91 J g −1 K −1 with an overall average value of 0.70 J g −1 K −1 and an uncertainty of 0.22 J g −1 K −1 at the 99 % confidence level. The combined uncertainty in the specific heat capacity masked detection of any effect of temperature or salt composition that occurred.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Neural lumped parameter differential equations with application in friction-stir processing

Lumped parameter methods aim to simplify the evolution of spatially-extended or continuous physical systems to that of a “lumped” element representative of the physical scales of the modeled system. For systems where the definition of a lumped element or its associated physics may be unknown, modeling tasks may be restricted to full-fidelity physics simulations. Here, in this work, we consider data-driven modeling tasks with limited point-wise measurements of otherwise continuous systems. We build upon the notion of the Universal Differential Equation (UDE) to construct data-driven models for reducing dynamics to that of a lumped parameter and inferring its properties. The flexibility of UDEs allow for composing various known physical priors suitable for application-specific modeling tasks, including lumped parameter methods. The motivating example for this work is the plunge and dwell stages for friction-stir welding; specifically, (i) mapping power input into the tool to a point-measurement of temperature and (ii) using this learned mapping for process control.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Efficient sensitivity analysis of the thermal profile in powder bed fusion of metals using hypercomplex automatic differentiation finite element method

Rapid cyclic temperature fluctuation occurring in powder bed fusion of metals using a laser beam (PBF-LB/M) influences the formation of flaws in printed parts. Consequently, there is a pressing need to enhance the quality of printed parts by developing innovative methodologies that can predict thermal histories and help uncover the intricate relationships between process parameters and thermal profiles. Sensitivity Analysis (SA) emerges as an essential tool for this, offering the potential for process optimization and enhanced quality control. Nonetheless, conventional SA methodologies often incur in excessive computational costs and potential numerical approximation errors. Here, to address this technical challenge, we present a novel method for SA that integrates the HYPercomplex-based Automatic Differentiation (HYPAD) technique with transient thermal simulations conducted via the finite element method (FEM). Leveraging this methodology, we efficiently and accurately perform SA for PBF-LB/M processes in a post-processing step. Compared to traditional methods like Finite Differences (FD), HYPAD-FEM required 96 % less computational time for obtaining sensitivities for 22 process parameters, under a comparative study conducted within the context of the 2018–02 AM benchmark of the National Institute of Standards and Technology. In summary, HYPAD-FEM offers superior efficiency and accuracy in SA over conventional methods, delivering the best sensitivity of a model without the need for step-size selection and problem or parameter-based implementations.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Differentiating densities on smooth manifolds

Lebesgue integration of derivatives of strongly-oscillatory functions is a recurring challenge in computational science and engineering. Integration by parts is an effective remedy for huge computational costs associated with Monte Carlo integration schemes. In case of Lebesgue integrals over a smooth manifold, however, integration by parts gives rise to a derivative of the density implied by charts describing the domain manifold. This paper focuses on the computation of that derivative, which we call the density gradient function, on general smooth manifolds. We analytically derive formulas for the density gradient and present examples of manifolds determined by popular differential equation-driven systems. Furthermore, we highlight the significance of the density gradient by demonstrating a numerical example of Monte Carlo integration involving oscillatory integrands.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Quasi-differential neutron induced neutron emissions from 235 U, and 239 Pu

Uncertainty in nuclear reaction cross sections, angular distributions, and other nuclear data directly impact how well simulations of nuclear systems represent physical observations. Here, to determine how well the nuclear data in ENDF/B-VIII.0, JEFF-3.3, and JENDL-4.0 evaluations describe the physical behaviour of 235 U, and 239 Pu when subjected to a neutron flux, the neutron emission spectrum was measured for carbon, 93.0% 235 U, and 93.9% 239 Pu samples, and compared against detailed MCNP6 simulations. The measurements were performed at the Los Alamos Neutron Science Center using a quasi-differential method previously developed at Rensselaer Polytechnic Institute. The measurement spanned 0.82–20 MeV and 30–150 degrees. The measurements show there are a significant number of discrepancies between library predictions of the neutron yield and physical observation. A few of the main discrepancies found are described in this paper. Based on these results a new evaluation utilizing these results for carbon, 235 U, and 239 Pu is recommended.

235U↗
DOE OSTI2021

Probabilistic learning on manifolds constrained by nonlinear partial differential equations for small datasets

A novel extension of the Probabilistic Learning on Manifolds (PLoM) is presented. It makes it possible to synthesize solutions to a wide range of nonlinear stochastic boundary value problems described by partial differential equations (PDEs) for which a stochastic computational model (SCM) is available and which depend on a vector-valued random control parameter. The cost of a single numerical evaluation of this SCM is assumed to be such that only a limited number of points can be computed for constructing the training dataset (small data). Each point of the training dataset is made up of realizations from a vector-valued stochastic process (the stochastic solution) and the associated random control parameter on which it depends. The presented PLoM constrained by PDE allows for generating a large number of learned realizations of the stochastic process and its corresponding random control parameter. These learned realizations are generated so as to minimize the vector-valued random residual of the PDE in the mean-square sense. Appropriate novel methods are developed to solve this challenging problem. Three applications are presented. The first one is a simple uncertain nonlinear dynamical system with a nonstationary stochastic excitation. The second one concerns the 2D nonlinear unsteady Navier–Stokes equations for incompressible flows in which the Reynolds number is the random control parameter. Here, the last one deals with the nonlinear dynamics of a 3D elastic structure with uncertainties. The results obtained make it possible to validate the PLoM constrained by stochastic PDE but also provide further validation of the PLoM without constraint.

Machine learning↗
DOE OSTI2024

Divide and conquer: Learning chaotic dynamical systems with multistep penalty neural ordinary differential equations

Forecasting high-dimensional dynamical systems is a fundamental challenge in various fields, such as geosciences and engineering. Neural Ordinary Differential Equations (NODEs), which combine the power of neural networks and numerical solvers, have emerged as a promising algorithm for forecasting complex nonlinear dynamical systems. However, classical techniques used for NODE training are ineffective for learning chaotic dynamical systems. In this work, we propose a novel NODE-training approach that allows for robust learning of chaotic dynamical systems. Here, our method addresses the challenges of non-convexity and exploding gradients associated with underlying chaotic dynamics. Training data trajectories from such systems are split into multiple, non-overlapping time windows. In addition to the deviation from the training data, the optimization loss term further penalizes the discontinuities of the predicted trajectory between the time windows. The window size is selected based on the fastest Lyapunov time scale of the system. Multi-step penalty(MP) method is first demonstrated on Lorenz equation, to illustrate how it improves the loss landscape and thereby accelerates the optimization convergence. MP method can optimize chaotic systems in a manner similar to least-squares shadowing with significantly lower computational costs. Our proposed algorithm, denoted the Multistep Penalty NODE, is applied to chaotic systems such as the Kuramoto-Sivashinsky equation, the two-dimensional Kolmogorov flow, and ERA5 reanalysis data for the atmosphere. It is observed that MP-NODE provide viable performance for such chaotic systems, not only for short-term trajectory predictions but also for invariant statistics that are hallmarks of the chaotic nature of these dynamics.

Chaotic dynamical systems↗
DOE OSTI2025

An attention-based neural ordinary differential equation framework for modeling inelastic processes

To preserve strictly conservative behavior as well as model the variety of dissipative behavior displayed by solid materials, we propose a significant enhancement to the internal state variable-neural ordinary differential equation (ISV-NODE) framework. In this data-driven, physics-constrained modeling framework internal states are inferred rather than prescribed. The ISV-NODE consists of: (a) a stress model dependent on observable deformation and inferred internal state, and (b) a model of the evolution of the internal states. The enhancements to ISV-NODE proposed in this work are multifold: (a) a partially input convex neural network stress potential provides polyconvexity in terms of observed strain while leaving the inferred state unconstrained, and (b) an internal state flow model uses common latent features to inform novel attention-based gating and drives the flow of internal state only in dissipative regimes. We demonstrated that this architecture can accurately model dissipative and conservative behavior across an isotropic, isothermal elastic-viscoelastic-elastoplastic spectrum with three exemplars, while maintaining fundamental principles by design.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Optimal sensor network design for multi-scale, time-varying differential algebraic equation systems: Application to an entrained-flow gasifier refractory brick

An algorithm for optimal sensor network design for multi-scale, time-varying differential algebraic equation systems with non-separable dynamics is presented. As the process is time-varying, an integral normalized posterior error covariance of a multi-scale filter is minimized to obtain the optimal sensor locations. For reducing the computational cost, an adaptive sampling rate approach is considered for the slowly-varying variables. The algorithm is applied to a smart refractory brick with embedded sensors as part of an entrained-flow gasifier. Thermistors and interdigital capacitors are considered as candidate measurement technologies for estimating temperature and slag penetration profile along the gasifier wall. Finally, when the optimal set of sensors obtained from the algorithm is used for estimating temperature and slag penetration profiles in a multi-scale Kalman filter framework, satisfactory estimates are obtained despite high measurement noise and model mismatch.

42 ENGINEERING↗
DOE OSTI2022

Model-based compositional predictions for a differential scanning calorimetry/thermogravimetric analysis-mass spectrometry system used for heat of vaporization measurements

A Differential Scanning Calorimetry/Thermogravimetric Analysis (DSC/TGA) procedure for determination of Heat of Vaporization (HOV) of fuel and surrogate fuel mixtures has been previously utilized for evaluation of oxygenate impacts on spark ignition fuels. This analysis has been further leveraged with mass spectrometry (MS) to elucidate vapor phase compositional changes during evaporation. In this study we focus on a simple system of three compounds (ethanol, n-hexane, and n-octane) to provide a model-based understanding of the evaporation process under these experimental conditions. An Aspen Plus model was set up to provide liquid and vapor phase concentration predictions during mixture evaporation using the initial mixture composition, and measured temperature and mass loss profiles from DSC/TGA experiments. Agreements between the trends of the MS ion count profiles and model composition predictions provide a degree of validation of this modeling approach that can allow the interpretation and extrapolation of DSC/TGA measurements for more complex fuel mixtures.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2022

Dynamic calibration of differential equations using machine learning, with application to turbulence models

We present a methodology for calibration of parametric ordinary and partial differential equation models, using off-the-shelf software for back-propagation in Neural Networks (NN). As a prototypical example, we consider calibration of a Reynolds-averaged Navier-Stokes (RANS) turbulence closure model, against ground truth data from direct numerical simulations (DNS) of two different turbulent flows. Numerical time integration is represented as a custom NN, where only the RANS model parameters are trainable. A loss function is defined to quantify the mismatch between the NN prediction and the ground truth over a predefined, finite time integration window. This loss function is then minimized using a gradient descent method utilizing the back-propagation algorithm. Furthermore, this dynamic approach to training is to be contrasted with a static approach, wherein a least square regression estimate for parameters is obtained in the limit of an infinitesimal time integration window. In a first test of static and dynamic approaches against ground truth data generated by the model, the former proves to be significantly faster and more accurate than the latter at recovering the parameters. When both calibration approaches are tested against DNS data, for which it is known that the model cannot achieve a perfect fit, the static approach yields a good prediction only for short times, while the dynamic approach results in physical and stable predictions over the entire integration window. After optimization of the dynamic approach for time step, spatial resolution, stability, and physics-based constraints, we obtain a 50% improvement of outcomes over those obtained from the existing, manually calibrated set of parameters, demonstrating the merits of this systematic and automated procedure.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Solving high-dimensional partial integral differential equations: The finite expression method

Partial integro-differential equations (PIDEs) have broad applications in the sciences, from electro-magnetism to options pricing. Here, in this paper, we introduce a new finite expression method (FEX) to solve PIDEs. This approach builds upon the original FEX and its inherent advantages with new advances: 1) A novel method of parameter grouping is proposed to reduce the number of coefficients in high-dimensional function approximation; 2) A Taylor series approximation method is implemented to significantly improve the computational efficiency and accuracy of the evaluation of the integral terms of PIDEs. The new FEX based method, denoted FEX-PG to indicate the addition of the parameter grouping (PG) step to the algorithm, provides both high accuracy and interpretable numerical solutions, with the outcome being an explicit equation that facilitates intuitive understanding of the underlying solution structures. These features are often absent in traditional methods, such as finite element methods (FEM) and finite difference methods, as well as in deep learning-based approaches. To benchmark our method against recent advances, we apply the new FEX-PG to solve benchmark PIDEs in the literature. In high-dimensional settings, FEX-PG exhibits strong and robust performance, achieving relative errors on the order of single precision machine epsilon, significantly outperforming existing approaches based on neural networks.

Combinatorial optimization↗