Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “equation learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46
All sourcesNASA NTRSDOE OSTI
NASA NTRS2018

TPSAS-NF1676L-30451-DND

The fundamental laws of the physics of fluid flow in the continuum regime are embedded in a somewhat "simple" set of partial differential equations describing the transport of mass, momentum, energy, and/orentropy. These basic equations can be manipulated to construct other important physical quantities such as vorticity that help further elucidate flow physics. Additionally, these equations can be nondimensionalized to identify important nondimensional groups governing compressible, reacting fluid flows, most prominently Reynolds, Mach, Froude, Prandtl, Lewis, Schmidt, Damkohler, and Zeldovich numbers. In this lecture, we present these governing equations and discuss the significance of the different terms and nondimensional groups. Furthermore, since these equations cannot be solved directly on current supercomputers for turbulent flows at Reynolds numbers of engineering interest, a scale reduction by averaging or filtering is introduced, which leads to a "closure" problem. The closure is then provided by introducing some common models. The current introduction is by no means complete, but it and the references herein may serve as a good starting point for learning about the most common approaches to turbulent reacting flows.

Tomasz (Tom) G Drozda↗
DOE OSTI2025

Coupling flux balance analysis with reactive transport modeling through machine learning for rapid and stable simulation of microbial metabolic switching

Integrating genome-scale metabolic networks with reactive transport models (RTMs) provides a detailed description of the dynamic changes in microbial growth and metabolism. Despite promising demonstrations in the past, computational inefficiency has been pointed out as a critical issue to overcome because it requires repeated application of linear programming (LP) to obtain flux balance analysis (FBA) solutions in every time step and spatial grid. To address this challenge, we propose a new simulation method where we train and validate artificial neural networks (ANNs) using randomly sampled FBA solutions and incorporate the resulting surrogate FBA model (represented as algebraic equations) into RTMs as source/sink terms. We demonstrate the efficiency of our method via a case study of Shewanella oneidensis MR-1. During aerobic growth on lactate, S. oneidensis produces metabolic byproducts (such as pyruvate and acetate), which are subsequently consumed as alternative carbon sources when the preferred nutrients are depleted. To effectively simulate these complex dynamics, we used a cybernetic approach that models metabolic switches as the outcome of dynamic competition among multiple growth options. In both zero-dimensional batch and one-dimensional column configurations, the ANN-based surrogate models achieved substantial reduction of computational time by several orders of magnitude compared to the original LP-based FBA models. Moreover, the ANN models produced robust solutions without any special measures to prevent numerical instability. These developments significantly promote our ability to utilize genome-scale networks in complex, multi-physics, and multi-dimensional ecosystem modeling.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Uncontrolled Learning: Codesign of Neuromorphic Hardware Topology for Neuromorphic Algorithms

Neuromorphic computing has the potential to revolutionize future technologies and our understanding of intelligence, yet it remains challenging to realize in practice. The learning-from-mistakes algorithm, inspired by the brain's simple learning rules of inhibition and pruning, is one of the few brain-like training methods. This algorithm is implemented in neuromorphic memristive hardware through a codesign process that evaluates essential hardware trade-offs. While the algorithm effectively trains small networks as binary classifiers and perceptrons, performance declines significantly with increasing network size unless the hardware is tailored to the algorithm. This work investigates the trade-offs between depth, controllability, and capacity—the number of learnable patterns—in neuromorphic hardware. This highlights the importance of topology and governing equations, providing theoretical tools to evaluate a device's computational capacity based on its measurements and circuit structure. The findings show that breaking neural network symmetry enhances both controllability and capacity. Additionally, by pruning the circuit, neuromorphic algorithms in all-memristive circuits can utilize stochastic resources to create local contrasts in network weights. Through combined experimental and simulation efforts, the parameters are identified that enable networks to exhibit emergent intelligence from simple rules, advancing the potential of neuromorphic computing.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Toward DMC Accuracy Across Chemical Space with Scalable Δ-QML

In the past decade, quantum diffusion Monte Carlo (DMC) has been demonstrated to successfully predict the energetics and properties of a wide range of molecules and solids by numerically solving the electronic many-body Schrödinger equation. With O(N 3 ) scaling with the number of electrons N, DMC has the potential to be a reference method for larger systems that are not accessible to more traditional methods such as CCSD(T). Assessing the accuracy of DMC for smaller molecules becomes the stepping stone in making the method a reference for larger systems. We show that when coupled with quantum machine learning (QML)-based surrogate methods, the computational burden can be alleviated such that quantum Monte Carlo (QMC) shows clear potential to undergird the formation of high-quality descriptions across chemical space. We discuss three crucial approximations necessary to accomplish this: the fixed-node approximation, universal and accurate references for chemical bond dissociation energies, and scalable minimal amons-set-based QML (AQML) models. Numerical evidence presented includes converged DMC results for over 1000 small organic molecules with up to five heavy atoms used as amons and 50 medium-sized organic molecules with nine heavy atoms to validate the AQML predictions. Finally, numerical evidence collected for Δ-AQML models suggests that already modestly sized QMC training data sets of amons suffice to predict total energies with near chemical accuracy throughout chemical space.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS2020

Global Aerodynamic Modeling Using Automated Local Model Networks in Real Time

A novel method is presented for automated real-time global aerodynamic modeling using local model networks, known as Smoothed Partitioning with Localized Trees in Real Time (SPLITR), as part of NASA’s Learn-to-Fly technology development initiative. The global nonlinear aerodynamics are partitioned into several local regions known as cells, with the dimension, location, and timing of each partition automatically selected based on a residual characterization procedure, under the constraints of real-time operation. Regression trees represent the successive partitioning of the global flight envelope and describe the evolution of the cell structure. Recursive equation-error least-squares parameter estimation in the time domain is used to estimate a model that represents the local aerodynamics in each region, so that it can be updated independently with non-contiguous data in the range of each cell over time. A weighted superposition of these piecewise local models across the flight envelope forms a global nonlinear model that also accurately captures the local aerodynamics. The SPLITR approach is demonstrated using both simulation and flight data, and the results are analyzed in terms of model predictive capabilities as well as interpretability. The results show that SPLITR can be used to automatically partition complex nonlinear aerodynamic behavior, produce an accurate model, and provide valuable physical insight into the local and global aerodynamics.

Weinstein, Rose↗
NASA NTRSDate not supplied

In Search of Data-Driven Improvements to RANS Models Applied to Separated Flows

The goal of this work is to improve the capability of Reynolds-averaged Navier-Stokes turbulence models for separated flows using data-driven enhancements. The resulting model should be “universal” in the sense that it can be used by anyone and applied to as many flows as possible without concern for unusual or detrimental behavior. At worst, the data-driven corrections should not degrade the accuracy of the baseline model (in this case the Spalart-Allmaras one-equation model), while preserving the Galilean invariance and similar theoretical qualities of the original model. In the literature, most current data-driven improvements to turbulence models are only applicable to very similar types of cases as those used to train the model for a specific class of flows. In this work, the impact of using a wide array of cases in the machine-learning training is described. Unwanted behaviors from trained neural networks are examined, and possible mitigation strategies are proposed. However, to date, consistent and broadly applicable data-driven improvements for separated flows have not been achieved.

turbulence modeling↗
DOE OSTI2026

A Data-Driven Method for Modeling Creep-Fatigue Stress- Strain Behavior Using Neural ODEs

In this paper, we introduce a data-driven machine learning approach for modeling one-dimensional stress–strain behavior under cyclic loading, utilizing experimental data from the nickel-based Alloy 617. The study employs uniaxial creep–fatigue test data acquired under various loading histories and compares two distinct neural network-based ODE models. The first model, known as the black-box model, comprehensively describes the strain–stress relationship using a Neural ODE equation. To interpret this black-box model, we apply the Sparse Identification of Nonlinear Dynamical Systems (SINDy) technique, transforming the black-box model into an equation-based model using symbolic regression. The second model, the Neural flow rule model, incorporates Hooke’s Law for the linear elastic component, with the nonlinear part characterized by a Neural ODE. Both models are trained with experimental data to accurately reflect the observed stress–strain behavior. We conduct a detailed comparison with the standard Chaboche model, which includes three back stresses. Our results demonstrate that the neural network-based ODE models precisely capture the experimental creep–fatigue mechanical behavior, exceeding the standard Chaboche model’s accuracy. Furthermore, an interpretable model derived from the black-box neural ODE model through symbolic regression achieves accuracy comparable to the Chaboche model, enhancing its interpretability. The results highlight the potential of neural network-based ODE models to depict complex creep–fatigue behavior, eliminating the necessity for experts to define a specific, material-focused model form.

creep-fatigue↗
DOE OSTI2024

A Pseudoreversible Normalizing Flow for Stochastic Dynamical Systems with Various Initial Distributions

Here, we present a pseudoreversible normalizing flow method for efficiently generating samples of the state of a stochastic differential equation (SDE) with various initial distributions. The primary objective is to construct an accurate and efficient sampler that can be used as a surrogate model for computationally expensive numerical integration of SDEs, such as those employed in particle simulation. After training, the normalizing flow model can directly generate samples of the SDE’s final state without simulating trajectories. The existing normalizing flow model for SDEs depends on the initial distribution, meaning the model needs to be retrained when the initial distribution changes. The main novelty of our normalizing flow model is that it can learn the conditional distribution of the state, i.e., the distribution of the final state conditional on any initial state, such that the model only needs to be trained once and the trained model can be used to handle various initial distributions. This feature can provide a significant computational saving in studies of how the final state varies with the initial distribution. Additionally, we propose to use a pseudoreversible network architecture to define the normalizing flow model, which has sufficient expressive power and training efficiency for a variety of SDEs in science and engineering, e.g., in particle physics. We provide a rigorous convergence analysis of the pseudoreversible normalizing flow model to the target probability density function in the Kullback–Leibler divergence metric. Numerical experiments are provided to demonstrate the effectiveness of the proposed normalizing flow model.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Ex Machina Determination of Structural Correlation Functions

Determining the structural properties of condensed-phase systems is a fundamental problem in theoretical statistical mechanics. In this study, we present a machine learning method that is able to predict structural correlation functions with significantly improved accuracy in comparison with traditional approaches. The usefulness of this ex machina (from the machine) approach is illustrated by predicting the radial distribution functions of two paradigmatic condensed-phase systems, a Lennard-Jones fluid and a hard-sphere fluid, and then comparing those results to the results obtained using both integral equation methods and empirically motivated analytical functions. We find that application of the developed ex machina method typically decreases the predictive error by more than an order of magnitude in comparison with traditional theoretical methods.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Macroscopic trends of neoclassical tearing stability in high-field H-mode tokamak pilot plants

The neoclassical tearing mode (NTM) stability metric—minimum marginally stable island width $w$$^{*}_{m}$—was compared across 14651 inductive high-field tokamak pilot plant equilibria. Larger devices with reduced elongation and/or increased minor radius demonstrated an order-of-magnitude increase in $w$$^{*}_{m}$, primarily due to a reduction in bootstrap drive. This work is part of an ongoing effort to ensure passive NTM-stability in the ARC tokamak, in which the technology to achieve active tearing-suppression with localised electron cyclotron current drive does not yet exist. The equilibrium scenarios in the database were Monte Carlo generated and normalised to the same >400MW fusion power, minimum pressure scenario at a range of plasma currents, before tearing analysis using the modified Rutherford equation was applied for all resonant poloidal and toroidal m, n modes up to n = 4. Single-helicity toroidal Δ' calculations in resistive DCON set the minimum marginally stable island width, and a simple modal scaling proportional to –m 2 n –1 was identified for high-m Δ' values. The dominant correlates of $w$$^{*}_{m}$ and Δ' across the database were analysed using interpretable machine learning techniques.

NTM seeding↗
DOE OSTI2025

Cation Disorder of ${\text{Mg}}_{\mathbf{2}}{\text{SiO}}_{\mathbf{4}}$ in Super‐Earth Mantles

Understanding the mineralogy of exoplanets is essential for unraveling their interior structures, dynamics, and evolution. For large super-Earths, the post-post spinel ${\text{Mg}}_{\mathbf{2}}{\text{SiO}}_{\mathbf{4}}$, one of the major mantle phases, may undergo the order-disorder transition (ODT) at high temperatures. However, the ODT phase boundary of ${\text{Mg}}_{\mathbf{2}}{\text{SiO}}_{\mathbf{4}}$ has not been rigorously constrained. Additionally, fundamental thermodynamic properties of the disordered ${\text{Mg}}_{\mathbf{2}}{\text{SiO}}_{\mathbf{4}}$ remain poorly investigated. Here, we develop a unified machine learning potential (MLP) for ${\text{Mg}}_{\mathbf{2}}{\text{SiO}}_{\mathbf{4}}$ of ab initio accuracy under super-Earth mantle conditions. With the efficient MLP, we extensively calculate the free energy of post-post spinel ${\text{Mg}}_{\mathbf{2}}{\text{SiO}}_{\mathbf{4}}$ via the thermodynamic integration method. The results are used to constrain the ODT phase boundary. Furthermore, we report the P-V-T equation of state and Grüneisen parameters for post-post spinel ${\text{Mg}}_{\mathbf{2}}{\text{SiO}}_{\mathbf{4}}$ across various degrees of disorder. These thermodynamic properties are further applied to update the adiabatic thermal profiles and the mass-radius relation of super-Earths.

36 MATERIALS SCIENCE↗
NASA NTRS2005

Convergence Acceleration and Documentation of CFD Codes for Turbomachinery Applications

The development and analysis of turbomachinery components for industrial and aerospace applications has been greatly enhanced in recent years through the advent of computational fluid dynamics (CFD) codes and techniques. Although the use of this technology has greatly reduced the time required to perform analysis and design, there still remains much room for improvement in the process. In particular, there is a steep learning curve associated with most turbomachinery CFD codes, and the computation times need to be reduced in order to facilitate their integration into standard work processes. Two turbomachinery codes have recently been developed by Dr. Daniel Dorney (MSFC) and Dr. Douglas Sondak (Boston University). These codes are entitled Aardvark (for 2-D and quasi 3-D simulations) and Phantom (for 3-D simulations). The codes utilize the General Equation Set (GES), structured grid methodology, and overset O- and H-grids. The codes have been used with success by Drs. Dorney and Sondak, as well as others within the turbomachinery community, to analyze engine components and other geometries. One of the primary objectives of this study was to establish a set of parametric input values which will enhance convergence rates for steady state simulations, as well as reduce the runtime required for unsteady cases. The goal is to reduce the turnaround time for CFD simulations, thus permitting more design parametrics to be run within a given time period. In addition, other code enhancements to reduce runtimes were investigated and implemented. The other primary goal of the study was to develop enhanced users manuals for Aardvark and Phantom. These manuals are intended to answer most questions for new users, as well as provide valuable detailed information for the experienced user. The existence of detailed user s manuals will enable new users to become proficient with the codes, as well as reducing the dependency of new users on the code authors. In order to achieve the objectives listed, the following tasks were accomplished: 1) Parametric Study Of Preconditioning Parameters And Other Code Inputs; 2) Code Modifications To Reduce Runtimes; 3) Investigation Of Compiler Options To Reduce Code Runtime; and 4) Development/Enhancement of Users Manuals for Aardvark and Phantom

Marquart, Jed E.↗
NASA NTRS2010

A Chess-Like Game for Teaching Engineering Students to Solve Large System of Simultaneous Linear Equations

Solving large (and sparse) system of simultaneous linear equations has been (and continues to be) a major challenging problem for many real-world engineering/science applications [1-2]. For many practical/large-scale problems, the sparse, Symmetrical and Positive Definite (SPD) system of linear equations can be conveniently represented in matrix notation as [A] {x} = {b} , where the square coefficient matrix [A] and the Right-Hand-Side (RHS) vector {b} are known. The unknown solution vector {x} can be efficiently solved by the following step-by-step procedures [1-2]: Reordering phase, Matrix Factorization phase, Forward solution phase, and Backward solution phase. In this research work, a Game-Based Learning (GBL) approach has been developed to help engineering students to understand crucial details about matrix reordering and factorization phases. A "chess-like" game has been developed and can be played by either a single player, or two players. Through this "chess-like" open-ended game, the players/learners will not only understand the key concepts involved in reordering algorithms (based on existing algorithms), but also have the opportunities to "discover new algorithms" which are better than existing algorithms. Implementing the proposed "chess-like" game for matrix reordering and factorization phases can be enhanced by FLASH [3] computer environments, where computer simulation with animated human voice, sound effects, visual/graphical/colorful displays of matrix tables, score (or monetary) awards for the best game players, etc. can all be exploited. Preliminary demonstrations of the developed GBL approach can be viewed by anyone who has access to the internet web-site [4]!

Nguyen, Duc T.↗
DOE OSTI2019

Managing uncertainty in data-driven simulation-based optimization

Optimization using data from complex simulations has become an attractive decision-making option, due to ability to embed high-fidelity, non-linear understanding of processes within the search for optimal values. Due to lack of tractable algebraic equations, the link between simulations and optimization is oftentimes a surrogate metamodel. However, several forms of uncertainty exist within the cycle that links simulation data, to metamodels, to optimization. Uncertainty may originate from parameters of the simulation, or the form and fitted parameters of the metamodel. This paper reviews different literatures that are relevant to surrogate-based optimization and proposes different strategies for handling uncertainty, by combining machine learning with stochastic programming, robust optimization, and discrepancy modeling. We show that incorporating uncertainty management within simulation-based optimization leads to more robust solutions, which protect the decision-maker from infeasible solutions. Here, we present the results of our proposed approaches through a case study for direct-air capture through temperature swing adsorption.

42 ENGINEERING↗
NASA NTRS2002

Technical Challenges of Drilling on Mars

In the last year, NASA's Mars science advisory committee (MEPAG: Mars Exploration Payload Advisory Group) has formally recommended that deep drilling be undertaken as a priority investigation to meet astrobiology and geology goals. This proposed new dimension in Mars exploration has come about for several reasons. Firstly, geophysical models of the martian subsurface environment indicate that we may well find liquid water (in the form of brines) under ground-ice at depths of several kilometers near the equator. On Earth we invariably find life forms associated with any environmental niche that supports liquid water. New data from the Mars Global Surveyor have shown that the most recent volcanism on Mars is very young so we cannot rule out contemporary volcanism -- in which case subsurface temperatures consistent with having water in its liquid phase may be found at relatively shallow depths. Secondly, in recent decades we have learned to our surprise that the Earth's subsurface (microbial) biosphere extends to depths of many kilometers and this discovery provides the basis for planning to explore the martian subsurface in search of ancient or even extant microbial life forms. We know (from Viking measurements) that all the biogenic elements (C, H, O, N, P, S) are available on Mars. What we therefore hope to learn is whether or not the evolution of life is inevitable given the necessary ingredients and, by implication, whether the Universe may be teeming with life. The feasibility of drilling deep into the surface of Mars has been the subject of increasing attention within NASA (and more recently among some of its international partners) for several years and this led to a broad-based feasibility study carried out by the Los Alamos National Laboratory and, subsequently, to the development of several hardware prototypes. This paper is intended to provide a general survey of that activity.

Briggs, Geoffrey↗
DOE OSTI2022

Manifold Learning-Based Polynomial Chaos Expansions for High-Dimensional Surrogate Models

In this work we introduce a manifold learning-based method for uncertainty quantification (UQ) in systems describing complex spatiotemporal processes. Our first objective is to identify the embedding of a set of high-dimensional data representing quantities of interest of the computational or analytical model. For this purpose, we employ Grassmannian diffusion maps, a two-step nonlinear dimension reduction technique which allows us to reduce the dimensionality of the data and identify meaningful geometric descriptions in a parsimonious and inexpensive manner. Polynomial chaos expansion is then used to construct a mapping between the stochastic input parameters and the diffusion coordinates of the reduced space. An adaptive clustering technique is proposed to identify an optimal number of clusters of points in the latent space. The similarity of points allows us to construct a number of geometric harmonic emulators which are finally utilized as a set of inexpensive pretrained models to perform an inverse map of realizations of latent features to the ambient space and thus perform accurate out-of-sample predictions. Thus, the proposed method acts as an encoder-decoder system which is able to automatically handle very high-dimensional data while simultaneously operating successfully in the small-data regime. The method is demonstrated on two benchmark problems and on a system of advection-diffusion-reaction equations which model a first-order chemical reaction between two species. In all test cases, the proposed method is able to achieve highly accurate approximations which ultimately lead to the significant acceleration of UQ tasks.

42 ENGINEERING↗
DOE OSTI2023

Physics‐Informed Machine Learning for Inverse Design of Optical Metamaterials

Optical metamaterials manipulate light through various confinement and scattering processes, offering unique advantages like high performance, small form factor and easy integration with semiconductor devices. However, designing metasurfaces with suitable optical responses for complex metamaterial systems remains challenging due to the exponentially growing computation cost and the ill‐posed nature of inverse problems. To expedite the computation for the inverse design of metasurfaces, a physics‐informed deep learning (DL) framework is used. A tandem DL architecture with physics‐based learning is used to select designs that are scientifically consistent, have low error in design prediction, and accurate reconstruction of optical responses. The authors focus on the inverse design of a representative plasmonic device and consider the prediction of design for the optical response of a single wavelength incident or a spectrum of wavelength in the visible light range. The physics‐based constraint is derived from solving the electromagnetic wave equations for a simplified homogenized model. The model converges with an accuracy up to 97% for inverse design prediction with the optical response for the visible light spectrum as input, and up to 96% for optical response of single wavelength of light as input, with optical response reconstruction accuracy of 99%.

Sarkar, Sulagna↗
DOE OSTI2021

Modeling atmospheric data and identifying dynamics Temporal data-driven modeling of air pollutants

Atmospheric modelling has recently experienced a surge with the advent of deep learning. Most of these models, however, predict concentrations of pollutants following a data-driven approach in which the physical laws that govern their behaviors and relationships remain hidden. Furthermore, with the aid of real-world air quality data collected hourly in different stations throughout Madrid, we present a case study using a series of data-driven techniques with the following goals: (1) Find systems of ordinary differential equations that model the concentration of pollutants and their changes over time; (2) assess the performance and limitations of our model using stability analysis; (3) reconstruct the time series of chemical pollutants not measured in certain stations using delay coordinate embedding results.

54 ENVIRONMENTAL SCIENCES↗