Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Equation learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43

Machine-Learning Assisted Identification of Battery Life Models

Predictive battery life models are commonly utilized to extrapolate degradation trends observed during accelerated aging tests for simulation of degradation in real-world applications. Thus, fitting accelerated aging data as accurately as possible and with low uncertainty is crucial for making believable projections of battery lifetime, but it is challenging to identify algebraic expressions that accurately fit multivariate degradation trends. A review of models published in literature reveal some common expressions for fitting calendar aging data, which is only dependent on temperature and state-of-charge, but no consistency across many models for fitting cycle aging data, indicating the need for a statistically rigorous data driven approach for developing empirical models. This talk will describe a machine-learning assisted method for identification of predictive battery life models utilizing bilevel optimization and symbolic regression. Bilevel optimization with cross-validation is used to statistically determine cell- and stress-dependent model parameters, while symbolic regression identifies both linear and multiplicative candidate expressions to predict stress-dependent degradation rates by selecting low-order subsets of features from a generated feature library. Because model expressions are identified empirically, it is crucial to ensure resulting models behave according to physical expectations, so the stability of models for interpolation or extrapolation is interrogated qualitatively through simulation and quantitatively through cross-validation and uncertainty quantification via bootstrap resampling. This model identification approach substantially improves upon models identified purely using expert judgement in terms of both accuracy and uncertainty. Model simulation and validation is then conducted by deriving a state-equation form of the predictive model, enabling simulation of battery aging under dynamic stresses. This enables validation of the predictive battery model on lab-based tests with varying conditions or on drive-cycle or application-cycle testing protocols. Parameter uncertainty can be carried forward into model simulation, giving lifetime estimates and confidence windows for cell- or system-level lifetime. The financial impact of battery model uncertainty can be estimated by incorporating uncertainty into a technoeconomic model.

battery↗

Object-oriented approach for gas turbine engine simulation

An object-oriented gas turbine engine simulation program was developed. This program is a prototype for a more complete, commercial grade engine performance program now being proposed as part of the Numerical Propulsion System Simulator (NPSS). This report discusses architectural issues of this complex software system and the lessons learned from developing the prototype code. The prototype code is a fully functional, general purpose engine simulation program, however, only the component models necessary to model a transient compressor test rig have been written. The production system will be capable of steady state and transient modeling of almost any turbine engine configuration. Chief among the architectural considerations for this code was the framework in which the various software modules will interact. These modules include the equation solver, simulation code, data model, event handler, and user interface. Also documented in this report is the component based design of the simulation module and the inter-component communication paradigm. Object class hierarchies for some of the code modules are given.

Curlett, Brian P.↗

Feasibility of Using Fourier Neural Operators for 3D Elastic Seismic Simulations

Seismic simulations in three-dimensional (3D) Earth models are important in many of the seismological applications related to our lab’s mission, however, accurate high-fidelity simulations are computationally costly. We investigated the capabilities of the newly developed Fourier Neural Operator (FNO) to solve the 3D elastic wave equations for seismic simulations. We generated simulation data for training the FNO model, and analyzed its performance on various test cases, such as the performance with different number of training data, different resolutions, and on more canonical structures. We found the FNO model can reproduce 3D seismic simulations with high accuracy and ~169 times faster on a small spatial grid size of 16 x 16 x16. When applied on higher resolution data, we found that transfer learning with fine-tuning on a small amount of data achieves reasonable results. This feasibility study showed promising results for using FNO’s for 3D seismic simulations and represents the foundation of further research to develop this into a more mature approach for different seismological applications. The potential impact of this project will provide techniques for large-scale or real-time applications of solving PEDs in support of national lab’s programs.

58 GEOSCIENCES↗

Making Invisible Visible: Data-Driven Seismic Inversion With Spatio-Temporally Constrained Data Augmentation

Deep learning and data-driven approaches have shown great potential in scientific domains. The promise of data-driven techniques relies on the availability of a large volume of high-quality training datasets. Due to the high cost of obtaining data through expensive physical experiments, instruments, and simulations, data augmentation techniques for scientific applications have emerged as a new direction for obtaining scientific data recently. However, existing data augmentation techniques originating from computer vision yield physically unacceptable data samples that are not helpful for the domain problems that we are interested in. In this article, we develop new data augmentation techniques based on convolutional neural networks. Specifically, our generative models leverage different physics knowledge (such as governing equations, observable perception, and physics phenomena) to improve the quality of the synthetic data. To validate the effectiveness of our data augmentation techniques, we apply them to solve a subsurface seismic full-waveform inversion using simulated CO 2 leakage data. Our interest is to invert for subsurface velocity models associated with very small CO 2 leakage. We validate the performance of our methods using comprehensive numerical tests. Here via comparison and analysis, we show that data-driven seismic imaging can be significantly enhanced by using our data augmentation techniques. Particularly, the imaging quality has been improved by 15% in test scenarios of general-sized leakage and 17% in small-sized leakage when using an augmented training set obtained with our techniques.

58 GEOSCIENCES↗

PYSEQM

PYSEQM is a package for performing semi-empirical quantum mechanical (SEQM) simulations on molecular systems utilizing PyTorch. SEQM simulations determine molecular properties (energy, electron density, dipole moment, ect.) by solving an approximate Schrödinger equation for the motions of electrons in a molecule. The use of PyTorch provides three specific advantages. First, it allows the calculations to be offloaded to GPU accelerators, giving an order of magnitude increase in speed. Second, back propagation is used to get atomic forces (derivative of the total energy with respect to atomic position) at the same computational cost as the energy calculation itself. Finally, the use of PyTorch makes for a natural interface to modern machine learning methods, which can be used to adjust the semi-empirical parameters build into SEQM methods. Additionally, PYSEQM implements various other optimizations for performing quantum mechanics based molecular dynamics, including SP2 for rapid GPU based solution of the self-consistent field algorithm, and the extended Lagrangian method for rapid QM-MD.

Nebgen, Benjamin↗

An Economics-by-Design Approach Applied to a Heat Pipe Microreactor Concept

Microreactors present a potential paradigm shift in the nuclear industry. Emphasis thus far has been on large-scale multi-billion-dollar projects that cater solely to grid electricity market. These projects can be challenging to finance and execute. On the other hand, microreactors are intended to target a wide variety of smaller niche markets and are expected to be factory-fabricated and more readily deployable. While diseconomies of scale for microreactors may tend to raise their costs per energy output (MWh) relative to large nuclear plants, offsetting gains can be expected from standardization, simplification, passive safety, lower radionuclide inventories, factory fabrication, fast installation, and low financing costs. To adequately assess these contributions, designers should have a different perspective on cost drivers than for large nuclear plants and can utilize novel approaches for systematic cost reduction. To account for these important aspects of microreactors, this report proposes an economics-by-design approach that places economic considerations at the center of the design process. The methodology builds on existing frameworks such as design-to-cost and value engineering, expanding them to new markets (beyond the grid), new attributes (beyond costs alone), and introducing the approach at earlier points in the design cycle. Design parameters and technical specifications are systematically evaluated until costs meet market entry points, while also providing the high-priority performance attributes of the particular use case. Determining first-order estimates for different components early in the process enables designers to focus R&D efforts on the biggest overall cost contributors and components with the most cost uncertainty. The analysis is always guided by market needs and threshold prices. In addition to microreactors, the approach is expected to be useful for other classes of nuclear reactors as well. The analysis was applied to a concept found in the open literature (the Design A heat-pipe reactor). A comprehensive bottom-up estimate was generated by leveraging a new microreactor-specific code of accounts and a range of cost equations. The initial estimate for levelized cost of electricity (LCOE) unsurprisingly exceeded market ranges since the use case had prioritized technological readiness over economic considerations in design choices. An alternate concept was then proposed, with various assumptions/targets made to reduce the largest cost contributors. Changes in the neutron spectrum, the power output, and building structures were found to make even the first-of-a-kind of this modified concept competitive with diesel generation in some remote communities. Learning rate (LR) assumptions indicated cost reductions achieved from sequential unit deployments could expand the range of competitiveness to include additional markets as deployments proceed.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Multi-Zone Liquid Thrust Chamber Performance Code with Domain Decomposition for Parallel Processing

Computational Fluid Dynamics (CFD) has considerably evolved in the last decade. There are many computer programs that can perform computations on viscous internal or external flows with chemical reactions. CFD has become a commonly used tool in the design and analysis of gas turbines, ramjet combustors, turbo-machinery, inlet ducts, rocket engines, jet interaction, missile, and ramjet nozzles. One of the problems of interest to NASA has always been the performance prediction for rocket and air-breathing engines. Due to the complexity of flow in these engines it is necessary to resolve the flowfield into a fine mesh to capture quantities like turbulence and heat transfer. However, calculation on a high-resolution grid is associated with a prohibitively increasing computational time that can downgrade the value of the CFD for practical engineering calculations. The Liquid Thrust Chamber Performance (LTCP) code was developed for NASA/MSFC (Marshall Space Flight Center) to perform liquid rocket engine performance calculations. This code is a 2D/axisymmetric full Navier-Stokes (NS) solver with fully coupled finite rate chemistry and Eulerian treatment of liquid fuel and/or oxidizer droplets. One of the advantages of this code has been the resemblance of its input file to the JANNAF (Joint Army Navy NASA Air Force Interagency Propulsion Committee) standard TDK code, and its automatic grid generation for JANNAF defined combustion chamber wall geometry. These options minimize the learning effort for TDK users, and make the code a good candidate for performing engineering calculations. Although the LTCP code was developed for liquid rocket engines, it is a general-purpose code and has been used for solving many engineering problems. However, the single zone formulation of the LTCP has limited the code to be applicable to problems with complex geometry. Furthermore, the computational time becomes prohibitively large for high-resolution problems with chemistry, two-equation turbulence model, and two-phase flow. To overcome these limitations, the LTCP code is rewritten to include the multi-zone capability with domain decomposition that makes it suitable for parallel processing, i.e., enabling the code to run every zone or sub-domain on a separate processor. This can reduce the run time by a factor of 6 to 8, depending on the problem.

Homayun K. Navaz↗

Improved Breathing Cartridge (IBC)

The Fire Cartridge (FC) is designed to work with the Emergency Mask (EM) to protect the crew by cleaning the inhaled air in a post fire environment. The Improved Breathing Cartridge (IBC) is designed as a next generation FC with the lessons learned from years of building and testing the FC design, as well as novel catalyst materials to improve the performance and robustness of the cartridge. The FC was designed with minimal margin to save on mass, while the IBC was sized to have over 100% excess catalyst to achieve the required conversion, and still reduce the production cost. Kinetic data taken from another project was used to size the catalyst bed from the standard plug flow reactor conversion equation. The cartridge has been 3D printed and will soon be filled with the required levels of media. Testing has not yet been performed to determine final performance.

Fire Response↗

Scalability analysis of heavy-duty gas turbines using data-driven machine learning

With the increasing integration of variable renewable energy sources into power systems, the role of flexible power generation technologies like gas turbines (GT) in rapid grid balancing remains crucial. This sustained importance underscores the need for scaled and precise modeling of GT to ensure effective integration within evolving energy frameworks. While physics-driven GT models integrate thermodynamics, fluid dynamics, and combustion principles, they often rely on approximate mathematical representations to accommodate scaling that may not capture the actual complex dynamics for GTs and inertial effects associated to GTs with different ratings. In this study, a data-driven model is proposed using machine learning (ML) techniques to conduct GT scalability analysis and performance evaluation with high accuracy. The ML model, trained on data from various operating conditions and performance parameters, aims to uncover intricate relationships and patterns, resembling GT characteristics at different scales (ratings). The model is developed to capture complex system interaction and to adapt to changing operational scenarios at different capacities, providing valuable insights of power system dynamics. In this study, the real-time digital simulator platform was employed to generate training data for the ML model and assess its dynamic characteristics. The ultimate objective was to develop a detailed modeling framework based on governing equations and data-driven ML capable of predicting key performance indicators, in thermal systems such as GTs, including power output, speed, fuel consumption, and exhaust temperature under diverse operating conditions at different scales. The developed ML framework demonstrated high accuracy, with mean relative errors for GT power prediction, reference speed, exhaust temperature, and compressor pressure ratio (CPR) parameters consistently below 0.1% across typical load fluctuation scenarios. Maximum deviations were limited to approximately 0.5 K for exhaust temperature and 0.009 for CPR, underscoring the model’s ability to replicating dynamic GT behavior with high precision. The adaptability of the ML model enables its application across diverse operational conditions and its extension to other thermal systems. By leveraging advanced ML techniques, this study presents a robust and scalable modeling framework that enhances GT simulation precision, facilitating improved integration into evolving power systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Data-driven surrogates for high dimensional models using Gaussian process regression on the Grassmann manifold

This paper introduces a surrogate modeling scheme based on Grassmannian manifold learning to be used for cost-efficient predictions of high-dimensional stochastic systems. The method exploits subspace-structured features of each solution by projecting it onto a Grassmann manifold. This point-wise linear dimensionality reduction harnesses the structural information to assess the similarity between solutions at different points in the input parameter space. The method utilizes a solution clustering approach in order to identify regions of the parameter space over which solutions are sufficiently similarly such that they can be interpolated on the Grassmannian. In this clustering, the reduced-order solutions are partitioned into disjoint clusters on the Grassmann manifold using the eigen-structure of properly defined Grassmannian kernels and, the Karcher mean of each cluster is estimated. Then, the points in each cluster are projected onto the tangent space with origin at the corresponding Karcher mean using the exponential mapping. For each cluster, a Gaussian process regression model is trained that maps the input parameters of the system to the reduced solution points of the corresponding cluster projected onto the tangent space. Using this Gaussian process model, the full-field solution can be efficiently predicted at any new point in the parameter space. In certain cases, the solution clusters will span disjoint regions of the parameter space. In such cases, for each of the solution clusters we utilize a second, density-based spatial clustering to group their corresponding input parameter points in the Euclidean space. The proposed method is applied to two numerical examples. Here, the first is a nonlinear stochastic ordinary differential equation with uncertain initial conditions where the surrogate is used to predict the time history solution. The second involves modeling of plastic deformation in a model amorphous solid using the Shear Transformation Zone theory of plasticity, where the proposed surrogate is used to predict the full strain field of a material specimen under large shear strains.

42 ENGINEERING↗

Autonomous control systems - Architecture and fundamental issues

A hierarchical functional autonomous controller architecture is introduced. In particular, the architecture for the control of future space vehicles is described in detail; it is designed to ensure the autonomous operation of the control system and it allows interaction with the pilot and crew/ground station, and the systems on board the autonomous vehicle. The fundamental issues in autonomous control system modeling and analysis are discussed. It is proposed to utilize a hybrid approach to modeling and analysis of autonomous systems. This will incorporate conventional control methods based on differential equations and techniques for the analysis of systems described with a symbolic formalism. In this way, the theory of conventional control can be fully utilized. It is stressed that autonomy is the design requirement and intelligent control methods appear at present, to offer some of the necessary tools to achieve autonomy. A conventional approach may evolve and replace some or all of the `intelligent' functions. It is shown that in addition to conventional controllers, the autonomous control system incorporates planning, learning, and FDI (fault detection and identification).

Antsaklis, P. J.↗

Recent Progress on Rans-Based Transition Model Verification

The current efforts to assess and improve the Reynolds-averaged Navier-Stokes (RANS)-coupled transition models in the NASA FUN3D and OVERFLOW codes are summarized in this study. The first AIAA Transition Modeling Workshop and the NATO AVT-313 Transition Workshop both emphasized the need for code verification for transport equations based transition models as a top priority. We discuss the methods used for the model verification, the resulting grid families, the flow solutions, and other supporting information collected with at least two established NASA flow solvers, namely, FUN3D and OVERFLOW. These results, which will be uploaded onto the NASA Turbulence Modeling Resource, should assist other members of the computational fluid dynamics (CFD) community in verifying their own implementations of various transition models, such as the Langtry-Menter (LM2009) model, the one-equation γ model, and Coder’s amplification factor transport (AFT) model. Grid convergence is assessed using both global and local flow metrics of interest such as lift and drag as well as local skin-friction coefficients. We also explore the anisotropic unstructured metric-based adaptive mesh refinement library known as refine with the NASA FUN3D solver to determine if this capability can achieve the same accuracy as handcrafted structured grids with a significantly smaller node count and to learn the characteristics of the resulting grid distribution, especially in the vicinity of the transition zone.

Transition↗

Recent Progress on RANS-Based Transition Model Verification

The current efforts to assess and improve the Reynolds-averaged Navier-Stokes (RANS)-coupled transition models in the NASA FUN3D and OVERFLOW codes are summarized in this study. The first AIAA Transition Modeling Workshop and the NATO AVT-313 Transition Workshop both emphasized the need for code verification for transport equations based transition models as a top priority. We discuss the methods used for the model verification, the resulting grid families, the flow solutions, and other supporting information collected with at least two established NASA flow solvers, namely, FUN3D and OVERFLOW. These results, which will be uploaded onto the NASA Turbulence Modeling Resource, should assist other members of the computational fluid dynamics (CFD) community in verifying their own implementations of various transition models, such as the Langtry-Menter (LM2009) model, the one-equation γ model, and Coder’s amplification factor transport (AFT) model. Grid convergence is assessed using both global and local flow metrics of interest such as lift and drag as well as local skin-friction coefficients. We also explore the anisotropic unstructured metric-based adaptive mesh refinement library known as refine with the NASA FUN3D solver to determine if this capability can achieve the same accuracy as handcrafted structured grids with a significantly smaller node count and to learn the characteristics of the resulting grid distribution, especially in the vicinity of the transition zone.

RANS↗

Subject-specific modeling framework for particle deposition using computational fluid dynamics

Quantifying particle deposition and dose in the respiratory tract requires a physiologically realistic representation and reproducible computational workflows. However, existing modeling frameworks, such as the International Commission on Radiological Protection (ICRP) compartmental models and the Multiple Path Particle Dosimetry (MPPD) tool, lack detailed deposition profiles and subject-specific capabilities. The combination of advances in computer vision algorithms applied to the respiratory tract and Computational Fluid and Particle Dynamics (CFPD) allows high-fidelity simulations of particle behavior in anatomically accurate geometries derived from individual CT scans. The segmentation, preprocessing, and file preparation task for a CFPD simulation was often time-consuming, and no prior studies to-date have yet presented a fully automated framework. This work presents a fully automated workflow to obtain individualized particle deposition profiles in the human respiratory tract. The pipeline starts with segmenting upper and lower airway geometries using morphological and deep learning-based methods, generating three-dimensional (3D) models from CT imaging data. Next, a series of algorithms are presented to quality check and prepare the 3D geometry for a CFD or CFPD simulation. The preprocessing step includes correcting geometric artifacts, enforcing a physically consistent mesh, and automatically identifying and capping multiple outlets, which is required for CFD/CFPD simulations. These processed models are then input into open-source (OpenFOAM) or commercial (StarCCM+) CFD solvers, where flow and transient particle transport equations — including turbulence and particle–wall interactions are solved under realistic breathing conditions. Finally, the resulting particle deposition profiles can be integrated with Monte Carlo radiation transport codes and state-of-the-art computational phantoms to assess organ-specific absorbed doses in scenarios of radioactive aerosol inhalation. The presented work streamlines respiratory tract segmentation, preprocessing for CFD/CFPD simulations, and integration with dose assessment workflows, reducing manual intervention and improving access to high-fidelity, subject-specific modeling. The high precision in predicted particle deposition and dose distributions can improve personalized treatment strategies in respiratory medicine and refine dose estimates for radiation protection.

AI↗

Physics-informed neural networks for identification of material properties using standing waves

A metallic structure in its initial stage of failure involves plastic deformation or environmental degradation that changes the elastic modulus and density. This work presents the detection of change in wave velocity (a function of elastic modulus and density) as a system identification problem. A physics-informed neural network (PINN) is proposed to solve the system identification problem. The PINN takes the spatial coordinates of scanning locations and time as inputs and provides the displacement and wave velocity as outputs. The governing partial differential equation of standing waves in a rod is incorporated into the neural network as physics in the form of a loss function. The wave velocity vector is randomly initiated. During the training of the network, physics is used to determine and update the wave velocity target vector from the network’s displacement predictions. The measured data, comprising sparse displacement response on the rod structure, are used to train the PINN. The wave velocity at the sparse locations on the rod is learned from the predicted displacements during the training. Using the predictions of the trained network, the response of free vibration or material property variation can be reconstructed at unscanned locations on the structure to obtain high-resolution maps for full-field imaging to detect and localize the changes caused by plastic deformation. The PINN’s sparse scanning and simultaneous prediction capability during training can lead to high scanning and data-processing speeds. This capability yields a nondestructive evaluation system that can predict the presence of degraded material locations as the structural vibrations are scanned and processed in real time.

Rathod, Vivek↗

Direct measurements of severe spacecraft charging in auroral ionosphere

Questions are addressed concerning how large space structures in polar orbit will interact with auroral environments. Because spacecraft charging at ionospheric attitudes does not seriously threaten the operation of today's relatively small polar satellites the subject of environment interactions has not received the widespread attention given to it at geostationary altitude. As a matter of economics it is desirable to apply as much as possible of what was learned about spacecraft interactions at geostationary orbit to low Earth orbits. The environment at auroral latitudes in the ionosphere differs from that encountered at geostationary altitude in at least two major aspects. (1) There is a large reservoir of high-density, cold plasma which tends to mitigate charging effects by providing a large source of charged particles from which neutralizing currents maybe drawn. Significant wake effects behind large structures will introduce new problems with differential charging. (2) Between the magnetic equator and the ionosphere, auroral electrons frequently undergo field-aligned accelerations of several kilovolts. In such environments, fluxes of energetic protons are usually below the levels of instrumentation sensitivity.

Burke, W. J.↗

A new approach for designing self-organizing systems and application to adaptive control

There is tremendous interest in the design of intelligent machines capable of autonomous learning and skillful performance under complex environments. A major task in designing such systems is to make the system plastic and adaptive when presented with new and useful information and stable in response to irrelevant events. A great body of knowledge, based on neuro-physiological concepts, has evolved as a possible solution to this problem. Adaptive resonance theory (ART) is a classical example under this category. The system dynamics of an ART network is described by a set of differential equations with nonlinear functions. An approach for designing self-organizing networks characterized by nonlinear differential equations is proposed.

Ramamoorthy, P. A.↗

CLPNets: Coupled Lie–Poisson neural networks for multi-part Hamiltonian systems with symmetries

To accurately compute data-based prediction of Hamiltonian systems, it is essential to utilize methods that preserve the structure of the equations over time. We consider a particularly challenging case of systems with interacting parts that do not reduce to pure momentum evolution. Such systems are essential in scientific computations, such as discretization of a continuum elastic rod, which can be viewed as the group of rotations and translations $SE(3)$. The evolution involves not only the momenta but also the relative positions and orientations of the particles. The presence of Lie group-valued elements, such as relative positions and orientations, poses a problem for applying previously derived methods for data-based computing. We develop a novel method of data-based computation and complete phase space learning of such systems. We follow the original framework of SympNets (Jin et al., 2020) and LPNets (Eldred et al., 2024), building the neural network from phase space mappings that preserve the Lie–Poisson structure. We derive a novel system of mappings that are built into neural networks describing the evolution of such systems. We call such networks Coupled Lie–Poisson Neural Networks, or CLPNets. We consider increasingly complex examples for the applications of CLPNets, starting with the rotation of two rigid bodies about a common axis, progressing to the free rotation of two rigid bodies, and finally to the evolution of two connected and interacting $SE(3)$ components, describing the discretization of an elastic rod into two elements. Our method preserves all Casimir invariants to machine precision, preserves energy to high accuracy, and shows good resistance to the curse of dimensionality, requiring only a few thousand data points for all cases studied (three to eighteen dimensions). Additionally, the method is highly economical in memory requirements, requiring only about 200 parameters for the most complex case considered.

Data-based modeling↗