Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “SURROGATE MODELS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,225 records · Page 68
All sourcesNASA NTRSDOE OSTI
NASA NTRS1991

Man in space - The use of animal models

The use of animal surrogates as experimental subjects in order to provide essential missing information on the effects of long-term spaceflights, to validate countermeasures, and to test medical treatment techniques is discussed. Research needs also include the definition of biomedical adaptations to flight, and the developments of standards for safe space missions to assure human health and productivity during and following flight. NASA research plans in this area are outlined. Over the next 40 years, NASA plans to concentrate on the use of rodents and nonhuman primates as the models of choice for various physiological responses observed in humans during extended stays in space. This research will include flights on the Space Shuttle, unmanned biosatellites, and the Space Station Freedom.

Ballard, Rodney W.↗
DOE OSTI2021

MFNets: data efficient all-at-once learning of multifidelity surrogates as directed networks of information sources

We present an approach for constructing a surrogate from ensembles of information sources of varying cost and accuracy. The multifidelity surrogate encodes connections between information sources as a directed acyclic graph, and is trained via gradient-based minimization of a nonlinear least squares objective. While the vast majority of state-of-the-art assumes hierarchical connections between information sources, our approach works with flexibly structured information sources that may not admit a strict hierarchy. The formulation has two advantages: (1) increased data efficiency due to parsimonious multifidelity networks that can be tailored to the application; and (2) no constraints on the training data—we can combine noisy, non-nested evaluations of the information sources. Finally, numerical examples ranging from synthetic to physics-based computational mechanics simulations indicate the error in our approach can be orders-of-magnitude smaller, particularly in the low-data regime, than single-fidelity and hierarchical multifidelity approaches.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2000

Thermophysics Characterization of Kerosene Combustion

A one-formula surrogate fuel formulation and its quasi-global combustion kinetics model are developed to support the design of injectors and thrust chambers of kerosene-fueled rocket engines. This surrogate fuel model depicts a fuel blend that properly represents the general physical and chemical properties of kerosene. The accompanying gaseous-phase thermodynamics of the surrogate fuel is anchored with the heat of formation of kerosene and verified by comparing a series of one-dimensional rocket thrust chamber calculations. The quasi-global combustion kinetics model consists of several global steps for parent fuel decomposition, soot formation, and soot oxidation, and a detailed wet-CO mechanism. The final thermophysics formulations are incorporated with a computational fluid dynamics model for prediction of the combustor efficiency of an uni-element, tri-propellant combustor and the radiation of a kerosene-fueled thruster plume. The model predictions agreed reasonably well with those of the tests.

Wang, Ten-See↗
NASA NTRS2001

Thermophysics Characterization of Kerosene Combustion

A one-formula surrogate fuel formulation and its quasi-global combustion kinetics model are developed to support the design of injectors and thrust chambers of kerosene-fueled rocket engines. This surrogate fuel model depicts a fuel blend that properly represents the general physical and chemical properties of kerosene. The accompanying gaseous-phase thermodynamics of the surrogate fuel is anchored with the heat of formation of kerosene and verified by comparing a series of one-dimensional rocket thrust chamber calculations. The quasi-global combustion kinetics model consists of several global steps for parent fuel decomposition, soot formation, and soot oxidation and a detailed wet-CO mechanism to complete the combustion process. The final thermophysics formulations are incorporated with a computational fluid dynamics model for prediction of the combustion efficiency of an unielement, tripropellant combustor and the radiation of a kerosene-fueled thruster plume. The model predictions agreed reasonably well with those of the tests.

Wang, Ten-See↗
NASA NTRSDate not supplied

Simulation of the Aerosol Size Distribution Using a Neural Network Surrogate for the Modal Aerosol Module (MAM7)

One objective of atmospheric simulations is to quantify the distribution of aerosols and their properties. Accurate parameterizations of the processes governing aerosol mass, particle number, and particle size distribution are important for predicting the Earth’s net radiative balance and aerosol-cloud interactions. The Modal Aerosol Module (MAM7) is a two-moment aerosol model that simulates mass, number, and size distribution of seven modes comprised of internally mixed aerosol species. The two-moment scheme adds significant computational expense but allows for the prediction of varying particle size distribution relative to the bulk method which predicts only total mass. In this work, we developed a neural network surrogate model for MAM7 (MAMnet) to predict the aerosol number concentration in NASA’s Global Earth Observing System (GEOS) without adding prohibitive computational expense. MAMnet, can be driven by output from a single moment, mass-based, aerosol scheme (Goddard Chemistry Aerosol and Radiation model (GOCART)) or from reanalysis products (Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2)). MAMnet was trained using number concentrations from a 5-year GEOS/MAM7 simulation at 1-degree horizontal resolution and using the total mass calculated across modes as inputs, as well as temperature and air density. The model architecture for MAMnet was based on AlexNet, the 2012 winner of the ImageNet Large Scale Visual Recognition Challenge. While some modifications were necessary to accommodate our problem, important aspects of the network were preserved. MAMnet was able to reproduce zonal dynamics and spatial distributions of the aerosol number concentration however predictability in the upper troposphere was poor.

Katherine H Breen↗
DOE OSTI2026

An mRNA vaccine encoding the Ebola virus glycoprotein induces high neutralizing antibody titers and provides strong protection against lethal infections in mouse models

Ebola virus (EBOV) is the causative agent of Ebola disease (EBOD), a viral hemorrhagic fever with a notably high case fatality rate. Current treatments for EBOD are limited to monoclonal antibodies or two licensed viral vector vaccines, a recombinant vesicular stomatitis virus (rVSV)-vectored vaccine or an adenovirus and modified vaccinia Ankara regimen. However, comparisons of protection, efficacy, and durability with alternative nucleotide platforms remain understudied. Here, we evaluated the immunogenicity of an mRNA vaccine expressing the EBOV glycoprotein (GP) in parallel with rVSV- and DNA-based vaccine platforms. The mRNA EBOV-GP vaccine, formulated in lipid nanoparticles, elicited significantly higher levels of total IgG and neutralizing antibody titers compared to the rVSV-EBOV-GP vaccine. Linear antibody epitope analysis indicated a preference for targeting the mucin-like domain in EBOV-GP1 following rVSV-based vaccination, while the mRNA platform distinctly targeted the internal fusion loop of EBOV-GP2. After characterizing the immunogenicity of the mRNA vaccine, two models of EBOD were used to demonstrate its protective efficacy: a surrogate rVSV-based challenge model of EBOD using type-I interferon deficient C57BL/6 mice and infection of BALB/c mice with authentic mouse-adapted EBOV. In both studies, the EBOV mRNA vaccine fully protected the mouse cohorts against morbidity and mortality. Additionally, the EBOV mRNA vaccine produced greater neutralizing antibody titers compared to the DNA EBOV-GP vaccine. These results suggest that an mRNA vaccine expressing EBOV-GP can induce robust, functional humoral responses that are protective against EBOD, warranting further development as an alternative to, or as part of a vaccine strategy including, viral vectored vaccines.

DNA vaccines↗
DOE OSTI2022

Particle-in-cell (hPIC) data

Data generated from the hPIC particle-in-cell code to construct a surrogate ion energy-angle distribution (IEAD) model.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Convoluted filtering for process cycle modeling

Principles of materials science and engineering, physics, mathematics, and information science are used to extract knowledge and insights from the process-structure–property-performance relationships hidden in materials data. The process-structure modeling can be accelerated without loss of interpretability, with artificial intelligence tools that mimic the salient features of the process and process-structure relations. In this work, a novel convoluted model-filtering technique was exploited to build and successfully train the Convoluted Filter (CoFi) artifacts for Fe-based alloy heat treatment cycles. The artifacts were pre-trained to filter out deep models that change the surrogate microstructure state after the heat treatment at ambient conditions. Direct representation of the thermal cycle features within knowledge Graph facilitated development of meaningful data models for microstructure evolution, which reduce overfitting to limited datasets.

36 MATERIALS SCIENCE↗
DOE OSTI2021

A two-phase three-field modeling framework for heat pipe application in nuclear reactors

Heat pipes and two-phase thermosyphons are highly efficient heat transfer devices utilizing continuous evaporation and condensation of working fluid for two-phase heat transport in closed systems. Because of the nearly isothermal and fully passive phase-change heat transfer mechanism, heat pipes and thermosyphons have found many applications in nuclear engineering, space technologies, and other energy systems. High-temperature heat pipes are used in nuclear microreactors to remove fission power from the primary system and are coupled with power conversion systems or process heat applications. Modeling of the two-phase flow phenomena inside a heat pipe is essential to its design and safety analysis. In this study, a comprehensive one-dimensional two-phase three-field flow model has been developed for the analysis of heat pipes in normal operation conditions and transients. The conservation or field equations of mass, momentum, and energy were developed for the liquid film, vapor, and droplet. In addition, constitutive models or correlations were reviewed thoroughly and provided for the closure of the three-field equations. Specific constitutive equations regarding interfacial mass and heat transfer at two interfaces, namely film-gas interface and gas-droplet interface, were reviewed for droplet entrainment and deposition rates as well as film and droplet evaporation rates. Furthermore, mechanistic correlations of annular flow film thickness were recommended for the modeling of the thermosyphons without a wick as a critical constitutive correlation. Furthermore, experimental data needs from new experiments using a prototype working fluid or surrogate fluids for the model validation of high-temperature heat pipes in microreactors were recommended for future research.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Differentiable Multiphysics Codes: A Breakthrough Technology for Simulation and Computing

This document summarizes the findings of a strategic planning exercise commissioned by the Weapons Simulation and Computing, Computational Physics (WSC/CP) program at the Lawrence Livermore National Laboratory (LLNL) in FY24. During the year, the committee met with multiple stakeholder communities to gather input, opinions, suggestions and concerns which have been incorporated throughout this document. The key findings from this exercise are summarized: • The development of multiphysics modelling and simulation (mod/sim) codes and software technologies, their deployment on exascale compute platforms, and their broad adoption across the NNSA is a major success of the Advanced Simulation and Computing (ASC) program and the Exascale Computing Project (ECP). Sustained investment in these core technologies is essential. • Today’s state of the art involves running ensembles of O(100K) simulations to perform uncertainty quantification (UQ) and design studies using multiple statistical methods such as Bayesian optimization to understand sensitivities of our models and explore parameterized design spaces. Even with exascale computing, we are practically limited to O(10) parameters in these studies since the number of simulations required to sample the space scales exponentially with the number of design parameters. • The data from these simulation ensembles is increasingly being used to train machine learned (ML) surrogates (or reduced order models, ROMs) which can then be used for optimization or real time design exploration. However, the trained surrogates are still limited in the number of parameters they can represent due to the sampling limitations previously noted. • Augmenting our suite of integrated multiphysics simulation codes, both current and emerging, with the ability to compute gradients (solution derivatives) of arbitrary simulation outputs with respect to (some or all) simulation inputs would be a breakthrough technology, opening the door to a new era of efficient and automated inverse design based on verified and validated mod/sim capabilities. • This capability, which we refer to as differentiable multiphysics codes (DMCs), would revolutionize both UQ and optimization studies by breaking the curse of dimensionality that presently limits our “gradient-free” ensemble based computing approach. A similar breakthrough occurred in the AI/ML community once the ability to compute gradients of arbitrary loss functions using back-propagation became commonplace. Gradient information from the multiphysics codes can also be used to dramatically improve the efficiency and scale of training of ML/ROM surrogates for rapid assessments. • Achieving this in our suite of codes will be a grand challenge, similar to the amount of effort that was required to transition from CPU to GPU computing. It will require buy-in from the entire WSC/CP program and beyond, including all integrated codes, physics and engineering models, third-party library dependencies and performance portability abstractions. It will also require investment in research and development of numerical methods for computing adjoints of coupled physics across multiple adaptively refined moving meshes and of stochastic (Monte Carlo) and mesh free (SPH) methods. • New software and numerical techniques, largely pioneered by the AI/ML community, make this feasible. Chief among these is automatic differentiation (AD), the ability to employ AD at point-wise locations in a physics calculation (instead of traditional black-box approaches) and the ability to perform “back-propagation in time” (or reverse mode AD) for non-linear partial differential equations (PDEs). Fundamentally, the conclusion of this strategic planning exercise is that the time is right to undertake a large scale effort in WSC, centered on the existing integrated codes, to continue the natural evolution of mod/sim in the age of AI/ML. Instead of attempting to replace mod/sim with purely data driven AI/ML models, we believe the key to success is to integrate AI/ML by building on top of the decades of hard-won knowledge and the verified/validated multiphysics modelling capability that is the hallmark of the ASC program.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

PyApprox: Enabling efficient model analysis

PyApprox is a Python-based one-stop-shop for probabilistic analysis of scientific numerical models. Easy to use and extendable tools are provided for constructing surrogates, sensitivity analysis, Bayesian inference, experimental design, and forward uncertainty quantification. The algorithms implemented represent the most popular methods for model analysis developed over the past two decades, including recent advances in multi-fidelity approaches that use multiple model discretizations and/or simplified physics to significantly reduce the computational cost of various types of analyses. Simple interfaces are provided for the most commonly-used algorithms to limit a user’s need to tune the various hyper-parameters of each algorithm. However, more advanced work flows that require customization of hyper-parameters is also supported. An extensive set of Benchmarks from the literature is also provided to facilitate the easy comparison of different algorithms for a wide range of model analyses. This paper introduces PyApprox and its various features, and presents results demonstrating the utility of PyApprox on a benchmark problem modeling the advection of a tracer in ground water.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Optimization with Neural Network Feasibility Surrogates: Formulations and Application to Security-Constrained Optimal Power Flow

In many areas of constrained optimization, representing all possible constraints that give rise to an accurate feasible region can be difficult and computationally prohibitive for online use. Satisfying feasibility constraints becomes more challenging in high-dimensional, non-convex regimes which are common in engineering applications. A prominent example that is explored in the manuscript is the security-constrained optimal power flow (SCOPF) problem, which minimizes power generation costs, while enforcing system feasibility under contingency failures in the transmission network. In its full form, this problem has been modeled as a nonlinear two-stage stochastic programming problem. In this work, we propose a hybrid structure that incorporates and takes advantage of both a high-fidelity physical model and fast machine learning surrogates. Neural network (NN) models have been shown to classify highly non-linear functions and can be trained offline but require large training sets. In this work, we present how model-guided sampling can efficiently create datasets that are highly informative to a NN classifier for non-convex functions. We show how the resultant NN surrogates can be integrated into a non-linear program as smooth, continuous functions to simultaneously optimize the objective function and enforce feasibility using existing non-linear solvers. Overall, this allows us to optimize instances of the SCOPF problem with an order of magnitude CPU improvement over existing methods.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Weighted greedy-optimal design of computer experiments for kernel-based and Gaussian process model emulation and calibration

This article is concerned with the approximation of high-dimensional functions by kernel-based methods. Motivated by uncertainty quantification, which often necessitates the construction of approximations that are accurate with respect to a probability density function of random variables, we aim at minimizing the approximation error with respect to a weighted $L^p$-norm. We present a greedy procedure for designing computer experiments based upon a weighted modification of the pivoted Cholesky factorization. The method successively generates nested samples with the goal of minimizing error in regions of high probability. Numerical experiments validate that this new importance sampling strategy is superior to other sampling approaches, especially when used with non-product probability density functions. We also show how to use the proposed algorithm to efficiently generate surrogates for inferring unknown model parameters from data.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Bayesian calibration of bubble size dynamics applied to CO 2 gas fermenters

To accelerate the scale-up of gaseous CO 2 fermentation reactors, computational models need to predict gas-to-liquid mass transfer which requires capturing the bubble size dynamics, i.e. bubble breakup and coalescence. However, the applicability of existing models beyond air–water mixtures remains to be established. Here, an inverse modeling approach, accelerated with a neural network surrogate, calibrates the breakup and coalescence closure models, that are used in class methods for population balance modeling (PBM). The calibration is performed based on experimental results obtained in a CO 2 -air–water-coflowing bubble column reactor. Bayesian inference is used to account for noise in the experimental dataset and bias in the simulation results. To accurately capture gas holdup and interphase mass transfer, the results show that the breakage rate needs to be increased by one order of magnitude. In conclusion, the inferred model parameters are then used on a separate configuration and shown to also improve bubble size distribution predictions.

09 BIOMASS FUELS↗
DOE OSTI2023

A unified non-equilibrium phase change model for injection flow modeling

The homogenous relaxation model (HRM) is one of the most widely used models to describe the liquid- gas phase transition. However, in its original formulation, it is unable to handle multispecies vapor-liquid equilibrium (VLE), which limits its applicability to single-component fluids. In this work, a unified non-equilibrium phase change model that considers the VLE of multicomponent mixtures is proposed building upon the HRM's structure. A time factor is introduced to mimic the effect of different phase change timescales due to different mechanisms, e.g., cavitation, flash-boiling, and evaporation. Here to assess the model's performance, computational fluid dynamics simulations of the internal and near-nozzle injection flow of the Engine Combustion Network's Spray G injector were performed using the nine-component PACE-20 fuel with both the unified model and the original HRM. The predicted fuel density in the near-nozzle region matched well with X-ray tomography measurements. The simulation results indicated that, whereas the HRM failed to capture the vaporization due to convective mixing between the fuel and ambient gas, the unified model performed well in predicting the mixing-driven vaporization and the corresponding evaporative cooling. Further comparisons using the nine-component fuel formula and a single-component fuel surrogate demonstrated the unified model's ability to predict preferential vaporization, which affects the predictions of local mixture composition and rate of vaporization. Finally, it is shown that the unified model is capable of representing multiple phase change mechanisms, and the relaxation time factor plays an important role in determining the degree of phase change due to the different mechanisms.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2022

Unified Language Frontend for Physic-Informed AI/ML

Artificial intelligence and machine learning (AI/ML) are becoming important tools for scientific modeling and simulation as in several other fields such as image analysis and natural language processing. ML techniques can leverage the computing power available in modern systems and reduce the human effort needed to configure experiments, interpret and visualize results, draw conclusions from huge quantities of raw data, and build surrogates for physics based models. Domain scientists in fields like fluid dynamics, microelectronics and chemistry can automate many of their most difficult and repetitive tasks or improve the design times by use of the faster ML-surrogates. However, modern ML and traditional scientific highperformance computing (HPC) tend to use completely different software ecosystems. While ML frameworks like PyTorch and TensorFlow provide Python APIs, most HPC applications and libraries are written in C++. Direct interoperability between the two languages is possible but is tedious and error-prone. In this work, we show that a compiler-based approach can bridge the gap between ML frameworks and scientific software with less developer effort and better efficiency. We use the MLIR (multi-level intermediate representation) ecosystem to compile a pre-trained convolutional neural network (CNN) in PyTorch to freestanding C++ source code in the Kokkos programming model. Kokkos is a programming model widely used in HPC to write portable, shared-memory parallel code that can natively target a variety of CPU and GPU architectures. Our compiler-generated source code can be directly integrated into any Kokkosbased application with no dependencies on Python or cross-language interfaces.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

Experimental and kinetic modeling study of tetralin: A naphtheno-aromatic fuel for gasoline, jet and diesel surrogates

Distillate fuels contain significant proportions of naphtheno-aromatic components and tetralin is a suitable surrogate component to represent this molecular moiety. The presence of aromatic and naphthyl rings makes kinetic modeling of tetralin very challenging. Primary radicals formed during the oxidation of tetralin can be aryl, benzylic or paraffinic in nature. Using available information on reaction paths and rate constants of naphthenes and alkyl-aromatics, in this study a kinetic model of tetralin has been developed with emphasis on low-temperature chemistry and high-pressure conditions. Due to the lack of high-level quantum chemical calculations on reaction pathways of tetralin, analogous rates from ab-initio studies on benzylic and paraffinic radicals have been adopted here. Some modifications to the reaction rate rules are incorporated to account for the unique characteristics of tetralin's molecular structure. Important reaction channels have been identified using reaction path and brute force sensitivity analyses. In order to investigate the model performance at low temperatures, new experiments are carried out in a rapid compression machine on blends of tetralin and 3-methylpentane. Blending of low-reactivity tetralin with a high-reactivity alkane allowed the investigation of tetralin ignition at very low temperatures (665 – 856 K). The kinetic model developed in the current study is found to predict the current experiments and literature data adequately. The new model will aid in high-fidelity surrogate predictions at engine-relevant conditions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗