Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Surrogate Models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,351 records · Page 75

Machine-Learning-Based Predictive Modeling of Glass Transition Temperatures: A Case of Polyhydroxyalkanoate Homopolymers and Copolymers

Polyhydroxyalkanoate-based polymers—being ecofriendly, biosynthesizable, and economically viable and possessing a broad range of tunable properties—are currently being actively pursued as promising alternatives for petroleum-based plastics. The vast chemical complexity accessible within this class of polymers gives rise to challenges in the rational discovery of novel polymer chemistries for specific applications. Here, the burgeoning field of polymer informatics addresses this challenge via providing tools and strategies for accelerated property prediction and materials design via surrogate machine-learning models built on reliable past data. In this contribution, we use glass transition temperature T g as an example target property to demonstrate promise of the data-enabled route to accelerated learning of accurate structure–property mappings in PHA-based polymers. Our analysis uses a data set of experimentally measured T g values, polymer molecular weights, and a polydispersity index for PHA-based homo- and copolymers that was carefully assembled from the literature. A fingerprinting scheme that captures key properties based on topology, shape, and charge/polarity of specific chemical units or motifs forming the polymer backbone was devised to numerically represent the polymers. A validated statistical learning model is then developed to allow for a mapping of the polymer fingerprints onto the property space in a physically meaningful and reliable manner. Once developed, the model can not only rapidly predict the property of new PHA polymers but also provide uncertainties underlying the predictions. The model is further combined with an evolutionary-algorithm-based search strategy to efficiently identify multicomponent polymer compositions with a prespecified T g . While the present contribution is focused specifically on T g , the surrogate model development approach put forward here is general and can, in principle, be extended to a range of other properties.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Hover and Forward Flight Performance Modeling of the Ingenuity Mars Helicopter

In 2015, NASA’s Jet Propulsion Laboratory partnered with Ames Research Center, Langley Research Center, and AeroVironment to develop Ingenuity, a small coaxial helicopter capable of flying within Mars’ unique atmospheric conditions. Ingenuity was successfully deployed from its protective shroud on the underside of the Mars 2020 Perseverance Rover and has flown 17 flights on Mars as of December 2021. A number of rotorcraft analysis tools were utilized, and a series of experimental tests were performed to ready Ingenuity for its launch with the Perseverance Rover in July 2020. In this paper, RotCFD, a Reynolds-averaged Navier-Stokes flow solver, is used to model Ingenuity in hover and forward flight for the purposes of validating tools to aid in the development of a future generation of Mars rotorcraft. The results from the RotCFD modeling are benchmarked against results from hover performance tests of the Ingenuity prototype in the 25-Foot Space Simulator at the Jet Propulsion Laboratory and are also compared to hover and forward flight predictions made by CAMRAD II, a well-known comprehensive rotorcraft analysis code. Surrogate performance models are trained to obtain a set of trimmed rotor settings for Ingenuity at different forward flight speeds, which are then used as inputs for the RotCFD forward flight simulations. Additionally, a study of the airframe-rotor interaction and a study of the aerodynamics of the individual airframe components of Ingenuity in forward flight are performed. Finally, to better understand performance predictions by RotCFD and CAMRAD II, a study is conducted on how sectional angles of attack in each code vary with radial station and azimuth.

Hover↗

Generalized Bayesian MARS: Tools for Stochastic Computer Model Emulation

The multivariate adaptive regression spline (MARS) approach of Friedman and its Bayesian counterpart are effective approaches for the emulation of computer models. The traditional assumption of Gaussian errors limits the usefulness of MARS, and many popular alternatives, when dealing with stochastic computer models. Here, we propose a generalized Bayesian MARS (GBMARS) framework which admits the broad class of generalized hyperbolic distributions as the induced likelihood function. This allows us to develop tools for the emulation of stochastic simulators which are parsimonious, scalable, and interpretable and require minimal tuning, while providing powerful predictive and uncertainty quantification capabilities. GBMARS is capable of robust regression with t distributions, quantile regression with asymmetric Laplace distributions, and a general form of “Normal-Wald” regression in which the shape of the error distribution and the structure of the mean function are learned simultaneously. We demonstrate the effectiveness of GBMARS on various stochastic computer models, and we show that it compares favorably to several popular alternatives.

97 MATHEMATICS AND COMPUTING↗

Development of advanced machine learning models for analysis of plutonium surrogate optical emission spectra

This work investigates and applies machine learning paradigms seldom seen in analytical spectroscopy for quantification of gallium in cerium matrices via processing of laser-plasma spectra. Ensemble regressions, support vector machine regressions, Gaussian kernel regressions, and artificial neural network techniques are trained and tested on cerium-gallium pellet spectra. A thorough hyperparameter optimization experiment is conducted initially to determine the best design features for each model. The optimized models are evaluated for sensitivity and precision using the limit of detection (LoD) and root mean-squared error of prediction (RMSEP) metrics, respectively. Gaussian kernel regression yields the superlative predictive model with an RMSEP of 0.33% and an LoD of 0.015% for quantification of Ga in a Ce matrix. This study concludes that these machine learning methods could yield robust prediction models for rapid quality control analysis of plutonium alloys.

Rao, Ashwin P. (ORCID:0000000319312568)↗

Tuning a RANS k-e model for jet-in-crossflow simulations.

We develop a novel calibration approach to address the problem of predictive k e RANS simulations of jet-incrossflow. Our approach is based on the hypothesis that predictive k e parameters can be obtained by estimating them from a strongly vortical flow, specifically, flow over a square cylinder. In this study, we estimate three k e parameters, C%CE%BC, Ce2 and Ce1 by fitting 2D RANS simulations to experimental data. We use polynomial surrogates of 2D RANS for this purpose. We conduct an ensemble of 2D RANS runs using samples of (C%CE%BC;Ce2;Ce1) and regress Reynolds stresses to the samples using a simple polynomial. We then use this surrogate of the 2D RANS model to infer a joint distribution for the k e parameters by solving a Bayesian inverse problem, conditioned on the experimental data. The calibrated (C%CE%BC;Ce2;Ce1) distribution is used to seed an ensemble of 3D jet-in-crossflow simulations. We compare the ensemble's predictions of the flowfield, at two planes, to PIV measurements and estimate the predictive skill of the calibrated 3D RANS model. We also compare it against 3D RANS predictions using the nominal (uncalibrated) values of (C%CE%BC;Ce2;Ce1), and find that calibration delivers a significant improvement to the predictive skill of the 3D RANS model. We repeat the calibration using surrogate models based on kriging and find that the calibration, based on these more accurate models, is not much better that those obtained with simple polynomial surrogates. We discuss the reasons for this rather surprising outcome.

Lefantzi, Sophia↗

Microstructure modeling of nuclear structural materials: Recent progress and future directions

Modeling and simulation of microstructures are essential to understand the complex responses and behaviors of nuclear materials in extreme environments. The needs to assess the extended life operation as well as the growing interest in accelerating nuclear materials development and qualification have stimulated the use of high-fidelity multiscale models aided by empirical and ab initio data. This paper reviews the role of various models across different length and time scales in investigating irradiation effects on microstructure evolution and degradation, in particular the embrittlement caused by radiation induced or enhanced formation of nanoscale chemical heterogeneities. The strength and limitations of these models, including classical rate theories, cluster dynamics, phase-field methods, and atomistic models informed by ab initio energies, are discussed with seminal examples. Challenges regarding the lack of thermo-kinetic data and theoretical treatments considering chemical complexities and magnetic excitations, as well as the stabilizing effect by excess point defects in nuclear structural materials are presented, along with potential solutions based on ab initio informed surrogate energy models and statistical sampling by Monte Carlo simulations. Further, the review then highlights the opportunities to leverage the advantages of different methods by establishing hybrid models by shared variables or coupled codes and applications. Finally, the review concludes with forward-looking remarks on how the use of physics-based models can aid the improvement of machine-learning models of property degradation and vice versa.

36 MATERIALS SCIENCE↗

Machine Learned Empirical Numerical Integrator from Simulated Data

Recently, a number of state-of-the-art surrogate machine learning (ML) models have been designed for global weather and climate prediction, which have been trained using reanalysis data products. Reanalysis data products are constructed using numerical model simulations that combine numerical integration of partial differential equations and parameterization schemes. These products are typically only archived and made available using coarsened spatial and temporal resolutions. This study explores the impact of the numerical generation methods used to produce the training datasets and the temporal resolution of those datasets on machine learning surrogate models. Using the nonlinear vector autoregression (NVAR) machine as an explainable ML technique, simple dynamical systems are emulated with ML models trained on data produced by three classical numerical integration schemes. NVAR is validated as a skillful ML method, capable of producing accurate predictions and, more importantly, reconstructing both the underlying dynamics and the numerical integration scheme used to generate the training data. However, the machine fails to generalize predictions on unseen test data generated by different numerical integration schemes, despite the underlying dynamical system being the same. This result provides a word of caution for the growing field of machine learning emulation of weather and climate dynamics. Furthermore, we illustrate using NVAR that training on temporally coarsened data may increase the required complexity of ML models and potentially introduce new numerical challenges. Finally, we discover that empirical integration schemes with arbitrary time-stepping sizes can be constructed directly from the data, which implies a potential for the development of empirical numerical integration schemes.

54 ENVIRONMENTAL SCIENCES↗

Flow Reactor Study and Kinetic Model Development of HEFA-SPK and its Surrogate

In this work, we formulate a two-component surrogate for HEFA-SPK, incorporating aromatic or cycloalkane components, and develop reduced kinetic models for the surrogates to be used in high-performance computing simulations. The HEFA-SPK surrogate was selected and optimized based on the fuel's physical and combustion properties, including ignition delay times and flame speeds. The resulting surrogate consists of 40% n-undecane and 60% 2-methylnonane. The surrogate was confirmed by flow reactor experiments for both the HEFA-SPK fuel and the suggested two-component surrogates, where excellent agreement was observed. To meet aromatic requirements, 1,2,4-trimethylbenzene (8%) was selected, and we determined that incorporating 30% propylcyclohexane into the HEFA-SPK will achieve a volume swell equivalent to 8% aromatics. The properties of the surrogates were measured, and a new reduced kinetic model was developed based on the semi-decoupling methodology, using a reduced CH4 chemistry from NUIG 1.0 as base chemistry. Kinetic models will be employed in combustor simulations to enable a comprehensive understanding of the effect of SAF fuel properties on aviation combustor performance.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A comparative study of machine learning models for predicting the state of reactive mixing

Mixing phenomena are important mechanisms controlling flow, species transport, and reaction processes in fluids and porous media. Accurate predictions of reactive mixing are critical for many Earth and environmental science problems such as contaminant fate and remediation, macroalgae growth, and plankton biomass evolution. Here, to investigate the evolution of mixing dynamics under different scenarios (e.g., anisotropy, fluctuating velocity fields), a finite-element-based numerical model was built to solve the fast, irreversible bimolecular reaction-diffusion equations to simulate a range of reactive-mixing scenarios. A total of 2,315 simulations were performed using different sets of model input parameters comprising various spatial scales of vortex structures in the velocity field, time-scales associated with velocity oscillations, the perturbation parameter for the vortex-based velocity, anisotropic dispersion contrast (i.e., ratio of longitudinal-to-transverse dispersion), and molecular diffusion. The outputs comprised concentration profiles of reactants and products. The inputs to and outputs from these simulations were concatenated into feature and label matrices, respectively, to train 20 different machine learning (ML) models intended to emulate system behavior. These 20 ML emulators, based on linear methods, Bayesian methods, ensemble learning methods, and multilayer perceptrons (MLPs), were trained to classify the state of mixing and predict three quantities of interest (QoIs) characterizing species production, decay (i.e., average concentration, square of average concentration), and degree of mixing (i.e., variances of species concentration). Unsurprisingly, linear classifiers and regressors failed to reproduce the QoIs; however, ensemble methods (classifiers and regressors) and the MLP model accurately classified the state of reactive mixing and the QoIs. Among ensemble methods, random forest and decision-tree-based AdaBoost faithfully predicted the QoIs. At run time, trained ML emulators produced results times faster than the finite-element simulations. Due to their low computational expense and high accuracy, ensemble and MLP models are excellent emulators for these numerical simulations and great utilities in uncertainty quantification exercises, which can require 1,000s of forward model runs.

97 MATHEMATICS AND COMPUTING↗

Monitoring water quality in the lower Kansas River using remote sensing

Abstract We demonstrate how to combine remote sensing data from satellite imagery (Sentinel‐2) with in situ water quality gauging (USGS Super Gages and the Gybe hyperspectral radiometer) to create spatially dense maps of water quality parameters (chlorophyll‐a concentration, turbidity, and nitrate plus nitrite concentration) along the lower Kansas River. The water quality maps are created using locally tuned models of the target water quality parameters, and this study describes the steps used to design, calibrate, and validate the empirical correlations. Water quality parameters such as chlorophyll‐a concentration are correlated with well‐studied absorption and scattering features in the visible spectrum (roughly 400–700 nm). Nutrients (such as nitrate plus nitrite concentration) lack strong absorption features in the visible spectrum, and in those cases we describe a novel surrogate data modeling approach that identifies overlapping water parcels between the in situ gauging and the remote sensing imagery. Measurements from the overlapping water parcels yield excellent correlations () for the target water quality parameters for limited windows of time (or limited sections of river reaches). Examples are provided illustrating how the water quality maps can be used to track river inputs from ungauged sources (such as creeks), or reveal the mixing patterns at the confluences.

Tufillaro, Nicholas↗

Machine-Learning-Based Multiscale Methods for 3D Modelling of Granular Materials by Incorporating History-Dependent State Variables

Over the past decades, the prevalence of machine learning (ML) methods has made the development of ML-based constitutive models for granular materials undoubtedly a popular subject. Numerous studies have been made to feature the loading path or history-dependent stress-strain response of granular media using neural networks. In this work, a novel finite element method (FEM)–ML multiscale approach was developed by incorporating internal variables to improve the simulation accuracy of 3D history-dependent granular materials for the first time. To this end, a surrogate constitutive model based on the single-step-based multi-layer perceptron (MLP) neural network was used to replace representative volume element (RVE) simulations conducted by the discrete element method (DEM) in the multiscale FEM–DEM approach. Although the prediction principle of the MLP aligns with the FEM algorithm, artificially added internal variables are required to differentiate the loading history. To address this issue, history variables associated with the Frobenius norm are proposed to be fed into the MLP coupled with the strain tensor to extract the history-dependent behaviour of granular assemblies. The developed FEM–ML approach was demonstrated in 3D conventional triaxial compression (CTC) simulations. Compared to the multiscale FEM–DEM approach, the proposed FEM–ML method exhibits a significantly improved computational efficiency.

granular materials↗

Compositional effects on the ignition of FACE gasolines [Compositional effects on the ignition of FACE gasoline fuels: experiments, surrogate fuel formulation, and chemical kinetic modeling]

As regulatory measures for improved fuel economy and decreased emissions are pushing gasoline engine combustion technologies towards extreme conditions (i.e., boosted and intercooled intake with exhaust gas recirculation), fuel ignition characteristics become increasingly important for enabling stable operation. Here, this study explores the effects of chemical composition on the fundamental ignition behavior of gasoline fuels. Two well-characterized, high-octane, non-oxygenated FACE (Fuels for Advanced Combustion Engines) gasolines, FACE F and FACE G, having similar antiknock indices but different octane sensitivities and chemical compositions are studied. Ignition experiments were conducted in shock tubes and a rapid compression machine (RCM) at nominal pressures of 20 and 40 atm, equivalence ratios of 0.5 and 1.0, and temperatures ranging from 650 to 1270 K. Results at temperatures above 900 K indicate that ignition delay time is similar for these fuels. However, RCM measurements below 900 K demonstrate a stronger negative temperature coefficient behavior for FACE F gasoline having lower octane sensitivity. In addition, RCM pressure profiles under two-stage ignition conditions illustrate that the magnitude of low-temperature heat release (LTHR) increases with decreasing fuel octane sensitivity. However, intermediate-temperature heat release is shown to increase as fuel octane sensitivity increases. Various surrogate fuel mixtures were formulated to conduct chemical kinetic modeling, and complex multicomponent surrogate mixtures were shown to reproduce experimentally observed trends better than simpler two- and three-component mixtures composed of n-heptane, iso-octane, and toluene. Measurements in a Cooperative Fuels Research (CFR) engine demonstrated that the multicomponent surrogates accurately captured the antiknock quality of the FACE gasolines. Simulations were performed using multicomponent surrogates for FACE F and G to reveal the underlying chemical kinetics linking fuel composition with ignition characteristics. Finally, a key discovery of this work is the kinetic coupling between aromatics and naphthenes, which affects the radical pool population and thereby controls ignition.

02 PETROLEUM↗

Machine learning properties of binary wurtzite superlattices

The burgeoning paradigm of high-throughput computations and materials informatics brings new opportunities in terms of targeted materials design and discovery. The discovery process can be significantly accelerated and streamlined if one can learn effectively from available knowledge and past data to predict materials properties efficiently. Indeed, a very active area in materials science research is to develop machine learning based methods that can deliver automated and cross-validated predictive models using either already available materials data or new data generated in a targeted manner. In the present paper, we show that fast and accurate predictions of a wide range of properties of binary wurtzite superlattices, formed by a diverse set of chemistries, can be made by employing state-of-the-art statistical learning methods trained on quantum mechanical computations in combination with a judiciously chosen numerical representation to encode materials’ similarity. These surrogate learning models then allow for efficient screening of vast chemical spaces by providing instant predictions of the targeted properties. Moreover, the models can be systematically improved in an adaptive manner, incorporate properties computed at different levels of fidelities and are naturally amenable to inverse materials design strategies. Finally, while the learning approach to make predictions for a wide range of properties (including structural, elastic and electronic properties) is demonstrated here for a specific example set containing more than 1200 binary wurtzite superlattices, the adopted framework is equally applicable to other classes of materials as well.

36 MATERIALS SCIENCE↗

Full-Scale Crash Test of an MD-500 Helicopter

A full-scale crash test was successfully conducted in March 2010 of an MD-500 helicopter at NASA Langley Research Center s Landing and Impact Research Facility. The reasons for conducting this test were threefold: 1 To generate data to be used with finite element computer modeling efforts, 2 To study the crashworthiness features typically associated with a small representative helicopter, and 3 To compare aircraft response to data collected from a previously conducted MD-500 crash test, which included an externally deployable energy absorbing (DEA) concept. Instrumentation on the airframe included accelerometers on various structural components of the airframe; and strain gages on keel beams, skid gear and portions of the skin. Three Anthropomorphic Test Devices and a specialized Human Surrogate Torso Model were also onboard to collect occupant loads for evaluation with common injury risk criteria. This paper presents background and results from this crash test conducted without the DEA concept. These results showed accelerations of approximately 30 to 50 g on the airframe at various locations, little energy attenuation through the airframe, and moderate to high probability of occupant injury for a variety of injury criteria.

Littell, Justin↗

Integrating Analytical Solutions and U-Net Model for Predicting Groundwater Contaminant Plumes in Pump-and-Treat Systems

Pump-and-treat (P&T) is a common technique for groundwater remediation involving the extraction and treatment of contaminated water above ground. Optimizing the design and operation of the P&T well network is essential for maximizing the system’s effectiveness and efficiency. However, this optimization often necessitates many model evaluations, leading to computationally demanding tasks. This study introduces a novel approach that integrates analytical solutions for groundwater dynamics with the U-Net (Ronneberger et al., 2015) deep learning framework to predict groundwater contaminant plume migration under dynamic pumping conditions. By incorporating the Thiem equation (Thiem, 1906) into the input preprocessing, the U-Net model transforms sparse well data into a continuous spatial field that captures the hydraulic impacts of pumping activities. This integration enables the model to leverage both deep learning capabilities and classical physics-based groundwater theories, enhancing prediction accuracy and computational efficiency. These advancements can facilitate rapid, large-scale evaluations of P&T optimization simulations, allowing for timely and effective decision-making in well placement and system management. We demonstrate the model's robust performance across both simplified transient 2D models and a more complex 3D heterogeneous site model at the 200 West P&T facility at the Hanford Site. The U-Net-based model offers substantial computational advantages, reducing simulation times significantly compared to full physics-based models and providing a powerful tool for rapid site evaluation and P&T system optimization, such as evaluating alternative P&T well network designs. Our findings highlight the potential of advanced machine learning models to significantly enhance the efficiency and sustainability of groundwater remediation efforts, offering a novel application of U-Net architecture in environmental science.

Pump-and-treat↗

Deterministic symbolic regression with derivative information: General methodology and application to equations of state

Symbolic regression methods simultaneously determine the model functional form and the regression parameter values by generating expression trees. Symbolic regression can capture the complexity of real–world phenomena but the use of deterministic optimization for symbolic regression has been limited due to the complexity of the search space of existing formulations. Herein we present a novel deterministic mixed–integer nonlinear programming formulation for symbolic regression that incorporates derivative constraints through auxiliary expression trees. By applying the chain rule to mathematical operations, binary expression trees are capable of representing the calculation of first and second derivatives. We apply this formulation to illustrative examples using derivative information to show increased model discrimination capability. In addition, we perform a case study of a thermodynamic equation of state to gain insight on valid functional forms with thermodynamics–based constraints on the first and second derivatives.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Coarse Graining Discrete Element Method Information in Particle-in-Cell Length Scales Using a Machine Learning Approach

This report details the development of a machine learning (ML)-driven framework to coarse-grain inter-particle collision dynamics from high-fidelity Discrete Element Method (DEM) simulations to Particle-in-Cell (PIC) scales for gas-solid systems. Traditional PIC models, while computationally efficient, rely on empirical granular stress formulations that fail to capture the full complexity of collision physics, particularly the heterogeneity in particle dynamics. This study adopts a bottom-up approach, integrating insights from DEM simulations to improve the physical fidelity and interpretability of PIC-scale models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗