Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “surrogates”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Predicting Fiber Failure of Plain Weave Fabric with Recursive Multiscale Micromechanics

Recent advances in the development of machine learning (ML) algorithms have enabled the creation of predictive models that can improve decision making, decrease computational cost, and improve efficiency in a variety of fields. As an organization begins to develop and implement such models, the data used in the training, validation, and testing of machine learning models, the model parameters, and the use cases or limitations of the models must be properly stored to ensure models are both fully traceable and used correctly. In the context of predicting material behavior, advances in computationally intense, physics-based, modeling of material behavior at various length scales, and the emergence of Integrated Computational Materials Engineering (ICME) have driven the need for developing data-driven surrogate models of the physics-based simulation tools using machine learning (ML) techniques. Surrogate model development allows for accurate material behavior prediction at a fraction of the cost of its physics-based counterpart, allowing for multiscale simulations of real-world applications, further enabling the ability to design fit-for-purpose materials for a reasonable computational investment. However, training such models requires extensive data, and thus effective data management is necessary to reach the full potential that ML can offer to material design and ICME. This paper proposes a generalized, robust schema that allows organizations to store both real (experimental) and virtual (simulation) data used to train machine learning models and the defining model parameters and architectures. The developed schema allows for various types of data inputs and outputs, including single point values, time-series data, and images that can be used in for various types of machine learning models while following outlined best practices for effective data management. An effective schema for machine learning data and models can help prevent the recreation of virtual/real training data and surrogate models, can help reduce the time to create new models similar to existing ones by offering a starting point in the hyperparameter determination stages, minimize resources devoted to verification and validation (V&V) and certification of models, and ensure that data and surrogate models are not misused due to full traceability of both the data and ML model. It also allows organizations access to models that have already been developed, such that they can be used in the design of new materials, enabling the overall goals of ICME.

Failure↗

Uncertainty Quantification using Deep Ensembles for Decision Making in Cyber-Physical-Human Systems

In this paper and its companion, Differential Equation Approximation Using Gradient-Boosted Quantile Regression, Robison et al., we examine an approach to quantifying model uncertainty with the aim of increasing the trustworthiness of computational models in human-machine interactions. In Differential Equation Approximation Using Gradient-Boosted Quantile Regression, we focus on gradient-boosted decision trees, while in this one, we give more details about deep ensembles. Uncertainty quantification is crucial for building trustworthy autonomous decision-making agents in human-machine teams. There are two types of uncertainties: aleatoric and epistemic. The former is related to the inherent stochasticity (noise) of the process, whereas the latter is associated with the lack of knowledge or representation capability of models, such as neural networks. By lack of knowledge, we mean the model’s inability to accurately predict outputs for all possible inputs. The aleatory uncertainty can be estimated fairly easily with, for example, filters, whereas epistemic uncertainty is challenging to compute. This paper uses deep ensembles to quantify both aleatory and epistemic uncertainty. It can act as an uncertainty-aware surrogate transition model for decision-making frameworks. "Uncertainty-aware" means that the surrogate transition model should make predictions along with confidence in those predictions. In the context of decision-making, the transition models are ordinary differential equations (ODEs). Since ODEs can be simulated to make one-step or multi-step predictions, a good surrogate model for them should perform reasonably well in both modes. In a multi-step approach, the trajectory sampling method TS∞ was used to propagate uncertainty over multiple steps. The cartpole dynamical system was selected to demonstrate the ability of deep ensembles as good surrogate transition models for decision-making frameworks. The deep ensembles modeled the dynamics of cartpole ODEs and made uncertainty-aware predictions in single-step and multi-step transition modes.

CPH systems↗

Derivation of Integrated Load Distributions from Resampled Computational Data

Principal component analysis (PCA) has been the center of many surrogate models used to characterize fluid flows in recent years. However, little work has been done to character- ize the uncertainty in the PCA transform itself and its effect on derived surrogate models. To explore the uncertainty, a typical interpolated surrogate model is constructed for a represen- tative aerodynamic body from computational data. The computational data is then resampled to explore the robustness of the PCA transformation. The variations of the model predictions during this resampling are analyzed to get a measure of confidence in the PCA transformation, which is then applied to the interpolated surrogate model to get uncertainty on integrated force predictions. An initial test case has been explored with promising results.

Principal Component Analysis↗

Derivation of Integrated Load Distributions from Resampled Computational Data

Principal component analysis (PCA) has been the center of many surrogate models used to characterize fluid flows in recent years. However, little work has been done to character- ize the uncertainty in the PCA transform itself and its effect on derived surrogate models. To explore the uncertainty, a typical interpolated surrogate model is constructed for a represen- tative aerodynamic body from computational data. The computational data is then resampled to explore the robustness of the PCA transformation. The variations of the model predictions during this resampling are analyzed to get a measure of confidence in the PCA transformation, which is then applied to the interpolated surrogate model to get uncertainty on integrated force predictions. An initial test case has been explored with promising results.

Computational Fluid Dynamics↗

A Framework for Deep Learning Emulation of Numerical Models With a Case Study in Satellite Remote Sensing

Numerical models based on physics represent the state of the art in Earth system modeling and comprise our best tools for generating insights and predictions. Despite rapid growth in computational power, the perceived need for higher model resolutions overwhelms the latest generation computers, reducing the ability of modelers to generate simulations for understanding parameter sensitivities and characterizing variability and uncertainty. Thus, surrogate models are often developed to capture the essential attributes of the full-blown numerical models. Recent successes of machine learning methods, especially deep learning (DL), across many disciplines offer the possibility that complex nonlinear connectionist representations may be able to capture the underlying complex structures and nonlinear processes in Earth systems. A difficult test for DL-based emulation, which refers to function approximation of numerical models, is to understand whether they can be comparable to traditional forms of surrogate models in terms of computational efficiency while simultaneously reproducing model results in a credible manner. A DL emulation that passes this test may be expected to perform even better than simple models with respect to capturing complex processes and spatiotemporal dependencies. Here, we examine, with a case study in satellite-based remote sensing, the hypothesis that DL approaches can credibly represent the simulations from a surrogate model with comparable computational efficiency. Our results are encouraging in that the DL emulation reproduces the results with acceptable accuracy and often even faster performance. We discuss the broader implications of our results in light of the pace of improvements in high-performance implementations of DL and the growing desire for higher resolution simulations in the Earth sciences.

Bayesian Deep Learning↗

Using Approximations to Accelerate Engineering Design Optimization

Optimization problems that arise in engineering design are often characterized by several features that hinder the use of standard nonlinear optimization techniques. Foremost among these features is that the functions used to define the engineering optimization problem often are computationally intensive. Within a standard nonlinear optimization algorithm, the computational expense of evaluating the functions that define the problem would necessarily be incurred for each iteration of the optimization algorithm. Faced with such prohibitive computational costs, an attractive alternative is to make use of surrogates within an optimization context since surrogates can be chosen or constructed so that they are typically much less expensive to compute. For the purposes of this paper, we will focus on the use of algebraic approximations as surrogates for the objective. In this paper we introduce the use of so-called merit functions that explicitly recognize the desirability of improving the current approximation to the objective during the course of the optimization. We define and experiment with the use of merit functions chosen to simultaneously improve both the solution to the optimization problem (the objective) and the quality of the approximation. Our goal is to further improve the effectiveness of our general approach without sacrificing any of its rigor.

Torczon, Virginia↗

Software Evolution and the Fault Process

In developing a software system, we would like to estimate the way in which the fault content changes during its development, as well determine the locations having the highest concentration of faults. In the phases prior to test, however, there may be very little direct information regarding the number and location of faults. This lack of direct information requires developing a fault surrogate from which the number of faults and their location can be estimated. We develop a fault surrogate based on changes in the fault index, a synthetic measure which has been successfully used as a fault surrogate in previous work. We show that changes in the fault index can be used to estimate the rates at which faults are inserted into a system between successive revisions. We can then continuously monitor the total number of faults inserted into a system, the residual fault content, and identify those portions of a system requiring the application of additional fault detection and removal resources.

Nikora, Allen P.↗

Thermophysics Characterization of Kerosene Combustion

A one-formula surrogate fuel formulation and its quasi-global combustion kinetics model are developed to support the design of injectors and thrust chambers of kerosene-fueled rocket engines. This surrogate fuel model depicts a fuel blend that properly represents the general physical and chemical properties of kerosene. The accompanying gaseous-phase thermodynamics of the surrogate fuel is anchored with the heat of formation of kerosene and verified by comparing a series of one-dimensional rocket thrust chamber calculations. The quasi-global combustion kinetics model consists of several global steps for parent fuel decomposition, soot formation, and soot oxidation, and a detailed wet-CO mechanism. The final thermophysics formulations are incorporated with a computational fluid dynamics model for prediction of the combustor efficiency of an uni-element, tri-propellant combustor and the radiation of a kerosene-fueled thruster plume. The model predictions agreed reasonably well with those of the tests.

Wang, Ten-See↗

Thermophysics Characterization of Kerosene Combustion

A one-formula surrogate fuel formulation and its quasi-global combustion kinetics model are developed to support the design of injectors and thrust chambers of kerosene-fueled rocket engines. This surrogate fuel model depicts a fuel blend that properly represents the general physical and chemical properties of kerosene. The accompanying gaseous-phase thermodynamics of the surrogate fuel is anchored with the heat of formation of kerosene and verified by comparing a series of one-dimensional rocket thrust chamber calculations. The quasi-global combustion kinetics model consists of several global steps for parent fuel decomposition, soot formation, and soot oxidation and a detailed wet-CO mechanism to complete the combustion process. The final thermophysics formulations are incorporated with a computational fluid dynamics model for prediction of the combustion efficiency of an unielement, tripropellant combustor and the radiation of a kerosene-fueled thruster plume. The model predictions agreed reasonably well with those of the tests.

Wang, Ten-See↗

Aerodynamic Optimization of Rocket Control Surface Geometry Using Cartesian Methods and CAD Geometry

Aerodynamic design is an iterative process involving geometry manipulation and complex computational analysis subject to physical constraints and aerodynamic objectives. A design cycle consists of first establishing the performance of a baseline design, which is usually created with low-fidelity engineering tools, and then progressively optimizing the design to maximize its performance. Optimization techniques have evolved from relying exclusively on designer intuition and insight in traditional trial and error methods, to sophisticated local and global search methods. Recent attempts at automating the search through a large design space with formal optimization methods include both database driven and direct evaluation schemes. Databases are being used in conjunction with surrogate and neural network models as a basis on which to run optimization algorithms. Optimization algorithms are also being driven by the direct evaluation of objectives and constraints using high-fidelity simulations. Surrogate methods use data points obtained from simulations, and possibly gradients evaluated at the data points, to create mathematical approximations of a database. Neural network models work in a similar fashion, using a number of high-fidelity database calculations as training iterations to create a database model. Optimal designs are obtained by coupling an optimization algorithm to the database model. Evaluation of the current best design then gives either a new local optima and/or increases the fidelity of the approximation model for the next iteration. Surrogate methods have also been developed that iterate on the selection of data points to decrease the uncertainty of the approximation model prior to searching for an optimal design. The database approximation models for each of these cases, however, become computationally expensive with increase in dimensionality. Thus the method of using optimization algorithms to search a database model becomes problematic as the number of design variables is increased.

Nelson, Andrea↗

Improved Verification for Aerospace Systems

Aerospace systems are subject to many stringent performance requirements to be verified with low risk. This report investigates verification planning using conditional approaches vice the standard classical statistical methods, and usage of historical surrogate data for requirement validation and in verification planning. The example used in this report to illustrate the results of these investigations is a proposed mission assurance requirement with the concomitant maximum acceptable verification risk for the NASA Constellation Program Orion Launch Abort System (LAS). This report demonstrates the following improvements: 1) verification planning using conditional approaches vice classical statistical methods results in plans that are more achievable and feasible; 2) historical surrogate data can be used to bound validation of performance requirements; and, 3) incorporation of historical surrogate data in verification planning using conditional approaches produces even less costly and more reasonable verification plans. The procedures presented in this report may produce similar improvements and cost savings in verification for any stringent performance requirement for an aerospace system.

Powell, Mark A.↗

Creation of an Upper Stage Trajectory Capability Boundary to Enable Booster System Trade Space Exploration

The problem of trajectory optimization is important in all space missions. The solution of this problem enables one to specify the optimum thrust steering program which should be followed to achieve a specified mission objective, simultaneously satisfying the constraints.1 It is well known that whether or not the ascent trajectory is optimal can have a significant impact on propellant usage for a given payload, or on payload weight for the same gross vehicle weight.2 Consequently, ascent guidance commands are usually optimized in some fashion. Multi-stage vehicles add complexity to this analysis process as changes in vehicle properties in one stage propagate to the other stages through gear ratios and changes in the optimal trajectory. These effects can cause an increase in analysis time as more variables are added and convergence of the optimizer to system closure requires more analysis iterations. In this paper, an approach to simplifying this multi-stage problem through the creation of an upper stage capability boundary is presented. This work was completed as part of a larger study focused on trade space exploration for the advanced booster system that will eventually form a part of NASA s new Space Launch System.3 The approach developed leverages Design of Experiments and Surrogate Modeling4 techniques to create a predictive model of the SLS upper stage performance. The design of the SLS core stages is considered fixed for the purposes of this study, which results in trajectory parameters such as staging conditions being the only variables relevant to the upper stage. Through the creation of a surrogate model, which takes staging conditions as inputs and predicts the payload mass delivered by the SLS upper stage to a reference orbit as the response, it is possible to identify a "surface" of staging conditions which all satisfy the SLS requirement of placing 130 metric tons into low-Earth orbit (LEO).3 This identified surface represents the 130 metric ton capability boundary for the upper stage, such that if the combined first stage and boosters can achieve any one staging point on that surface, then the design is identified as feasible. With the surrogate model created, design and analysis of advanced booster concepts is streamlined, as optimization of the upper stage trajectory is no longer required in every design loop.

Walsh, Ptrick↗

Airborne Simulation of Launch Vehicle Dynamics

In this paper we present a technique for approximating the short-period dynamics of an exploration-class launch vehicle during flight test with a high-performance surrogate aircraft in relatively benign endoatmospheric flight conditions. The surrogate vehicle relies upon a nonlinear dynamic inversion scheme with proportional-integral feedback to drive a subset of the aircraft states into coincidence with the states of a time-varying reference model that simulates the unstable rigid body dynamics, servodynamics, and parasitic elastic and sloshing dynamics of the launch vehicle. The surrogate aircraft flies a constant pitch rate trajectory to approximate the boost phase gravity-turn ascent, and the aircraft's closed-loop bandwidth is sufficient to simulate the launch vehicle's fundamental lateral bending and sloshing modes by exciting the rigid body dynamics of the aircraft. A novel control allocation scheme is employed to utilize the aircraft's relatively fast control effectors in inducing various failure modes for the purposes of evaluating control system performance. Sufficient dynamic similarity is achieved such that the control system under evaluation is optimized for the full-scale vehicle with no changes to its parameters, and pilot-control system interaction studies can be performed to characterize the effects of guidance takeover during boost. High-fidelity simulation and flight test results are presented that demonstrate the efficacy of the design in simulating the Space Launch System (SLS) launch vehicle dynamics using NASA Dryden Flight Research Center's Full-scale Advanced Systems Testbed (FAST), a modified F/A-18 airplane, over a range of scenarios designed to stress the SLS's adaptive augmenting control (AAC) algorithm.

Gilligan, Eric T.↗

Recommended Methods for Monitoring Skeletal Health in Astronauts to Distinguish Specific Effects of Prolonged Spaceflight

NASA uses areal bone mineral density (aBMD) by dual-energy X-ray absorptiometry (DXA) to monitor skeletal health in astronauts after typical 180-day spaceflights. The osteoporosis field and NASA, however, recognize the insufficiency of DXA aBMD as a sole surrogate for fracture risk. This is an even greater concern for NASA as it attempts to expand fracture risk assessment in astronauts, given the complicated nature of spaceflight-induced bone changes and the fact that multiple 1-year missions are planned. In the past decade, emerging analyses for additional surrogates have been tested in clinical trials; the potential use of these technologies to monitor the biomechanical integrity of the astronaut skeleton will be presented. OVERVIEW: An advisory panel of osteoporosis policy-makers provided NASA with an evidence-based assessment of astronaut biomedical and research data. The panel concluded that spaceflight and terrestrial bone loss have significant differences and certain factors may predispose astronauts to premature fractures. Based on these concerns, a proposed surveillance program is presented which a) uses Quantitative Computed Tomography (QCT) scans of the hip to monitor the recovery of spaceflight-induced deficits in trabecular BMD by 2 years after return, b) develops Finite Element Models [FEM] of QCT data to evaluate spaceflight effect on calculated hip bone strength and c) generates Trabecular Bone Score [TBS] from serial DXA scans of the lumbar spine to evaluate the effect of age, spaceflight and countermeasures on this novel index of bone microarchitecture. SIGNIFICANCE: DXA aBMD is a widely-applied, evidence-based predictor for fractures but not applicable as a fracture surrogate for premenopausal females and males <50 years. Its inability to detect structural parameters is a limitation for assessing changes in bone integrity with and without countermeasures. Collective use of aBMD, TBS, QCT, and FEM analysis for astronaut surveillance could accommodate NASA's aggressive schedule for risk definition and inform a NASA-developed model which assesses the probability of overloading bones during mechanically-loaded mission tasks and possibly for physical activities after return to Earth.

Vasadi, Lukas J.↗

Airborne Simulation of Launch Vehicle Dynamics

In this paper we present a technique for approximating the short-period dynamics of an exploration-class launch vehicle during flight test with a high-performance surrogate aircraft in relatively benign endoatmospheric flight conditions. The surrogate vehicle relies upon a nonlinear dynamic inversion scheme with proportional-integral feedback to drive a subset of the aircraft states into coincidence with the states of a time-varying reference model that simulates the unstable rigid body dynamics, servodynamics, and parasitic elastic and sloshing dynamics of the launch vehicle. The surrogate aircraft flies a constant pitch rate trajectory to approximate the boost phase gravity turn ascent, and the aircraft's closed-loop bandwidth is sufficient to simulate the launch vehicle's fundamental lateral bending and sloshing modes by exciting the rigid body dynamics of the aircraft. A novel control allocation scheme is employed to utilize the aircraft's relatively fast control effectors in inducing various failure modes for the purposes of evaluating control system performance. Sufficient dynamic similarity is achieved such that the control system under evaluation is configured for the full-scale vehicle with no changes to its parameters, and pilot-control system interaction studies can be performed to characterize the effects of guidance takeover during boost. High-fidelity simulation and flight-test results are presented that demonstrate the efficacy of the design in simulating the Space Launch System (SLS) launch vehicle dynamics using the National Aeronautics and Space Administration (NASA) Armstrong Flight Research Center Fullscale Advanced Systems Testbed (FAST), a modified F/A-18 airplane (McDonnell Douglas, now The Boeing Company, Chicago, Illinois), over a range of scenarios designed to stress the SLS's Adaptive Augmenting Control (AAC) algorithm.

airborne simulation↗

Improvement of Automated POST Case Success Rate Using Support Vector Machines

During early conceptual design of complex systems, concept down selection can have a large impact upon program life-cycle cost. Therefore, any concepts selected during early design will inherently commit program costs and affect the overall probability of program success. For this reason it is important to consider as large a design space as possible in order to better inform the down selection process. For conceptual design of launch vehicles, trajectory analysis and optimization often presents the largest obstacle to evaluating large trade spaces. This is due to the sensitivity of the trajectory discipline to changes in all other aspects of the vehicle design. Small deltas in the performance of other subsystems can result in relatively large fluctuations in the ascent trajectory because the solution space is non-linear and multi-modal [1]. In order to help capture large design spaces for new launch vehicles, the authors have performed previous work seeking to automate the execution of the industry standard tool, Program to Optimize Simulated Trajectories (POST). This work initially focused on implementation of analyst heuristics to enable closure of cases in an automated fashion, with the goal of applying the concepts of design of experiments (DOE) and surrogate modeling to enable near instantaneous throughput of vehicle cases [2]. Additional work was then completed to improve the DOE process by utilizing a graph theory based approach to connect similar design points [3]. The conclusion of the previous work illustrated the utility of the graph theory approach for completing a DOE through POST. However, this approach was still dependent upon the use of random repetitions to generate seed points for the graph. As noted in [3], only 8% of these random repetitions resulted in converged trajectories. This ultimately affects the ability of the random reps method to confidently approach the global optima for a given vehicle case in a reasonable amount of time. With only an 8% pass rate, tens or hundreds of thousands of reps may be needed to be confident that the best repetition is at least close to the global optima. However, typical design study time constraints require that fewer repetitions be attempted, sometimes resulting in seed points that have only a handful of successful completions. If a small number of successful repetitions are used to generate a seed point, the graph method may inherit some inaccuracies as it chains DOE cases from the non-global-optimal seed points. This creates inherent noise in the graph data, which can limit the accuracy of the resulting surrogate models. For this reason, the goal of this work is to improve the seed point generation method and ultimately the accuracy of the resulting POST surrogate model. The work focuses on increasing the case pass rate for seed point generation.

Zwack, Matthew R.↗

Improving Accuracy of Structural Dynamic Modification with Augmented Residual Vectors

It is often important to perform sensitivity analysis to determine how a structural model will be impacted by design changes. Often, the structural analysts will manually make changes to the finite element model (FEM) to determine the effects. But when dealing with a large FEM with millions of degrees of freedom these manual changes can be cumbersome and calculation of the effects can computationally expensive. Therefore, it is desirable to determine the effects of model changes through approximation methods. One common technique is to determine the analytical sensitivity of the FEM model with respect to the given change. These analytical sensitivities are valid when small changes are made to the structural model, but invalid if large changes need to be assessed. Another approach is to use Structural Dynamic Modification (SDM) to create a surrogate model to analyze model changes. SDM is a widely-used sensitivity method and is used in applications of model updating, uncertainty quantification, and model design studies. SMD is valid for moderate (10-20 percent) changes in the structural model, but model approximations are often needed for large parameter changes (greater than 20 percent). Structural Dynamic Modification can be improved by using residual vectors to augment the surrogate model formulation from SDM. Adding the residual modes increases the fidelity of the surrogate model while keeping the computational cost low. This paper discusses the application and limitations of the augmented residual modes method to two structures: the Integrated Spacecraft and Payload Element (ISPE) of the Space Launch System (SLS) and the full SLS as it is configured during its Integrated Modal Test (IMT).

Stewart, Eric C.↗

Numerical Investigation and Optimization of a Flushwall Injector for Scramjet Applications at Hypervelocity Flow Conditions

An investigation utilizing Reynolds-averaged simulations (RAS) was performed in order to find optimal designs for an interdigitated flushwall injector suitable for scramjet applications at hypervelocity conditions. The flight Mach number, duct height, spanwise width, and injection angle were the design variables selected to maximize two objective functions: the thrust potential and combustion efficiency. A Latin hypercube sampling design-of-experiments method was used to select design points for RAS. A methodology was developed that automated building geometries and generating grids for each design. The ensuing RAS analysis generated the performance database from which the two objective functions of interest were computed using a one-dimensional performance utility. The data were fitted using four surrogate models: an artificial neural network (ANN) model, a cubic polynomial, a quadratic polynomial, and a Kriging model. Variance-based decomposition showed that both objective functions were primarily driven by changes in the duct height. Multiobjective design optimization was performed for all four surrogate models via a genetic algorithm method. Optimal solutions were obtained at the upper and lower bounds of the flight Mach number range. The Kriging model obtained an optimal solution set that predicted high values for both objective functions. Additionally, three challenge points were selected to assess the designs on the Pareto fronts. Further sampling among the designs of the Pareto fronts are required in order to lower the errors and perform more accurate surrogate-based optimization. sed optimization.

Shenoy, Rajiv R.↗