Experiments on Flat-BOLT Surrogates for Investigating the Impact of Nose Region on Acreage Heating and Transition to Turbulence
Explore the source record for details and available documents.
Hypersonic↗
SEARCH · Engineering Papers
Results for “surrogates”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Experiments on Flat-BOLT Surrogates for Investigating the Impact of Nose Region on Acreage Heating and Transition to Turbulence
Explore the source record for details and available documents.
Hypersonic↗
Surrogate Modeling of Subgrid Turbulent Transport Based on 3D Radiative Hydrodynamic Simulations of the Quiet Sun
Turbulent Transport: Plays a critical role in astrophysical plasmas, such as the solar interior, spanning multiple scales and challenging traditional modeling approaches. Objective: Develop machine learning (ML) models—MLP and CNN—to predict subgrid Reynolds stress tensors from StellarBox 3D simulations of the solar atmosphere. Benchmarking: Compare ML-driven models against physics-based Gradient and Smagorinsky approaches.
SMD↗
Intercomparison Between Surrogate, Explicit, and Full Treatments of VSL Bromine Chemistry Within the CAM‐Chem Chemistry‐Climate Model
Explore the source record for details and available documents.
Rafael P. Fernandez↗
Atmospheric Chemistry Surrogate Modeling With Sparse Identification of Nonlinear Dynamics
Explore the source record for details and available documents.
Xiaokai Yang↗
Numerical Investigation and Optimization of a Flushwall Injector for Scramjet Applications at Hypervelocity Flow Conditions
An investigation utilizing Reynolds-averaged simulations (RAS) was performed in order to demonstrate the use of design and analysis of computer experiments (DACE) methods in Sandia’s DAKOTA software package for surrogate modeling and optimization. These methods were applied to a flow- path fueled with an interdigitated flushwall injector suitable for scramjet applications at hyper- velocity conditions and ascending along a constant dynamic pressure flight trajectory. The flight Mach number, duct height, spanwise width, and injection angle were the design variables selected to maximize two objective functions: the thrust potential and combustion efficiency. Because the RAS of this case are computationally expensive, surrogate models are used for optimization. To build a surrogate model a RAS database is created. The sequence of the design variables comprising the database were generated using a Latin hypercube sampling (LHS) method. A methodology was also developed to automatically build geometries and generate structured grids for each design point. The ensuing RAS analysis generated the simulation database from which the two objective functions were computed using a one-dimensionalization (1D) of the three-dimensional simulation data. The data were fitted using four surrogate models: an artificial neural network (ANN), a cubic polynomial, a quadratic polynomial, and a Kriging model. Variance-based decomposition showed that both objective functions were primarily driven by changes in the duct height. Multiobjective design optimization was performed for all four surrogate models via a genetic algorithm method. Optimal solutions were obtained at the upper and lower bounds of the flight Mach number range. The Kriging model predicted an optimal solution set that exhibited high values for both objective functions. Additionally, three challenge points were selected to assess the designs on the Pareto fronts. Further sampling among the designs of the Pareto fronts may be required to lower the surrogate model errors and perform more accurate surrogate-model-based optimization.
Shenoy, Rajiv R.↗
Creation of a Rapid High-Fidelity Aerodynamics Module for a Multidisciplinary Design Environment
In the traditional aerospace vehicle design process, each successive design phase is accompanied by an increment in the modeling fidelity of the disciplinary analyses being performed. This trend follows a corresponding shrinking of the design space as more and more design decisions are locked in. The correlated increase in knowledge about the design and decrease in design freedom occurs partly because increases in modeling fidelity are usually accompanied by significant increases in the computational expense of performing the analyses. When running high fidelity analyses, it is not usually feasible to explore a large number of variations, and so design space exploration is reserved for conceptual design, and higher fidelity analyses are run only once a specific point design has been selected to carry forward. The designs produced by this traditional process have been recognized as being limited by the uncertainty that is present early on due to the use of lower fidelity analyses. For example, uncertainty in aerodynamics predictions produces uncertainty in trajectory optimization, which can impact overall vehicle sizing. This effect can become more significant when trajectories are being shaped by active constraints. For example, if an optimal trajectory is running up against a normal load factor constraint, inaccuracies in the aerodynamic coefficient predictions can cause a feasible trajectory to be considered infeasible, or vice versa. For this reason, a trade must always be performed between the desired fidelity and the resources available. Apart from this trade between fidelity and computational expense, it is very desirable to use higher fidelity analyses earlier in the design process. A large body of work has been performed to this end, led by efforts in the area of surrogate modeling. In surrogate modeling, an up-front investment is made by running a high fidelity code over a Design of Experiments (DOE); once completed, the DOE data is used to create a surrogate model, which captures the relationships between input variables and responses into regression equations. Depending on the dimensionality of the problem and the fidelity of the code for which a surrogate model is being created, the initial DOE can itself be computationally prohibitive to run. Cokriging, a modeling approach from the field of geostatistics, provides a desirable compromise between computational expense and fidelity. To do this, cokriging leverages a large body of data generated by a low fidelity analysis, combines it with a smaller set of data from a higher fidelity analysis, and creates a kriging surrogate model with prediction fidelity approaching that of the higher fidelity analysis. When integrated into a multidisciplinary environment, a disciplinary analysis module employing cokriging can raise the analysis fidelity without drastically impacting the expense of design iterations. This is demonstrated through the creation of an aerodynamics analysis module in NASA’s OpenMDAO framework. Aerodynamic analyses including Missile DATCOM, APAS, and USM3D are leveraged to create high fidelity aerodynamics decks for parametric vehicle geometries, which are created in NASA’s Vehicle Sketch Pad (VSP). Several trade studies are performed to examine the achieved level of model fidelity, and the overall impact to vehicle design is quantified.
Aerodynamic Properties↗
The First Government Sanctioned Delivery of Medical Supplies by Remotely Controlled Unmanned Aerial System (UAS)
The first government sanctioned delivery of medical supplies by UAS occurred at Wise, Virginia, on July 17, 2015. The "Let's Fly Wisely" event was a demonstration of the humanitarian use of UAS to facilitate delivery of medical supplies to remote or otherwise difficult-to-reach areas. The event was the result of coordinated efforts by a partnership which included the National Aeronautics and Space Administration (NASA) Langley Research Center (LaRC), Virginia Polytechnic Institute, the Mid-Atlantic Aviation Partnership (MAAP), Flirtey Corporation, Lonesome Pine Airport, Remote Area Medical (RAM), Health Wagon, SEESPAN Aerial Interactive, Rx Partnership, and Wise County, Virginia. The historic event occurred during the annual Remote Area Medical clinic at the Wise County Fairgrounds. The medical supplies in small packages were delivered to the Wise County Fairgrounds from the Lonesome Pine Airport by UAS operated by Firtey. A larger supply of medical supplies were delivered to the Lonesome Pine Airport from the Tazewell County Airport by NASA Langley's SR22 UAS Surrogate Research aircraft. The UAS Surrogate aircraft was remotely controlled for most of the flight by a UAS Ground Control Station located at the Lonesome Pine Airport. The medical supplies were delivered from the UAS Surrogate to Flirtey for final delivery by Hex Multi-Rotor UAS in smaller packages and multiple trips to the fairgrounds. A Certificate of Authorization (COA) issued by the Federal Aviation Administration (FAA) designated the site as an authorized UAS test site. The paper will present additional details of the historic delivery of pharmaceuticals by UAS during the "Let's Fly Wisely" event. The paper will also provide details of NASA's SR22 UAS Surrogate Research aircraft. The UAS Surrogate was designed to investigate the procedures, aircraft sensors and other systems that may be required to allow Unmanned Aerial Systems (UAS) to safely operate with manned aircraft in the National Airspace System (NAS).
Howell, Charles T., III↗
The Virtual Tablet: Virtual Reality as a Control System
In the field of human-computer interaction, Augmented Reality (AR) and Virtual Reality (VR) have been rapidly growing areas of interest and concerted development effort thanks to both private and public research. At NASA, a number of groups have explored the possibilities afforded by AR and VR technology, among which is the IT Advanced Concepts Lab (ITACL). Within ITACL, the AVR (Augmented/Virtual Reality) Lab focuses on VR technology specifically for its use in command and control. Previous work in the AVR lab includes the Natural User Interface (NUI) project and the Virtual Control Panel (VCP) project, which created virtual three-dimensional interfaces that users could interact with while wearing a VR headset thanks to body- and hand-tracking technology. The Virtual Tablet (VT) project attempts to improve on these previous efforts by incorporating a physical surrogate which is mirrored in the virtual environment, mitigating issues with difficulty of visually determining the interface location and lack of tactile feedback discovered in the development of previous efforts. The physical surrogate takes the form of a handheld sheet of acrylic glass with several infrared-range reflective markers and a sensor package attached. Using the sensor package to track orientation and a motion-capture system to track the marker positions, a model of the surrogate is placed in the virtual environment at a position which corresponds with the real-world location relative to the user's VR Head Mounted Display (HMD). A set of control mechanisms is then projected onto the surface of the surrogate such that to the user, immersed in VR, the control interface appears to be attached to the object they are holding. The VT project was taken from an early stage where the sensor package, motion-capture system, and physical surrogate had been constructed or tested individually but not yet combined or incorporated into the virtual environment. My contribution was to combine the pieces of hardware, write software to incorporate each piece of position or orientation data into a coherent description of the object's location in space, place the virtual analogue accordingly, and project the control interface onto it, resulting in a functioning object which has both a physical and a virtual presence. Additionally, the virtual environment was enhanced with two live video feeds from cameras mounted on the robotic device being used as an example target of the virtual interface. The working VT allows users to naturally interact with a control interface with little to no training and without the issues found in previous efforts.
virtual control interface↗
Benchmarking Bayesian Optimization Frameworks and Acquisition Strategies for Materials Discovery and Autonomous Laboratories
Bayesian optimization (BO) can accelerate materials discovery by guiding expensive experiments toward the most promising processing conditions. We systematically compare five BO surrogate and framework combinations (Gaussian processes in Ax, Gaussian processes and Monte-Carlo neural networks in BayBE, random forests in Lolopy, and tree-structured Parzen (TPE) estimators in Hyperopt) on three benchmarks that mimic common materials design tasks (a discrete solid-electrolyte composition space, a hybrid discrete/continuous laminate-composite design problem solved with micromechanics modeling, and the continuous Ishigami analytic function which is a standard optimization benchmark). Each BO surrogate is paired with posterior mean, probability of improvement, and expected improvement acquisition functions and run for 100 trials from randomized initial samples with uniform random search providing a control. Across five random seeds per setting, BayBE’s Gaussian-process surrogate with expected improvement consistently reached ≥95 % of the known optimum in the fewest evaluations, while Lolopy’s random forest matched or exceeded GP performance on purely categorical or mixed spaces at a higher computational cost. Posterior mean alone often stagnated at local optima, underscoring the need for exploration, whereas probability and expected improvement balanced exploration and exploitation leading to better optimization in fewer trials. Execution times ranged from milliseconds for TPE to minutes for neural-network and random-forest surrogates. These results establish baseline expectations for BO in automated materials laboratories and highlight expected improvement with Gaussian processes as a reliable first choice, with random forests offering a strong alternative when categorical variables dominate. The benchmark suite and code are released to facilitate future surrogate, acquisition, and constraint-handling research in data-driven materials optimization.
Bayesian optimization↗
Uncertainty Analysis of Decomposing Polyurethane Foam
Sensitivity/uncertainty analyses are necessary to determine where to allocate resources for improved predictions in support of our nation's nuclear safety mission. Yet, sensitivity/uncertainty analyses are not commonly performed on complex combustion models because the calculations are time consuming, CPU intensive, nontrivial exercises that can lead to deceptive results. To illustrate these ideas, a variety of sensitivity/uncertainty analyses were used to determine the uncertainty associated with thermal decomposition of polyurethane foam exposed to high radiative flux boundary conditions. The polyurethane used in this study is a rigid closed-cell foam used as an encapsulant. Related polyurethane binders such as Estane are used in many energetic materials of interest to the JANNAF community. The complex, finite element foam decomposition model used in this study has 25 input parameters that include chemistry, polymer structure, and thermophysical properties. The response variable was selected as the steady-state decomposition front velocity calculated as the derivative of the decomposition front location versus time. An analytical mean value sensitivity/uncertainty (MV) analysis was used to determine the standard deviation by taking numerical derivatives of the response variable with respect to each of the 25 input parameters. Since the response variable is also a derivative, the standard deviation was essentially determined from a second derivative that was extremely sensitive to numerical noise. To minimize the numerical noise, 50-micrometer element dimensions and approximately 1-msec time steps were required to obtain stable uncertainty results. As an alternative method to determine the uncertainty and sensitivity in the decomposition front velocity, surrogate response surfaces were generated for use with a constrained Latin Hypercube Sampling (LHS) technique. Two surrogate response surfaces were investigated: 1) a linear surrogate response surface (LIN) and 2) a quadratic response surface (QUAD). The LHS techniques do not require derivatives of the response variable and are subsequently relatively insensitive to numerical noise. To compare the LIN and QUAD methods to the MV method, a direct LHS analysis (DLHS) was performed using the full grid and timestep resolved finite element model. The surrogate response models (LIN and QUAD) are shown to give acceptable values of the mean and standard deviation when compared to the fully converged DLHS model.
Hobbs, Michael L.↗
Investigation of Navier-Stokes Code Verification and Design Optimization
With rapid progress made in employing computational techniques for various complex Navier-Stokes fluid flow problems, design optimization problems traditionally based on empirical formulations and experiments are now being addressed with the aid of computational fluid dynamics (CFD). To be able to carry out an effective CFD-based optimization study, it is essential that the uncertainty and appropriate confidence limits of the CFD solutions be quantified over the chosen design space. The present dissertation investigates the issues related to code verification, surrogate model-based optimization and sensitivity evaluation. For Navier-Stokes (NS) CFD code verification a least square extrapolation (LSE) method is assessed. This method projects numerically computed NS solutions from multiple, coarser base grids onto a freer grid and improves solution accuracy by minimizing the residual of the discretized NS equations over the projected grid. In this dissertation, the finite volume (FV) formulation is focused on. The interplay between the xi concepts and the outcome of LSE, and the effects of solution gradients and singularities, nonlinear physics, and coupling of flow variables on the effectiveness of LSE are investigated. A CFD-based design optimization of a single element liquid rocket injector is conducted with surrogate models developed using response surface methodology (RSM) based on CFD solutions. The computational model consists of the NS equations, finite rate chemistry, and the k-6 turbulence closure. With the aid of these surrogate models, sensitivity and trade-off analyses are carried out for the injector design whose geometry (hydrogen flow angle, hydrogen and oxygen flow areas and oxygen post tip thickness) is optimized to attain desirable goals in performance (combustion length) and life/survivability (the maximum temperatures on the oxidizer post tip and injector face and a combustion chamber wall temperature). A preliminary multi-objective optimization study is carried out using a geometric mean approach. Following this, sensitivity analyses with the aid of variance-based non-parametric approach and partial correlation coefficients are conducted using data available from surrogate models of the objectives and the multi-objective optima to identify the contribution of the design variables to the objective variability and to analyze the variability of the design variables and the objectives. In summary the present dissertation offers insight into an improved coarse to fine grid extrapolation technique for Navier-Stokes computations and also suggests tools for a designer to conduct design optimization study and related sensitivity analyses for a given design problem.
Vaidyanathan, Rajkumar↗
Opposed Jet Burner Extinction Limits: Simple Mixed Hydrocarbon Scramjet Fuels vs Air
Opposed Jet Burner tools have been used extensively by the authors to measure Flame Strength (FS) of laminar non-premixed H2 air and simple hydrocarbon (HC) air counterflow diffusion flames at 1-atm. FS represents a strain-induced extinction limit based on air jet velocity. This paper follows AIAA-2006-5223, and provides new HC air FSs for global testing of chemical kinetics, and for characterizing idealized flameholding potentials during early scramjet-like combustion. Previous FS data included six HCs, pure and N2-diluted; and three HC-diluted H2 fuels, where FS decayed very nonlinearly as HC was added to H2, due to H-atom scavenging. This study presents FSs on mixtures of (candidate surrogate) HCs, some with very high FS ethylene. Included are four binary gaseous systems at 300 K, and a hot ternary system at approx. 600 K. The binaries are methane + ethylene, ethane + ethylene, methane + ethane, and methane + propylene. The first three also form two ternary systems. The hot ternary includes both 10.8 and 21.3 mole % vaporized n-heptane and full ranges of methane + ethylene. Normalized FS data provide accurate means of (1) validating, globally, chemical kinetics for extinction of non-premixed flames, and (2) estimating (scaling by HC) the loss of incipient flameholding in scramjet combustors. The n-heptane is part of a proposed baseline simulant (10 mole % with 30% methane + 60% ethylene) that mimics the ignition of endothermically cracked JP-7 like kerosene fuel, as suggested by Colket and Spadaccini in 2001 in their shock tube Scramjet Fuels Autoignition Study. Presently, we use FS to gauge idealized flameholding, and define HC surrogates. First, FS was characterized for hot nheptane + methane + ethylene; then a hot 36 mole % methane + 64% ethylene surrogate was defined that mimics FS of the baseline simulant system. A similar hot ethane + ethylene surrogate can also be defined, but it has lower vapor pressure at 300 K, and thus exhibits reduced gaseous capacity. The new FS results refine our earlier idealized reactivity scale that shows wide ranging (50 x) diameter-normalized FSs for various HCs. These range from JP-10 and methane to H2 air, which produces an exceptionally strong flame that agrees within approx. 1% of recent 2-D numerically simulations. Finally, we continue advocating the FS approach as more direct and fundamental, for assessing idealized scramjet flameholding potentials, than measurements of unstrained laminar burning velocity or blowout in a Perfectly Stirred Reactor.
Pellett, Gerald L.↗
Nitric Oxide and Oxygen Air-Contamination Effects on Extinction Limits of Non-Premixed Hydrocarbon-Air Flames for a HIFiRE Scramjet
Unique nitric oxide (NO) and oxygen air-contamination effects on the extinction Flame Strength (FS) of non-premixed hydrocarbon (HC) vs. air flames are characterized for 7 gaseous HCs, using a new idealized 9.3 mm straight-tube Opposed Jet Burner (OJB) at 1 atm. FS represents a laminar strain-induced extinction limit based on cross-section-average air jet velocity, Uair, that sustains combustion of a counter jet of gaseous fuel just before extinction. Besides ethane, propane, butane, and propylene, the HCs include ethylene, methane, and a 64 mole-% ethylene / 36 % methane mixture, the writer s previously recommended gaseous surrogate fuel for HIFiRE scramjet tests. The HC vs. clean air part of the work is an extension of a May 2008 JANNAF paper that characterized surrogates for the HIFiRE project that should mimic the flameholding of reformed (thermally- or catalytically-cracked) endothermic JP-like fuels. The new FS data for 7 HCs vs. clean air are thus consolidated with the previously validated data, normalized to absolute (local) axial-input strain rates, and co-plotted on a dual kinetically dominated reactivity scale. Excellent agreement with the prior data is obtained for all 7 fuels. Detailed comparisons are also made with recently published (Univ. Va) numerical results for ethylene extinction. A 2009-revised ethylene kinetic model (Univ. Southern Cal) led to predicted limits within approx. 5 % (compared to 45 %, earlier) of this writer s 2008 (and present) ethylene FSs, and also with recent independent data (Univ. Va) obtained on a new OJB system. These +/- 5 % agreements, and a hoped-for "near-identically-performing" reduced kinetics model, would greatly enhance the capability for accurate numerical simulations of surrogate HC flameholding in scramjets. The measured air-contamination effects on normalized FS extinction limits are projected to assess ongoing Arc-Heater-induced "facility test effects" of NO production (e.g., 3 mole-%) and resultant oxygen depletion (from 21 to 19.5 %), for testing the "64/36" surrogate fuel in Langley s Arc-Heated Scramjet Test Facility for HIFiRE engine designs. The FS results show a generally small (< 4 %) "nitric oxide enhancement" effect, relative to clean air, for up to 3 % NO (freestream Mach number up to 7 in Arc Jet testing). However, a progressively large "oxygendeficiency weakening" effect develops. For 3 % NO, a net weakening of 26 % in FS is derived for the "64/36" fuel vs. air. The corresponding net weakening for pure ethylene is 20 %. A number of practical recommendations regarding facility test effects are offered.
Pellett, Gerald L.↗
Simulation and Flight Test Capability for Testing Prototype Sense and Avoid System Elements
NASA Langley Research Center (LaRC) and The MITRE Corporation (MITRE) have developed, and successfully demonstrated, an integrated simulation-to-flight capability for evaluating sense and avoid (SAA) system elements. This integrated capability consists of a MITRE developed fast-time computer simulation for evaluating SAA algorithms, and a NASA LaRC surrogate unmanned aircraft system (UAS) equipped to support hardware and software in-the-loop evaluation of SAA system elements (e.g., algorithms, sensors, architecture, communications, autonomous systems), concepts, and procedures. The fast-time computer simulation subjects algorithms to simulated flight encounters/ conditions and generates a fitness report that records strengths, weaknesses, and overall performance. Reviewed algorithms (and their fitness report) are then transferred to NASA LaRC where additional (joint) airworthiness evaluations are performed on the candidate SAA system-element configurations, concepts, and/or procedures of interest; software and hardware components are integrated into the Surrogate UAS research systems; and flight safety and mission planning activities are completed. Onboard the Surrogate UAS, candidate SAA system element configurations, concepts, and/or procedures are subjected to flight evaluations and in-flight performance is monitored. The Surrogate UAS, which can be controlled remotely via generic Ground Station uplink or automatically via onboard systems, operates with a NASA Safety Pilot/Pilot in Command onboard to permit safe operations in mixed airspace with manned aircraft. An end-to-end demonstration of a typical application of the capability was performed in non-exclusionary airspace in October 2011; additional research, development, flight testing, and evaluation efforts using this integrated capability are planned throughout fiscal year 2012 and 2013.
Howell, Charles T.↗
Passive Earth Entry Vehicle Landing Test
Two full-scale passive Earth Entry Vehicles (EEV) with realistic structure, surrogate sample container, and surrogate Thermal Protection System (TPS) were built at NASA Langley Research Center (LaRC) and tested at the Utah Test and Training Range (UTTR). The main test objective was to demonstrate structural integrity and investigate possible impact response deviations of the realistic vehicle as compared to rigid penetrometer responses. With the exception of the surrogate TPS and minor structural differences in the back shell construction, the two test vehicles were identical in geometry and both utilized the Integrated Composite Stiffener Structure (ICoSS) structural concept in the forward shell. The ICoSS concept is a lightweight and highly adaptable composite concept developed at NASA LaRC specifically for entry vehicle TPS carrier structures. The instrumented test vehicles were released from a helicopter approximately 400 m above ground. The drop height was selected such that at least 98% of the vehicles terminal velocity would be achieved. While drop tests of spherical penetrometers and a low fidelity aerodynamic EEV model were conducted at UTTR in 1998 and 2000, this was the first time a passive EEV with flight-like structure, surrogate TPS, and sample container was tested at UTTR for the purpose of complete structural system validation. Test results showed that at a landing vertical speed of approximately 30 m/s, the test vehicle maintained structural integrity and enough rigidity to penetrate the sandy clay surface thus attenuating the landing load, as measured at the vehicle CG, to less than 600 g. This measured deceleration was found to be in family with rigid penetrometer test data from the 1998 and 2000 test campaigns. Design implications of vehicle structure/soil interaction with respect to sample container and sample survivability are briefly discussed.
Kellas, Sotiris↗
Probabilistic Modeling of a Three-Stage Human Landing System Architecture
Space Policy Directive-1 has led to NASA partnerships with commercial entities on procurement which includes the development of the Human Landing System (HLS) [1]. With the goal of delivering human crew to the lunar surface by 2024, system uncertainties become an important obstacle to the maturation of multiple new, driving technologies and mission concepts of the HLS program. As unmitigated uncertainties have previously led to failed development programs, these risks and their impacts must be understood and handled to ensure program success [2]. Sources of uncertainty include novel engine designs and configurations, increased reliance on cryogenic fluid management(CFM), and refueling technologies—which propagate as high-level performance metrics such as overall propellant mass and engine performance. Also, the occurrence of operational uncertainties—e.g. launch conditions or need to abort during the mission—can cause cascading effects on the rest of the mission that are difficult to definitively quantify, and are outside the scope of control. These concrete examples and other occurrences can be categorized as either epistemic or aleatory uncertainties.Epistemic uncertainty arises due to a lack of knowledge and can be alleviated with design and program maturation. Aleatory uncertainty is due to the inherent randomness of the system and cannot be directly reduced, unlike epistemic uncertainty. Robust design and probabilistic methods can compensate for aleatory effects. A taxonomy of uncertainty is referred to for this work [3]. In this paper, a probabilistic methodology to handle uncertainties has been demonstrated on a three-element HLS concept [1, 4], which allows tracking of current best estimates of the concept and assessment of concept design robustness against uncertainties. A sample case has been completed for this abstract, and an expansion on the methodology will be included in the final paper. This methodology has two key parts: first, the creation of a dynamic architecture model of a three-element HLS concept; and second, its use with surrogate modeling and range estimating techniques to capture and propagate uncertainties. This abstract will cover the basics of the approach used, and further details and justifications will be in the final paper.The mission profile associated with this three-element concept (Fig 1) was modeled as a set of mission events that facilitated mass changes, idles, or spacecraft maneuvers. The mission profile scope starts with each element’s NRHO orbit insertion and aggregation and ends at post-sortie rendezvous with Orion. More detail on the mission profile will be in the final paper. The DYnamic Rocket EQuation Tool (DYREQT), a space systems synthesis and sizing framework used by NASA, was used as the physics framework to model the HLS architecture for applying the probabilistic methodology [5, 6]. Specifically, a parametric representation of the lander, ascent, and transfer elements and the mission profile of each element was established, with vehicle and mission parameters available as inputs to allow for a dynamic model. Each vehicle stage was modeled with high-level performance metrics, using Isp and propellant mass fraction (PMF) to remain parametric. For the probabilistic analysis, uncertainties of interest within the HLS concept were enumerated and represented as parameters within the DYREQT model as inputs for vehicle stages or mission profile events. These parameters were frozen at their nominal values for the purposes of baselining architecture performance and sizing the vehicle appropriately based on reference documentation [1]. Range estimating—a probabilistic method that combines Monte Carlo sampling, focus on critical parameters, and heuristics to assess risk and opportunities—is traditionally used with Mass Equipment Lists (MELs), but has been adapted with operational parameters as well as vehicle parameters in theDYREQT model to capture mission uncertainty alongside vehicle uncertainty [7, 3]. This method was selected due to its application and insight on a system from a bottom-up perspective, independence from historical rules of thumb, and ability to generate sensitivities based on design decisions and uncertainties. As a sample case for the abstract, the boiloff rates of the vehicle elements and the loiter times during the mission (simulating launch time variations and changing window of opportunities) were used with range estimating to provide preliminary results. To perform the range estimation portion of this methodology (depicted in Fig. 3, further details in final paper), the DYREQT model was sampled using a Design of Experiments (DoE) to efficiently explore the architecture design space with respect to the sample set of uncertainty parameters; 5,000 cases via Latin Hypercube Sampling were computed on the DYREQT architecture model. Then, the results were used to create surrogate models, multivariate regressions that can visualize hypercube trends in the design space, of the architecture with respect to the uncertainty parameters. Range estimating was applied to the surrogates instead of the actual models, which saves computational expense due to the bulk of cases needed for the Monte Carlo simulation as part of range estimating. Uncertainty parameters were sampled independently from triangular distributions using the DoE ranges as ‘min’ and ‘max’, and the nominal value as ‘most likely’. Based engineering intuition, some uncertainty parameters are correlated—e.g. if the main propellant has a high boil-off rate, the oxidizer should follow suit as both are related to CFM technology.While a Monte Carlo simulation samples all inputs as independent, the results would show model correlations; thus, it is efficient to sample the inputs as correlated. Using a correlation matrix constructed for the uncertainty parameters, previously independent samples were transformed to perform a Correlated Monte Carlo. A table for the DoE ranges and probability distribution parameters is shown in Table 1, and more details on Correlated Monte Carlo Simulations will be discussed in the final paper. The model’s resulting DoE showed that multivariate polynomial equations fit via least squares method captured its behavior accurately for the sample case. For the Correlated Monte Carlo Simulation, a positive correlation between fuel and oxidizer boiloff rates was used as a demonstration. 10,000 cases were computed with the surrogates and the launched masses for each vehicle element was collated. The results can be displayed in a probability density function (PDF), showing the impact of the uncertainty parameters chosen. Integrating the PDFs will yield a cumulative distribution function (CDF) that shows the cumulative probability of a given value on the x-axis. For the sample case, the elements’ launch mass margin was calculated and represented in as CDFs, as a demonstrated representation of figures of merit for the HLS concept. For the lander and ascent elements, the NRHO mass insertion limit is 16t; the transfer element has a limit of 30t [1]. It can be seen with Figure 2 that this probabilistic methodology can provide insight into mass margin with respect to the uncertainties being modeled. Currently, the results show that the lander (descent) vehicle element has the most restrictive design space; it is the only element to show a 10% probability of negative margin. Further analysis on the Monte Carlo results will show sensitivities for driving constraints and parameters for architecture feasibility, which can lead to establishing potential mission rules.The combination of range estimating with a parametric architecture model for HLS demonstrated the capability of this probabilistic methodology in a sample case. As the HLS development progresses, this methodology has the potential for keeping current best estimates of architecture performance for awarded concepts due to the flexibility in DYREQT’s modeling framework and its parametric nature. Concept maturation and increased epistemic knowledge can be injected into the model probabilistic modeling, and thus continue to track probability of mission success.
Stephanie Y Zhu↗
A Robust Machine Learning Schema for Developing, Maintaining, and Disseminating Machine Learning Models
Recent advances in the development of machine learning (ML) algorithms have enabled the creation of predictive models that can improve decision making, decrease computational cost, and improve efficiency in a variety of fields. As an organization begins to develop and implement such models, the data used in the training, validation, and testing of ML models, the model parameters, and the use cases or limitations of the models must be properly stored to ensure models are both fully traceable and used correctly. In the context of predicting material behavior, advances in computationally intense, physics-based modeling of material behavior at various length scales and the emergence of Integrated Computational Materials Engineering (ICME) have driven the need for developing data-driven surrogate models of the physics-based simulation tools using ML techniques. Surrogate model development allows for accurate material behavior prediction at a fraction of the cost of its physics-based counterpart, allowing for multiscale simulations of real-world applications, further enabling the ability to design fit-for-purpose materials for a reasonable computational investment. However, training such models requires extensive data, and thus, effective data management is necessary to reach the full potential that ML can offer to material design and ICME. This paper proposes a generalized, robust schema that allows organizations to store both real (experimental) and virtual (simulation) data used to train ML models and the defining model parameters and architectures within the Granta MI Platform. The developed schema allows for various types of data inputs and outputs, including single point values, time-series data, and images that can be used in the prediction of material behavior, while following outlined best practices for effective data management. An effective schema for ML data and models can help prevent the recreation of virtual/real training data and surrogate models, help reduce the time to create new models similar to existing ones by offering a starting point in the hyperparameter determination stages, minimize resources devoted to verification and validation (V&V) and certification of models, and ensure that data and surrogate models are not misused due to full traceability of both the data and ML model. It also allows organizations access to models that have already been developed, such that they can be used in the design of new materials, enabling the overall goals of ICME.
Brandon L. Hearley↗