Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainty Propagation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

Toward Comprehensive Uncertainty Predictions for Remote Imaging Spectroscopy

Remote imaging spectroscopy’s role in Earth science will grow in the coming decade as a series of globe-spanning spectroscopy missions launch from NASA, ESA, and other agencies. The nature of remote imaging spectroscopy will change, advancing from short regional studies to address global multi-year questions. The diversity of data will also grow with exposure to a wider range of biomes and atmospheric conditions. To execute these new investigations we must reconcile diverse observing conditions to derive consistent global maps. To this end, rig- orous uncertainty quantification and propagation enables an optimal synthesis of data accounting for observing conditions and data quality. Understanding data uncertainties is also important for principled hypothesis testing, information content assessment, and informed decision making by end users. We survey prior efforts in uncer- tainty quantification for imaging spectroscopy, and describe methods for validating the accuracy of uncertainty predictions. We conclude with a discussion of remaining challenges and promising avenues for future research.

Susiluoto, Jouni↗

Stochastic nonlinear analysis of unidirectional fiber composites using image-based microstructural uncertainty quantification

Here, we present a data-driven nonlinear uncertainty quantification and propagation framework to study the microstructure-induced stochastic performance of unidirectional (UD) carbon fiber reinforced polymer (CFRP) composites. The proposed approach integrates (1) microscopic image characterization, (2) stochastic microstructure reconstruction, and (3) efficient multiscale finite element simulations enabled by self-consistent clustering (SCA) analysis. To model the complex microstructural variability, the proposed UQ methods take the non-Gaussian uncertainty sources into account through a distribution-free sampling approach leveraging nonparametric and asymptotic statistical tools. A hierarchical conditional sampling strategy enables the simultaneous sampling of multiple sources of uncertainties. Our approach provides insights into the impact of microstructural variabilities, which are shown to have an increasing impact on the nonlinear responses of UD CFRP parts under progressive compression loading and ultimately on the failure rate over time. We discover that before CFRP parts start to fail, a characteristic time period emerges with distinctive uncertainty distributions specific to the microstructure variability and the probability of failure. Identifying the failure time period is crucial to the reliability prediction, which is an essential component of CFRP design.

36 MATERIALS SCIENCE↗

High-Accuracy Heats of Formation for Alkane Oxidation: From Small to Large via the Automated CBH-ANL Method

It is generally challenging to obtain high-accuracy predictions for the heat of formation for species with more than a handful of heavy atoms, such as those of importance in standard combustion mechanisms. To this end, we construct the CBH-ANL approach and illustrate that, for a set of 194 alkane oxidation species, it can be used to produce ΔH f (o K) values with 2σ uncertainties of 0.2-0.5 kcal mol -1 . This set includes the alkanes, hydroperoxides, and alkyl, peroxy, and hydroperoxyalkyl radicals for 17 representative hydrocarbon fuels containing up to 10 heavy atoms with various degrees of branching in the alkane backbone. The CBH-ANL approach, automated in the QTC and AutoMech software suites, builds balanced chemical equations for the calculation of ΔH f (o K), in which the reference species may be up to five heavy atoms. The high-level ANLo and ANL1 reference ΔH f (o K) values are further refined for even the largest of these reference species with a novel laddering approach. We perform a comprehensive quantification of the uncertainties for both the individual reference species (the largest of which is 0.15 kcal mol -1 ) and the propagation of those uncertainties when used in the calculation of ΔH f (o K) for the 194 target species. Here we examine the sensitivity of the predicted ΔH f (o K) values to (i) electronic energies from various methods, including ωB97X-D/cc-pVTZ, B2PLYP-D3/cc-pVTZ, CCSD(T)-F12b/cc-pVDZ-F12//B2PLYP-D3/cc-pVTZ, and CCSD(T)-F12b/cc-pVTZ-F12//B2PLYP-D3/cc-pVTZ; (ii) the zero-point vibrational energies (ZPVEs), where we consider harmonic ZPVEs as well as two scaling-based estimates of the anharmonic ZPVEs, all implemented for both ωB97X-D/cc-pVTZ and B2PLYP-D3/cc-pVTZ calculations; (iii) the particular CBH-ANL scheme employed; and (iv) the procedure for choosing the reference conformer for the analyses. The discussion concludes with a summary of the estimated overall uncertainty in the predictions and a validation of the predictions for the alkane subset.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Propagating information content: an example with advection

The mathematical algorithm to derive geophysical information from remote sensing observations is called a retrieval. The mathematics of many retrieval problems are ill-posed, and thus a priori information is used to help constrain the derived geophysical variable to realistic values. One quantity of interest, therefore, is the information content of the observation. Perfect information content in the observation would be achieved if the retrieval were able to capture any perturbation in the desired geophysical variable with the proper magnitude. Many new data products can be derived by combining geophysical variables retrieved from multiple different remote sensors. This paper explores, for the first time, how to derive the information content of these derived products. The approach uses traditional error propagation techniques to derive the uncertainty of the derived field twice, both when the observations are used in the retrieval and also when only the a priori information from each remote sensor is propagated. These two uncertainties are then used to provide an estimate of the information content of the derived geophysical variable. This study demonstrates how to propagate the uncertainties from six different instruments to provide the information content for water vapor and temperature advection. A multi-month analysis demonstrates that, in a mean sense, the information content for temperature advection is nearly unity for all heights below 700 m while, the information content for water vapor advection is somewhat more variable but still larger than 0.6 in the convective boundary layer.

Turner, David D. [National Oceanic and Atmospheric↗

Sensitivity of the simulation of passive neutron emission from UF 6 cylinders to the uncertainties in both 19 F(α,n) energy spectrum and thick target yield of 234 U in UF 6

Interest in safeguards verification measurements using passive thermal neutron counting to assay 235 U content in large 30B UF 6 canisters has grown in recent years. Here, the prohibitively high cost and impracticality of using reference 30B calibration cylinders extensively will likely make accurate simulations of increasing interest. Accuracy of the simulated response will define the confidence in the predicted response and the extent to which simulations can reasonably be relied upon. With 234 U driven 19 F(α, n) reactions being the main neutron source in low enriched UF 6 the uncertainties of the 19 F(α, n) energy spectrum and the thick target yield of 234 U in UF 6 propagate into the uncertainty in the predicted response and represent a major influence of basic nuclear data. Here sensitivity of the simulated total (Singles) and coincidence (Doubles) count rates are assessed for the Passive Neutron Enrichment Meter using six potential 19 F(α, n) neutron energy spectra over a range of enrichments and material distributions. The results indicate that variations in the Singles and Doubles due to simulated (α, n) neutron spectrum are less than 1.5% for this set of simulated neutron spectra, with dependence varying inversely with enrichment. Singles uncertainty is only slightly less than that of the thick target 19 F(α, n) yield corresponding to the primary neutron source, whereas the 19 F(α, n) yield dependence of the Doubles is reduced by the non-negligible 238 U(SF) coincident neutron emissions. Based on available thick target 19 F(α, n) yield estimates the uncertainty is on the order of 5%, establishing this as the main nuclear data limitation when simulating thermal neutron detectors response for 30B UF 6 storage cylinders. Based on these findings, it appears that the measurement and evaluation of the thick target 19 F(α, n) yield for uranium hexafluoride is due.

19F(α,n) neutron spectrum↗

A Bayesian Framework for Milling Stability Prediction and Reverse Parameter Identification

This paper describes a physics-guided Bayesian framework for identifying the milling stability boundary and system parameters through iterative testing. Prior uncertainties for the parameters are identified through physical simulation and literature reviews, without physical testing of the actual milling system. Those uncertainties are then propagated to the stability map using a physics-based stability model, which is used to suggest a test point. The uncertainties are updated based on the new information acquired from the cutting test to form a new probability distribution, called the posterior. Finally, the posterior are compared to measured values for the stability boundary and system parameters to evaluate the approach. Based on experimental observations, the advantages and disadvantages of using a physics-guided model are discussed.

Cornelius, Aaron↗

Dark energy survey year 3 results: likelihood-free, simulation-based w CDM inference with neural compression of weak-lensing map statistics

We present simulation-based cosmological wcold dark matter (wCDM) inference using dark energy survey year 3 weak-lensing maps, via neural data compression of weak-lensing map summary statistics: power spectra, peak counts, and direct map-level compression/inference with convolutional neural networks (CNN). Using simulation-based inference, also known as likelihood-free or implicit inference, we use forward-modelled mock data to estimate posterior probability distributions of unknown parameters. This approach allows all statistical assumptions and uncertainties to be propagated through the forward-modelled mock data; these include sky masks, non-Gaussian shape noise, shape measurement bias, source galaxy clustering, photometric redshift uncertainty, intrinsic galaxy alignments, non-Gaussian density fields, neutrinos, and non-linear summary statistics. We include a series of tests to validate our inference results. This paper also describes the Gower Street simulation suite: 791 full-sky pkdgrav3 dark matter simulations, with cosmological model parameters sampled with a mixed active-learning strategy, from which we construct over 3000 mock dark energy survey lensing data sets. For wCDM inference, for which we allow –1 < w < –$\frac{1}{3}$⁠, our most constraining result uses power spectra combined with map-level (CNN) inference. Using gravitational lensing data only, this map-level combination gives Ω m = 0.283$^{+0.020}_{–0.027}$⁠, S 8 = 0.804$^{+0.025}_{–0.017⁠}$, and w < –0.80 (with a 68 per cent credible interval); compared to the power spectrum inference, this is more than a factor of two improvement in dark energy parameter (Ω⁠ DE , w⁠) precision.

79 ASTRONOMY AND ASTROPHYSICS↗

Uncertainty analysis of correlated parameters in automated reaction mechanism generation

Abstract Uncertainty analysis is a useful tool for inspecting and improving detailed kinetic mechanisms because it can identify the greatest sources of model output error. Owing to the very nonlinear relationship between kinetic and thermodynamic parameters and computed concentrations, model predictions can be extremely sensitive to uncertainties in some parameters while uncertainties in other parameters can be irrelevant. Error propagation becomes even more convoluted in automatically generated kinetic models, where input uncertainties are correlated through kinetic rate rules and thermodynamic group values. Local and global uncertainty analyses were implemented and used to analyze error propagation in Reaction Mechanism Generator (RMG), an open‐source software for generating kinetic models. A framework for automatically assigning parameter uncertainties to estimated thermodynamics and kinetics was created, enabling tracking of correlated uncertainties. Local first‐order uncertainty propagation was implemented using sensitivities computed natively within RMG. Global uncertainty analysis was implemented using adaptive Smolyak pseudospectral approximations as implemented in the MIT Uncertainty Quantification Library to efficiently compute and construct polynomial chaos expansions to approximate the dependence of outputs on a subset of uncertain inputs. Cantera was used as a backend for simulating the reactor system in the global analysis. Analyses were performed for a phenyldodecane pyrolysis model. Local and global methods demonstrated similar trends; however, many uncertainties were significantly overestimated by the local analysis. Both local and global analyses show that correlated uncertainties based on kinetic rate rules and thermochemical groups drastically reduce a model's degrees of freedom and have a large impact on the determination of the most influential input parameters. These results highlight the necessity of incorporating uncertainty analysis in the mechanism generation workflow.

Gao, Connie W.↗

Bayesian optimal experimental design for constitutive model calibration

Computational simulation is increasingly relied upon for high/consequence engineering decisions, which necessitates a high confidence in the calibration of and predictions from complex material models. However, the calibration and validation of material models is often a discrete, multi-stage process that is decoupled from material characterization activities, which means the data collected does not always align with the data that is needed. To address this issue, an integrated workflow for delivering an enhanced characterization and calibration procedure—Interlaced Characterization and Calibration (ICC)—is introduced and demonstrated. Further, this framework leverages Bayesian optimal experimental design (BOED), which creates a line of communication between model calibration needs and data collection capabilities in order to optimize the information content gathered from the experiments for model calibration. Eventually, the ICC framework will be used in quasi real-time to actively control experiments of complex specimens for the calibration of a high-fidelity material model. This work presents the critical first piece of algorithm development and a demonstration in determining the optimal load path of a cruciform specimen with simulated data. Calibration results, obtained via Bayesian inference, from the integrated ICC approach are compared to calibrations performed by choosing the load path a priori based on human intuition, as is traditionally done. The calibration results are communicated through parameter uncertainties which are propagated to the model output space (i.e. stress–strain). In these exemplar problems, data generated within the ICC framework resulted in calibrated model parameters with reduced measures of uncertainty compared to the traditional approaches.

42 ENGINEERING↗

Making sense of uncertain nuclear data

At its core, and in an imperfect world, the scientific method relies heavily on the concept of uncertain knowledge. Understanding the nature and magnitude of our lack of knowledge on nuclear data has important ramifications on a wide range of nuclear technologies that encompass defense, energy, medicine, astrophysics, among others. Over the span of a long and fruitful carrier, Dr. Massimo Salvatores has made significant contributions to the fields of nuclear reactor physics, nuclear data, and uncertainty quantification and propagation. Advances in machine learning techniques and computational capabilities are enabling a new level of confidence in our ability to predict key nuclear metrics as well as their associated uncertainties across many applications. Here this short article reviews some of those concepts with an eye towards developing a new paradigm to provide nuclear data libraries of benefit to various applications.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Pervaporative Dehydration of 2,3-Butanediol by Dense Poly(vinylidene fluoride) Hollow Fiber Membranes: Parameter Estimation, Process Design, and Technoeconomic Evaluation under Uncertainty

Pervaporation, combined with other separation processes, can effectively remove water from fermentation product streams, making it highly suitable for purifying alcohols like 2,3-butanediol (BDO). In this study, a dense poly(vinylidene fluoride) (PVDF) hollow fiber membrane module prototype was fabricated for BDO dehydration, achieving >0.2 LMH total flux and >95% BDO rejection. With a Markov chain Monte Carlo (MCMC) approach, Bayesian inference was used to quantify the uncertainty of the permeance parameters. A membrane cascade model was developed to scale up a process that purifies a preconcentrated BDO feed (70 wt %) to high purity (90 wt %). Through propagation of the uncertainty of the parameters and sensitivity analyses of the process variables, a cascade design was recommended. Despite data and model limitations, the framework enabled a reliable system analysis and economic evaluation, validated through tight confidence intervals in key process metrics, establishing the foundation for future applications of Bayesian methods in membrane-based processes.

Animal feed↗

The New Sun-Sky-Lunar Cimel CE318-T Multiband Photometer - A Comprehensive Performance Evaluation

This paper presents the new photometer CE318-T, able to perform daytime and night-time photometric measurements using the sun and the moon as light source. Therefore,this new device permits a complete cycle of diurnal aerosol and water vapour measurements valuable to enhance atmospheric monitoring to be extracted. In this study wehave found significantly higher precision of triplets when comparing the CE318-T master instrument and the Cimel AErosol RObotic NET work (AERONET) master (CE318-AERONET) triplets as a result of the new CE318-T tracking system. Regarding the instrument calibration, two new methodologies to transfer the calibration from a reference instrument using only daytime measurements (Sun Ratio and Sun-Moon gain factor techniques) are presented and discussed. These methods allow the reduction of the previous complexities inherent to nocturnal calibration. A quantitative estimation of CE318-T AOD uncertainty by means of error propagation theory during daytime revealed AOD uncertainties (u(sup D)(sub AOD)) for Langley-calibrated instruments similar to the expected values for other reference instruments (0.002-0.009). We have also found u(sup D)(sub AOD) values similar to the values reported in sun photometry for field instruments (approximately 0.015). In the case of the night-time period, the CE318-T-estimated standard combined uncertainty (u(sup N)(sub AOD)) is dependent not only on the calibration technique but also on illumination conditions and the instrumental noise. These values range from 0.011-0.018 for Lunar Langley-calibrated instruments to 0.012-0.021 for instruments calibrated using the Sun Ratio technique. In the case of moon-calibrated instruments using the Sun-Moon gain factor method and sun calibrated using the Langley technique, we found u(sup N)(sub AOD) ranging from 0.016 to 0.017 (up to 0.019 in 440 nm channel), not dependent on any lunar irradiance model. A subsequent performance evaluation including CE318-T and collocated measurements from independent reference instruments has served to assess the CE318-T performance as well as to confirm its estimated uncertainty. Daytime AOD evaluation, performed at Izana station from March to June 2014, encompassed measurements from a reference CE318-T, a CE318-AERONET master instrument, a Precision Filter Radiometer (PFR) and a Precision Spectroradiometer (PSR) prototype, reporting low AOD discrepancies between the four instruments (up to 0.006). The nocturnal AOD evaluation was performed using CE318-T- and starphotometer-collocated measurements and also by means of a day/night coherence transition test using the CE318-T master instrument and the CE318 daytime data from the CE318-AERONET master instrument. Results showed low discrepancies with the star photometer at 870 and 500 nm channels(less tna or equal to 0.013) and differences with AERONET daytime data (1 h after and before sunset and sunrise) in agreement with the estimated u(sup N)(sub AOD) values at all illumination conditions in the case of channels within the visible spectral range, and only for high moon's illumination conditions in the case of near infrared channels. Perceptible water vapour (PWV) validation showed a good agreement between CE318-T and Global Navigation Satellite System (GNSS) PWV values for all illumination conditions, within the expected precision for sun photometry. Finally, two case studies have been included to highlight the ability of the new CE318-T to capture the diurnal cycle of aerosols and water vapour as well as short-term atmospheric variations, critical for climate studies.

Barreto, Africa↗

Long-range vertical propagation

Development of the advanced turboprop has led to concerns about en route noise. Advanced turboprops generate low-frequency, periodic noise signatures at relatively high levels. As demonstrated in a flight test of NASA Lewis Research Center's Propfan Test Assessment (PTA) airplane in Alabama in October 1987, the noise of an advanced turboprop operating at cruise altitudes can be audible on the ground. The assessment of the en route noise issue is difficult due to the variability in received noise levels caused by atmospheric propagation and the uncertainty in predicting community response to the relatively low-level en route noise, as compared to noise associated with airport operations. The En Route Noise Test was designed to address the atmospheric propagation of advanced turboprop noise from cruise altitudes and consisted of measuring the noise of an advance turboprop at cruise in close proximity to the turboprop and on the ground. Measured and predicted ground noise levels are presented.

Willshire, William L., Jr.↗

Atomic masses with machine learning for the astrophysical r process

The astrophysical r process plays a vital role in the production of heavy elements. Modeling of the r process is sensitive to masses and further requires knowledge of masses beyond current experimental reach. Therefore, simulations of the r process offer a unique test bed for predicting mass extrapolations. We take a Machine-Learning (ML) approach to model the masses across the entire chart of nuclides. For the first time, we simulate r-process nucleosynthesis with a physics-based ML mass model. We compare simulated abundances to solar data in order to evaluate the model's performance far from stability. The resulting r-process abundances up to thorium and uranium qualitatively match those of the observed solar system abundance pattern, with the characteristic peaks well positioned. We propagate the mass uncertainties obtained from the ML model to r-process abundance yields to estimate an uncertainty band associated with our approach. The size of the uncertainty band is approximately one order of magnitude which aligns with the uncertainty reported using alternative techniques.

79 ASTRONOMY AND ASTROPHYSICS↗

Uncertainty Analysis of Instrument Calibration and Application

Experimental aerodynamic researchers require estimated precision and bias uncertainties of measured physical quantities, typically at 95 percent confidence levels. Uncertainties of final computed aerodynamic parameters are obtained by propagation of individual measurement uncertainties through the defining functional expressions. In this paper, rigorous mathematical techniques are extended to determine precision and bias uncertainties of any instrument-sensor system. Through this analysis, instrument uncertainties determined through calibration are now expressed as functions of the corresponding measurement for linear and nonlinear univariate and multivariate processes. Treatment of correlated measurement precision error is developed. During laboratory calibration, calibration standard uncertainties are assumed to be an order of magnitude less than those of the instrument being calibrated. Often calibration standards do not satisfy this assumption. This paper applies rigorous statistical methods for inclusion of calibration standard uncertainty and covariance due to the order of their application. The effects of mathematical modeling error on calibration bias uncertainty are quantified. The effects of experimental design on uncertainty are analyzed. The importance of replication is emphasized, techniques for estimation of both bias and precision uncertainties using replication are developed. Statistical tests for stationarity of calibration parameters over time are obtained.

Tripp, John S.↗

Potentially Underestimated Gas Flaring Activities—A New Approach to Detect Combustion Using Machine Learning and NASA’s Black Marble Product Suite

Monitoring changes in greenhouse gas (GHG) emission is critical for assessing climate mitigation efforts towards the Paris Agreement goal. A crucial aspect of science-based GHG monitoring is to provide objective information for quality assurance and uncertainty assessment of the reported emissions. Emission estimates from combustion events (gas flaring and biomass burning) are often calculated based on activity data (AD) from satellite observations, such as those detected from the visible infrared imaging radiometer suite (VIIRS) onboard the Suomi-NPP and NOAA-20 satellites. These estimates are often incorporated into carbon models for calculating emissions and removals. Consequently, errors and uncertainties associated with AD propagate into these models and impact emission estimates. Deriving uncertainty of AD is therefore crucial for transparency of emission estimates but remains a challenge due to the lack of evaluation data or alternate estimates. This work proposes a new approach using machine learning (ML) for combustion detection from NASA's Black Marble product suite and explores the assessment of potential uncertainties through comparison with existing detections. We jointly characterize combustion using thermal and light emission signals, with the latter improving detection of probable weaker combustion with less distinct thermal signatures. Being methodologically independent, the differences in ML-derived estimates with existing approaches can indicate the potential uncertainties in detection. The approach was applied to detect gas flares over the Eagle Ford Shale, Texas. We analyzed the spatio-temporal variations in detections and found that approximately 79.04% and 72.14% of the light emission-based detections are missed by ML-derived detections from VIIRS thermal bands and existing datasets, respectively. This improvement in combustion detection and scope for uncertainty assessment is essential for comprehensive monitoring of resulting emissions and we discuss the steps for extending this globally.

gas flaring↗

Recent advances in the quantification of uncertainties in reaction theory

Uncertainty quantification has become increasingly more prominent in nuclear physics over the past several years. In few-body reaction theory, there are four main sources that contribute to the uncertainties in the calculated observables: the effective potentials, approximations made to the few-body problem, structure functions, and degrees of freedom left out of the model space. In this work, we illustrate some of the features that can be obtained when modern statistical tools are applied in the context of nuclear reactions. This work consists of a summary of the progress that has been made in quantifying theoretical uncertainties in this domain, focusing primarily on those uncertainties coming from the effective optical potential as well as their propagation within various reaction theories. We use, as the central example, reactions on the doubly-magic stable nucleus 40 Ca, namely neutron and proton elastic scattering and single-nucleon transfer 40 Ca(d,p) 41 Ca. First, we show different optimization schemes used to constrain the optical potential from differential cross sections and other experimental constraints; we then discuss how these uncertainties propagate to the transfer cross section, comparing two reaction theories. Finally, we finish by laying out our future plans.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Probabilistic Modeling of a Three-Stage Human Landing System Architecture

Space Policy Directive-1 has led to NASA partnerships with commercial entities on procurement which includes the development of the Human Landing System (HLS) [1]. With the goal of delivering human crew to the lunar surface by 2024, system uncertainties become an important obstacle to the maturation of multiple new, driving technologies and mission concepts of the HLS program. As unmitigated uncertainties have previously led to failed development programs, these risks and their impacts must be understood and handled to ensure program success [2]. Sources of uncertainty include novel engine designs and configurations, increased reliance on cryogenic fluid management(CFM), and refueling technologies—which propagate as high-level performance metrics such as overall propellant mass and engine performance. Also, the occurrence of operational uncertainties—e.g. launch conditions or need to abort during the mission—can cause cascading effects on the rest of the mission that are difficult to definitively quantify, and are outside the scope of control. These concrete examples and other occurrences can be categorized as either epistemic or aleatory uncertainties.Epistemic uncertainty arises due to a lack of knowledge and can be alleviated with design and program maturation. Aleatory uncertainty is due to the inherent randomness of the system and cannot be directly reduced, unlike epistemic uncertainty. Robust design and probabilistic methods can compensate for aleatory effects. A taxonomy of uncertainty is referred to for this work [3]. In this paper, a probabilistic methodology to handle uncertainties has been demonstrated on a three-element HLS concept [1, 4], which allows tracking of current best estimates of the concept and assessment of concept design robustness against uncertainties. A sample case has been completed for this abstract, and an expansion on the methodology will be included in the final paper. This methodology has two key parts: first, the creation of a dynamic architecture model of a three-element HLS concept; and second, its use with surrogate modeling and range estimating techniques to capture and propagate uncertainties. This abstract will cover the basics of the approach used, and further details and justifications will be in the final paper.The mission profile associated with this three-element concept (Fig 1) was modeled as a set of mission events that facilitated mass changes, idles, or spacecraft maneuvers. The mission profile scope starts with each element’s NRHO orbit insertion and aggregation and ends at post-sortie rendezvous with Orion. More detail on the mission profile will be in the final paper. The DYnamic Rocket EQuation Tool (DYREQT), a space systems synthesis and sizing framework used by NASA, was used as the physics framework to model the HLS architecture for applying the probabilistic methodology [5, 6]. Specifically, a parametric representation of the lander, ascent, and transfer elements and the mission profile of each element was established, with vehicle and mission parameters available as inputs to allow for a dynamic model. Each vehicle stage was modeled with high-level performance metrics, using Isp and propellant mass fraction (PMF) to remain parametric. For the probabilistic analysis, uncertainties of interest within the HLS concept were enumerated and represented as parameters within the DYREQT model as inputs for vehicle stages or mission profile events. These parameters were frozen at their nominal values for the purposes of baselining architecture performance and sizing the vehicle appropriately based on reference documentation [1]. Range estimating—a probabilistic method that combines Monte Carlo sampling, focus on critical parameters, and heuristics to assess risk and opportunities—is traditionally used with Mass Equipment Lists (MELs), but has been adapted with operational parameters as well as vehicle parameters in theDYREQT model to capture mission uncertainty alongside vehicle uncertainty [7, 3]. This method was selected due to its application and insight on a system from a bottom-up perspective, independence from historical rules of thumb, and ability to generate sensitivities based on design decisions and uncertainties. As a sample case for the abstract, the boiloff rates of the vehicle elements and the loiter times during the mission (simulating launch time variations and changing window of opportunities) were used with range estimating to provide preliminary results. To perform the range estimation portion of this methodology (depicted in Fig. 3, further details in final paper), the DYREQT model was sampled using a Design of Experiments (DoE) to efficiently explore the architecture design space with respect to the sample set of uncertainty parameters; 5,000 cases via Latin Hypercube Sampling were computed on the DYREQT architecture model. Then, the results were used to create surrogate models, multivariate regressions that can visualize hypercube trends in the design space, of the architecture with respect to the uncertainty parameters. Range estimating was applied to the surrogates instead of the actual models, which saves computational expense due to the bulk of cases needed for the Monte Carlo simulation as part of range estimating. Uncertainty parameters were sampled independently from triangular distributions using the DoE ranges as ‘min’ and ‘max’, and the nominal value as ‘most likely’. Based engineering intuition, some uncertainty parameters are correlated—e.g. if the main propellant has a high boil-off rate, the oxidizer should follow suit as both are related to CFM technology.While a Monte Carlo simulation samples all inputs as independent, the results would show model correlations; thus, it is efficient to sample the inputs as correlated. Using a correlation matrix constructed for the uncertainty parameters, previously independent samples were transformed to perform a Correlated Monte Carlo. A table for the DoE ranges and probability distribution parameters is shown in Table 1, and more details on Correlated Monte Carlo Simulations will be discussed in the final paper. The model’s resulting DoE showed that multivariate polynomial equations fit via least squares method captured its behavior accurately for the sample case. For the Correlated Monte Carlo Simulation, a positive correlation between fuel and oxidizer boiloff rates was used as a demonstration. 10,000 cases were computed with the surrogates and the launched masses for each vehicle element was collated. The results can be displayed in a probability density function (PDF), showing the impact of the uncertainty parameters chosen. Integrating the PDFs will yield a cumulative distribution function (CDF) that shows the cumulative probability of a given value on the x-axis. For the sample case, the elements’ launch mass margin was calculated and represented in as CDFs, as a demonstrated representation of figures of merit for the HLS concept. For the lander and ascent elements, the NRHO mass insertion limit is 16t; the transfer element has a limit of 30t [1]. It can be seen with Figure 2 that this probabilistic methodology can provide insight into mass margin with respect to the uncertainties being modeled. Currently, the results show that the lander (descent) vehicle element has the most restrictive design space; it is the only element to show a 10% probability of negative margin. Further analysis on the Monte Carlo results will show sensitivities for driving constraints and parameters for architecture feasibility, which can lead to establishing potential mission rules.The combination of range estimating with a parametric architecture model for HLS demonstrated the capability of this probabilistic methodology in a sample case. As the HLS development progresses, this methodology has the potential for keeping current best estimates of architecture performance for awarded concepts due to the flexibility in DYREQT’s modeling framework and its parametric nature. Concept maturation and increased epistemic knowledge can be injected into the model probabilistic modeling, and thus continue to track probability of mission success.

Stephanie Y Zhu↗