Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty reduction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

How Much Testing is Needed to Manage Supportability Risks for Beyond-LEO Missions?

Supportability will be a significantly greater driver of cost and risk for future deep-space crewed missions than it has been in the past. Spares requirements and maintenance risk mitigation in particular present an unprecedented challenge for missions beyond Low Earth Orbit (LEO), since, for the first time in human spaceflight history, crews will be weeks or months away from resupply or a safe return to Earth in the event of an abort. Under these conditions, failure rates are a critical parameter that must be well-understood in order to manage logistics and risk effectively. However, failure rates cannot be measured directly, and can only be estimated based on past experience and test results. Previous research has shown that International Space Station (ISS) operational experience has provided significant benefits to future missions by reducing uncertainty and improving accuracy in failure rate estimates, resulting in significant reductions in mass and risk for beyond-LEO missions. This paper updates and expands on that research and quantifies the potential value of continued testing for future mission supportability. Frequentist and Bayesian models for evaluating, validating, and updating failure rate estimates are described, and are combined with supportability models to examine potential impacts of additional operating experience for future missions in terms of logistics mass reduction. The implications of these results for technology development, system design, and program planning are discussed along with lessons learned and recommendations for future system development. In the end, there is no simple answer to the question of how much testing is required, but the models described in this paper provide a way to evaluate the potential impacts of testing in order to inform test planning.

Andrew C Owens↗

Direct Measurement of the Cosmic-Ray Helium Spectrum from 40 GeV to 250 TeV with the Calorimetric Electron Telescope on the International Space Station

We present the results of a direct measurement of the cosmic-ray helium spectrum with the CALET instrument in operation on the International Space Station since 2015. The observation period covered by this analysis spans from October 13, 2015, to April 30, 2022 (2392 days). The very wide dynamic range of CALET allowed for the collection of helium data over a large energy interval, from ∼40 GeV to ∼250 TeV, for the first time with a single instrument in low Earth orbit. The measured spectrum shows evidence of a deviation of the flux from a single power law by more than 8σ with a progressive spectral hardening from a few hundred GeV to a few tens of TeV. This result is consistent with the data reported by space instruments including PAMELA, AMS-02, and DAMPE and balloon instruments including CREAM. At higher energy we report the onset of a softening of the helium spectrum around 30 TeV (total kinetic energy). Though affected by large uncertainties in the highest energy bins, the observation of a flux reduction turns out to be consistent with the most recent results of DAMPE. A double broken power law is found to fit simultaneously both spectral features: the hardening (at lower energy) and the softening (at higher energy). A measurement of the proton to helium flux ratio in the energy range from 60 GeV=n to about 60 TeV=n is also presented, using the CALET proton flux recently updated with higher statistics.

O Adriani↗

The Use of Gridded Fossil Fuel CO2 Emissions (FFCO2) Inventory for Climate Mitigation Applications: Errors, Uncertainties, and Current and Future Challenges

Emission Inventory (EI) is a fundamental tool to monitor global compliance of greenhouse gases (GHGs) emissions reduction actions. Inventory guidelines provide a best practice to help EI compilers to make comparable national emission estimates, in spite of the differences in data availability across countries and regions. There are a variety of sources of errors and uncertainties, however, that originate beyond what the inventory guidelines define. For example, spatially-explicit EIs, which are a key product for atmospheric modeling applications, are often developed for research purposes, and there are no specific guidelines to disaggregate emission estimates from country scale. On top of that, EIs are fundamentally prone to systematic biases due to the simple calculation methodology and thus an objective evaluation (e.g. atmospheric top-down estimates) is needed to assure the accuracy of the estimates. ODIAC is a global high-resolution (1x1 km) fossil fuel carbon dioxide (CO2) gridded EI that is now often used in atmospheric CO2 modeling. ODIAC is based on disaggregation of national emission estimates made by CDIAC, which is the well accepted standard in the community. The ODIAC emission data product is updated on an annual basis using best available statistical data. Subnational spatial emission patterns are estimated using power plant profiles and satellite-observations of nighttime lights. In addition to the conventional CDIAC gridded data product, ODIAC carries international bunker emissions (shipping and aviation), which allows flux inversion modelers to accurately impose the global total fossil fuel emissions and their horizontal and vertical distribution. We have extensively evaluated ODIAC emissions using fine-grained EIs as well as a high-resolution atmospheric model simulation across different scales (national, subnational/regional, and urban policy relevant) with a focus on the uncertainties associated with the emission disaggregation. We have examined the use of NASA's Black Marble Suomi-NPP/VIIRS nightlight data.

Oda, Tomohiro↗

An out-of-distribution-aware autoencoder model for reduced chemical kinetics

While detailed chemical kinetic models have been successful in representing rates of chemical reactions in continuum scale computational fluid dynamics (CFD) simulations, applying the models in simulations for engineering device conditions is computationally prohibitive. To reduce the cost, data-driven methods, e.g., autoencoders, have been used to construct reduced chemical kinetic models for CFD simulations. Despite their success, data-driven methods rely heavily on training data sets and can be unreliable when used in out-of-distribution (OOD) regions (i.e., when extrapolating outside of the training set). In this paper, we present an enhanced autoencoder model for combustion chemical kinetics with uncertainty quantification to enable the detection of model usage in OOD regions, and thereby creating an OOD-aware autoencoder model that contributes to more robust CFD simulations of reacting flows.Here, we first demonstrate the effectiveness of the method in OOD detection in two well-known datasets, MNIST and Fashion-MNIST, in comparison with the deep ensemble method, and then present the OOD-aware autoencoder for reduced chemistry model in syngas combustion.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

An Analysis of Future Wind Energy Resources and Cost Uncertainties Across the United States

Wind power is a growing source of energy generation that relies on complex global atmospheric and earth system processes. There has been evidence of reductions in average wind speeds over land in North America since the 1980s, and several models project that average wind speeds will continue to decrease. Concurrently, the cost of wind energy systems in the United States has been decreasing since around 2010, a trend also projected to continue. There is considerable uncertainty in these future projections, with quantitative estimates of future wind resource and system costs varying widely. To study this, we run wind energy models with possible future system costs, turbine designs, and meteorological inputs from multiple downscaled earth system models over the contiguous United States. Changes in mean annual energy production from 2000-2019 to 2040-2059 can be as high as +10% in South Texas or as low as -20% in Iowa. Larger turbines and moderate reductions in system costs can offset the largest projected decreases in wind resource, but much uncertainty remains in the extent to which wind resources will change and to what extent system costs can be reduced. An analysis of variance shows, in several states in the Midwest, uncertainty in future wind resources can influence the cost of wind energy nearly as much as uncertainty in future system costs.

17 WIND ENERGY↗

Multifidelity Uncertainty Quantification of a Commercial Supersonic Transport

The objective of this work was to develop a multifidelity uncertainty quantification approach for efficient analysis of a commercial supersonic transport concept. An approach based on point-collocation, non-intrusive polynomial chaos was formulated in which a low-fidelity model could be corrected using multiple higher-fidelity models. The formulation and methodology also allows for the addition of uncertainty sources not present in the lower fidelity models. To demonstrate the applicability and potential computational savings of the multifidelity polynomial chaos approach, two model problems were explored. The first was a supersonic airfoil with three levels of modeling fidelity, each capturing a gradual increase in modeling of the underlying flow physics. As much as 50% computational cost reduction was observed using the mutlifidelity approach, while predicting nearly the same amount of uncertainty in drag. The second problem was a commercial supersonic transport. This model had three levels of fidelity that included two different modeling approaches and the addition of physics between the fidelity levels. Results of this analysis yielded nearly a 70% computational savings to predict a comparable amount of uncertainty in ground noise. Both problems illustrate the applicability and significant computational savings of the multifidelity method for efficient and accurate uncertainty quantification.

Thomas K. West IV↗

Uncertainty quantification and optimization of precipitating hydrometeor parameters for winter precipitation in a cloud microphysics scheme

The precipitating hydrometeor parameters used in cloud microphysics schemes carry inherent uncertainties. The quantification of these uncertainties, together with parameter optimization, can significantly improve precipitation forecasts. This study investigates the effects of 13 parameters in the Weather Research and Forecasting (WRF) Double-Moment 6-class (WDM6) microphysics scheme, which define the hydrometeor characteristics such as fall velocity–diameter and mass–diameter relationships, as well as the shape parameter of the drop size distribution for precipitating particles such as rain, snow, and graupel on simulated winter precipitation. A comparison between the model's pre-defined parameters and observations from the International Collaborative Experiments for the PyeongChang 2018 Olympic and Paralympic winter games (ICE-POP 2018) field campaign reveals that the fall velocity–diameter relationship for rain, the mass–diameter relationships for snow and graupel, and the shape parameters for all precipitating particles in the WDM6 scheme deviate from the median values observed by the two-dimensional video disdrometer (2DVD). To quantify parameter sensitivities, a perturbed parameter ensemble (PPE) of 256 simulations was conducted within parameter ranges constrained by 2DVD observations for three winter precipitation cases. Bayesian optimization was then applied to identify parameter sets that minimized the root mean square error (RMSE) for each case, achieving reductions of up to 30.2 %. These results demonstrate that ensemble-based uncertainty quantification and parameter optimization can help identify key parameters and provide a pathway to improving precipitation simulation performance. In addition, measurement sites can be strategically selected based on regions that show high sensitivity to variations in hydrometeor characteristic parameters.

Bayesian optimization↗

Climate and air quality impacts due to mitigation of non-methane near-term climate forcers

It is important to understand how future environmental policies will impact both climate change and air pollution. Although targeting near-term climate forcers (NTCFs), defined here as aerosols, tropospheric ozone, and precursor gases, should improve air quality, NTCF reductions will also impact climate. Prior assessments of the impact of NTCF mitigation on air quality and climate have been limited. This is related to the idealized nature of some prior studies, simplified treatment of aerosols and chemically reactive gases, as well as a lack of a sufficiently large number of models to quantify model diversity and robust responses. Here, we quantify the 2015–2055 climate and air quality effects of non-methane NTCFs using nine state-of-the-art chemistry–climate model simulations conducted for the Aerosol and Chemistry Model Intercomparison Project (AerChemMIP). Simulations are driven by two future scenarios featuring similar increases in greenhouse gases (GHGs) but with “weak” (SSP3-7.0) versus “strong” (SSP3-7.0-lowNTCF) levels of air quality control measures. As SSP3-7.0 lacks climate policy and has the highest levels of NTCFs, our results (e.g., surface warming) represent an upper bound. Unsurprisingly, we find significant improvements in air quality under NTCF mitigation (strong versus weak air quality controls). Surface fine particulate matter (PM2.5) and ozone (O3) decrease by −2.2±0.32 µg m−3 and −4.6±0.88 ppb, respectively (changes quoted here are for the entire 2015–2055 time period; uncertainty represents the 95 % confidence interval), over global land surfaces, with larger reductions in some regions including south and southeast Asia. Non-methane NTCF mitigation, however, leads to additional climate change due to the removal of aerosol which causes a net warming effect, including global mean surface temperature and precipitation increases of 0.25±0.12 K and 0.03±0.012 mm d−1, respectively. Similarly, increases in extreme weather indices, including the hottest and wettest days, also occur. Regionally, the largest warming and wetting occurs over Asia, including central and north Asia (0.66±0.20 K and 0.03±0.02 mm d−1), south Asia (0.47±0.16 K and 0.17±0.09 mm d−1), and east Asia (0.46±0.20 K and 0.15±0.06 mm d−1). Relatively large warming and wetting of the Arctic also occur at 0.59±0.36 K and 0.04±0.02 mm d−1, respectively. Similar surface warming occurs in model simulations with aerosol-only mitigation, implying weak cooling due to ozone reductions. Our findings suggest that future policies that aggressively target non-methane NTCF reductions will improve air quality but will lead to additional surface warming, particularly in Asia and the Arctic. Policies that address other NTCFs including methane, as well as carbon dioxide emissions, must also be adopted to meet climate mitigation goals.

Climate↗

Boosting efficiency and reducing graph reliance: Basis adaptation integration in Bayesian multi-fidelity networks

The computational cost of high-fidelity numerical models makes outer-loop analysis, which requires repeated interrogation of the model such as uncertainty quantification, computationally demanding. Multi-fidelity methods, which construct a surrogate model using data from an ensemble of models of varying cost and accuracy, can substantially reduce the cost of outer-loop analysis. However, these methods can be difficult to apply when the model ensemble does not admit a clear hierarchy a priori and the correlations between models are low. Consequently, in this paper, we present a multi-fidelity method that leverages dimension reduction to enhance the correlation between models, thereby reducing the amount of data needed to train a surrogate from an unordered ensemble of models. Our method utilizes basis adaptation to build low-dimensional polynomial chaos expansions of each model and employs Multi-fidelity Networks to encode the relationships among models. We show that the resulting method exhibit two notable advantages over its counterpart: (1) enhanced accuracy (both reduced bias and variance); and (2) reduced dependency on the graph structure encoding relationships among models. We demonstrate the approach on an analytical test problem and a challenging finite element model for a spent nuclear fuel. Our method produces a surrogate model that is significantly more accurate than either a single-fidelity surrogate or a multi-fidelity surrogate constructed without basis adaptation.

42 ENGINEERING↗

Evaluating Grid Strength under Uncertain Renewable Generation

The increasing displacement of synchronous generators with renewable resources such as wind and solar via power electronic interfaces causes a reduction in short-circuit strength and weak grid issues. The variation and uncertainty of renewable energy increase challenges for identifying weak grid conditions. This paper proposes an efficient method to analyze the impact of uncertain renewable energy on grid strength. The proposed method uses the probabilistic collocation method (PCM) to approximate the results of grid strength assessment under uncertain renewable generation, in order to reduce computational burden without compromising result accuracy when compared with traditional Monte Carlo simulation (MCS). To improve the accuracy of the approximation results, the proposed method integrates the K-means clustering technique with PCM to select the approximation samples of input variables. The efficacy of the proposed method is demonstrated by comparison with MCS on the modified IEEE 9-bus system and modified IEEE 39-bus system with multiple renewable generators.

grid strength↗

The WRF-Solar Ensemble Prediction System to Provide Solar Irradiance Probabilistic Forecasts

In this study, we introduce the recently developed WRF-solar ensemble prediction system and a calibration method. The performances of forecast models are evaluated using the National Solar Radiation Database observational analysis for day-ahead solar irradiance predictions. The results demonstrate that the ensemble forecast improves the quality of the forecasts by considering the uncertainty of each ensemble member. The analog ensemble calibration contributed to the reduction of positive bias and an overall improvement in the probabilistic attributes, such as reliability and statistical consistency.

14 SOLAR ENERGY↗

Adaptive resource allocation for surrogate modeling of systems comprised of multiple disciplines with varying fidelity

We present an adaptive algorithm for constructing surrogate models for integrated systems composed of a set of coupled components. With this goal we introduce ‘coupling’ variables with a priori unknown distributions that allow approximations of each component to be built independently. Once built, the surrogates of the components are combined and used to predict system-level quantities of interest (QoI) at a fraction of the cost of interrogating the full system model. We use a greedy experimental design procedure, based upon a modification of Multi-Index Stochastic Collocation (MISC), to minimize the error of the combined surrogate. This is achieved by refining each component surrogate in accordance with its relative contribution to error in the approximation of the system-level QoI. Our adaptation of MISC is a multi-fidelity procedure that can leverage ensembles of models of varying cost and accuracy, for one or more components, to produce estimates of system-level QoI. Several numerical examples demonstrate the efficacy of the proposed approach on systems involving feed-forward and feedback coupling. For a fixed computational budget, the proposed algorithm is able to produce approximations that are orders of magnitude more accurate than approximations that treat the integrated system as a black-box.

97 MATHEMATICS AND COMPUTING↗

Preliminary analysis of remote infrared imagery of shuttle during entry: An aerothermodynamic flight experiment

The preliminary feasibility of remote high-resolution infrared imagery of the space shuttle orbiter lower surface during entry to obtain accurate measurements of aerodynamic heat transfer to that vehicle was examined. In general, it was determined that such such images can be taken from an existing aircraft/telescope system (the C-141 AIRO) with a minimum modification or addition of systems using available technology. These images will have a spatial resolution of about 0.3 m and a temperature resolution much better than 2.5 percent. The data from these images will be at conditions and at a scale not reproducible in ground based facilities and should aid in the reduction of the prudent factors of safety required to account for phenomenological uncertainties on the thermal protection system design. Principal phenomena to be observed include laminar heating, boundary-layer transition, turbulent heating, surface catalysis, and flow separation and reattachment.

Swenson, B. L.↗

Preliminary noise tradeoff study of a Mach 2.7 cruise aircraft

NASA computer codes in the areas of preliminary sizing and enroute performance, takeoff and landing performance, aircraft noise prediction, and economics were used in a preliminary noise tradeoff study for a Mach 2.7 design supersonic cruise concept. Aerodynamic configuration data were based on wind-tunnel model tests and related analyses. Aircraft structural characteristics and weight were based on advanced structural design methodologies, assuming conventional titanium technology. The most advanced noise prediction techniques available were used, and aircraft operating costs were estimated using accepted industry methods. The 4-engines cycles included in the study were based on assumed 1985 technology levels. Propulsion data was provided by aircraft manufacturers. Additional empirical data is needed to define both noise reduction features and other operating characteristics of all engine cycles under study. Data on VCE design parameters, coannular nozzle inverted flow noise reduction and advanced mechanical suppressors are urgently needed to reduce the present uncertainties in studies of this type.

Mascitti, V. R.↗

Radiometric gains of satellite sensors of reflected solar radiation - Results from NASA ER-2 aircraft measurements

A method for using congruent aircraft-satellite observations to calibrate a satellite sensor is presented. A calibrated spectroradiometer at an altitude of 19 km above White Sands, NM, is oriented to view White Sands at the satellite overpass time along the same view vector as the satellite sensor. Collected data are transformed into corresponding estimates of sensor band radiance at the satellite (derived from the aircraft measurements), and average count (from the sensor measurements). These are both averaged across the footprint of the spectroradiometer. Results are presented for the evolution of NOAA-11 Advanced Very High Resolution Radiometer (AVHRR) (Bands 1 and 2) gain between November 1988 and October 1990, and for GOES-6 and GOES-7 VISSR/VAS visible bands during the same period. Estimates of uncertainty in the results are presented, as well as ideas for their reduction in future flights.

Abel, Peter↗

A Multi-Parameter Approach for Calculating Crack Instability

An accurate fracture control analysis of spacecraft pressure systems, boosters, rocket hardware and other critical low-cycle fatigue cases where the fracture toughness highly impacts cycles to failure requires accurate knowledge of the material fracture toughness. However, applicability of the measured fracture toughness values using standard specimens and transferability of the values to crack instability analysis of the realistically complex structures is refutable. The commonly used single parameter Linear Elastic Fracture Mechanics (LEFM) approach which relies on the key assumption that the fracture toughness is a material property would result in inaccurate crack instability predictions. In the past years extensive studies have been conducted to improve the single parameter (K-controlled) LEFM by introducing parameters accounting for the geometry or in-plane constraint effects]. Despite the importance of the thickness (out-of-plane constraint) effects in fracture control problems, the literature is mainly limited to some empirical equations for scaling the fracture toughness data] and only few theoretically based developments can be found. In aerospace hardware where the structure might have only one life cycle and weight reduction is crucial, reducing the design margin of safety by decreasing the uncertainty involved in fracture toughness evaluations would result in lighter hardware. In such conditions LEFM would not suffice and an elastic-plastic analysis would be vital. Multi-parameter elastic plastic crack tip field quantifying developments combined with statistical methods] have been shown to have the potential to be used as a powerful tool for tackling such problems. However, these approaches have not been comprehensively scrutinized using experimental tests. Therefore, in this paper a multi-parameter elastic-plastic approach has been used to study the crack instability problem and the transferability issue by considering the effects of geometrical constraints as well as the thickness. The feasibility of the approach has been examined using a wide range of specimen geometries and thicknesses manufactured from 7075-T7351 aluminum alloy.

Zanganeh, M.↗

The Deep Space Network in the Common Platform Era: A Prototype Implementation at DSS-13

To enhance NASA's Deep Space Network (DSN), an effort is underway to improve network performance and simplify its operation and maintenance. This endeavor, known as the "Common Platform," has both short- and long-term objectives. The long-term work has not begun yet; however, the activity to realize the short-term goals has started. There are three goals for the long-term objective: 1. Convert the DSN into a digital network where signals are digitized at the output of the down converters at the antennas and are distributed via a digital IF switch to the processing platforms. 2. Employ a set of common hardware for signal processing applications, e.g., telemetry, tracking, radio science and Very Long Baseline Interferometry (VLBI). 3. Minimize in-house developments in favor of purchasing commercial off-the-shelf (COTS) equipment. The short-term goal is to develop a prototype of the above at NASA's experimental station known as DSS-13. This station consists of a 34m beam waveguide antenna with cryogenically cooled amplifiers capable of handling deep space research frequencies at S-, X-, and Ka-bands. Without the effort at DSS-13, the implementation of the long-term goal can potentially be risky because embarking on the modification of an operational network without prior preparations can, among other things, result in unwanted service interruptions. Not only are there technical challenges to address, full network implementation of the Common Platform concept includes significant cost uncertainties. Therefore, a limited implementation at DSS-13 will contribute to risk reduction. The benefits of employing common platforms for the DSN are lower cost and improved operations resulting from ease of maintenance and reduced number of spare parts. Increased flexibility for the user is another potential benefit. This paper will present the plans for DSS-13 implementation. It will discuss key issues such as the Common Platform architecture, choice of COTS equipment, and the standard for radio frequency (RF) to digital interface.

Space Communications and Navigation (SCaN)↗

Fast-Time Simulation for Evaluating the Impact of Estimated Flight Ready Time Uncertainty on Surface Metering

NASA has been developing and demonstrating new concepts and technologies for Integrated Arrival, Departure, and Surface (IADS) traffic management capabilities under the Airspace Technology Demonstration 2 (ATD-2) project. One of the IADS capabilities in the ATD-2 project is surface metering enabled by a tactical surface scheduler to provide controllers with the pushback advisories for departures at gates. The tactical surface scheduler uses the estimated flight ready times provided by airlines, called Earliest Off-Block Times (EOBTs), as input to calculate the target off-block times for pushback advisories. However, the EOBTs are often inaccurate and deviate from the actual flight ready times, which may reduce the benefits of surface metering. In this paper, a linear regression model is developed to model the EOBT uncertainty distribution over time based on actual EOBT data collected at Charlotte airport. This EOBT model is integrated with a tactical surface scheduler and a fast-time simulation tool. To evaluate the impact of the EOBT accuracy on airport surface operations, fast-time simulations are implemented for selected traffic scenarios under different levels of modelled EOBT accuracy. The simulation results show that the EOBT uncertainty affects several performance metrics related to the surface metering, such as gate hold, taxi time reduction, and target takeoff time predictability, which in turn influences ATD-2's scheduler performance.

tactical surface scheduler↗