Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainties”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
NASA NTRS2022

Look-up Table Approach for Uncertainty Determination for Operational Vicarious Calibration of Earth Imaging Sensors

Understanding the uncertainty of a vicarious calibration is essential for any application to Earth imaging sensors. The Radiometric Calibration Network provides SI-traceable spectral top-of-atmosphere (TOA) reflectance from a network of ground sites and uses a look-up table (LUT) approach for uncertainty determination. The uncertainty LUT was derived using Monte Carlo techniques applied to the relevant solar geometry, surface, and atmospheric variables. While surface reflectance is typically the dominant uncertainty source, atmospheric contributions do play an important role, depending upon the exact scenario and conditions. This approach allows knowledge of TOA reflectance uncertainty to within 0.5%.

Brian N. Wenny↗
NASA NTRSDate not supplied

PACE OCI Short-Wave Infrared Detection Assembly frequency-dependent linearity characterization and uncertainty analysis

The Ocean Color Instrument (OCI), the primary payload of the Plankton, Aerosol, Cloud, ocean Ecosystem (PACE)observatory, will collect data to monitor the health of Earth’s oceans and atmosphere. The Short-Wave Infrared(SWIR) Detection Assembly (SDA) was built and characterized by the Utah State University Space DynamicsLaboratory (SDL) and is a subsystem of OCI. The SDA measures seven bands centered at 940, 1038, 1250, 1378,1615, 2130, and 2260 nm, with standard- and high-gain varieties for the 1250 and 1615 nm bands, resulting in nine total detection configurations in the SWIR. The delivery of high-quality science data is critically dependent upon accurately characterizing the linearity of the SDA. Two metrology techniques were employed to measure the linearity and characterize the frequency-dependent linearity uncertainty of the system. The first technique used superposition linearity measurements to determine the DC linearity, and the second technique involved an oscillating small-signal response at seven frequencies to determine the frequency-dependent linearity. Discrepancies between the DC and frequency-dependent linearities constrain the uncertainty between the two. Examining the difference between these two methods for all SDA channels, we find most channels experience an uncertainty below0.2% with a worst-case measurement uncertainty of 0.31%. Averaging SDA channels with similar detectors, optical filters, and electronics to simulate the flight-like data products yields a worst-case frequency-dependence linearity uncertainty of 0.12%, demonstrating minimal frequency dependence, implying an excellent linearity knowledge.Detailed performance knowledge, including linearity performance, verifies data quality and builds confidence in the success of the PACE mission.

PACE↗
NASA NTRS2022

MODIS TEB Electronic Crosstalk Correction Update and Impact on L1B Product Uncertainty

The MODIS instruments onboard the Terra and Aqua satellites have been in operation for over22 and 20 years, respectively. The instruments’ calibration accuracy has been maintained, even with instrument degradation. Electronic crosstalk in the thermal emissive bands (TEB) is a known issue with an increasing impact on the calibration and product. The Terra MODIS photovoltaic (PV) longwave infrared (LWIR) bands crosstalk corrections have been applied in Collection 6.1 (C6.1). However, the electronic crosstalk contamination for some detectors in the mid-wave infrared (MWIR) bands and the Aqua PVLWIR bands affect the Level-1B (L1B) product’s measurement accuracy and image quality. In Collection 7 (C7), crosstalk corrections for select detectors in the Terra and Aqua MWIR and Aqua PV LWIR bands are applied. The entire mission crosstalk coefficients for the select detectors and bands are derived from scheduled lunar observations and populated in the form of look-up tables (LUTs). The Aqua PV-LWIR bands exhibit similar downward crosstalk trends as the Terra PV-LWIR bands, especially in recent years. The crosstalk coefficients and their trends provide a guideline for the correction application. Earth measurement analyses before and after the correction provide contamination and correction assessments. It has been shown that the product quality is enhanced with the crosstalk correction applied in C7. For C7, the crosstalk coefficient uncertainty is derived from the fit residuals between the measured values and a linear fit over a three-year sliding window. The uncertainty propagation is modeled and applied in the total uncertainty calculation intheL1B product. The TEB electronic crosstalk LUTs have been processed over the entire Terra and Aqua MODIS missions. This paper presents the C7 crosstalk correction, as well as its assessment and uncertainty propagation algorithm to the TEB uncertainty.

Tiejun Chang↗
NASA NTRS2021

Pre-Flight Assessment of Xenon Propellant Usage and Usage Uncertainty for the Psyche Mission

NASA’s Psyche mission will launch in 2022 and begin a 3.6-year cruise to the metallic asteroid Psyche, the largest metal asteroid in the solar system. All primary propulsion will be done with the flight-proven SPT-140 electric propulsion subsystem. The Psyche mission will feature the first use of Hall thrusters for a NASA mission, and the first use of Hall thrusters beyond cis-lunar space, which has presented some unique challenges. In this paper we describe the Psyche propellant feed system architecture, expected propellant usage for the mission, propellant gauging requirements, and challenges associated with propellant gauging. Data from two recent Maxar electric orbit-raising missions with SPT-140 thrusters are reviewed and used to assess in-flight performance. We develop a pressure-volume-temperature gauging method that incorporates the propellant temperature distributions observed in the flight data, and use this method to provide an improved quantitative understanding of in-flight propellant consumption rates and their uncertainties. The results are in excellent agreement with the results of standard Maxar gauging methods and we determine a propellant usage uncertainty of ± 7.1% 3σ based on flight telemetry. Additionally, we demonstrate that the bookkeeping method of propellant gauging accurately predicts the tank pressure flight data. This work has led to design changes in the Psyche spacecraft avionics that will further improve propellant gauging uncertainties, which is particularly important for later phases of the mission. Finally, we statistically combine the predicted propellant mass uncertainties from the two gauging methods and demonstrate that the system will meet the mission requirements for propellant uncertainty. Together, all of this work provides confidence that the Psyche mission can be successfully completed within the existing propellant budget and propellant tank capacity.

Baldwin, Jeff↗
NASA NTRS2022

Modis TEB Electronic Crosstalk Correction Update and Impact on L1B Product Uncertainty

The MODIS instruments on board the Terra and Aqua satellites have been in operation for over 22 and 20 years, respectively. The instruments’ calibration accuracy has been maintained, even with instrument degradation. Electronic crosstalk in the thermal emissive bands (TEB) is a known issue with an increasing impact on the calibration and product. The Terra MODIS photovoltaic (PV) longwave infrared (LWIR) bands crosstalk corrections have been applied in Collection 6.1 (C6.1). However, the electronic crosstalk contamination for some detectors in the mid-wave infrared(MWIR) bands and the Aqua PVLWIR bands affect the Level-1B(L1B) product’s measurement accuracy and image quality. In Collection 7 (C7), crosstalk corrections for select detectors in the Terra and Aqua MWIR and Aqua PV LWIR bands are applied. The entire mission crosstalk coefficients for the select detectors and bands are derived from scheduled lunar observations and populated in the form of look-up tables (LUTs). The Aqua PV-LWIR bands exhibit similar downward crosstalk trends as the Terra PV-LWIR bands, especially in recent years. The crosstalk coefficients and their trends provide a guideline for the correction application. Earth measurement analyses before and after the correction provide contamination and correction assessments. It has been shown that the product quality is enhanced with the crosstalk correction applied in C7. For C7, the crosstalk coefficient uncertainty is derived from the fit residuals between the measured values and a linear fit over a three-year sliding window. The uncertainty propagation is modeled and applied in the total uncertainty calculation intheL1B product. The TEB electronic cross talk LUT shave been processed over the entire Terra and Aqua MODIS missions. This paper presents the C7 crosstalk correction, as well as its assessment and uncertainty propagation algorithm to the TEB uncertainty.

Tiejun Chang↗
NASA NTRSDate not supplied

Methods for System-Level Multidisciplinary Uncertainty Analysis of Low-Boom Flight Vehicles

Current research supporting NASA’s Commercial Supersonic Technology project is focused on the efficient prediction of uncertainty in sonic boom loudness generated by low-boom aircraft concepts. This paper focuses on research incorporating aircraft trim and aerostructural analysis into a multidisciplinary system-level uncertainty analysis. This enables the modeling of a steady-state representation of a point in the uncertainty space, simulating the vehicle as it would be flown. This approach also enables multiple uncertain parameters defining the configuration of the vehicle to be reduced to three: Mach number, altitude, and aircraft weight. To demonstrate this methodology, a case study exploring a conceptual low-boom supersonic aircraft is performed. Two different approaches are used to model the interactions between nearfield pressure signature analysis and sonic boom propagation, and their performance is evaluated in terms of accuracy and computational expense. One method uses a set of local surrogate models to generate a large number of nearfield signatures and perform Monte Carlo analysis. This method is found to produce, at a lower expense, uncertainty metrics that are comparable to the second method, in which uncertainty metrics are computed based on loudness metric values obtained directly from simulated nearfield signatures.

UQ↗
NASA NTRSDate not supplied

Design Under Uncertainty with Design-Dependent Uncertain Variables

Uncertainty quantification (UQ) can provide a more robust understanding of a system, leading to better informed decisions earlier in the design process. The additional information that UQ provides can be leveraged during a design optimization process known as design under uncertainty that, when incorporated with multidisciplinary design and optimization, can become computationally infeasible due to the large number of responses required for meaningful results. Previous work addressed reducing the computational expense in design under uncertainty by incorporating analytic derivatives throughout polynomial chaos expansion. Although this allows design under uncertainty to be feasible for more systems, some multidisciplinary systems have design-dependent uncertain variables. This paper details an implementation of design dependent uncertain variables in a manner than preserves derivatives required for efficient gradient-based optimization throughout the process. Two analytic examples of design-dependent uncertain variables are given: the first transforms a uniform uncertain variable with one design variable and the second transforms a normal uncertain variable with two design variables. The polynomial chaos expansion (PCE) results are comparable to both the Monte Carlo (MC) results and the analytic results for the two examples. A case study that maximizes the lift-to-drag ratio with a design-dependence between the wing leading edge sweep angle and uncertain parameter percentage of laminar flow is compared to a MC and alternative optimization formulations. This paper demonstrates that design-dependent uncertain variables are valid and hold throughout PCE.

robust design↗
NASA NTRS2011

Climate Change Impact Uncertainties for Maize in Panama: Farm Information, Climate Projections, and Yield Sensitivities

We present results from a pilot project to characterize and bound multi-disciplinary uncertainties around the assessment of maize (Zea mays) production impacts using the CERES-Maize crop model in a climate-sensitive region with a variety of farming systems (Panama). Segunda coa (autumn) maize yield in Panama currently suffers occasionally from high water stress at the end of the growing season, however under future climate conditions warmer temperatures accelerate crop maturation and elevated CO (sub 2) concentrations improve water retention. This combination reduces end-of-season water stresses and eventually leads to small mean yield gains according to median projections, although accelerated maturation reduces yields in seasons with low water stresses. Calibrations of cultivar traits, soil profile, and fertilizer amounts are most important for representing baseline yields, however sensitivity to all management factors is reduced in an assessment of future yield changes (most dramatically for fertilizers), suggesting that yield changes may be more generalizable than absolute yields. Uncertainty around General Circulation Model (GCM)s' projected changes in rainfall gain in importance throughout the century, with yield changes strongly correlated with growing season rainfall totals. Climate changes are expected to be obscured by the large inter-annual variations in Panamanian climate that will continue to be the dominant influence on seasonal maize yield into the coming decades. The relatively high (A2) and low (B1) emissions scenarios show little difference in their impact on future maize yields until the end of the century. Uncertainties related to the sensitivity of CERES-Maize to carbon dioxide concentrations have a substantial influence on projected changes, and remain a significant obstacle to climate change impacts assessment. Finally, an investigation into the potential of simple statistical yield emulators based upon key climate variables characterizes the important uncertainties behind the selection of climate change metrics and their performance against more complex process-based crop model simulations, revealing a danger in relying only on long-term mean quantities for crop impact assessment.

Maize↗
NASA NTRS2015

Estimating Uncertainties in the Multi-Instrument SBUV Profile Ozone Merged Data Set

The MOD data set is uniquely qualified for use in long-term ozone analysis because of its long record, high spatial coverage, and consistent instrument design and algorithm. The estimated MOD uncertainty term significantly increases the uncertainty over the statistical error alone. Trends in the post-2000 period are generally positive in the upper stratosphere, but only significant at 1-1.6 hPa. Remaining uncertainties not yet included in the Monte Carlo model are Smoothing Error ( 1 from 10 to 1 hPa) Relative calibration uncertainty between N11 and N17Seasonal cycle differences between SBUV records.

Uncertainties↗
NASA NTRS2016

Uncertainty Analysis of NASA Glenn's 8- by 6-Foot Supersonic Wind Tunnel

An analysis was performed to determine the measurement uncertainty of the Mach Number of the 8- by 6-foot Supersonic Wind Tunnel at the NASA Glenn Research Center. This paper details the analysis process used, including methods for handling limited data and complicated data correlations. Due to the complexity of the equations used, a Monte Carlo Method was utilized for this uncertainty analysis. A summary of the findings are presented as pertains to understanding what the uncertainties are, how they impact various research tests in the facility, and methods of reducing the uncertainties in the future.

uncertainty↗
NASA NTRS2016

Uncertainty of Wheat Water Use: Simulated Patterns and Sensitivity to Temperature and CO2

Projected global warming and population growth will reduce future water availability for agriculture. Thus, it is essential to increase the efficiency in using water to ensure crop productivity. Quantifying crop water use (WU; i.e. actual evapotranspiration) is a critical step towards this goal. Here, sixteen wheat simulation models were used to quantify sources of model uncertainty and to estimate the relative changes and variability between models for simulated WU, water use efficiency (WUE, WU per unit of grain dry mass produced), transpiration efficiency (Teff, transpiration per kg of unit of grain yield dry mass produced), grain yield, crop transpiration and soil evaporation at increased temperatures and elevated atmospheric carbon dioxide concentrations ([CO2]). The greatest uncertainty in simulating water use, potential evapotranspiration, crop transpiration and soil evaporation was due to differences in how crop transpiration was modelled and accounted for 50 of the total variability among models. The simulation results for the sensitivity to temperature indicated that crop WU will decline with increasing temperature due to reduced growing seasons. The uncertainties in simulated crop WU, and in particularly due to uncertainties in simulating crop transpiration, were greater under conditions of increased temperatures and with high temperatures in combination with elevated atmospheric [CO2] concentrations. Hence the simulation of crop WU, and in particularly crop transpiration under higher temperature, needs to be improved and evaluated with field measurements before models can be used to simulate climate change impacts on future crop water demand.

Sensitivity↗
NASA NTRS2016

On the Calculation of Uncertainty Statistics with Error Bounds for CFD Calculations Containing Random Parameters and Fields

This chapter discusses the ongoing development of combined uncertainty and error bound estimates for computational fluid dynamics (CFD) calculations subject to imposed random parameters and random fields. An objective of this work is the construction of computable error bound formulas for output uncertainty statistics that guide CFD practitioners in systematically determining how accurately CFD realizations should be approximated and how accurately uncertainty statistics should be approximated for output quantities of interest. Formal error bounds formulas for moment statistics that properly account for the presence of numerical errors in CFD calculations and numerical quadrature errors in the calculation of moment statistics have been previously presented in [8]. In this past work, hierarchical node-nested dense and sparse tensor product quadratures are used to calculate moment statistics integrals. In the present work, a framework has been developed that exploits the hierarchical structure of these quadratures in order to simplify the calculation of an estimate of the quadrature error needed in error bound formulas. When signed estimates of realization error are available, this signed error may also be used to estimate output quantity of interest probability densities as a means to assess the impact of realization error on these density estimates. Numerical results are presented for CFD problems with uncertainty to demonstrate the capabilities of this framework.

Uncertainty↗
NASA NTRS2017

Methods for Probabilistic Uncertainty Analysis and Bayesian Analysis with Examples of Statistically Analyzing Data to Revise MMOD Risk Estimates and Compare Models

Probabilistic methods are presented for characterizing and quantifying uncertainties in models and model predictions. Techniques are given for constructing specific uncertainty distributions based on available information. Alternative techniques are given for propagating uncertainties in model inputs to obtain the uncertainty in the model result or prediction. Bayesian techniques are also described for utilizing data and information to update and revise model results and predictions. The focus is on applications with numerous specific examples given. The use of data to revise Micrometeoroid and Orbital Debris (MMOD) risk prediction models are among the examples given.

Risk↗
NASA NTRS2019

Evaluating the Uncertainty of Terrestrial Water Budget Components over High Mountain Asia

This study explores the uncertainties in terrestrial water budget estimation over High Mountain Asia (HMA) using a suite of uncoupled land surface model (LSM) simulations. The uncertainty in the water balance components of precipitation (P), evapotranspiration (ET), runoff (R), and terrestrial water storage (TWS) is significantly impacted by the uncertainty in the driving meteorology, with precipitation being the most important boundary condition. Ten gridded precipitation datasets along with a mix of model-, satellite-, and gauge-based products, are evaluated first to assess their suitability for LSM simulations over HMA. The datasets are evaluated by quantifying the systematic and random errors of these products as well as the temporal consistency of their trends. Though the broader spatial patterns of precipitation are generally well captured by the datasets, they differ significantly in their means and trends. In general, precipitation datasets that incorporate information from gauges are found to have higher accuracy with low Root Mean Square Errors and high correlation coefficient values. An ensemble of LSM simulations with selected subset of precipitation products is then used to produce the mean annual fluxes and their uncertainty over HMA in P, ET, and R to be 2.11 ± 0.45, 1.26 ± 0.11, and 0.85 ± 0.36 mm per day, respectively. The mean annual estimates of the surface mass (water) balance components from this model ensemble are comparable to global estimates from prior studies. However, the uncertainty/spread of P, ET, and R is significantly larger than the corresponding estimates from global studies. A comparison of ET, snow cover fraction, and changes in TWS estimates against remote sensing-based references confirms the significant role of the input meteorology in influencing the water budget characterization over HMA and points to the need for improving meteorological inputs.

Terrestrial water budget↗
NASA NTRSDate not supplied

More Data Needed for Failure Rate Estimation, Validation, and Uncertainty Reduction

Current Environmental Control and Life Support System (ECLSS) development and test activities are not generating data fast enough to provide statistically-supportable precise Orbital Replacement Unit (ORU) failure rate estimates for future missions. Accurate and precise failure rate estimates are critical for missions beyond Low Earth Orbit (LEO) because current risk mitigation approaches – namely regular resupply and rapid abort capabilities – will not be available. Safe operations will depend on mission planners’ ability to accurately forecast spares demand and efficiently provide the necessary resources. However, even after more than a decade of operations on board the International Space Station (ISS), a significant amount of uncertainty remains in failure rate estimates. Uncertain or inaccurate failure rates result in increased risk and spares mass for future missions. A Bayesian failure rate estimation approach, such as the one currently implemented by the ISS Program, can help reduce uncertainty by incorporating engineering judgement into failure rate estimates. However, experience on the ISS and with other complex systems shows that these prior failure rate estimates are often inaccurate. In addition, prior failure rate estimates are typically point values; some level of uncertainty must be added to convert these into probability distributions for Bayesian updating, and there are several potential methods for doing so. Due to the low rate of data collection, these subjective (and often inaccurate) prior estimates currently have a strong influence on the end result. This paper examines the challenges associated with failure rate estimation, validation, and uncertainty reduction in the context of ECLSS development for beyond-LEO missions. A variety of techniques for generating and updating Bayesian priors are discussed and evaluated using both real-world and simulated data. Potential solutions for improving failure rate estimation, including testing additional units, are analyzed and discussed, and a set of recommendations are provided for next-generation system development activities.

Supportability↗
NASA NTRSDate not supplied

Minimum-Variance Control Allocation Considering Parametric Model Uncertainty

The control allocation problem was investigated for linear dynamical systems with known parametric uncertainty. Minimizing a cost function that penalizes the variance of the error in achieving commanded forces and moments on the vehicle resulted in a special case of the weighted pseudo-inverse allocator. Rather than an engineer designing the weighting matrix, it is computed from the covariances of the control effectiveness parameters. This minimum-variance allocator balances the effectiveness of the control inputs against the corresponding levels of uncertainty. The approach was demonstrated using simulations of aircraft with realistic uncertainty levels operating in open-loop and closed-loop configurations. Results showed that when model uncertainty is known, significant, and unevenly distributed amongst the controls, the minimum-variance allocator more often achieves the intended forces and moments on the vehicle in comparison to other allocators, which can lead to increased performance, reliability, and safety during flight tests. The cost for this robustness is a diminished achievable moment space for the vehicle.

Control allocation↗
NASA NTRSDate not supplied

Uncertainty Quantification of CFD Model Assumptions Against Sonic Boom Noise Prediction of a Commercial Supersonic Transport

This paper presents the results of uncertainty modeling of sonic boom noise generation from commercial supersonic transport considering the Spalart-Allmaras (SA) turbulence modeling parameters as well as Mach number, angle of attack and altitude. Sample generation and analysis for this uncertainty model was performed by UQPCE, which is a software package developed at the NASA Langley Research Center. To build the uncertainty model, 42 cases of sonic boom noise calculation were performed. Computation of the ground noise can be briefly summarized in two steps. First, the near field pressure waveforms are sampled from CFD calculation using the NASA Langley’s FUN3D solver. Second, this information is passed to an atmospheric propagation code, sBOOM, which solves an augmented Burger’s equation and simulates how the near field waveforms will change while passing through the atmosphere. The ground signature is further processed to obtain the perceived loudness, PLdB. Having a high spatial resolution near the shockwave in the CFD calculation is critical in sonic boom noise prediction. Because the variation in the input parameters for the current uncertainty quantification (UQ) study is likely to lead to change in shock location, angle and strength, the grid adaptation for shock capturing is independently applied for each condition. The final mesh used in the CFD calculation consists of approximately 420 million cells. The pressure signatures are sampled at three, four and five body lengths away from the aircraft to make sure the three dimensional effects around the aircraft are resolved. The results of the UQ analysis shows that within the three aleatory variables, the angle of attack had the most impact against ground noise, followed by the altitude and the Mach number. Between the two SA model parameters, the Kármán constant (𝜅) was significantly more important than the turbulent Prandtl number (𝜎), but these two parameters were only marginally significant in the overall prediction variance in ground noise. The UQ procedure explained in this paper can be widely applied to other model parameters.

Uncertainty Quantification↗
NASA NTRSDate not supplied

Uncertainty Quantification of CFD Model Assumptions Against Sonic Boom Noise Prediction of a Commercial Supersonic Transport

This paper presents the results of uncertainty modeling of sonic boom noise generation from commercial supersonic transport considering the Spalart-Allmaras (SA) turbulence modeling parameters as well as Mach number, angle of attack and altitude. Sample generation and analysis for this uncertainty model was performed by UQPCE, which is a software package developed at the NASA Langley Research Center. To build the uncertainty model, 42 cases of sonic boom noise calculation were performed. Computation of the ground noise can be briefly summarized in two steps. First, the near field pressure waveforms are sampled from CFD calculation using the NASA Langley’s FUN3D solver. Second, this information is passed to an atmospheric propagation code, sBOOM, which solves an augmented Burger’s equation and simulates how the near field waveforms will change while passing through the atmosphere. The ground signature is further processed to obtain the perceived loudness, PLdB. Having a high spatial resolution near the shock wave in the CFD calculation is critical in sonic boom noise prediction. Because the variation in the input parameters for the current uncertainty quantification (UQ) study is likely to lead to change in shock location, angle and strength, the grid adaptation for shock capturing is independently applied for each condition. The final mesh used in the CFD calculation consists of approximately 420 million cells. The pressure signatures are sampled at three, four and five body lengths away from the aircraft to make sure the three dimensional effects around the aircraft are resolved. The results of the UQ analysis shows that within the three aleatory variables, the angle of attack had the most impact against ground noise, followed by the altitude and the Mach number. Between the two SA model parameters, the Kármán constant (𝜅) was significantly more important than the turbulent Prandtl number (𝜎), but these two parameters were only marginally significant in the overall prediction variance in ground noise. The UQ procedure explained in this paper can be widely applied to other model parameters.

Uncertainty Quantifications↗