Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainties”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Managing Traffic on the Three-Way Street: Steps Toward Closing the Aerosol Forcing Uncertainty Gap

Understanding changes in the radiative forcing of climate is critical for any effort to attribute, mitigate, or predict climate change. Although greenhouse gases (GHGs) contribute most of the radiative forcing, uncertainty in the climate forcing by airborne particles (aerosols) dominates the uncertainty in forcing changes overall. Yet, aerosol forcing has remained virtually undiminished for more than 20 years despite considerable advances in most of the key contributing elements. Satellite and suborbital measurements, as well as modeling, each have essential roles to play in reducing the uncertainty in the aerosol forcing of climate. This presentation will begin by briefly covering the reasons why aerosols are important for climate study, and will then summarize what we are learning about aerosols from current satellite remote-sensing work, and allude to the roles of suborbital measurements and models. Emphasis will be placed on nascent efforts to link satellite data with models, the need to continue as planned current programs supporting advanced, global-scale satellite and surface-based aerosol and precursor gas observations, climate modeling, as well as intensive field campaigns aimed at characterizing the underlying physical and chemical processes involved. The talk will conclude by highlighting new efforts needed to obtain systematic in situ measurements of aerosol microphysical and chemical properties, along with a greater research focus on integrating the unique contributions of measurements and modeling toward reducing the aerosol climate forcing uncertainty gap.

aerosol↗
NASA NTRSDate not supplied

Quantifying Uncertainty in Particle Size Distribution Parameters Inferred from SAGE III/ISS Extinction Spectra

Stratospheric aerosols play key roles in the chemistry and radiation balance of the atmosphere and are a key input parameter for global chemistry and climate models. The degree to which aerosols impact chemistry and radiation balance depends primarily on their microphysical properties such as particle size distribution (PSD). The PSD is a mathematical description of the relative abundance of different sized particles within a sampling volume. If the PSD is accurately known then other key modeling parameters (e.g., surface area density) can be derived. Occultation observations from orbital instruments such as SAGE III/ISS have been used to infer these PSD parameters by inverting the extinction coefficient spectra. However, past efforts failed to address two key issues with this methodology: 1. The measurement uncertainty was not accounted for; 2. They assumed the PSDs to be single-mode only, while “real-world” PSDs are predominantly bi-modal. Accounting for both issues in the retrieval will yield an expanded solution space to the inferred PSD parameters; the question is “by how much?” To address this knowledge gap, we propose to carry out a series of simulations and, for every valid SAGE III/ISS data point, determine the range of PSD parameters that yield extinction spectra that are indistinguishable from the SAGE III/ISS data, within the limits of the reported uncertainty. Further, we will expand the solution space, for the first time, to include bimodal distributions. The results of this work will advance Earth system modeling/prediction capability through identifying the uncertainty of PSD parameter estimates using SAGE III/ISS data. The key benefits of this study over previous studies are twofold: 1. we will provide PSD estimates that include bimodal distributions in the solution space, 2. we will provide an uncertainty estimate for these parameters. The results of this study may be used directly in current and future climate and chemistry models.

SAGE III/ISS↗
NASA NTRSDate not supplied

Uncertainty Estimation for SMAP Level-1 Brightness Temperature Assimilation at Different Timescales

In this study, we assimilate Soil Moisture Active Passive (SMAP) mission brightness temperature (Tb) observations into NASA’s Catchment Land Surface Model using an Ensemble Kalman filter to update surface and root-zone soil moisture simulations. Different time series components of the Tb observations are assimilated including anomalies, inter-annual variations, and high-frequency variations. To optimize the weights that the data assimilation (DA) puts on the observations, the ratio between the un-certainties of modeled and observed Tb is approximated using modeled and observed soil moisture uncertainties estimated using triple collocation analysis. Results are compared to a benchmark experiment that mimics the operational SMAP Level-4 algorithm, which assimilates Tb observations using a spatially-constant 4 Kelvin (K) observation uncertainty. All DA experiments exhibit notable skill improvements in most regions. Improvements are greatest for the inter-annual variations in the simulations of both surface and root-zone soil moisture (mean improvements in terms of Pearson correlation (-) are 0.08 and 0.06, respectively). Anomaly simulations improve similarly (0.07), and improvements in the high-frequency variations are only observed for sur-face soil moisture simulations (0.06). Strikingly, however, no notable difference in skill—neither improvement nor deterioration—is observed between the experiments that use optimized observation uncertainty parameters and the 4 K benchmark experiment. We show, analytically, that this may be explained by the presence of large observation operator errors, which have the potential to render post-update uncertainty insensitive to inaccuracies in the Kalman gain.

Alexander Gruber↗
NASA NTRSDate not supplied

From Formal Errors Towards Realistic Uncertainties

Evaluation of uncertainties of geodetic parameter estimates is the problem that is not yet solved in a satisfactory way. A direct evaluation of the uncertainties derived from a least square solution is labeled "formal" and is usually biased, sometimes up to an order of magnitude. Customary, the use of formal errors for scientific analysis is discouraged. We claim that the root of the problem is neglecting off-diagonal elements in the variance-covariance matrix of the noise in the data. A careful reconstruction of the full variance-covariance matrix, including the off-diagonal terms greatly improves realism of uncertainty estimates derived from least squares. We processed the dataset of VLBI group delays and built a prior variance-covariance of the atmosphere-driven noise based on analysis of the output of NASA high-resolution numerical weather models. We found that the uncertainties of parameter estimates derived from this least square solution that uses such variance-covariance matrices become much closer to realistic errors. We consider approaches for implementation of this method in routine data analysis of space geodesy data.

Leonid Petrov↗
NASA NTRSDate not supplied

Accounting for Point Estimate Uncertainty in Space Systems Reliability and Risk Analysis

Understanding and accounting for uncertainty in risk analysis is a critical step in the management and communication of risk in engineered systems. The component and system-level analysis to determine the probability of a negative outcome and its consequence is often quantified by a point estimate. Many Program and Enterprise decisions involving technical concerns and issues rely on reliability engineering activities to produce quantified risk analysis to inform the decision making process. At NASA, it is common to use a Probabilistic Risk Analysis (PRA) to inform the overall risk to Loss of Mission or Loss of Crew that involves integration across all spacecraft subsystem fault trees to produce an overall probability of mission failure. The point estimate is an estimate of this overall probability and is an immediate result of a fault tree model. It is the result of a model where the probability of each event is taken to be equal to its mean. The value provides an approximation of the overall mean without running any uncertainty calculations (e.g., no sampling). Using only the point estimate can lead to a false sense of precision and the point estimate may not match the resulting mean when uncertainty is taken into consideration. This paper will explore five conditions that can cause the PRA model mean to diverge from the point estimate and will provide engineers and managers insight into the importance of understanding uncertainty in the elements of PRA models.

Paul J Collier↗
NASA NTRS2024

Quantification of Uncertainty and Risk Sensitivity for Safety of Emerging Operations

The growing need to develop and deploy small unmanned aerial vehicles (sUAVs) for various applications in the airspace necessitates reliable tools to accurately predict the flight trajectories of the sUAVs. The knowledge of the predicted trajectories help decision makers anticipate potential conflict, assess the risk, and take appropriate risk mitigation actions. In addition, uncertainties in vehicle models, weather, and controller action further highlights the need for reliable prediction tools. In this project, the application of mixed sparse grid-based quadrature and generalized polynomial chaos(gPC) expansion method for uncertainty quantification and collision assessment in air traffic consisting of fixed-wing small unmanned aerial vehicles (sUAV) was studied. From the results obtained, it can be concluded that this provides a reliable framework to carry out quantitative conflict assessment in an unmanned air traffic, which when employed, can improve the functionalities of the unmanned traffic management system. It was observed that the results from the gPC expansion framework developed in the project can be utilized to conduct rapid probabilistic collision assessment for near real-time unmanned traffic management in the airspace. From the vehicle models, position updates, and wind-field data, a priori gPC based 3-σcon-fidence ellipses can provide estimates of potential conflict at some future instants. The computational costs scaled linearly when the uncertain inputs were fewer. Further, the largest allowable distribution of para-metric uncertainties that leads to the smallest risk of collision in traffic of small unmanned aerial vehicles could be calculated. The time of closest approach between two sUAVs can be established paving way for development of proactive mitigation strategies. The separation between the sUAVs was found to be most significantly affected by uncertainties in the maximum available thrusts, zero-lift drag coefficients, and wing planform areas of the sUAVs. The study of uncertain wind-fields indicated that a heterogeneous traffic mix resulted in an increased probability of conflict. Increased measurement update rate reduced the uncertain-ties in the trajectories of the vehicles, further reducing the probability of conflict but rapid updates of all vehicles in the airspace poses a stringent communication limitation. The gPC framework also provided the means to analyze vehicle impact (crash region) due to loss of control resulting from actuator failure in sUAS traffic, essentially to predict impact and crash zones for representative vehicles. The predicted regions when compared with non-participant density, provides a means to develop an early mitigation strategy, should the sUAV detect an imminent actuator failure.

Rajnish Bhusal↗
NASA NTRSDate not supplied

Design Under Uncertainty with Design-Dependent Uncertain Variables

Uncertainty quantification (UQ) can provide a more robust understanding of a system, leading to better informed decisions earlier in the design process. The additional information that UQ provides can be leveraged during a design optimization process known as design under uncertainty that, when incorporated with multidisciplinary design and optimization, can become computationally infeasible due to the large number of responses required for meaningful results. Previous work addressed reducing the computational expense in design under uncertainty by incorporating analytic derivatives throughout polynomial chaos expansion. Although this allows design under uncertainty to be feasible for more systems, some multidisciplinary systems have design-dependent uncertain variables. This paper details an implementation of design dependent uncertain variables in a manner than preserves derivatives required for efficient gradient-based optimization throughout the process. Two analytic examples of design-dependent uncertain variables are given: the first transforms a uniform uncertain variable with one design variable and the second transforms a normal uncertain variable with two design variables. The polynomial chaos expansion (PCE) results are comparable to both the Monte Carlo (MC) results and the analytic results for the two examples. A case study that maximizes the lift-to-drag ratio with a design-dependence between the wing leading edge sweep angle and uncertain parameter percentage of laminar flow is compared to a MC and alternative optimization formulations. This paper demonstrates that design-dependent uncertain variables are valid and hold throughout PCE.

Joanna N Schmidt↗
NASA NTRSDate not supplied

Uncertainty Propagation in Pre-Flight Prediction of Unmanned Aerial Vehicle Separation Violation

Current forecasts on the future of aeronautics suggest an in- creasing number of unmanned aerial vehicles entering the low- altitude airspace in the next decades (FAA, 2018; Kopardekar et al., 2016). Small vehicles for package delivery as well as larger vehicles for urban air mobility will change the airspace drastically, increasing density of operations both in time, i.e. high number of take-off and landings per unit time, and in space, operating in dense urban environment. This scenario poses challenges to the current approach to air traffic control, and large efforts from academia, industry and regulatory bodies are dedicated to the development of new traffic management strategies that leverage higher computing and simulating capabilities available today. In this paper, we propose a simple look-ahead approach to predict potential minimum separation violations at the strategic level, that is before vehicles start flying, depending on the predefined 4D trajectories and uncertainty affecting the wind acting along those routes. The wind field is extracted from the NOAA North America Mesoscale Forecast System and interpolated using Gaussian process regression, while uncertainty affecting the expected cruise airspeed is propagated through error intervals. The approach allows the prediction of aircraft separation as a function of time, highlighting potential safety violations that would go undetected if uncertainty affecting the expected 4D trajectories is not considered. The paper will also discuss issues related to accuracy and scalability of the approach to multiple vehicle operations.

Trajectory Prediction↗
NASA NTRSDate not supplied

Robust Design Under Uncertainty of Hypersonic Inlets

The objective of this work is to optimize scramjet inlet designs under uncertainty at multiple fidelity levels. Optimizations are performed for both deterministic and stochastic conditions. For stochastic conditions, robust design is used to minimize the variance in system performance in addition to optimizing mean system performance. Uncertainty quantification is performed using non-intrusive polynomial chaos. Comparisons are made between low-fidelity analysis and high-fidelity analysis, as well as deterministic optimization and robust optimization. Results indicate that the general design trend of previous inlet optimization techniques is recovered for the external compression portion of an inlet. For the internal compression portion of an inlet, when viscous effects become more significant and boundary layer separation becomes more likely, the optimal trend departs from previous results. Multifidelity uncertainty quantification methods are found to substantially reduce the computation time of robust design while obtaining results that nearly match those of high-fidelity analysis. Robust optimization is found to decrease the standard deviation of throat Mach number by up to 40% compared to deterministic optimization. Changes in the design variables and total turning that lead to robust scramjet inlets are identified and linked back to fundamental physical principles through the theta-beta-Mach function.

Hypersonic↗
NASA NTRSDate not supplied

Efficient Global Optimization with Gradient Finish for Design Under Uncertainty

The Efficient Global Optimization (EGO) algorithm is extended to include a gradient-descent-based finish upon reaching a threshold value of the expected improvement function. Emphasis is placed on efficient evaluation of local gradients using Kriging models during the gradient-based finish to enable application to design under uncertainty (DUU) problems. The modified algorithm is applied to both the well-known Rosenbrock function and a more challenging hypersonic inlet design under uncertainty problem. Results demonstrate improvement in locating the global optimum compared to the classical implementation of EGO, as well as a reduced number of true function evaluations compared to pure gradient-based algorithms. For the Rosenbrock function, a global optimum is returned using an average of 12% fewer function calls than a gradient-based optimizer with comparable tolerances. For the design under uncertainty problem, a global optimum is found using an average of 75% fewer function calls than a gradient-based optimizer. Global Pareto fronts of multiobjective DUU problems are obtained at little additional cost after a single optimization is complete.

Optimization↗
NASA NTRSDate not supplied

Techniques in Assessing Random Uncertainty of Wind Tunnel Replicate Test Data

The preferred method to determine the random uncertainty of variables of interest during wind tunnel tests is by direct analysis of replicate data. However, current information is limited to analysis of a single replicate set condition that does not consider data covariance. This paper provides additional information on considerations for quantifying random uncertainty including the evaluation and correction of replicate data covariance, the selection of replicate set conditions for the test, and the interpolation of random uncertainty at other than replicate set conditions. The analysis and techniques are supported by data from a conventional aircraft configuration test at the Oran Nicks Low-Speed Wind Tunnel and an ASME nozzle flow characterization at the Propulsion Systems Laboratory.

Uncertainty↗
NASA NTRS2003

Assessing model uncertainty in the conceptual design of a monopropellant propulsion system

An assessment of model uncertainty via probabilistic methods is described. An important question that arises in conceptual design is how accurate do models have to be to be useful? That is to say, when do other uncertainties in higher fidelity model counteract its accuracy when compared to a lower fidelity model faced with these same uncertainties?.

model uncertainty probabilistic methods conceptual↗
NASA NTRS2017

Wheels-Off Time Uncertainty Impact on Benefits of Early Call for Release Scheduling

Arrival traffic scenarios with 808 flights from 173 airports to Houston George Bush International airport are simulated to determine if Call For Release flights can receive a benefit in terms of less delay over other flights by scheduling prior to gate pushback (look-ahead in time) as opposed to at gate pushback. Call for Release flights are departures that require approval from Air Route Traffic Control Center prior to release. Realism is brought to the study by including gate departure delay and taxi-out delay uncertainties for the 77 major U. S. airports. Gate departure delay uncertainty is assumed to increase as a function of look-ahead time. Results show that Call For Release flights from an airport within the freeze horizon (a region surrounding the arrival airport) can get an advantage over other flights to a capacity constrained airport by scheduling prior to gate pushback, provided the wheels-off time uncertainty with respect to schedule is controlled to a small value, such as within a three-minute window. Another finding of the study is that system delay, measured as the sum of arrival delays, is smaller when flights are scheduled in the order of arrival compared to in the order of departure. Because flights from airports within the freeze horizon are scheduled in the order of departure, an increase in the number of internal airports with a larger freeze horizon increases system delay. Delay in the given scenario was found to increase by 126% (from 13.8 hours to 31.2 hours) as freeze horizon was increased from 30-minutes to 2-hours in the baseline scenario.

wheels-off time uncertainty↗
NASA NTRS2018

Required Time of Arrival as a Control Mechanism to Mitigate Uncertainty in Arrival Traffic Demand Management

The objective of this study is to explore the use of Required Time of Arrival (RTA) capability on the flight deck as a control mechanism on arrival traffic management to improve traffic delivery accuracy by mitigating the effect of traffic demand uncertainty. The uncertainties are caused by various factors, such as departure error due to the difference between scheduled departure and the actual take-off time. A simulation study was conducted using the Multi Aircraft Control System (MACS) software, a comprehensive research platform developed in the Airspace Operations Laboratory (AOL) at NASA Ames Research Center. The Crossing Time (CT) performance (i.e. the difference between target crossing time and actual crossing time) of the RTA for uncertainty mitigation during cruise phase was evaluated under the influence of varying two main factors: wind severity (heavy wind vs. mild wind), and wind error (1 hour, 2 hours, and 5 hours wind forecast errors). To examine the CT performance improvement made by the RTA, the comparison to the CT of the aircraft that were not assigned with RTA (Non-RTA) under the influence of the selected factors was also made. The Newark Liberty International Airport (EWR) was chosen for this study. A total 66 inbound traffic to the EWR (34 of them were airborne when the simulation was initiated, 32 were pre-departures at that time) was simulated, where the pre-scripted departure error was assigned to each pre-departure (61 conform to their Expected Departure Clearance Time, which is +-300 seconds of their scheduled departure time). The results of the study show that the delivery accuracy improvement can be achieved by assigning RTA, regardless of the influence of the selected two factors (the wind severity and the wind information inaccuracy). Across all wind variances, 66.9 (265 out of 396) of the CT performance of the RTA assigned aircraft was within +- 60 seconds (i.e. target tolerance range) and 88.9 (352 out of 396) aircraft met +-300 seconds marginal tolerance range, while only 33.6 (133 out of 396) of the Non-RTA assigned aircrafts CT performance achieved the target tolerance range and 75.5 (299 out of 396) stayed within the marginal. Examination of the impact of different error sources i.e. departure error, wind severity, and wind error suggest that although large departure errors can significantly impact the CT performance, the impacts of wind severity and errors were modest relative the targeted +- 60 second conformance range.

required time of arrival (RTA)↗
NASA NTRS2018

Updates of Moderate Resolution Imaging Spectroradiometer On-Orbit Calibration Uncertainty Assessments

The Moderate Resolution Imaging Spectroradiometer (MODIS) instruments have successfully operated for more than 18 and 16 years, respectively, on-board the NASA’s Earth Observing System Terra and Aqua spacecraft. Both Terra and Aqua MODIS have significantly contributed to the advance of global Earth remote sensing applications with a broad range of science products that have been continuously produced since the beginning of each mission and freely distributed to users worldwide. MODIS collects data in 20 reflective solar bands (RSB) and 16 thermal emissive bands (TEB), covering wavelengths from 0.41 to 14.4 μm. Its level 1B (L1B) data products, which provide the input for the MODIS high-level science products, include the top of the atmosphere reflectance factors for the RSB, radiances for both the RSB and TEB, and associated uncertainty indices (UI) at a pixel-by-pixel level. This paper provides a brief review of MODIS L1B calibration algorithms, including a number of improvements made in recent years. It presents an update of sensor calibration uncertainty assessments with a focus on several new contributors resulting from on-orbit changes in sensor characteristics, approaches developed to address these changes, and the impact due to on-orbit changes on the L1B data quality. Also discussed are remaining challenges and potential improvements to be made to continuously maintain sensor calibration and data quality, particularly those related to the quality of MODIS L1B uncertainty.

Spectroradiometer↗
NASA NTRSDate not supplied

Impact of Airborne Radar Uncertainties on Detect-and-Avoid Systems’ Performance

Impact of sensor uncertainty on Detect-and-Avoid (DAA) systems’ performance is investigated. Key metrics analyzed are the loss of DAA well clear ratio, the near-mid-air-collision risk ratio, the alert ratio, and the number of maneuvers per loss of DAA well clear. Sensitivity of these metrics to the magnitude of sensor uncertainty, pilots’ selection of maneuver, and surveillance range is investigated. Benefits of a dynamic buffer around the DAA well clear separation boundary, computed based on track accuracies, are also analyzed. These metrics are computed from open- and closed-loop simulations of a large number of representative encounters between an unmanned aircraft system and a manned aircraft. Results show that sensor uncertainty degrades safety metrics considerably but has only a minor effect on the number of maneuvers per loss of DAA well clear. The number of maneuvers, nonetheless, can be reduced by a 5◦ buffer away from the edge of the range of conflict-resulting heading in pilots’ selection of maneuver.

UAS↗
NASA NTRS2020

Pre-launch Radiometric Calibration and Uncertainty Analysis of Landsat Thermal Infrared Sensor 2

The Thermal Infrared Sensor-2 that will be on-board Landsat 9 has undergone a pre-launch testing campaign to characterize its radiometric, spectral, and spatial performance and demonstrate compliance to its requirements. This work reviews key elements of the instrument-level radiometric testing using an SI traceable source to derive its uncertainties. Those arising from on-orbit calibration using the TIRS-2 on-board blackbody are also discussed. We use a Monte Carlo approach to propagate the uncertainties through a non-linear calibration equation and address both random and systematic uncertainty terms. Achieving the required performance demonstrates the instrument’s potential for enhancing our understanding of the Earth’s environment.

Landsat↗
NASA NTRS2021

An Uncertainty Quantification Framework for Autonomous Flight System Tracking and Health Monitoring

This work proposes a perspective towards establishing a framework for uncertainty quantification of autonomous system tracking and health monitoring. The approach leverages the use of a predictive process structure, which maps uncertainty sources and their interaction according to the quantity of interest and the goal of the predictive estimation. It is systematic and uses basic elements that are system agnostic, and therefore needs to be tailored according to the specificity of the application. This work is motivated by the interest in low-altitude unmanned aerial vehicle operations, where awareness of vehicle and airspace state becomes more relevant as the density of autonomous operations grows rapidly. Predicted scenarios in the area of small vehicle operations and urban air mobility have no precedent, and holistic frameworks to perform prognostics and health management (PHM) at the system- and airspace-level are missing formal approaches to account for uncertainty. At the end of the paper, two case studies demonstrate implementation framework of trajectory tracking and health diagnosis for a small unmanned aerial vehicle. This work has been accepted for publication at the International Journal of Prognostics and Health Management Jan 2021. Minor edits have been incorporated to this original submission to incorporate complete overview and software integration.

Uncertainty Quantification↗