Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32

Uncertainty in Twenty-First-Century CMIP5 Sea Level Projections

The representative concentration pathway (RCP) simulations included in phase 5 of the Coupled Model Intercomparison Project (CMIP5) quantify the response of the climate system to different natural and anthropogenic forcing scenarios. These simulations differ because of 1) forcing, 2) the representation of the climate system in atmosphere-ocean general circulation models (AOGCMs), and 3) the presence of unforced (internal) variability. Global and local sea level rise projections derived from these simulations, and the emergence of distinct responses to the four RCPs depend on the relative magnitude of these sources of uncertainty at different lead times. Here, the uncertainty in CMIP5 projections of sea level is partitioned at global and local scales, using a 164-member ensemble of twenty-first-century simulations. Local projections at New York City (NYSL) are highlighted. The partition between model uncertainty, scenario uncertainty, and internal variability in global mean sea level (GMSL) is qualitatively consistent with that of surface air temperature, with model uncertainty dominant for most of the twenty-first century. Locally, model uncertainty is dominant through 2100, with maxima in the North Atlantic and the Arctic Ocean. The model spread is driven largely by 4 of the 16 AOGCMs in the ensemble; these models exhibit outlying behavior in all RCPs and in both GMSL and NYSL. The magnitude of internal variability varies widely by location and across models, leading to differences of several decades in the local emergence of RCPs. The AOGCM spread, and its sensitivity to model exclusion and/or weighting, has important implications for sea level assessments, especially if a local risk management approach is utilized.

Variability↗

Aerodynamic Models for the Low Density Supersonic Decelerator (LDSD) Test Vehicles

An overview of aerodynamic models for the Low Density Supersonic Decelerator (LDSD) Supersonic Flight Dynamics Test (SFDT) campaign test vehicle is presented, with comparisons to reconstructed flight data and discussion of model updates. The SFDT campaign objective is to test Supersonic Inflatable Aerodynamic Decelerator (SIAD) and large supersonic parachute technologies at high altitude Earth conditions relevant to entry, descent, and landing (EDL) at Mars. Nominal SIAD test conditions are attained by lifting a test vehicle (TV) to 36 km altitude with a helium balloon, then accelerating the TV to Mach 4 and 53 km altitude with a solid rocket motor. Test flights conducted in June of 2014 (SFDT-1) and 2015 (SFDT-2) each successfully delivered a 6 meter diameter decelerator (SIAD-R) to test conditions and several seconds of flight, and were successful in demonstrating the SFDT flight system concept and SIAD-R technology. Aerodynamic models and uncertainties developed for the SFDT campaign are presented, including the methods used to generate them and their implementation within an aerodynamic database (ADB) routine for flight simulations. Pre- and post-flight aerodynamic models are compared against reconstructed flight data and model changes based upon knowledge gained from the flights are discussed. The pre-flight powered phase model is shown to have a significant contribution to off-nominal SFDT trajectory lofting, while coast and SIAD phase models behaved much as predicted.

Van Norman, John W.↗

The two-dimensional diagnostic model for tropospheric OH - An uncertainty analysis

Tropospheric OH is believed to play a major role in atmospheric photochemistry, and, via its chemical interactions OH ultimately may affect the climate, stratospheric ozone levels, and the pH of rain. A valuable tool for predicting the global OH abundance as a function of latitude and altitude is the two-dimensional diagnostic model for tropospheric OH. This model can also be applied to budget studies of species which interact with OH, such as CH4, CO, and O3. In addition to laboratory-obtained kinetic data, important variables include the rate constants for several reactions, the rate of heterogeneous removal of soluble species, and the global abundance and spatial variability in H2O, O3, CO, and NOx. The uncertainties in these parameters imply over a factor of 3 variability in the calculated global OH concentration as well as significant uncertainties in the latitudinal and vertical OH distribution.

Chameides, W. L.↗

Precise orbit determination for NASA's Earth Observing System using GPS

A precision orbit determination technique for NASA's Earth Observing System (EOS) is discussed. The technique exploits the redundant geometric information from GPS carrier phase and P-code pseudorange measurements and minimizes the requirements for precision dynamical modeling. Performance estimates for the application of the technique to the orbit geometry planned for the EOS platforms show that decimeter accuracies of orbit position may be obtained. The sensitivity of the predicted orbit uncertainties to model errors for station locations, nongravitational platform accelerations, and earth gravity are presented.

Williams, Bobby G.↗

Real-Time Prediction of Safety Margins in the National Airspace

Underlying all operations in the National Airspace System (NAS) is the concept of safety. Safety, as defined by acceptable levels of risk, is to be maintained at all times. The real-time safety monitoring (RTSM) framework is under development to provide an automated system to quantify safety in the NAS, estimate the current level of safety, and predict the future evolution of safety and the occurrence of events that pose an increased risk to flights so that these occurrences can be managed strategically rather than mitigated reactively. This paper presents the mathematical framework, the models, and the monitoring and prediction algorithms used to achieve this. RTSM computes safety as expressed through a set of safety margins based on user-defined safety metrics, thresolds, and events. Sources of uncertainty are modeled and propagated through the predictions in order to compute the probabilistic evolution of safety and the probability of events that introduce increased risk to operations. A prototype implementation is discussed and results demonstrating feasibility are presented. The results highlight the kinds of predictions that can be computed and the fidelity that is currently achieved.

national airspace system↗

A Gaussian Process Enhancement to Linear Parameter Varying Models

Simulation and analysis for modern engineering systems now routinely requires the merging of multiple disciplines, physical-domains, time-scales, and data sets — all at ever increasing levels. These capabilities are especially needed in the domain of Advanced Air Mobility, where rapidly emerging vehicle designs are significantly more complex, while having to be both cost-effective and safe. To meet these engineering challenges, machine learning methods are an attractive option for merging models and data across multiple areas while providing uncertainty quantification and maintaining computational efficiency. This paper examines the use of Gaussian process machine learning to generalize and enhance the commonly used class of quasi-Linear Parameter Varying models for fast full-envelope simulation while also supporting control system design and analysis with model uncertainty. Gaussian process machine learning is selected because it: can fuse multiple data sets, enables an easy trade-off between data fitting and smoothing, provides model uncertainty quantification, scales well with increasing complexity, and does not generally require starting from a large training data set. To demonstrate the benefits of the approach, a robust stability analysis with Gaussian process uncertainty is shown for a NASA reference design of an electric quad-rotor air-taxi concept vehicle with motor parameter uncertainty.

Gaussian Process↗

Calibration Probe Uncertainty and Validation for the Hypersonic Material Environmental Test System

This paper presents an uncertainty analysis of the stagnation-point calibration probe surface predictions for conditions that span the performance envelope of the Hypersonic Materials Environmental Test System facility located at NASA Langley Research Center. A second-order stochastic expansion was constructed over 47 uncertain parameters to evaluate the sensitivities, identify the most significant uncertain variables, and quantify the uncertainty in the stagnation-point heat flux and pressure predictions of the calibration probe for a low- and high-enthalpy test condition. A sensitivity analysis showed that measurement bias uncertainty is the most significant contributor to the stagnation-point pressure and heat flux variance for the low-enthalpy condition. For the high-enthalpy condition, a paradigm shift in sensitivities revealed the computational fluid dynamics model input uncertainty as the main contributor. A comparison between the prediction and measurement of the stagnation-point conditions under uncertainty showed that there was evidence of statistical disagreement. A validation metric was proposed and applied to the prediction uncertainty to account for the statistical disagreement when compared to the possible stagnation-point heat flux and pressure measurements.

Brune, Andrew J.↗

Robust Control Design for Uncertain Nonlinear Dynamic Systems

Robustness to parametric uncertainty is fundamental to successful control system design and as such it has been at the core of many design methods developed over the decades. Despite its prominence, most of the work on robust control design has focused on linear models and uncertainties that are non-probabilistic in nature. Recently, researchers have acknowledged this disparity and have been developing theory to address a broader class of uncertainties. This paper presents an experimental application of robust control design for a hybrid class of probabilistic and non-probabilistic parametric uncertainties. The experimental apparatus is based upon the classic inverted pendulum on a cart. The physical uncertainty is realized by a known additional lumped mass at an unknown location on the pendulum. This unknown location has the effect of substantially altering the nominal frequency and controllability of the nonlinear system, and in the limit has the capability to make the system neutrally stable and uncontrollable. Another uncertainty to be considered is a direct current motor parameter. The control design objective is to design a controller that satisfies stability, tracking error, control power, and transient behavior requirements for the largest range of parametric uncertainties. This paper presents an overview of the theory behind the robust control design methodology and the experimental results.

Kenny, Sean P.↗

Probabilistic Forecasting of Ground Magnetic Perturbation Spikes at Mid-Latitude Stations

The prediction of large fluctuations in the ground magnetic field (dB/dt) is essential for preventing damage from Geomagnetically Induced Currents. Directly forecasting these fluctuations has proven difficult, but accurately determining the risk of extreme events can allow for the worst of the damage to be prevented. Here we trained Convolutional Neural Network models for eight mid-latitude magnetometers to predict the probability that dB/dt will exceed the 99th percentile threshold 30–60 min in the future. Two model frameworks were compared, a model trained using solar wind data from the Advanced Composition Explorer (ACE) satellite, and another model trained on both ACE and SuperMAG ground magnetometer data. The models were compared to examine if the addition of current ground magnetometer data significantly improved the forecasts of dB/dt in the future prediction window. A bootstrapping method was employed using a random split of the training and validation data to provide a measure of uncertainty in model predictions. The models were evaluated on the ground truth data during eight geomagnetic storms and a suite of evaluation metrics are presented. The models were also compared to a persistence model to ensure that the model using both datasets did not over-rely on dB/dt values in making its predictions. Overall, we find that the models using both the solar wind and ground magnetometer data had better metric scores than the solar wind only and persistence models, and was able to capture more spatially localized variations in the dB/dt threshold crossings.

Michael Coughlan↗

Probabilistic and deterministic aspects of linear estimation in geodesy

Recent advances in observational techniques related to geodetic work (VLBI, laser ranging) make it imperative that more consideration should be given to modeling problems. Uncertainties in the effect of atmospheric refraction, polar motion and precession-nutation parameters, cannot be dispensed with in the context of centimeter level geodesy. Even physical processes that have generally been previously altogether neglected (station motions) must now be taken into consideration. The problem of modeling functions of time or space, or at least their values at observation points (epochs) is explored. When the nature of the function to be modeled is unknown. The need to include a limited number of terms and to a priori decide upon a specific form may result in a representation which fails to sufficiently approximate the unknown function. An alternative approach of increasing application is the modeling of unknown functions as stochastic processes.

Dermanis, A.↗

Precise orbit determination for NASA's earth observing system using GPS (Global Positioning System)

An application of a precision orbit determination technique for NASA's Earth Observing System (EOS) using the Global Positioning System (GPS) is described. This technique allows the geometric information from measurements of GPS carrier phase and P-code pseudo-range to be exploited while minimizing requirements for precision dynamical modeling. The method combines geometric and dynamic information to determine the spacecraft trajectory; the weight on the dynamic information is controlled by adjusting fictitious spacecraft accelerations in three dimensions which are treated as first order exponentially time correlated stochastic processes. By varying the time correlation and uncertainty of the stochastic accelerations, the technique can range from purely geometric to purely dynamic. Performance estimates for this technique as applied to the orbit geometry planned for the EOS platforms indicate that decimeter accuracies for EOS orbit position may be obtainable. The sensitivity of the predicted orbit uncertainties to model errors for station locations, nongravitational platform accelerations, and Earth gravity is also presented.

Williams, B. G.↗

Human and Natural Influences on the Changing Thermal Structure of the Atmosphere

Since the late 1970s, satellite-based instruments have monitored global changes in atmospheric temperature. These measurements reveal multidecadal tropospheric warming and stratospheric cooling, punctuated by short-term volcanic signals of reverse sign. Similar long- and short-term temperature signals occur in model simulations driven by human-caused changes in atmospheric composition and natural variations in volcanic aerosols. Most previous comparisons of modeled and observed atmospheric temperature changes have used results from individual models and individual observational records. In contrast, we rely on a large multimodel archive and multiple observational datasets. We show that a human-caused latitude/altitude pattern of atmospheric temperature change can be identified with high statistical confidence in satellite data. Results are robust to current uncertainties in models and observations. Virtually all previous research in this area has attempted to discriminate an anthropogenic signal from internal variability. Here, we present evidence that a human-caused signal can also be identified relative to the larger "total" natural variability arising from sources internal to the climate system, solar irradiance changes, and volcanic forcing. Consistent signal identification occurs because both internal and total natural variability (as simulated by state-of-the-art models) cannot produce sustained global-scale tropospheric warming and stratospheric cooling. Our results provide clear evidence for a discernible human influence on the thermal structure of the atmosphere.

Santer, Benjamin D.↗

In-flight thrust determination on a real-time basis

A real time computer program was implemented on a F-15 jet fighter to monitor in-flight engine performance of a Digital Electronic Engine Controlled (DEES) F-100 engine. The application of two gas generator methods to calculate in-flight thrust real time is described. A comparison was made between the actual results and those predicted by an engine model simulation. The percent difference between the two methods was compared to the predicted uncertainty based on instrumentation and model uncertainty and agreed closely with the results found during altitude facility testing. Data was obtained from acceleration runs of various altitudes at maximum power settings with and without afterburner. Real time in-flight thrust measurement was a major advancement to flight test productivity and was accomplished with no loss in accuracy over previous post flight methods.

Ray, R. J.↗

The probability distribution of the predicted CFM-induced ozone depletion

It is argued from the central limit theorem that the uncertainty in model predicted changes of the ozone column density is best represented by a normal probability density distribution. This conclusion is validated by comparison with a probability distribution generated by a Monte Carlo technique. In the case of the CFM-induced ozone depletion, and based on the estimated uncertainties in the reaction rate coefficients alone the relative mean standard deviation of this normal distribution is estimated to be 0.29.

Ehhalt, D. H.↗

MODIS Reflective Solar Bands Lunar Calibration Update and Improvements

The MODerate resolution Imaging Spectroradiometer (MODIS) instruments on-board the Terra and Aqua spacecrafts were launched on December 18, 1999 and May 4, 2002, respectively. Each instrument has been scheduled to view the Moon through its Space View (SV) port approximately once per month in order to monitor the long-term radiometric stability of their reflective solar bands (RSB). The lunar calibration has played a key role in tracking the change in the response versus scan angle (RVS) of the instrument’s scan mirror, which is an essential part of the RSB calibration. The lunar irradiance observed by MODIS depends on the view geometry and it is crucial to remove the geometric effects in order to derive accurate RSB calibration coefficients. With a scheduled roll maneuver, the lunar phase angles are kept in a narrow range of 1° for each MODIS instrument such that the impact of these geometric effects is minimized. Nevertheless, it remains a challenge to completely remove the impact of geometric effects in the calibration coefficients derived from the lunar observations, considering the high expectations for the accuracy and quality of the results. In the current MODIS lunar calibration, the geometric effects on the lunar irradiance are corrected by the RObotic Lunar Observatory (ROLO) model. The overall relative uncertainty of the ROLO model for the MODIS calibration has been assessed to be about 1% in the selected lunar phase angle range of 1°. It could be as large as 4% beyond this small phase angle range, especially for the shortest wavelengths. This uncertainty induces noticeable oscillations in the calibration coefficients derived from the lunar observations. We developed a simple lunar model, which is based on MODIS lunar measurements, derived from scheduled lunar observations, as well as those obtained from intrusion of the Moon in the SV, referred to as unscheduled lunar observations, in the time period from 2005 to 2012. Here, the scheduled lunar observations for the entire mission are reprocessed with the new lunar model applied to correct the view geometry effects for each MODIS instrument. New calibration coefficients for the RSBs are calculated. We show that oscillations and noise in the derived lunar calibration coefficients are significantly reduced for both MODIS instruments.

Terra↗

Understanding Aerosol Direct Radiative Forcing - How Satellites Fit In

The aerosol data products from the NASA Earth Observing System's MISR and MODIS instruments provide significant advances in regional and global aerosol optical depth (AOD) mapping, aerosol type measurement, and source plume characterization from space. Although these products have been and are being used for many applications, ranging from regional air quality assessment, to aerosol air mass type identification and evolution, to aerosol injection height and aerosol transport model validation, uncertainties still limit the quantitative constraints these satellite data place on global-scale direct aerosol radiative forcing. Some further refinement of the current aerosol products is possible, but a major advance in this area seems to require a different paradigm, involving the integration of satellite and suborbital data with models. This presentation will briefly summarize where we stand, and what incremental advances we can expect, with the current aerosol products, and will then elaborate on some initial steps aimed at the necessary integration of data from multiple sources and models.

Kahn, R. A.↗

Assessing the Risk of Crew Injury Due to Dynamic Loads During Spaceflight

Spaceflight requires tremendous amounts of energy to achieve Earth orbit and to attain escape velocity for interplanetary missions. Although the majority of the energy is managed in such a way as to limit the accelerations on the crew, several mission phases may result in crew exposure to dynamic loads. In the automotive industry, risk of serious injury can be tolerated because the probability of a crash is remote each time a person enters a vehicle, resulting in a low total risk of injury. For spaceflight, the level of acceptable injury risk must be lower to achieve a low total risk of injury because the dynamic loads are expected on each flight. To mitigate the risk of injury due to dynamic loads, the NASA Human Research Program has developed a research plan to inform the knowledge gaps and develop relevant tools for assessing injury risk. The risk of injury due to dynamic loads can be further subdivided into extrinsic and intrinsic risk factors. Extrinsic risk factors include the vehicle dynamic profile, seat and restraint design, and spacesuit design. Human tolerance to loads varies considerably depending on the direction, amplitude, and rise-time of acceleration therefore the orientation of the body to the dynamic vector is critical to determining crew risk of injury. Although a particular vehicle dynamic profile may be safe for a particular design, the seat, restraint, and suit designs can affect the risk of injury due to localized effects. In addition, characteristics intrinsic to the crewmember may also contribute to the risk of injury, such as crewmember sex, age, anthropometry, and deconditioning due to spaceflight, and each astronaut may have a different risk profile because of these factors. The purpose of the research plan is to address any knowledge gaps in the risk factors to mitigate injury risk. Methods for assessing injury risk have been well documented in other analogous industries and include human volunteer testing, human exposure to dynamic environments, post-mortem human subject (PMHS) testing, animal testing, anthropomorphic test devices (ATD), dynamic models of the human, numerical models of ATDs, and numerical models of the human. Each has inherent strengths and limitations. For example, human volunteer testing is advantageous because a population can be selected that is similar to the astronaut corps; however, because of the inherent ethical limitations, only sub-injurious conditions can be tested. PMHSs can be tested in a variety of conditions including injurious levels, but the responses are not completely analogous to living human subjects. In addition, it is exceedingly difficult to select a PMHS population that is similar to the astronaut corps. ATDs are currently widely used in the automotive industry and military because they are highly repeatable and durable. Unfortunately, because they are mechanical models of the human body, the biofidelity of the responses are limited to dynamic conditions used to validate the ATD. Numerical models of the ATD, in addition to the strengths and limitations for ATDs, are easy to use for a variety of designs before a design is fabricated, but also have additional limitations for ATDs, are easy to use for a variety of designs before a design is fabricated, but also have additional uncertainty. Dynamic models are simple and easy to use, but do not account for localized effects of the seat and suit. Finally, numerical models of the human have the potential to have the most advantages; however, the current models are not validated for the conditions expected during spaceflight. To properly assess spaceflight conditions with numerical human models, human data would be needed to optimize the model responses for those conditions. Using the appropriate assessment method with the knowledge gained for each risk factor, an appropriate approach for mitigating the risk of injury due to dynamic loads can be developed ensuring crew safety in future NASA vehicles.

Somers, J. T.↗

Using LIDAR and Quickbird Data to Model Plant Production and Quantify Uncertainties Associated with Wetland Detection and Land Cover Generalizations

Spatiotemporal data from satellite remote sensing and surface meteorology networks have made it possible to continuously monitor global plant production, and to identify global trends associated with land cover/use and climate change. Gross primary production (GPP) and net primary production (NPP) are routinely derived from the MOderate Resolution Imaging Spectroradiometer (MODIS) onboard satellites Terra and Aqua, and estimates generally agree with independent measurements at validation sites across the globe. However, the accuracy of GPP and NPP estimates in some regions may be limited by the quality of model input variables and heterogeneity at fine spatial scales. We developed new methods for deriving model inputs (i.e., land cover, leaf area, and photosynthetically active radiation absorbed by plant canopies) from airborne laser altimetry (LiDAR) and Quickbird multispectral data at resolutions ranging from about 30 m to 1 km. In addition, LiDAR-derived biomass was used as a means for computing carbon-use efficiency. Spatial variables were used with temporal data from ground-based monitoring stations to compute a six-year GPP and NPP time series for a 3600 ha study site in the Great Lakes region of North America. Model results compared favorably with independent observations from a 400 m flux tower and a process-based ecosystem model (BIOME-BGC), but only after removing vapor pressure deficit as a constraint on photosynthesis from the MODIS global algorithm. Fine resolution inputs captured more of the spatial variability, but estimates were similar to coarse-resolution data when integrated across the entire vegetation structure, composition, and conversion efficiencies were similar to upland plant communities. Plant productivity estimates were noticeably improved using LiDAR-derived variables, while uncertainties associated with land cover generalizations and wetlands in this largely forested landscape were considered less important.

Cook, Bruce D.↗