Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51

Lunar Prospector Orbit Determination Uncertainties Using the High Resolution Lunar Gravity Models

The Lunar Prospector (LP) mission began on January 6, 1998, when the LP spacecraft was launched from Cape Canaveral, Florida. The objectives of the mission were to determine whether water ice exists at the lunar poles, generate a global compositional map of the lunar surface, detect lunar outgassing, and improve knowledge of the lunar magnetic and gravity fields. Orbit determination of LP performed at the Jet Propulsion Laboratory (JPL) is conducted as part of the principal science investigation of the lunar gravity field. This paper will describe the JPL effort in support of the LP Gravity Investigation. This support includes high precision orbit determination, gravity model validation, and data editing. A description of the mission and its trajectory will be provided first, followed by a discussion of the orbit determination estimation procedure and models. Accuracies will be examined in terms of orbit-to-orbit solution differences, as a function of oblateness model truncation, and inclination in the plane-of-sky. Long term predictions for several gravity fields will be compared to the reconstructed orbits to demonstrate the accuracy of the orbit determination and oblateness fields developed by the Principal Gravity Investigator.

Carranza, Eric↗

Consensus on Aquatic Primary Productivity Field Protocols for Satellite Validation and Model Synthesis

The NASA PACE project, in conjunction with the IOCCG, EUMETSAT, and JAXA, have initiated an Aquatic Primary Productivity working group, with the aim to develop community consensus on multiple methods for measuring aquatic primary productivity used for satellite validation and model synthesis. A workshop to commence the working group efforts was held December 05-07, 2018 at the University Space Research Association headquarters in Columbia, MD U.S.A., bringing together 26 active researchers from 16 institutions. The group discussed the primary differences, nuances, scales, uncertainties, definitions, and best practices for measurements of primary productivity derived from in situ/on-deck/laboratory radio/stable isotope incubations, dissolved oxygen concentrations (from incubations or autonomous platforms such as floats or gliders), oxygen-argon ratios, triple oxygen isotope, natural fluorescence, and FRRF/ETR/kinetic analysis. These discussions highlighted the necessity to move the community forward towards the establishment of climate-quality primary productivity measurements that follow uniform protocols, which is imperative to ensure that existing and future measurements can be compared, assimilated, and their uncertainties determined for model development and validation. The specific deliverable resulting from of this activity will be a protocol document, published in coordination with the IOCCG. This presentation will discuss the findings of the meeting, and address future activities of the working group.

Vandermeulen, Ryan A.↗

Modified LTR robust control for flexible structures

A procedure is developed for dealing with performance and robustness issues in the design of multi-input multi-output compensators for lightly damped flexible structures. The procedure is based upon representing errors in the plant design model as structured uncertainties, and applying a modified version of the Loop Transfer Recovery (LTR) design method. Real parameter errors, such as frequency errors, damping errors or modal displacement errors can be treated. The approach involves adjusting the cost function in the regulator problem and the process noise model in the estimator problem in a particular manner which reflects the assumed structure of the modeling errors. Numerical examples dealing with the control of a large flexible space antenna with uncertain frequencies demonstrate a considerable improvement over standard LTR methods. Convenient design parameters can be varied until a satisfactory compromise is achieved between performance and robustness.

Blelloch, P. A.↗

A comparison of soil moisture characteristics predicted by the Arya-Paris model with laboratory-measured data

Soil moisture characteristics predicted by the Arya-Paris model were compared with the laboratory measured data for 181 New Jersey soil horizons. For a number of soil horizons, the predicted and the measured moisture characteristic curves are almost coincident; for a large number of other horizons, despite some disparity, their shapes are strikingly similar. Uncertainties in the model input and laboratory measurement of the moisture characteristic are indicated, and recommendations for additional experimentation and testing are made.

Arya, L. M.↗

Sources, Transport, and Climate Impacts of Biomass Burning Aerosols

In this presentation, I will first talk about fundamentals of modeling of biomass burning emissions of aerosols, then show the results of GOCART model simulated biomass burning aerosols. I will compare the model results with observations of satellite and ground-based network in terms of total aerosol optical depth, aerosol absorption optical depth, and vertical distributions. Finally the long-range transport of biomass burning aerosols and the climate effects will be addressed. I will also discuss the uncertainties associated with modeling and observations of biomass burning aerosols

Chin, Mian↗

Integration of Linear Dynamic Emission and Climate Models with Air Traffic Simulations

Future air traffic management systems are required to balance the conflicting objectives of maximizing safety and efficiency of traffic flows while minimizing the climate impact of aviation emissions and contrails. Integrating emission and climate models together with air traffic simulations improve the understanding of the complex interaction between the physical climate system, carbon and other greenhouse gas emissions and aviation activity. This paper integrates a national-level air traffic simulation and optimization capability with simple climate models and carbon cycle models, and climate metrics to assess the impact of aviation on climate. The capability can be used to make trade-offs between extra fuel cost and reduction in global surface temperature change. The parameters in the simulation can be used to evaluate the effect of various uncertainties in emission models and contrails and the impact of different decision horizons. Alternatively, the optimization results from the simulation can be used as inputs to other tools that monetize global climate impacts like the FAA s Aviation Environmental Portfolio Management Tool for Impacts.

Sridhar, Banavar↗

Uncertainty Quantification of Inducer Natural Frequency using Conditional Assessment of Modeling and Modal Testing of Simpler Systems

The low pressure fuel pump inducer of the new Space Launch System RS25 core stage engine operates in a highly complex environment that substantially affects its modal characteristics. Some of the more important effects are fluid-added mass resulting from operation within a light liquid (Hydrogen), and the magnification of this effect due to tight tip clearance. Since higher order cavitation has been identified as a significant harmonic driver, knowledge of the natural frequency of potentially excitable modes is critical for safe operation, but this frequency cannot be measured during the severe operational environment. A comprehensive testing and analysis program has therefore been performed over the last four years to identify the nominal value and uncertainty of the frequency by modeling and testing four simpler structures which share some of the characteristics of the operational inducer. This testing was used to assess and adjust modeling techniques and excellent correlation was achieved. Identification of the uncertainty in the inducer frequency itself was still problematic, however. This difficulty led to an investigation of Bayesian uncertainty quantification techniques, and to the application of the relatively simple technique of Multi-Variate Normal conditional distributions to calculate the inducer natural frequency uncertainty. Assumptions on prior distributions of uncertainty of the fluid-added mass and tip clearance effect are initially applied to models of each of the simple structures and the inducer itself, and these uncertainties are propagated to generate natural frequencies using design of experiments. Simple response surfaces are then created from this data in order to calculate a Covariance Matrix relating all of these natural frequencies. Finally, the results from modal test of the simple structures are considered to be observations and used to calculate the conditional variance of the desired inducer frequencies. As this method is less rigorous than more complicated Bayesian methods reported in the literature, a conservative factor is applied to the result, but the resulting uncertainty is still significantly less than originally estimated and will greatly assist certification of the inducer for use in the engine.

Uncertainty Quantification↗

Simulation and Analysis of Technology and Operational Procedures to Reduce the Combined Effects of Emissions and Contrails

The development and evaluation of concepts and technology to support future air traffic management systems require a hierarchy of models ranging from real-time simulations to extensive field evaluations. Air traffic simulation models such as Airspace Concept Evaluation System, Center Tracon Automation System, Future Air traffic management Concept Evaluation Tool and others are used to design air traffic systems balancing the conflicting objectives of maximizing safety, meeting future demands for airports and airspace and increase efficiency of traffic flows in the presence of uncertain weather. The impact of aviation emissions and contrails on climate imposes another constraint on the design of aircraft and aviation operations. The understanding of the complex interaction between physical climate system, the carbon and other greenhouse gas emissions and aviation activity can be improved by the development of integrated assessment models that include emission and climate models together with air traffic simulations. The modeling of aircraft emissions and their interaction with each other to change the concentration levels of different gasses in the atmosphere and the resulting impact of the radiative forcing on the equilibrium of the Earth's atmosphere is complex and requires the use of coupled atmosphere-ocean general circulation models together with three-dimensional models of carbon cycle and chemistry of other non-CO2 greenhouse gases. These models are computationally intensive and unsuitable for studies involving the generation of multiple scenarios. Simple emission and climate models, based on the input-output relations of linear systems, capture the fundamental emission to climate impact behavior by careful selection of key variables and their dynamics. The impact of various greenhouse gases depends on the total concentration, effect per unit change in atmospheric concentration and the spatial distribution of the gas. All these quantities are influenced by the lifetime of the gas. The impact of a greenhouse gas depends on the interval of assessment, which may vary from a few decades to a few centuries. Climate metrics are aimed at providing a common scale to compare different greenhouse gases. If the metrics are to be used as a tool in developing and evaluating aviation operations, they should be transparent and easy to apply. Global Warming Potential and Aggregate Global Temperature Potential are some of the commonly used metrics. This paper integrates a national-level air traffic simulation and optimization capability with simple climate models and carbon cycle models, and climate metrics to assess the impact of aviation on climate. The capability brings together metrics, which are useful in aviation operations together with metrics used in climate studies. The capability can be used to make trade-offs between extra fuel cost and reduction in climate impact. There is considerable uncertainty in our understanding of the radiative forcing associated with emissions and contrails. The parameters in the simulation can be used to evaluate the effect of various uncertainties in emission models and contrails. It can also be used to evaluate the impact of different decision horizons. Alternatively, the optimization results from the simulation can be used as inputs to other tools that monetize global climate impacts like the FAA's Aviation Environmental Portfolio Management Tool for Impacts.

impact of aviation on the environment↗

Establishing Calibration Standards for Remote Sensing Retrievals of Greenhouse Gases

While in situ greenhouse gas measurements have a concrete calibration standard, establishing a similar standard for remote sensing retrievals remains challenging. As the constellation of greenhouse gas observing satellites grows, such a standard is essential to ensure data are of the quality necessary to support scientific and policy applications. A primary goal of NASA's Atmospheric Carbon and Transport (ACT) - America aircraft campaign is to evaluate column CO2 retrievals from the Orbiting Carbon Observatory 2 (OCO-2) through coordinated underflights. The campaign also includes airborne lidar instruments that measure the amount of CO2 and CH4 below the aircraft. This presentation introduces a system that establishes calibration standards for OCO-2 and lidar retrievals based on in situ data from the ACT-America campaign. The system assimilates the in situ data into NASA's Goddard Earth Observing System (GEOS) to produce high-resolution, two-dimensional transects of CO2 along the flight path which we refer to as curtains. Excluding the ability to sample the entire atmosphere at once, any such analysis must make assumptions about the connection of measurements at different places and times to a given retrieval. We chose to use the GEOS general circulation model forced by meteorology from its data assimilation system because their scientific merits are extensively documented. Furthermore, in areas rich in data, the assimilated curtains approach a field constrained by data alone. Where data are lacking, e.g., the stratosphere, age of air and other transport diagnostics can be used to quantify the uncertainty introduced by the model. Given these uncertainties, we can determine the uncertainties of the curtains and thus our ability to evaluate remote sensing instruments. Here, we demonstrate this for several flights over North America and discuss possible applications to upcoming missions, e.g., GeoCarb.

Weir, B.↗

Continuously Improving Parametric Modeling with Historical Data on the ICESat-2 Mission

This paper delves into the details of the Joint Confidence Level (JCL) process performed for the Ice, Cloud, and Land Elevation Satellite (ICESat)-2 mission and how past performance was incorporated into subsequent JCL models to enable the project to continuously analyze potential slips to their launch readiness date (LRD). One year prior to the mission Preliminary Review (mPDR), the JCL model development process began. The first model was well received at the mPDR, held on October 10, 2012, and the input received by the Standing Review Board was incorporated into the model for the official data drop for key decision point (KDP)-C. The 70% JCL results of the October 2012 mPDR model forecast an LRD of February 2017 and associated cost of $830M. This result in 2012 immediately highlighted potential challenges with the project-planned LRD of July 2016. The year following the mPDR, the project had sustained a oneyear slip in the LRD due to problematic systems engineering requirement issues which impacted all project subsystems. This slip moved the project planned LRD from July 2016 to July 2017, an additional 5 months beyond the 2012 model’s 70% JCL result for the LRD of February 2017. As the project was quickly approaching the mission Critical Design Review (mCDR), the need for reliable JCL results increased significantly. The project held discussions on the JCL modeling process and focused on the input uncertainty distributions. Specifically, to identify the uncertainty distributions that the 2012 mPDR model would have needed to produce a 70% LRD result of July 2017. This led the project to compare multiple uncertainty distributions, and ultimately spurred the project to utilize uncertainty distributions that incorporated project past performance and historical data to forecast potential LRD slips. The revised results, created in 2014 and utilizing the new uncertainty distributions, showed that with 70% confidence, the ICESat-2 mission would launch in August 2018 with a cost of $1,044M. Today, ICESat-2 is scheduled to launch on September 15, 2018 with a project management (PM) agreement value of $1,056M. This illustrates how a JCL model can be continuously improved to produce valuable results for a project, even in cases of LRD delays. The primary reason for the ICESat-2 LRD delay is due to a laser failure on the primary instrument. Laser failure was one of the highest risk and uncertainty drivers within the JCL model. The project placed the most risk in this area of the model, and the model further identified the laser as the top risk driver and contributor to the LRD result. This further illustrates how a JCL can be used to predict and quantify possible issues on new technology missions.

Krygiel, Joseph↗

Surface Nitrification: A Major Uncertainty in Marine N2O Emissions

The ocean is responsible for up to a third of total global nitrous oxide (N2O) emissions, but uncertainties in emission rates of this potent greenhouse gas are high (approaching 100%). Here we use a marine biogeochemical model to assess six major uncertainties in estimates of N2O production, thereby providing guidance in how future studies may most effectively reduce uncertainties in current and future marine N2O emissions. Potential surface N2O production from nitrification causes the largest uncertainty in N2O emissions (estimated up to approximately 1.6 Tg N/yr (sup -1) or 48% of modeled values), followed by the unknown oxygen concentration at which N2O production switches to N2O consumption (0.8 Tg N/yr (sup -1)or 24% of modeled values). Other uncertainties are minor, cumulatively changing regional emissions by less than 15%. If production of N2O by surface nitrification could be ruled out in future studies, uncertainties in marine N2O emissions would be halved.

N2O↗

Picturing Data With Uncertainty

NASA is in the business of creating maps for scientific purposes to represent important biophysical or geophysical quantities over space and time. For example, maps of surface temperature over the globe tell scientists where and when the Earth is heating up; regional maps of the greenness of vegetation tell scientists where and when plants are photosynthesizing. There is always uncertainty associated with each value in any such map due to various factors. When uncertainty is fully modeled, instead of a single value at each map location, there is a distribution expressing a set of possible outcomes at each location. We consider such distribution data as multi-valued data since it consists of a collection of values about a single variable. Thus, a multi-valued data represents both the map and its uncertainty. We have been working on ways to visualize spatial multi-valued data sets effectively for fields with regularly spaced units or grid cells such as those in NASA's Earth science applications. A new way to display distributions at multiple grid locations is to project the distributions from an individual row, column or other user-selectable straight transect from the 2D domain. First at each grid cell in a given slice (row, column or transect), we compute a smooth density estimate from the underlying data. Such a density estimate for the probability density function (PDF) is generally more useful than a histogram, which is a classic density estimate. Then, the collection of PDFs along a given slice are presented vertically above the slice and form a wall. To minimize occlusion of intersecting slices, the corresponding walls are positioned at the far edges of the boundary. The PDF wall depicts the shapes of the distributions very dearly since peaks represent the modes (or bumps) in the PDFs. We've defined roughness as the number of peaks in the distribution. Roughness is another useful summary information for multimodal distributions. The uncertainty of the multi-valued data can also be interpreted by the number of peaks and the widths of the peaks as shown by the PDF walls.

Kao, David↗

Columnar Aerosol Single-Scattering Albedo and Phase Function Retrieved from Sky Radiance Over the Ocean: Measurements of African Dust

The single-scattering albedo and phase function of African mineral dust are retrieved from ground-based measurements of sky radiance collected in the Florida Keys. The retrieval algorithm employs the radiative transfer equation to solve by iteration for these two properties which best reproduce the observed sky radiance using an assumed aerosol vertical structure and measured aerosol optical depth. Thus, no assumptions regarding particle size, shape, or composition are required. The single-scattering albedo, presented at fourteen wavelengths between 380 and 870 nm, displays a spectral shape expected of iron-bearing minerals but is much higher than current dust models allow. This indicates the absorption of light by mineral dust is significantly overestimated in climate studies. Uncertainty in the retrieved albedo is less than 0.02 due to the small uncertainty in the solar-reflectance-based calibration (12.2%) method employed. The phase function retrieved at 860 nm is very robust under simulations of expected experimental errors, indicating retrieved phase functions at this wavelength may be confidently used to describe aerosol scattering characteristics. The phase function retrieved at 443 nm is very sensitive to expected experimental errors and should not be used to describe aerosol scattering. Radiative forcing by aerosol is the greatest source of uncertainty in current climate models. These results will help reduce uncertainty in the absorption of light by mineral dust. Assessment of the radiative impact of aerosol species is a key component to NASA's Earth System Enterprise.

Cattrall, Christopher↗

Uncertainty Considerations for Ballistic Limit Equations

The overall risk for any spacecraft system is typically determined using a Probabilistic Risk Assessment (PRA). A PRA attempts to determine the overall risk associated with a particular mission by factoring in all known risks (and their corresponding uncertainties, if known) to the spacecraft during its mission. The threat to mission and human life posed by the mircro-meteoroid & orbital debris (MMOD) environment is one of the risks. NASA uses the BUMPER II program to provide point estimate predictions of MMOD risk for the Space Shuttle and the International Space Station. However, BUMPER II does not provide uncertainty bounds or confidence intervals for its predictions. With so many uncertainties believed to be present in the models used within BUMPER II, providing uncertainty bounds with BUMPER II results would appear to be essential to properly evaluating its predictions of MMOD risk. The uncertainties in BUMPER II come primarily from three areas: damage prediction/ballistic limit equations, environment models, and failure criteria definitions. In order to quantify the overall uncertainty bounds on MMOD risk predictions, the uncertainties in these three areas must be identified. In this paper, possible approaches through which uncertainty bounds can be developed for the various damage prediction and ballistic limit equations encoded within the shuttle and station versions of BUMPER II are presented and discussed. We begin the paper with a review of the current approaches used by NASA to perform a PRA for the Space Shuttle and the International Space Station, followed by a review of the results of a recent sensitivity analysis performed by NASA using the shuttle version of the BUMPER II code. Following a discussion of the various equations that are encoded in BUMPER II, we propose several possible approaches for establishing uncertainty bounds for the equations within BUMPER II. We conclude with an evaluation of these approaches and present a recommendation regarding which of them would be the most appropriate to follow.

Schonberg, W. P.↗

Energy-balance climate models

An introductory survey of the global energy balance climate models is presented with an emphasis on analytical results. A sequence of increasingly complicated models involving ice cap and radiative feedback processes are solved and the solutions and parameter sensitivities are studied. The model parameterizations are examined critically in light of many current uncertainties. A simple seasonal model is used to study the effects of changes in orbital elements on the temperature field. A linear stability theorem and a complete nonlinear stability analysis for the models are developed. Analytical solutions are also obtained for the linearized models driven by stochastic forcing elements. In this context the relation between natural fluctuation statistics and climate sensitivity is stressed.

North, G. R.↗