Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

Optimized MODIS Channel Selection to Improve the NASA CERES FluxByCloudType Product Fluxes

The NASA Clouds and the Earth’s Radiant Energy System (CERES) project has provided the climate community more than a 20-year record of top of the atmosphere (TOA) reflected shortwave (SW) and emitted longwave (LW) fluxes. The fluxes used to monitor the Earth’s energy balance as well as for climate model validation and cloud feedback studies. One of the largest uncertainties in climate models is the response of clouds in feedback studies. To reduce this uncertainty requires more stringently validation of model generated fluxes by cloud-type. Rather than relying on radiative transfer model generated fluxes from observed cloud-type retrievals, the CERES FluxByCloudType (FBCT) product, relies on MODIS empirical narrowband to broadband relationships to convert the cloudy portions of the CERES footprints into fluxes. The overcast footprint and sub-footprint cloud layer fluxes are then stratified by 7 pressure layers and 6 optical depth bins and temporally averaged into daily and monthly regional cloud-type fluxes. The CERES project analyzed a total of 19 MODIS channels for use in the next generation FBCT product narrowband to broadband conversion. This was accomplished by comparing the narrowband to broadband RMS errors from all possible 5-channel combinations. The SW and LW optimized channels were selected by also considering analogous geostationary, MODIS and VIIRS imager channels as well as channel combinations that provided the lowest RMS errors across all surface types. The optimized channel combinations will be tested in the FBCT algorithm to investigate any cloud fraction, effective pressure, optical depth, PW, solar and view angle, surface type and regional narrowband to broadband dependencies.

CERES↗

On the Reconstruction of Palaeo-Ice Sheets: Recent Advances and Future Challenges

Reconstructing the growth and decay of palaeo-ice sheets is critical to understanding mechanisms of global climate change and associated sea-level fluctuations in the past, present and future. The significance of palaeo-ice sheets is further underlined by the broad range of disciplines concerned with reconstructing their behaviour, many of which have undergone a rapid expansion since the 1980s. In particular, there has been a major increase in the size and qualitative diversity of empirical data used to reconstruct and date ice sheets, and major improvements in our ability to simulate their dynamics in numerical ice sheet models. These developments have made it increasingly necessary to forge interdisciplinary links between sub-disciplines and to link numerical modelling with observations and dating of proxy records. The aim of this paper is to evaluate recent developments in the methods used to reconstruct ice sheets and outline some key challenges that remain, with an emphasis on how future work might integrate terrestrial and marine evidence together with numerical modelling. Our focus is on pan-ice sheet reconstructions of the last deglaciation, but regional case studies are used to illustrate methodological achievements, challenges and opportunities. Whilst various disciplines have made important progress in our understanding of ice-sheet dynamics, it is clear that data-model integration remains under-used, and that uncertainties remain poorly quantified in both empirically-based and numerical ice-sheet reconstructions. The representation of past climate will continue to be the largest source of uncertainty for numerical modelling. As such, palaeo-observations are critical to constrain and validate modelling. State-of-the-art numerical models will continue to improve both in model resolution and in the breadth of inclusion of relevant processes, thereby enabling more accurate and more direct comparison with the increasing range of palaeo-observations. Thus, the capability is developing to use all relevant palaeo-records to more strongly constrain deglacial (and to a lesser extent pre-LGM) ice sheet evolution. In working towards that goal, the accurate representation of uncertainties is required for both constraint data and model outputs. Close cooperation between modelling and data-gathering communities is essential to ensure this capability is realised and continues to progress.

Ice sheet reconstruction↗

Uncertainties in an Observation-Based Estimate of the Global Aerosol Direct Radiative Effect

Aerosols impact Earth’s radiation budget directly through interactions with radiation and indirectly via interactions with clouds. Aerosols have significant radiative impacts on Earth’s energy budget and represent the largest uncertainty in the radiative forcing of the current climate. Although the magnitude of the aerosol direct radiative effect (DRE) is estimated to be less than that of the indirect effect, uncertainties are large. While model-based estimates of aerosol radiative forcing are subject to uncertainties in modeled aerosol properties and uncertainties in simulated cloud cover and albedo, most observation-based studies of global aerosol DRE have their own difficulties with aerosol optical properties and have been limited to cloud-free skies in most cases. Estimates of the uncertainty of the aerosol DRE are themselves uncertain and have varied widely among different published studies. In this study we use the CERES-CALIPSO-CloudSat-MODIS (C3M) product to estimate the global clear-sky and all-sky aerosol DRE. C3M merges collocated data from CERES, CALIPSO, CloudSat, and MODIS with information from reanalysis and an aerosol transport model. With CALIOP observations of aerosol below optically thin clouds and above clouds, co-located with cloud albedo from MODIS, the C3M dataset allows a detailed exploration of observational uncertainties. By perturbing the aerosol properties used and comparing radiative effects in perturbed cases with the base case we characterize uncertainties in estimated aerosol DRE due to uncertainties in the aerosol properties involved. The results also provide a basis for determining measurement requirements to improve the accuracy of DRE estimates. We will describe the approach and present results.

Dave Winker↗

Uncertainty and Sensitivity Analyses of a Two-Parameter Impedance Prediction Model

This paper presents comparisons of predicted impedance uncertainty limits derived from Monte-Carlo-type simulations with a Two-Parameter (TP) impedance prediction model and measured impedance uncertainty limits based on multiple tests acquired in NASA Langley test rigs. These predicted and measured impedance uncertainty limits are used to evaluate the effects of simultaneous randomization of each input parameter for the impedance prediction and measurement processes. A sensitivity analysis is then used to further evaluate the TP prediction model by varying its input parameters on an individual basis. The variation imposed on the input parameters is based on measurements conducted with multiple tests in the NASA Langley normal incidence and grazing incidence impedance tubes; thus, the input parameters are assigned uncertainties commensurate with those of the measured data. These same measured data are used with the NASA Langley impedance measurement (eduction) processes to determine the corresponding measured impedance uncertainty limits, such that the predicted and measured impedance uncertainty limits (95% confidence intervals) can be compared. The measured reactance 95% confidence intervals encompass the corresponding predicted reactance confidence intervals over the frequency range of interest. The same is true for the confidence intervals of the measured and predicted resistance at near-resonance frequencies, but the predicted resistance confidence intervals are lower than the measured resistance confidence intervals (no overlap) at frequencies away from resonance. A sensitivity analysis indicates the discharge coefficient uncertainty is the major contributor to uncertainty in the predicted impedances for the perforate-over-honeycomb liner used in this study. This insight regarding the relative importance of each input parameter will be used to guide the design of experiments with test rigs currently being brought on-line at NASA Langley.

Jones, M. G.↗

The Use of Satellite-Measured Aerosol Optical Depth to Constrain Biomass Burning Emissions Source Strength in a Global Model GOCART

Small particles in the atmosphere, called "atmospheric aerosol" have a direct effect on Earth climate through scattering and absorbing sunlight, and also an indirect effect by changing the properties of clouds, as they interact with solar radiation as well. Aerosol typically stays in the atmosphere for several days, and can be transported long distances, affecting air quality, visibility, and human health not only near the source, but also far downwind. Smoke from vegetation fires is one of the main sources of atmospheric aerosol; other sources include anthropogenic pollution, dust, and sea salt. Chemistry transport models (CTMs) are among the major tools for studying the atmospheric and climate effects of aerosol. Due to the considerable variation of aerosol concentrations and properties on many temporal and spatial scales, and the complexity of the processes involved, the uncertainties in aerosol effects on climate are large, as is featured in the latest report of Intergovernmental Panel on Climate Change (IPCC) in 2007. Reducing this uncertainty in the models is very important both for predicting future climate scenarios and for regional air quality forecasting and mitigation. During vegetation fires, also called biomass burning (BB) events, complex mixture of gases and particles is emitted. The amount of BB emissions is usually estimated taking into account the intensity and size of the fire and the properties of burning vegetation. These estimates are input into CTMs to simulate BB aerosol. Unfortunately, due to large variability of fire and vegetation properties, the quantity of BB emissions is very difficult to estimate and BB emission inventories provide numbers that can differ by up to the order of magnitude in some regions. Larger uncertainties in data input make uncertainties in model output larger as well. A powerful way to narrow the range of possible model estimates is to compare model output to observations. We use satellite observations of aerosol properties, specifically aerosol optical depth, which is directly proportional to the amount of aerosol in the atmosphere, and compare it to the model output. Assuming the model represents aerosol transport and particle properties correctly, the amount of BB emissions determines the simulated aerosol optical depth. In this study, we explore the regional performance of 13 commonly used emission estimates. These are each input to global Goddard Chemistry Aerosol Radiation and Transport (GOCART) model. We then evaluate how well each emission estimate reproduces the smoke aerosol optical depth measured by the MODIS instrument. We compared GOCART-simulate aerosol optical depth with that measured from the satellite for 124 fire cases around the world during 2006 and 2007. We summarize the regional performance of each emission inventory and discuss reasons for their differences by considering the assumptions made during their development. We also show that because stronger wind disperses smoke plumes more readily, in cases with stronger wind, a larger increase in emission amount is needed to increase aerosol optical depth. In quiet, low-wind-speed environments, BB emissions produce a more significant increase in aerosol optical depth, other things being equal. Using the region-specific, quantitative relationships derived in our paper, together with the wind speed obtained from another source for a given fire case, we can constrain the amount of emission required in the model to reproduce the observations. The results of this paper are useful to the developers of BB emission inventories, as they show the strengths and weaknesses of individual emission inventories in different regions of the globe, and also for modelers who use these inventories and wish to improve their model results.

Petrenko, Mariya↗

Reply to ''Comments on 'Why Hasn't Earth Warmed as much as Expected?'''

In response to our article, Why Hasnt Earth Warmed as Much as Expected? (2010), Knutti and Plattner (2012) wrote a rebuttal. The term climate sensitivity is usually defined as the change in global mean surface temperature that is produced by a specified change in forcing, such as a change in solar heating or greenhouse gas concentrations. We had argued in the 2010 paper that although climate models can reproduce the global mean surface temperature history over the past century, the uncertainties in these models, due primarily to the uncertainty in climate forcing by airborne particles, mean that the models lack the confidence to actually constrain the climate sensitivity within useful limits for climate prediction. Knutti and Plattner are climate modelers, and they argued essentially that because the models could reproduce the surface temperature history, the issue we raised was moot. Our response amounts to straightening out this confusion; for the models to be constraining, they must be able to reproduce the surface temperature history with sufficient confidence, not just to match the measurements, but to exclude alternative histories. As before, we concluded that if we can actually make the aerosol measurements using currently available, state-of-the-art techniques, we can determine the aerosol climate forcing to the degree required to constrain that aspect of model climate sensitivity. A technical issue relating to the timescale over which a change in CO2 emissions would be equilibrated in the environmental energy balance was also discussed, again, a matter of differences in terminology.

Schwartz, Stephen E.↗

Wind Tunnel Testing of the NASA-DFRC Flutterometer using a Two DOF Wing Section

Flutter of an aeroelastic structure is potentially destructive aeroelastic instability. This phenomenon has motivated research within the aeroelastic community to develop methods that can accurately predict aeroelastic instabilities. The Flutterometer method used herein, and as developed by NASA DFRC, is based upon the mu method which has been coupled with wavelet filtering processes in estimating aeroelastic models from flight data. The approach leads to a methodology to predict the occurrence of flutter boundaries, and may prove to reliably predict flutter boundaries during flight tests. An analytical model is used as the first estimate of the aeroelastic structural dynamics, and uncertainty operators are introduced into the system to model variations between the theoretical system and the physical system. The modelling uncertainties are then updated from experimental data. Although the model used did not work well with this particular experiment, a sensitivity analysis was additionally performed and improvements suggested.

Strganac, Thomas W.↗

Analytical model accuracy requirements for structural dynamic systems

A test/analysis correlation criterion for the analytical model accuracy requirement has been developed. It is based on the principle of equal errors from the model inaccuracy and the uncertainties of dynamic environments. The forcing functions are idealized to establish the base for uncertainty definition and the maximum allowable errors from these uncertainties are obtained. Then the model accuracy requirement is established by comparing the responses due to the model errors to those due to the forcing function uncertainties.

Chen, J.-C.↗

A Probabilistic Approach to Model Update

Finite element models are often developed for load validation, structural certification, response predictions, and to study alternate design concepts. In rare occasions, models developed with a nominal set of parameters agree with experimental data without the need to update parameter values. Today, model updating is generally heuristic and often performed by a skilled analyst with in-depth understanding of the model assumptions. Parameter uncertainties play a key role in understanding the model update problem and therefore probabilistic analysis tools, developed for reliability and risk analysis, may be used to incorporate uncertainty in the analysis. In this work, probability analysis (PA) tools are used to aid the parameter update task using experimental data and some basic knowledge of potential error sources. Discussed here is the first application of PA tools to update parameters of a finite element model for a composite wing structure. Static deflection data at six locations are used to update five parameters. It is shown that while prediction of individual response values may not be matched identically, the system response is significantly improved with moderate changes in parameter values.

Horta, Lucas G.↗

Progress in stratospheric hydroxyl measurement by balloon-borne lidar

Knowledge of the concentration of hydroxyl radical is crucial to understanding the chemistry of the stratosphere. Hydroxyl participates in several catalytic cycles which destroy ozone and strongly influences the cycles of chlorine and nitrogen oxides by its reactions which form or destroy reservoirs for chlorine and odd-nitrogen compounds. Measurements have been conducted of the concentration of hydroxyl radical between the altitudes of 32.5 and 38.5 km using the technique of laser-induced fluorescence. The results ranging from 4 to 9 x 10 to the 6th per cu cm (with an accuracy of + or - 50 percent) are about 2-3 times lower than predicted by current one-dimensional models, although the uncertainties in the determination and in the models are sufficiently large to explain the differences. A number of potential improvements to the instrument are discussed.

Heaps, W. S.↗

Parametric robust control and system identification: Unified approach

Despite significant advancement in the area of robust parametric control, the problem of synthesizing such a controller is still a wide open problem. Thus, we attempt to give a solution to this important problem. Our approach captures the parametric uncertainty as an H(sub infinity) unstructured uncertainty so that H(sub infinity) synthesis techniques are applicable. Although the techniques cannot cope with the exact parametric uncertainty, they give a reasonable guideline to model the unstructured uncertainty that contains the parametric uncertainty. An additional loop shaping technique is also introduced to relax its conservatism.

Keel, Leehyun↗

Study of geopotential error models used in orbit determination error analysis

The uncertainty in the geopotential model is currently one of the major error sources in the orbit determination of low-altitude Earth-orbiting spacecraft. The results of an investigation of different geopotential error models and modeling approaches currently used for operational orbit error analysis support at the Goddard Space Flight Center (GSFC) are presented, with emphasis placed on sequential orbit error analysis using a Kalman filtering algorithm. Several geopotential models, known as the Goddard Earth Models (GEMs), were developed and used at GSFC for orbit determination. The errors in the geopotential models arise from the truncation errors that result from the omission of higher order terms (omission errors) and the errors in the spherical harmonic coefficients themselves (commission errors). At GSFC, two error modeling approaches were operationally used to analyze the effects of geopotential uncertainties on the accuracy of spacecraft orbit determination - the lumped error modeling and uncorrelated error modeling. The lumped error modeling approach computes the orbit determination errors on the basis of either the calibrated standard deviations of a geopotential model's coefficients or the weighted difference between two independently derived geopotential models. The uncorrelated error modeling approach treats the errors in the individual spherical harmonic components as uncorrelated error sources and computes the aggregate effect using a combination of individual coefficient effects. This study assesses the reasonableness of the two error modeling approaches in terms of global error distribution characteristics and orbit error analysis results. Specifically, this study presents the global distribution of geopotential acceleration errors for several gravity error models and assesses the orbit determination errors resulting from these error models for three types of spacecraft - the Gamma Ray Observatory, the Ocean Topography Experiment, and the Cosmic Background Explorer.

Yee, C.↗

Performance and Reliability Optimization for Aerospace Systems subject to Uncertainty and Degradation

This report summarizes work performed by the Space Systems Laboratory (SSL) for NASA Langley Research Center in the field of performance optimization for systems subject to uncertainty. The objective of the research is to develop design methods and tools to the aerospace vehicle design process which take into account lifecycle uncertainties. It recognizes that uncertainty between the predictions of integrated models and data collected from the system in its operational environment is unavoidable. Given the presence of uncertainty, the goal of this work is to develop means of identifying critical sources of uncertainty, and to combine these with the analytical tools used with integrated modeling. In this manner, system uncertainty analysis becomes part of the design process, and can motivate redesign. The specific program objectives were: 1. To incorporate uncertainty modeling, propagation and analysis into the integrated (controls, structures, payloads, disturbances, etc.) design process to derive the error bars associated with performance predictions. 2. To apply modern optimization tools to guide in the expenditure of funds in a way that most cost-effectively improves the lifecycle productivity of the system by enhancing the subsystem reliability and redundancy. The results from the second program objective are described. This report describes the work and results for the first objective: uncertainty modeling, propagation, and synthesis with integrated modeling.

Miller, David W.↗

A New Formulation of the Filter-Error Method for Aerodynamic Parameter Estimation in Turbulence

A new formulation of the filter-error method for estimating aerodynamic parameters in nonlinear aircraft dynamic models during turbulence was developed and demonstrated. The approach uses an estimate of the measurement noise covariance to identify the model parameters, their uncertainties, and the process noise covariance, in a relaxation method analogous to the output-error method. Prior information on the model parameters and uncertainties can be supplied, and a post-estimation correction to the uncertainty was included to account for colored residuals not considered in the theory. No tuning parameters, needing adjustment by the analyst, are used in the estimation. The method was demonstrated in simulation using the NASA Generic Transport Model, then applied to the subscale T-2 jet-engine transport aircraft flight. Modeling results in different levels of turbulence were compared with results from time-domain output error and frequency- domain equation error methods to demonstrate the effectiveness of the approach.

Grauer, Jared A.↗

The Agricultural Model Intercomparison and Improvement Project (AgMIP): Protocols and Pilot Studies

The Agricultural Model Intercomparison and Improvement Project (AgMIP) is a major international effort linking the climate, crop, and economic modeling communities with cutting-edge information technology to produce improved crop and economic models and the next generation of climate impact projections for the agricultural sector. The goals of AgMIP are to improve substantially the characterization of world food security due to climate change and to enhance adaptation capacity in both developing and developed countries. Analyses of the agricultural impacts of climate variability and change require a transdisciplinary effort to consistently link state-of-the-art climate scenarios to crop and economic models. Crop model outputs are aggregated as inputs to regional and global economic models to determine regional vulnerabilities, changes in comparative advantage, price effects, and potential adaptation strategies in the agricultural sector. Climate, Crop Modeling, Economics, and Information Technology Team Protocols are presented to guide coordinated climate, crop modeling, economics, and information technology research activities around the world, along with AgMIP Cross-Cutting Themes that address uncertainty, aggregation and scaling, and the development of Representative Agricultural Pathways (RAPs) to enable testing of climate change adaptations in the context of other regional and global trends. The organization of research activities by geographic region and specific crops is described, along with project milestones. Pilot results demonstrate AgMIP's role in assessing climate impacts with explicit representation of uncertainties in climate scenarios and simulations using crop and economic models. An intercomparison of wheat model simulations near Obregón, Mexico reveals inter-model differences in yield sensitivity to [CO2] with model uncertainty holding approximately steady as concentrations rise, while uncertainty related to choice of crop model increases with rising temperatures. Wheat model simulations with midcentury climate scenarios project a slight decline in absolute yields that is more sensitive to selection of crop model than to global climate model, emissions scenario, or climate scenario downscaling method. A comparison of regional and national-scale economic simulations finds a large sensitivity of projected yield changes to the simulations' resolved scales. Finally, a global economic model intercomparison example demonstrates that improvements in the understanding of agriculture futures arise from integration of the range of uncertainty in crop, climate, and economic modeling results in multi-model assessments.

Rosenzweig, C.↗

Overview of Large-scale Tropospheric Transport in the Chemistry Climate Model Initiative (CCMI) Simulations

The transport of chemicals is a major uncertainty in the modeling of tropospheric composition. Here we compare the large-scale tropospheric transport properties among different models in the Chemistry Climate Modeling Initiative (CCMI) with a focus on transport defined with respect to the Northern Hemisphere (NH) midlatitude surface. Among simulations of the recent past (1980-2010) we show that there are substantial differences in their global-scale tropospheric transport properties. For example, the mean transit time since southern hemisphere air last contacted the NH midlatitude surface differs by ~30-40% among simulations. We show that these differences are most likely associated with differences in parameterized convection over the oceans, such that the spread in transport among simulations constrained with analysis fields is as large as the spread among free-running simulations.

large-scale tropospheric transport↗

Desensitizing structural-control design

A new method for targeted robustness optimization is presented. This method allows the analyst to 'target' the most critical performance parameter (or family of design requirements with almost the same criticality) for enhanced protection from uncertainties in the model. To create this protection, this method uses knowledge about the uncertainties in some of the parameters of the model - this information is usually available to the structural analyst. The power of the targeted robustness method is demonstrated numerically using an active damping example. The results show that the most critical damping ratio is protected - its sensitivity to the uncertainties is far below those of non-critical damping ratios.

Ponslet, E.↗

Quantifying Uncertainty in Projections of Stratospheric Ozone Over the 21st Century

Future stratospheric ozone concentrations will be determined both by changes in the concentration of ozone depleting substances (ODSs) and by changes in stratospheric and tropospheric climate, including those caused by changes in anthropogenic greenhouse gases (GHGs). Since future economic development pathways and resultant emissions of GHGs are uncertain, anthropogenic climate change could be a significant source of uncertainty for future projections of stratospheric ozone. In this pilot study, using an ensemble of opportunity of chemistry-climate model (CCM) simulations, the contribution of scenario uncertainty from different plausible emissions pathways for 10 ODSs and GHGs to future ozone projections is quantified relative to the contribution from model uncertainty and internal variability of the chemistry-climate system. For both the global, annual mean ozone concentration and for ozone in specific geographical regions, differences between CCMs are the dominant source of uncertainty for the first two-thirds of the 21 st century, up-to and after the time when ozone concentrations 15 return to 1980 values. In the last third of the 21st century, dependent upon the set of greenhouse gas scenarios used, scenario uncertainty can be the dominant contributor. This result suggests that investment in chemistry-climate modelling is likely to continue to refine projections of stratospheric ozone and estimates of the return of stratospheric ozone concentrations to pre-1980 levels.

Charlton-Perez, A. J.↗