Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “forecast error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Stratospheric Assimilation of Chemical Tracer Observations Using a Kalman Filter: Chi-Square Validated Results and Analysis of Variance and Correlation Dynamics - Pt. 2

A Kalman filter system designed for the assimilation of limb-sounding observations of stratospheric chemical tracers, which has four tunable covariance parameters, was developed in Part I (Menard et al. 1998) The assimilation results of CH4 observations from the Cryogenic Limb Array Etalon Sounder instrument (CLAES) and the Halogen Observation Experiment instrument (HALOE) on board of the Upper Atmosphere Research Satellite are described in this paper. A robust (chi)(sup 2) criterion, which provides a statistical validation of the forecast and observational error covariances, was used to estimate the tunable variance parameters of the system. In particular, an estimate of the model error variance was obtained. The effect of model error on the forecast error variance became critical after only three days of assimilation of CLAES observations, although it took 14 days of forecast to double the initial error variance. We further found that the model error due to numerical discretization as arising in the standard Kalman filter algorithm, is comparable in size to the physical model error due to wind and transport modeling errors together. Separate assimilations of CLAES and HALOE observations were compared to validate the state estimate away from the observed locations. A wave-breaking event that took place several thousands of kilometers away from the HALOE observation locations was well captured by the Kalman filter due to highly anisotropic forecast error correlations. The forecast error correlation in the assimilation of the CLAES observations was found to have a structure similar to that in pure forecast mode except for smaller length scales. Finally, we have conducted an analysis of the variance and correlation dynamics to determine their relative importance in chemical tracer assimilation problems. Results show that the optimality of a tracer assimilation system depends, for the most part, on having flow-dependent error correlation rather than on evolving the error variance.

Menard, Richard↗

Sensitivity of Lower Stratospheric Assimilated Ozone on Error Covariance Modeling and Data Selection

Assimilated ozone is produced at the NASA/Goddard Data Assimilation Office by blending ozone retrieved from the Solar Backscatter UltraViolet/2 (SBUV/2) instrument and the Earth Probe Total Ozone Mapping Spectrometer (EP TOMS) measurements into an off-line transport model. The current system tends to overestimate the amount of lower stratospheric ozone. This is a region where ozone plays a key role in the forcing of climate. A biased ozone field in this region will adversely impact calculations of the stratosphere-troposphere exchange and, when used as a first guess in retrievals, the values determined from satellite observations. Since these are all important applications of assimilated ozone products, effort is being directed towards reducing this bias. The SBUV ozone data have a coarse vertical resolution with increased uncertainty below the ozone maximum, and TOMS provides only total ozone columns. Thus, the assimilated ozone in the lower stratosphere, and its vertical distribution in particular, are only weakly constrained by the incoming SBUV and TOMS data. Consequently, the assimilated ozone distribution should be sensitive to changes in inputs to the statistical analysis scheme. Accordingly, the sensitivity of the assimilated lower stratospheric ozone fields to changes in the TOMS error-covariance modeling and the SBUV data selection has been investigated. The use of a spatially correlated TOMS error covariance model led to improvements in the product. However, withholding the SBUV/2 data for the layer between 63 and 126 hPa typically degraded the product, a result which vindicates the use of this layer ozone product, despite its known errors. These efforts to improve the lower stratospheric distribution will be extended to include a more advanced forecast error covariance model, and by assimilating ozone products from new instruments on Envisat and EOS Aura.

Stajner, Ivanka↗

Adjoint Estimation of Observation Impact Explored with an Observing System Simulation Experiment

In an Observing System Simulation Experiment, the full, true state of the simulated atmosphere is known. This knowledge allows the direct calculation of analysis and forecast errors, and also may be used in conjunction with an adjoint tool to calculate metrics that are unachievable in the real world. For example, the errors that result from the use of the analysis state as verification when running adjoint calculations of observation impact on a forecast can be quantified. The adjoint itself can also be used to operate on the analysis state rather than on the forecast state. Results from these and other adjoint experiments using the NASA/GMAO OSSE framework will be presented.

Prive, Nikki↗

Multivariate Error Covariance Estimates by Monte-Carlo Simulation for Assimilation Studies in the Pacific Ocean

One of the most difficult aspects of ocean state estimation is the prescription of the model forecast error covariances. The paucity of ocean observations limits our ability to estimate the covariance structures from model-observation differences. In most practical applications, simple covariances are usually prescribed. Rarely are cross-covariances between different model variables used. Here a comparison is made between a univariate Optimal Interpolation (UOI) scheme and a multivariate OI algorithm (MvOI) in the assimilation of ocean temperature. In the UOI case only temperature is updated using a Gaussian covariance function and in the MvOI salinity, zonal and meridional velocities as well as temperature, are updated using an empirically estimated multivariate covariance matrix. Earlier studies have shown that a univariate OI has a detrimental effect on the salinity and velocity fields of the model. Apparently, in a sequential framework it is important to analyze temperature and salinity together. For the MvOI an estimation of the model error statistics is made by Monte-Carlo techniques from an ensemble of model integrations. An important advantage of using an ensemble of ocean states is that it provides a natural way to estimate cross-covariances between the fields of different physical variables constituting the model state vector, at the same time incorporating the model's dynamical and thermodynamical constraints as well as the effects of physical boundaries. Only temperature observations from the Tropical Atmosphere-Ocean array have been assimilated in this study. In order to investigate the efficacy of the multivariate scheme two data assimilation experiments are validated with a large independent set of recently published subsurface observations of salinity, zonal velocity and temperature. For reference, a third control run with no data assimilation is used to check how the data assimilation affects systematic model errors. While the performance of the UOI and MvOI is similar with respect to the temperature field, the salinity and velocity fields are greatly improved when multivariate correction is used, as evident from the analyses of the rms differences of these fields and independent observations. The MvOI assimilation is found to improve upon the control run in generating the water masses with properties close to the observed, while the UOI failed to maintain the temperature and salinity structure.

Borovikov, Anna↗

The impact of satellite soundings and their distribution on forecast accuracy

The impact of satellite data is found to vary considerably from one map to another and from one geographic region to another. However, the impact of satellite data is generally small in comparison with forecast error. On the average, over land areas (where good conventional data permit accurate verification), the impact of satellite data on 48-hr forecasts of 500-mb height is seen to be neutral. Indirect numerical evidence is found, however, that satellite data has a marked positive impact in the lower and middle troposphere in ocean regions, especially those regions where conventional data are sparse. The impact over oceans is found to be especially noticeable in maps depicting the mean differences between the satellite and the conventional-data-only maps averaged over the period of the data set (January 1-14, 1980), both for analyses and for forecasts to 48 hours.

Thomasell, A., Jr.↗

An assessment of the FGGE satellite observing system during SOP-1

The sensitivity of a Goddard Laboratory for Atmospheric Sciences global objective analysis cycle to the addition of FGGE level II-b data is assessed. The GOAS system comprises a predictive continuity provided by a model first-guess forecast integrated from a previous forecast and updated by data gathered in the interim. FGGE data originated in the Jan.-Mar. 1979 period and were acquired by rawinsondes, pilot balloons, surface stations, satellites, ships, and drifting buoys deployed during SOP-1. Focussing on 2-5 and 8-day forecasts, comparisons were made of the 6 hr forecast error at the 300 mb height in three experiments using all, no-satellite (NOSAT), and without rawinsondes or pilot balloons modes. Larger errors occurred in the case of NOSAT, while significant corrections to the GOAS predictions were noted using all the FGGE data. It was concluded that all forecasts were improved by inclusion of full FGGE data sets, including forecasting beyond one week.

Halem, M.↗

Background Error Covariance Estimation Using Information from a Single Model Trajectory with Application to Ocean Data Assimilation

An attractive property of ensemble data assimilation methods is that they provide flow dependent background error covariance estimates which can be used to update fields of observed variables as well as fields of unobserved model variables. Two methods to estimate background error covariances are introduced which share the above property with ensemble data assimilation methods but do not involve the integration of multiple model trajectories. Instead, all the necessary covariance information is obtained from a single model integration. The Space Adaptive Forecast error Estimation (SAFE) algorithm estimates error covariances from the spatial distribution of model variables within a single state vector. The Flow Adaptive error Statistics from a Time series (FAST) method constructs an ensemble sampled from a moving window along a model trajectory.SAFE and FAST are applied to the assimilation of Argo temperature profiles into version 4.1 of the Modular Ocean Model (MOM4.1) coupled to the GEOS-5 atmospheric model and to the CICE sea ice model. The results are validated against unassimilated Argo salinity data. They show that SAFE and FAST are competitive with the ensemble optimal interpolation (EnOI) used by the Global Modeling and Assimilation Office (GMAO) to produce its ocean analysis. Because of their reduced cost, SAFE and FAST hold promise for high-resolution data assimilation applications.

Error Covariance↗

Background Error Covariance Estimation using Information from a Single Model Trajectory with Application to Ocean Data Assimilation into the GEOS-5 Coupled Model

An attractive property of ensemble data assimilation methods is that they provide flow dependent background error covariance estimates which can be used to update fields of observed variables as well as fields of unobserved model variables. Two methods to estimate background error covariances are introduced which share the above property with ensemble data assimilation methods but do not involve the integration of multiple model trajectories. Instead, all the necessary covariance information is obtained from a single model integration. The Space Adaptive Forecast error Estimation (SAFE) algorithm estimates error covariances from the spatial distribution of model variables within a single state vector. The Flow Adaptive error Statistics from a Time series (FAST) method constructs an ensemble sampled from a moving window along a model trajectory. SAFE and FAST are applied to the assimilation of Argo temperature profiles into version 4.1 of the Modular Ocean Model (MOM4.1) coupled to the GEOS-5 atmospheric model and to the CICE sea ice model. The results are validated against unassimilated Argo salinity data. They show that SAFE and FAST are competitive with the ensemble optimal interpolation (EnOI) used by the Global Modeling and Assimilation Office (GMAO) to produce its ocean analysis. Because of their reduced cost, SAFE and FAST hold promise for high-resolution data assimilation applications.

Data Assimilation↗

Future possibilities in objective analysis and data assimilation for atmospheric dynamics

The role that dynamics plays in estimating the state of the atmosphere from incomplete and noisy data is reviewed. Objective analysis represents an attempt at relying mostly on the data and minimizing the role of dynamics in the estimation. Data assimilation tries to balance properly the roles of dynamical and observational information. Sequential estimation is presented as the proper framework for understanding this balance, and the Kalman filter as the ideal, optimal procedure for data assimilation. The optimal filter computes forecast error covariances of a given atmospheric model exactly, and hence data assimilation should be closely connected with predictability studies. This connection is described, and consequences drawn for currently active areas of the atmospheric and related sciences, namely, mesoscale meteorology, long range forecasting, and upper ocean dynamics. Possibilities offered by judicious data assimilation in understanding barotropic adjustment, a phenomenon that appears to play a crucial role in atmospheric behavior on the scale of weeks to months, and hence in long range forecasting are addressed.

Ghil, M.↗

Three CA-Related Covariance Issues and Their Solutions

This presentation addresses three issues that arise in the use of DoD-produced satellite state estimate covariances in the conjunction assessment process: the realism of the provided covariances, how to address correlated error between two satellites' covariance matrices, and how to proceed when a furnished covariance is non-positive-definite. To address the first, DoD has implemented a set of two "consider parameters" with which to alter/expand the covariance to account for atmospheric density forecast error and satellite frontal area uncertainty, the two largest sources of unmodeled position prediction error for LEO orbits; these values are governed by a satellite's orbital parameters and ballistic coefficient histories, as well as the current and predicted space weather situation. This approach substantially improves the realism of the covariance by accounting for expected prediction errors that are not part of the fit process that generates the covariance. The second issue of covariance correlation is a complicated one, but the main shared error source—global atmospheric density error that is common to both satellites can be characterized and, through sensitivity vectors, quantified at the conjunction's time of closest approach and removed from the joint covariance, which is used in the CA probability of collision (Pc) calculation. Finally, while according to the orbit determination theory a non-positive-definite (NPD) covariance is not possible, numerical truncation and covariance interpolation can conspire to produce NPD results, which render the covariance unusable for certain CA risk assessment calculations, such as Monte Carlo Pc determination. Three similar techniques are profiled and the simplest of them recommended as a reasonable remediation technique when NPD covariances are encountered by CA practitioners.

Dynamic Consider Parameter↗

Sequential estimation and satellite data assimilation in meteorology and oceanography

The central theme of this review article is the role that dynamics plays in estimating the state of the atmosphere and of the ocean from incomplete and noisy data. Objective analysis and inverse methods represent an attempt at relying mostly on the data and minimizing the role of dynamics in the estimation. Four-dimensional data assimilation tries to balance properly the roles of dynamical and observational information. Sequential estimation is presented as the proper framework for understanding this balance, and the Kalman filter as the ideal, optimal procedure for data assimilation. The optimal filter computes forecast error covariances of a given atmospheric or oceanic model exactly, and hence data assimilation should be closely connected with predictability studies. This connection is described, and consequences drawn for currently active areas of the atmospheric and oceanic sciences, namely, mesoscale meteorology, medium and long-range forecasting, and upper-ocean dynamics.

Ghil, M.↗

Some economic benefits of a synchronous earth observatory satellite

An analysis was made of the economic benefits which might be derived from reduced forecasting errors made possible by data obtained from a synchronous satellite system which can collect earth observation and meteorological data continuously and on demand. User costs directly associated with achieving benefits are included. In the analysis, benefits were evaluated which might be obtained as a result of improved thunderstorm forecasting, frost warning, and grain harvest forecasting capabilities. The anticipated system capabilities were used to arrive at realistic estimates of system performance on which to base the benefit analysis. Emphasis was placed on the benefits which result from system forecasting accuracies. Benefits from improved thunderstorm forecasts are indicated for the construction, air transportation, and agricultural industries. The effects of improved frost warning capability on the citrus crop are determined. The benefits from improved grain forecasting capability are evaluated in terms of both U.S. benefits resulting from domestic grain distribution and U.S. benefits from international grain distribution.

Battacharyya, R. K.↗

The effect of horizontal resolution on systematic errors of the GLA forecast model

Systematic prediction errors of the Goddard Laboratory for Atmospheres (GLA) forecast system are reduced when the higher-resolution (2 x 2.5 deg) model version is used. Based on a budget analysis of the 200-mb eddy streamfunction, the improvement of stationary eddy forecasting is seen to be caused by the following mechanism: by increasing the horizontal spatial resolution of the forecast model, atmospheric diabatic heating over the three tropical continents is changed in a way that intensifies the planetary-scale divergent circulations associated with the three pairs of divergent-convergent centers over these continents. The intensified divergent circulation results in an enhancement of vorticity sources in the Northern Hemisphere. The additional vorticity is advected eastward by a stationary wave train along 30 deg N, thereby reducing systematic errors in the lower-resolution (4 x 5 deg) GLA model.

Chen, Tsing-Chang↗

A Comparative Study of Interval Management Control Law Capabilities

This paper presents a new tool designed to allow for rapid development and testing of different control algorithms for airborne spacing. This tool, Interval Management Modeling and Spacing Tool (IM MAST), is a fast-time, low-fidelity tool created to model the approach of aircraft to a runway, with a focus on their interactions with each other. Errors can be induced between pairs of aircraft by varying initial positions, winds, speed profiles, and altitude profiles. Results to-date show that only a few of the algorithms tested had poor behavior in the arrival and approach environment. The majority of the algorithms showed only minimal variation in performance under the test conditions. Trajectory-based algorithms showed high susceptibility to wind forecast errors, while performing marginally better than the other algorithms under other conditions. Trajectory-based algorithms have a sizable advantage, however, of being able to perform relative spacing operations between aircraft on different arrival routes and flight profiles without employing ghosting. methods. This comes at the higher cost of substantially increased complexity, however. Additionally, it was shown that earlier initiation of relative spacing operations provided more time for corrections to be made without any significant problems in the spacing operation itself. Initiating spacing farther out, however, would require more of the aircraft to begin spacing before they merge onto a common route.

Barmore, Bryan E.↗

Analysis and Forecast of Two Storms Characterized by Extreme Deepening Rates

Between 25 and 27 December 1999 two very intense cyclones, named Lothar and Martin, swept across northern and western France causing substantial life and property loss. In this work, the finite volume general circulation model and data assimilation system (fvDAS) developed at the Data Assimilation Office of the NASA Goddard Space and Flight Center is being used to investigate these storms. In the first part of this article the dynamics of the storms is analyzed, and some important mechanisms are unveiled. The second part describes a set of eleven data assimilation experiments to study the impact of different data types on the automated analyses. Cloud-track winds provided by EUMETSAT and surface winds from QuikSCAT are being used. These data are assimilated with a range of different parameter settings of the forecast error covariance model. The results show that generally the additional wind data set have positive impacts on the analyses: particularly, the analysis of Lothar can be slightly improved by using the Eumetsat winds, and the analysis of Martin can be strongly improved by using the full-resolution QuikSCAT winds with a more localized influence. The third part of this article is focused on the forecast of Lothar which is very well predicted in the 1-5 day range by the fvDAS system.

Reale, Oreste↗

Monthly mean forecast experiments with the GISS model

The GISS general circulation model was used to compute global monthly mean forecasts for January 1973, 1974, and 1975 from initial conditions on the first day of each month and constant sea surface temperatures. Forecasts were evaluated in terms of global and hemispheric energetics, zonally averaged meridional and vertical profiles, forecast error statistics, and monthly mean synoptic fields. Although it generated a realistic mean meridional structure, the model did not adequately reproduce the observed interannual variations in the large scale monthly mean energetics and zonally averaged circulation. The monthly mean sea level pressure field was not predicted satisfactorily, but annual changes in the Icelandic low were simulated. The impact of temporal sea surface temperature variations on the forecasts was investigated by comparing two parallel forecasts for January 1974, one using climatological ocean temperatures and the other observed daily ocean temperatures. The use of daily updated sea surface temperatures produced no discernible beneficial effect.

Spar, J.↗

The Role of Model and Initial Condition Error in Numerical Weather Forecasting Investigated with an Observing System Simulation Experiment

A series of experiments that explore the roles of model and initial condition error in numerical weather prediction are performed using an observing system simulation experiment (OSSE) framework developed at the National Aeronautics and Space Administration Global Modeling and Assimilation Office (NASA/GMAO). The use of an OSSE allows the analysis and forecast errors to be explicitly calculated, and different hypothetical observing networks can be tested with ease. In these experiments, both a full global OSSE framework and an 'identical twin' OSSE setup are utilized to compare the behavior of the data assimilation system and evolution of forecast skill with and without model error. The initial condition error is manipulated by varying the distribution and quality of the observing network and the magnitude of observation errors. The results show that model error has a strong impact on both the quality of the analysis field and the evolution of forecast skill, including both systematic and unsystematic model error components. With a realistic observing network, the analysis state retains a significant quantity of error due to systematic model error. If errors of the analysis state are minimized, model error acts to rapidly degrade forecast skill during the first 24-48 hours of forward integration. In the presence of model error, the impact of observation errors on forecast skill is small, but in the absence of model error, observation errors cause a substantial degradation of the skill of medium range forecasts.

Model Error↗

A Variable Resolution Stretched Grid Data Assimilation System for Regional Studies and Applications

The variable resolution stretched grid (SG) version of the Goddard Earth Observing System (GEOS) Data Assimilation System (DAS) incorporating the GEOS SG-GCM, has been developed and tested. The area/region of interest used in experiments is a rectangle over the U.S. with -60 km horizontal resolution and 70 layers extending from the surface to 0.1 hPa. The forecast error statistics has been reassessed for finer regional resolution. The experiments are performed for winter and summer seasons. The SG-GCM and SG-DAS experiments show that a definite down-scaling takes place over the area of interest. The SG-DAS is capable of reproducing regional mesoscale patterns and diagnostics that are not produced by coarser uniform resolution runs. The SG-DAS fields and diagnostics are used for regional forecasting, new instrument impact studies, and for validation of regional climate simulation experiments.

Fox-Rabinovitz, Michael S.↗