Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “forecast error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Evaluation of Near-Surface Air Temperature from Reanalysis over the United States and Ukraine: Application to Winter Wheat Yield Forecasting

In this work we evaluate the near-surface air temperature datasets from the ERA-Interim, JRA55, MERRA2, NCEP1, and NCEP2 reanalysis projects. Reanalysis data were first compared to observations from weather stations located on wheat areas of the United States and Ukraine, and then evaluated in the context of a winter wheat yield forecast model. Results from the comparison with weather station data showed that all datasets performed well (r2>0.95) and that more modern reanalysis such as ERAI had lower errors (RMSD ~ 0.9) than the older, lower resolution datasets like NCEP1 (RMSD ~ 2.4). We also analyze the impact of using surface air temperature data from different reanalysis products on the estimations made by a winter wheat yield forecast model. The forecast model uses information of the accumulated Growing Degree Day (GDD) during the growing season to estimate the peak NDVI signal. When the temperature data from the different reanalysis projects were used in the yield model to compute the accumulated GDD and forecast the winter wheat yield, the results showed smaller variations between obtained values, with differences in yield forecast error of around 2% in the most extreme case. These results suggest that the impact of temperature discrepancies between datasets in the yield forecast model get diminished as the values are accumulated through the growing season.

GSOD↗

Biases and nonsystematic errors in NMC MRF predictions of momentum and zonal winds

The period of study considered by Rosen et al. (1987) for M forecasts is extended and the source of errors in these forecasts is examined. Time series of daily values of MRF forecasted minus the observed M are presented for forecast lead times of 2, 5, and 10 days from December 1985 through November 1988. A graph is presented of the covariance between errors in the angular momentum per unit mass forecasted at a 10-day lag, and those in the forecasted global angular momentum for the same period.

Rosen, Richard D.↗

Tropical Pacific moisture variability

The objectives are to describe synoptic scale variability of moisture over the tropical Pacific Ocean and the systems leading to this variability; implement satellite analysis procedures in support of this effort, and to incorporate additional satellite information into operational analysis forecast systems at the National Meteorological Center (NMC). Composite satellite radiance patterns describe features detectable well before the development of synoptic scale tropical plumes. These typical features were extracted from historical files of Tiros Operational Vertical Sounder (TOVS) radiance observations for a pair of tropical plumes which developed during January 1989. Signals were inserted into the NMC operational medium range forecast model and a suite of model integrations were conducted. Many of the 48 h model errors of the historical forecasts were eliminated by the inclusion of more complete satellite observations. Three studies in satellite radiance analysis progressed. An analysis which blended TOVS moisture channels, OLR observations and European Center for Medium Weather Forecasts (ECMWF) model analysis to generate fields of total precipitable water comparable to those estimated from Scanning Multichannel Microwave Radiometer (SMMR) mu-wave observations. This study demonstrated that a 10 y climatology of precipitable water over the oceans is feasible, using available infrared observations (OLR and TOVS) and model analysis (ECMWF, NMC or similar quality). The estimates are sensitive to model quality and the estimating model must be updated with operational model changes. Coe developed a set of tropical plume and ITCZ composites from TOVS observations, and from NMC and ECMWF analyses which had been passed through a radiative transfer model to simulate TOVS radiances. The composites have been completed as well as many statistical diagnostics of individual TOVS channels. Analysis of the computations is commencing. Chung has initiated a study of the differences between TOVS observed vapor structure during El Nino Southern Oscillation (ENSO) (1983) and non-ENSO (1984) years. Preliminary diagnosis demonstrates gross moisture changes between warm and cold sea surface temperature episodes.

Mcguirk, James P.↗

Evaluating GXS Impact in the Context of International Coordination

The proposed NOAA/NASA Geostationary eXtended Observations (GeoXO) program plans to include a hyperspectral infrared (IR) sounder on its central satellite. Expected to launch in the mid-2030s, the GeoXO Sounder (GXS) will join international counterparts in a geostationary orbit. Ahead of launch, the NASA Global Modeling and Assimilation Office (GMAO) assessed the potential effectiveness of GXS both as a single GEO IR sounder and as part of a global ring of such instruments, including those already being built by international agencies. Using an observing system simulation experiment (OSSE) framework, GXS was assessed from a global numerical weather prediction (NWP) perspective. The ability of GXS, both alone and as part of a global ring of GEO sounders, to improve weather prediction of thermodynamic variables was evaluated globally and regionally. Compared to a control, GXS dominated regional analysis and forecast improvements, and contributed significantly to global increases in forecast skill. However, more sustained global improvements on the order of 4 days rely on international partnerships. Using the FSOI metric over CONUS, the GXS observations provide the strongest radiance impact on the moist energy error norm reduction. Additionally, GXS shows the capability to improve hurricane forecast track errors, resulting in improved forecast warnings. Overall, the persistent atmospheric profile information from GXS over much of the western hemisphere provide an opportunity to improve the representation of weather systems and their forecasts.

Erica McGrath-Spangler↗

Evaluating the Impact of Geostationary Sounders in the Context of International Coordination

The proposed NOAA/NASA Geostationary eXtended Observations (GeoXO) program plans to include a hyperspectral infrared (IR) sounder (GXS) on its central satellite, joining international counterparts. Ahead of launch, the NASA Global Modeling and Assimilation Office (GMAO) assessed the potential effectiveness of GXS both as a lone sounder in a GEO orbit and as part of a global ring of such instruments. Using an observing system simulation experiment (OSSE) framework from a global numerical weather prediction (NWP) perspective, the ability of GXS and the global ring to improve weather prediction of thermodynamic variables was assessed both globally and regionally. GXS dominated regional analysis and forecast improvements and contributed significantly to global increases in forecast skill. However, more sustained global improvements on the order of 4 days rely on international partnerships. Over CONUS, the FSOI metric showed the GXS observations provide the strongest radiance impact on the moist energy error norm reduction. Additionally, GXS shows the capability to improve hurricane forecast track errors, resulting in improved forecast warnings. Overall, the persistent atmospheric profile information from GXS over much of the western hemisphere provide an opportunity to improve the representation of weather systems and their forecasts.

Erica L. McGrath-Spangler↗

Evaluating the Impact of Geostationary Sounders in the Context of International Coordination

The proposed NOAA/NASA Geostationary eXtended Observations (GeoXO) program plans to include a hyperspectral infrared (IR) sounder (GXS) on its central satellite, joining international counterparts. Ahead of launch, the NASA Global Modeling and Assimilation Office (GMAO) assessed the potential effectiveness of GXS both as a lone sounder in a GEO orbit and as part of a global ring of such instruments. Using an observing system simulation experiment (OSSE) framework from a global numerical weather prediction (NWP) perspective, the ability of GXS and the global ring to improve weather prediction of thermodynamic variables was assessed both globally and regionally. GXS dominated regional analysis and forecast improvements and contributed significantly to global increases in forecast skill. However, more sustained global improvements on the order of 4 days rely on international partnerships. Over CONUS, the FSOI metric showed the GXS observations provide the strongest radiance impact on the moist energy error norm reduction. Additionally, GXS shows the capability to improve hurricane forecast track errors, resulting in improved forecast warnings. Overall, the persistent atmospheric profile information from GXS over much of the western hemisphere provide an opportunity to improve the representation of weather systems and their forecasts.

Erica McGrath-Spangler↗

Evaluating GXS Impact in the Context of International Coordination

The proposed NOAA/NASA Geostationary eXtended Observations (GeoXO) program plans to include a hyperspectral infrared (IR) sounder on its central satellite. Expected to launch in the mid-2030s, the GeoXO Sounder (GXS) will join international counterparts in a geostationary orbit. Ahead of launch, the NASA Global Modeling and Assimilation Office (GMAO) assessed the potential effectiveness of GXS both as a single GEO IR sounder and as part of a global ring of such instruments, including those already being built by international agencies. Using an observing system simulation experiment (OSSE) framework, GXS was assessed from a global numerical weather prediction (NWP) perspective. The ability of GXS, both alone and as part of a global ring of GEO sounders, to improve weather prediction of thermodynamic variables was evaluated globally and regionally. Compared to a control, GXS dominated regional analysis and forecast improvements, and contributed significantly to global increases in forecast skill. However, more sustained global improvements on the order of 4 days rely on international partnerships. Using the FSOI metric over CONUS, the GXS observations provide the strongest radiance impact on the moist energy error norm reduction. Additionally, GXS shows the capability to improve hurricane forecast track errors, resulting in improved forecast warnings. Overall, the persistent atmospheric profile information from GXS over much of the western hemisphere provide an opportunity to improve the representation of weather systems and their forecasts.

Erica McGrath-Spangler↗

Development, Validation, and Application of OSSEs at NASA-GMAO

The GMAO OSSE framework has two general classes of applications. One is to estimate the potential improvements to weather forecasting and analysis by using new proposed instruments that are not as yet built or deployed. This exploits the simulated nature of the OSSE. The other is to assess various aspects of the GMAO data assimilation system. This exploits the availability of truth provided by the OSSE. Two examples of the first class of application will be offered. One concerns deployment of constellations of passive MW sounders on small CUBESATs placed in very low orbits. The other concern is increasing the frequency of radiosonde observations to 4-times daily at all current stations. Several examples of the second class will also be presented. One is an estimation of analysis error characteristics. Another is a comparison between covariances directly determined from explicitly known background errors and those estimated by computing differences between lagged forecasts using the NMC-method prior to tuning. A third is a comparison of effects of model and observation errors on analysis and forecast skill. The last is an examination of spectra of forecast errors in a study of predictability. This latter is an ongoing study.

OSSE↗

A New Eddy Dissipation Rate Formulation for the Terminal Area PBL Prediction System(TAPPS)

The TAPPS employs the MASS model to produce mesoscale atmospheric simulations in support of the Wake Vortex project at Dallas Fort-Worth International Airport (DFW). A post-processing scheme uses the simulated three-dimensional atmospheric characteristics in the planetary boundary layer (PBL) to calculate the turbulence quantities most important to the dissipation of vortices: turbulent kinetic energy and eddy dissipation rate. TAPPS will ultimately be employed to enhance terminal area productivity by providing weather forecasts for the Aircraft Vortex Spacing System (AVOSS). The post-processing scheme utilizes experimental data and similarity theory to determine the turbulence quantities from the simulated horizontal wind field and stability characteristics of the atmosphere. Characteristic PBL quantities important to these calculations are determined based on formulations from the Blackadar PBL parameterization, which is regularly employed in the MASS model to account for PBL processes in mesoscale simulations. The TAPPS forecasts are verified against high-resolution observations of the horizontal winds at DFW. Statistical assessments of the error in the wind forecasts suggest that TAPPS captures the essential features of the horizontal winds with considerable skill. Additionally, the turbulence quantities produced by the post-processor are shown to compare favorably with corresponding tower observations.

Charney, Joseph J.↗

Lagged average predictions in a predictability experiment

Lagged average predictions are examined here within the context of an idealized predictability experiment. Lagged predictions contribute to making better forecasts than the forecasts obtained from using only the latest initial state. Analytic models suggest that lagged predictions contribute the greatest amount when the error growth rates are small. Little dependence upon the magnitude of the intial error is found if the growth rates remain constant. It is also shown how lagged average forecasts can be used to predict the error. Discriminating forecasts made only when the error is predicted to be small are shown to have much better than average skill.

Roads, John O.↗

Investigating seasonal ENSO forecast amplitude calibration for GEOS-S2S-2

The GEOS-S2S-2 is a global coupled model and assimilation system, encompassing many aspects of the Earth climate system. This project looked at seasonal (nine-month) ensemble forecasts, over the period from 1982 through the present. We explored and validated a forecast amplitude correction technique used by the North American Multi-Model Ensemble (NMME), of which GEOS is a member, for Niño3.4 sea-surface temperature (SST) anomaly predictions. The method relies on deriving a set of correction factors based on the standard deviations of hindcast and observed SST anomalies. This algorithm was implemented at the Global Modeling and Assimilation Office (GMAO) and applied to the GEOS-S2S-2 Niño 3.4 hindcasts. In general, the correction reduced the forecast amplitude. This improved the quality of the forecasts when measured by the root mean square error (RMSE) of the ensemble mean forecast. RMSE decreased for most initialization months and forecast leads. The correction had a larger impact on seasons with strong El Niño-Southern Oscillation (ENSO) events than neutral seasons. The effects of the correction on the ensemble characteristics were also examined, and a variation of the algorithm was proposed that preserves the ensemble spread. The outcome of this project is a tool that can be used to calibrate GEOS-S2S-2 ENSO forecasts and potentially improve the precision of multi-model El Niño outlooks.

ENSO↗

Wind Information Uplink to Aircraft Performing Interval Management Operations

Interval Management (IM) is an ADS-B-enabled suite of applications that use ground and flight deck capabilities and procedures designed to support the relative spacing of aircraft (Barmore et al., 2004, Murdoch et al. 2009, Barmore 2009, Swieringa et al. 2011; Weitz et al. 2012). Relative spacing refers to managing the position of one aircraft to a time or distance relative to another aircraft, as opposed to a static reference point such as a point over the ground or clock time. This results in improved inter-aircraft spacing precision and is expected to allow aircraft to be spaced closer to the applicable separation standard than current operations. Consequently, if the reduced spacing is used in scheduling, IM can reduce the time interval between the first and last aircraft in an overall arrival flow, resulting in increased throughput. Because IM relies on speed changes to achieve precise spacing, it can reduce costly, low-altitude, vectoring, which increases both efficiency and throughput in capacity-constrained airspace without negatively impacting controller workload and task complexity. This is expected to increase overall system efficiency. The Flight Deck Interval Management (FIM) equipment provides speeds to the flight crew that will deliver them to the achieve-by point at the controller-specified time, i.e., assigned spacing goal, after the target aircraft crosses the achieve-by point (Figure 1.1). Since the IM and target aircraft may not be on the same arrival procedure, the FIM equipment predicts the estimated times of arrival (ETA) for both the IM and target aircraft to the achieve-by point. This involves generating an approximate four-dimensional trajectory for each aircraft. The accuracy of the wind data used to generate those trajectories is critical to the success of the IM operation. There are two main forms of uncertainty in the wind information used by the FIM equipment. The first is the accuracy of the forecast modeling done by the weather provider. This is generally a global environmental prediction obtained from a weather model such as the Rapid Refresh (RAP) from the National Centers for Environmental Prediction (NCEP). The weather forecast data will have errors relative to the actual, or truth, winds that the aircraft will encounter. The second source of uncertainty is that only a small subset of the forecast data can be uplinked to the aircraft for use by the FIM equipment. This results in loss of additional information. The Federal Aviation Administration (FAA) and RTCA are currently developing standards for the communication of wind and atmospheric data to the aircraft for use in NextGen operations. This study examines the impact of various wind forecast sampling methods on IM performance metrics to inform the standards development.

Ahmad, Nashat N.↗

Assessing the Skills of a Seasonal Forecast of Chlorophyll in the Global Pelagic Oceans

While forecasts of atmospheric variables, and to a lesser degree ocean circulation, are relatively common, the forecast of biogeochemical conditions is still in its infancy. Using a dynamical ocean biogeochemical forecast forced by seasonal forecasts of atmospheric and physical ocean variables, we produce seasonal predictions of chlorophyll concentration at the global scale. Results show significant Anomaly Correlation Coefficients (ACCs) for the majority of regions (11 out of the 12 regions for the 1-month lead forecast). Root mean square errors are smaller (<0.05μg chlorophyll (chl) L−1) in the Equatorial regions compared to the higher latitudes(range from 0.05 up to 0.13 μg chl L−1). The forecast for all regions except three (North Atlantic, South Pacific and North Indian) are within the Semi-Interquartile Range of the satellite chlorophyll concentration (Suomi-National Polar-orbiting Partnership (NPP), 27.9%). This suggests the potential for skillful global biogeochemical forecasts on seasonal timescales of chlorophyll, primary production and harmful algal blooms that could support fisheries management and other applications.

ocean biogeochemistry↗

Assimilation of ozone profiles from the Improved Limb Atmospheric Spectrometer: Study on Antarctic Ozone - 2

Ozone data from the Improved Limb Atmospheric Spectrometer-II (ILAS-II) were included in addition to other satellite observations in the ozone assimilation system at the Global Modeling and Assimilation Office (GMAO) of NASA/Goddard. The control run assimilated data from NOAA 16 Solar Backscatter Ultraviolet/2 (SBUV/2) and Polar Ozone and Aerosol Measurement III (POAM III) instruments. Persistent impacts over Antarctica and transient impacts over northern middle and high latitudes are seen from April to October 2003, when ILAS-II provided good coverage. The largest improvements with respect to independent ozone sonde data are seen over the South Pole station. Ozone analyses and forecasts from the assimilation of SBUV/2, POAM III and ILAS-II data b e used to investigate the transport of ozone to southern middle latitudes following the breakup of the Antarctic vortex. The quality of analyses and forecasts is evaluated by comparison with independent Stratospheric Aerosol and Gas Experiment III (SAGE III) ozone data near 46degs. Anomaly correlations between SAGE III data and forecasts'exceed 0.6 for up to five to seven days at 30,50, and 70 ma. The loss of skill with advancing forecast length is related to dynamical errors due to an excessively persistent vortex in longer forecasts, which hampers the transport of low ozone air into middle latitudes.

Stajner, Ivanka↗

Simulation studies of the application of SEASAT data in weather and state of sea forecasting models

The design and analysis of SEASAT simulation studies in which the error structure of conventional analyses and forecasts is modeled realistically are presented. The development and computer implementation of a global spectral ocean wave model is described. The design of algorithms for the assimilation of theoretical wind data into computers and for the utilization of real wind data and wave height data in a coupled computer system are presented.

Cardone, V. J.↗

Tropical cyclone track and genesis forecasting using satellite microwave sounder data

Although many dynamical and statistical prediction schemes are available to forecasters, tropical cyclone track errors are still large. One primary difficulty is that tropical cyclones exist over the data-sparse tropical oceans. Satellite sounders, however, routinely provide numerous data over these areas. Mean layer temperatures from the Scanning Microwave Spectrometer on board the Nimbus 6 satellite are decomposed using empirical orthogonal functions, and the expansion coefficients are related to deviations from the persistence forecast location, to speed change, to direction change and to intensity change. The significance of the regression equations is tested by a null hypothesis of zero correlation coefficient. It appears that significant information about tropical cyclone motion exists in the satellite-estimated mean layer temperatures, especially at upper levels. A physical interpretation of the statistical results is offered, and a one-storm-out independent test is used to test the stability of the equations. Finally, some further work is suggested.

Kidder, S. Q.↗

Evaluation of the 29-km Eta Model: Objective Verification at Three Selected Stations - Part 1

This paper describes an objective verification of the National Centers for Environmental Prediction (NCEP) 29-km eta model from May 1996 through January 1998. The evaluation was designed to assess the model's surface and upper-air point forecast accuracy at three selected locations during separate warm (May - August) and cool (October - January) season periods. In order to enhance sample sizes available for statistical calculations, the objective verification includes two consecutive warm and cool season periods. Systematic model deficiencies comprise the larger portion of the total error in most of the surface forecast variables that were evaluated. The error characteristics for both surface and upper-air forecasts vary widely by parameter, season, and station location. At upper levels, a few characteristic biases are identified. Overall however, the upper-level errors are more nonsystematic in nature and could be explained partly by observational measurement uncertainty. With a few exceptions, the upper-air results also indicate that 24-h model error growth is not statistically significant. In February and August 1997, NCEP implemented upgrades to the eta model's physical parameterizations that were designed to change some of the model's error characteristics near the surface. The results shown in this paper indicate that these upgrades led to identifiable and statistically significant changes in forecast accuracy for selected surface parameters. While some of the changes were expected, others were not consistent with the intent of the model updates and further emphasize the need for ongoing sensitivity studies and localized statistical verification efforts. Objective verification of point forecasts is a stringent measure of model performance, but when used alone, is not enough to quantify the overall value that model guidance may add to the forecast process. Therefore, results from a subjective verification of the meso-eta model over the Florida peninsula are discussed in the companion paper by Manobianco and Nutter. Overall verification results presented here and in part two should establish a reasonable benchmark from which model users and developers may pursue the ongoing eta model verification strategies in the future.

Nutter, Paul A.↗

Regional Model Nesting Within GFS Daily Forecasts Over West Africa

The study uses the RM3, the regional climate model at the Center for Climate Systems Research of Columbia University and the NASA/Goddard Institute for Space Studies (CCSR/GISS). The paper evaluates 30 48-hour RM3 weather forecasts over West Africa during September 2006 made on a 0.5 grid nested within 1 Global Forecast System (GFS) global forecasts. September 2006 was the Special Observing Period #3 of the African Monsoon Multidisciplinary Analysis (AMMA). Archived GFS initial conditions and lateral boundary conditions for the simulations from the US National Weather Service, National Oceanographic and Atmospheric Administration were interpolated four times daily. Results for precipitation forecasts are validated against Tropical Rainfall Measurement Mission (TRMM) satellite estimates and data from the Famine Early Warning System (FEWS), which includes rain gauge measurements, and forecasts of circulation are compared to reanalysis 2. Performance statistics for the precipitation forecasts include bias, root-mean-square errors and spatial correlation coefficients. The nested regional model forecasts are compared to GFS forecasts to gauge whether nesting provides additional realistic information. They are also compared to RM3 simulations driven by reanalysis 2, representing high potential skill forecasts, to gauge the sensitivity of results to lateral boundary conditions. Nested RM3/GFS forecasts generate excessive moisture advection toward West Africa, which in turn causes prodigious amounts of model precipitation. This problem is corrected by empirical adjustments in the preparation of lateral boundary conditions and initial conditions. The resulting modified simulations improve on the GFS precipitation forecasts, achieving time-space correlations with TRMM of 0.77 on the first day and 0.63 on the second day. One realtime RM3/GFS precipitation forecast made at and posted by the African Centre of Meteorological Application for Development (ACMAD) in Niamey, Niger is shown.

Druyan, Leonard M.↗