Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “forecast error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Operational maize yield forecasts for Sub-Saharan Africa using Earth observation data and machine learning

Food insecurity continues to grow in Sub-Saharan Africa (SSA). In 2019, chronically malnourished people numbered nearly 240 million, or 20% of the population in SSA. Globally, numerous efforts have been made to anticipate potential droughts, crop conditions, and food shortages to foster improved food insecurity early warning and risk management. To support this goal, we develop an Earth Observation (EO) and machine-learning-based operational, subnational maize yield forecast system and evaluate its out-of-sample forecast skills during the growing seasons for Kenya, Somalia, Malawi, and Burkina Faso. In general, forecast skills improve substantially during the vegetative growth period (VP) and gradually during the reproductive development period (RP). Thus, mid-season assessment can provide effective early warning months before harvest. Skillful forecasts (Nash Sutcliffe Efficiency (NSE) > 0.6 and Mean Absolute Percentage Error (MAPE) < 20%) appear approximately two dekads after the VP; for example, they appear in May in Kenya and Somalia, January in Malawi, and July in Burkina Faso.

Donghoon Lee↗

Can Remotely Sensed Snow Disappearance Explain Seasonal Water Supply?

Understanding the relationship between remotely sensed snow disappearance and seasonal water supply may become vital in coming years to supplement limited ground based, in situ measurements of snow in a changing climate. For the period 2001–2019, we investigated the relationship between satellite derived Day of Snow Disappearance (DSD)—the date at which snow has completely disappeared—and the seasonal water supply, i.e., the April—July total streamflow volume, for 15 snow dominated basins across the western U.S. A Monte Carlo framework was applied, using linear regression models to evaluate the predictive skill—defined here as a model’s ability to accurately predict seasonal flow volumes—of varied predictors, including DSD and in situ snow water equivalent (SWE), across a range of spring forecast dates. In all basins there is a statistically significant relationship between mean DSD and seasonal water supply (p ≤ 0.05), with mean DSD explaining roughly half of the variance. Satellite-based model skill improves later in the forecast season, surpassing the skill of in-situ-based (SWE) models in skill in 10 of the 15 basins by the latest forecast date. We found little to no correlation between model error and basin characteristics such as elevation and the ratio of snow water equivalent to total precipitation. Despite a relatively short data record, this exploratory analysis shows promise for improving seasonal water supply prediction, in particular for snow dominated basins lacking in situ observations.

snow remote sensing↗

The Impact of the Assimilation of Aquarius Sea Surface Salinity Data in the GEOS Ocean Data Assimilation System

Ocean salinity and temperature differences drive thermohaline circulations. These properties also play a key role in the ocean-atmosphere coupling. With the availability of L-band space-borne observations, it becomes possible to provide global scale sea surface salinity (SSS) distribution. This study analyzes globally the along-track (Level 2) Aquarius SSS retrievals obtained using both passive and active L-band observations. Aquarius alongtrack retrieved SSS are assimilated into the ocean data assimilation component of Version 5 of the Goddard Earth Observing System (GEOS-5) assimilation and forecast model. We present a methodology to correct the large biases and errors apparent in Version 2.0 of the Aquarius SSS retrieval algorithm and map the observed Aquarius SSS retrieval into the ocean models bulk salinity in the topmost layer. The impact of the assimilation of the corrected SSS on the salinity analysis is evaluated by comparisons with insitu salinity observations from Argo. The results show a significant reduction of the global biases and RMS of observations-minus-forecast differences at in-situ locations. The most striking results are found in the tropics and southern latitudes. Our results highlight the complementary role and problems that arise during the assimilation of salinity information from in-situ (Argo) and space-borne surface (SSS) observations

Salinty↗

An evaluation of soundings, analyses and model forecasts derived from TIROS-N and NOAA-6 satellite data

TIROS-N and NOAA-6 temperature soundings over North America during three days in January 1980, and synoptic analyses and numerical-model forecasts derived from them, are compared with conventional data and analyses from NMC's limited-area fine-mesh model (LFM). The collocated sounding comparison revealed significant errors, especially near the surface and the tropopause. Satellite-derived thermal gradients were found to be weak, and thickness-analysis difference fields to propagate eastward, suggesting that sounding errors are correlated with synoptic patterns. The same pattern of anomalies is seen in the model forecasts. More detailed determinations of the correlation detected here could be used to optimize the assimilation of satellite soundings to conventional data.

Koehler, T. L.↗

State of the Art in Large-Scale Soil Moisture Monitoring

Soil moisture is an essential climate variable influencing land atmosphere interactions, an essential hydrologic variable impacting rainfall runoff processes, an essential ecological variable regulating net ecosystem exchange, and an essential agricultural variable constraining food security. Large-scale soil moisture monitoring has advanced in recent years creating opportunities to transform scientific understanding of soil moisture and related processes. These advances are being driven by researchers from a broad range of disciplines, but this complicates collaboration and communication. For some applications, the science required to utilize large-scale soil moisture data is poorly developed. In this review, we describe the state of the art in large-scale soil moisture monitoring and identify some critical needs for research to optimize the use of increasingly available soil moisture data. We review representative examples of 1) emerging in situ and proximal sensing techniques, 2) dedicated soil moisture remote sensing missions, 3) soil moisture monitoring networks, and 4) applications of large-scale soil moisture measurements. Significant near-term progress seems possible in the use of large-scale soil moisture data for drought monitoring. Assimilation of soil moisture data for meteorological or hydrologic forecasting also shows promise, but significant challenges related to model structures and model errors remain. Little progress has been made yet in the use of large-scale soil moisture observations within the context of ecological or agricultural modeling. Opportunities abound to advance the science and practice of large-scale soil moisture monitoring for the sake of improved Earth system monitoring, modeling, and forecasting.

Review↗

Dynamical predictability in a simple general circulation model - Average error growth

Average predictability and error growth in a simple realistic two-level general circulation model (GCM) were investigated using a series of Monte Carlo experiments for fixed external forcing (perpetual winter in the Northern Hemisphere). It was found that, for realistic initial errors, the dependence of the limit of dynamic predictability on total wavenumber was similar to that found for the ECMWF model for the 1980/1981 winter conditions, with the lowest wavenumbers showing significant skill for forecast ranges of more than 1 month. On the other hand, for very small amplitude errors distributed according to the climate spectrum, the total error growth was superexponential, reaching a maximum growth rate (2-day doubling time) in about 1 week. A simple empirical model of error variance, which involved two broad wavenumber bands and incorporating a 3/2 power saturation term, was found to provide an excellent fit to the GCM error growth behavior.

Schubert, Siegfried D.↗

On the sensitivity of numerical weather prediction to remotely sensed marine surface wind data - A simulation study

The reported investigation has the objective to assess the potential impact on numerical weather prediction (NWP) of remotely sensed surface wind data. Other investigations conducted with similar objectives have not been satisfactory in connection with a use of procedures providing an unrealistic distribution of initial errors. In the current study, care has been taken to duplicate the actual distribution of information in the conventional observing system, thus shifting the emphasis from accuracy of the data to the data coverage. It is pointed out that this is an important consideration in assessing satellite observing systems since experience with sounder data has shown that improvements in forecasts due to satellite-derived information is due less to a general error reduction than to the ability to fill data-sparse regions. The reported study concentrates on the evaluation of the observing system simulation experimental design and on the assessment of the potential of remotely sensed marine surface wind data.

Cane, M. A.↗

Statrospheric warmings during the winter of 1979

Some of the arguments crucial to the current understanding of stratospheric warmings are recapitulated briefly. The circulation at 10 mb during the winter of 1979 is described. A review of numerical forecasts of stratospheric warmings reveals that, in general, these events are predictable from several days in advance. In some cases, however, relatively small errors in the predicted tropospheric zonal mean wind produce large differences in upward wave propagation and, consequently, in the stratospheric forecast.

Mechoso, C. R.↗

Data Assimilation in the Presence of Forecast Bias: The GEOS Moisture Analysis

We describe the application of the unbiased sequential analysis algorithm developed by Dee and da Silva (1998) to the GEOS DAS moisture analysis. The algorithm estimates the persistent component of model error using rawinsonde observations and adjusts the first-guess moisture field accordingly. Results of two seasonal data assimilation cycles show that moisture analysis bias is almost completely eliminated in all observed regions. The improved analyses cause a sizable reduction in the 6h-forecast bias and a marginal improvement in the error standard deviations.

Dee, Dick P.↗

1D Variational Assimilation of TOVS/ATOVS Level 1b Data

Recently, it has been shown that the use of observations from satellite-borne microwave and infrared radiometers in data assimilation systems consistently increases forecast skill. Considerable effort has been expended over the past two decades, particularly with the TIROS Operational Vertical Sounder (TOVS), to achieve this result. The positive impact on forecast skill has resulted from improvements in quality control algorithms, systematic error correction schemes, and data assimilation systems. Despite these recent advances, there are still many issues regarding the use of satellite data in data assimilation systems that remain unresolved. For example, at several centers, much of the TOVS data are not assimilated over land as a result of the difficulty in specifying the surface emissivity. In this study, we add the microwave surface emissivity to the state vector so that it is retrieved rather than specified by a model. The LDVAR temperature and humidity information is then assimilated interactively into the Goddard Earth Observing System - Data Assimilation System (GEOS-DAS). Results of 1DVAR assimilations with both TOVS and ATOVS will be shown. We will compare the results obtained with HIRS/MSU/SSU and HIRS/AMSU-A2.

Joiner, J.↗

Effects of Version 2 of the International Sunspot Number on Naive Predictions of Solar Cycle 25

The recalibration of the International Sunspot Number brings new challenges to predictions of Solar Cycle 25. One is that the list of extrema for the original series is no longer usable because the values of all maxima and minima are different for the new version of the sunspot number. Timings of extrema are less sensitive to the recalibration but are a natural result of the calculation. Predictions of Solar Cycle 25 published before 2016 must be converted to the new version of the sunspot number. Any prediction method that looks across the entire time span will have to be reconsidered because values in the nineteenth century were corrected by a larger factor than those in the twentieth century. We report a list of solar maxima and minima values and timings based on the recalibrated sunspot number. Naïve forecasts that depend only on the current values of the time series are common in economic studies. Several naïve predictions of Solar Cycle 25, the climatological average (180 ± 60), two versions of the inertial forecast, and two versions of the even-odd forecast, are derived from that table. The climatological average forecast is the baseline for more accurate predictions and the initial forecast in assimilative models of the Sun. It also provides the error estimate for Monte Carlo techniques that anticipate the long-term effects on the terrestrial environment. The other four predictions are shown to be statistically insignificant.

Pesnell, W. Dean↗

Impacts of Marine Surface Pressure Observations From A Spaceborne Differential Absorption Radar Investigated With an Observing System Simulation Experiment

A new instrument has been proposed for measuring surface air pressure over the marine surface with a combined active/passive scanning multi-channel differential absorption radar (DAR) to provide an estimate of the total atmospheric column oxygen content. A demonstrator instrument, the Microwave Barometric Radar and Sounder (MBARS), has been funded by the National Aeronautics and Space Administration (NASA) for airborne test missions. Here, a proof-of-concept study to evaluate the potential impact of spaceborne surface pressure data on numerical weather prediction is performed using the Goddard Modeling and Assimilation Office global observing system simulation experiment (OSSE) framework. This OSSE framework employs the Goddard Earth Observing System model and the hybrid 4D ensemble variational Gridpoint Statistical Interpolation data assimilation system. Multiple flight and scanning configurations of potential spaceborne orbits are examined. Swath width and observation spacing for the surface pressure data are varied to explore a range of sampling strategies. For wider swaths, the addition of surface pressures reduces the root mean square surface pressure analysis error by as much as 20% over some ocean regions. The forecast sensitivity observation impact tool estimates impacts on the Pacific Ocean basin boundary layer 24-hour forecast temperatures for spaceborne surface pressures on par with rawinsondes and aircraft, and greater impacts than the current network of ships and buoys. The largest forecast impacts are found in the southern hemisphere extratropics.

N.C. Privé↗

Understanding and Utilizing PBL Height Data from Multiple Observing Systems in the GEOS System

The accuracy of PBL height simulation is a key issue in many applications including forecasting near surface meteorology and air quality, however, it is a very challenging problem due to the lack of not only comprehensive, global Planetary Boundary Layer (PBL) observations but also a strategy and infrastructure to utilize PBL height data from a variety of sensors. Following the designation of PBL as an incubation class observable in the 2017 Decadal Survey, the PBL Incubation Study Team Report [14] made clear that “a future global PBL observing system requires modeling and data assimilation as essential components.” There is an urgent need for global modeling development in order to utilize Program of Record (POR) observations, assess their impacts, and identify gaps to be filled by future PBL missions. Our overall objective is to develop PBL data assimilation capabilities in the NASA Global Earth Observing System (GEOS), focusing on PBL height from multiple observing systems, to support the assessment and use of future PBL observations. The NASA GEOS system is composed of the GEOS global atmospheric general circulation model (AGCM) and the atmospheric data assimilation system (ADAS). The PBL parameterizations include the “Lock” K-profile scheme driven by surface and cloud-top buoyancy fluxes ([4]), and the “Louis” local scheme for stable conditions based on the Richardson number ([5]). Above the mixed layer defined by the Lock surface plume, shallow cumulus convection is represented by the mass flux scheme of [9]. Additional parameterizations are summarized in [1]. The ADAS employs the hybrid 4D Ensemble- Variational (EnVar) configuration ([15]), with the ensemble providing flow-dependent background error covariance information. The resultant analysis increments are fed back to the forecast model through the 4D incremental analysis update (IAU) approach ([11]). In this study, PBL height data are being or have been generated from radiosondes, GNSS RO, satellite (CATS, CALIPSO and ICESat-2) and ground-based (MPLNET) lidars, and wind profiler. Investigations have been conducted to specify quality marks for PBL height retrievals for the data assimilation purpose. These PBL height data have different strengths and weaknesses ([2], [3], [6], [7], [8], [10]), and the satellite PBL height data provide better global coverage and complement in-situ PBL height data. Radiosondes offer high accuracy and in situ measurement of temperature and humidity profiles, but with poor spatio-temporal sampling. The in-situ observing systems like MPLNET and wind profiler provide long history of PBL height records at each station. The GNSS RO based PBL height is retrieved based on the sharp gradients in refractivity profile that represent the fine vertical structure of temperature and moisture changes above the PBL. However, not all RO refractivity profiles reach the surface depending on location and regime, and RO refractivity retrievals can be negatively biased below 2km. The PBL height data from satellite lidars provide high resolution along track PBL height retrievals, but over land they are affected by previous day convective PBL aerosol and strongly associated with mixing layer and retrievals cannot be made below thick, attenuating clouds. A successful assimilation of PBL height data requires a thorough understanding of the observing method and the retrieval algorithm for each observing system in order to use the PBL height data from multiple observing systems properly. Due to the sensitivity of PBL height data to the observing method and choice of algorithm, it is important to use a model definition appropriate for each observation type to compute differences between PBL height data and model PBL height (OmFs). The GEOS model currently includes two PBL height definitions suitable for direct comparison with observed PBL height, and additional definitions are being added in this study. Evaluation of different model PBL height definitions is underway. Meanwhile, efforts have been made in the GEOS data assimilation system to develop PBL height data assimilation capability. PBL height data can be assimilated using two different approaches. The traditional approach is to construct an observation operator and its tangent linear and adjoint, which link control variables to PBL height data from each observing system. This observation operator can be very complicated, e.g., the lidar-based PBL height observation operator includes the backscatter lidar forward observation operator, the algorithm to derive PBL height from attenuated total backscatter, interpolation, and calculations handling the mismatch between observed and model scales. The other approach is to augment PBL height to the control variable vector, and it is adopted in this study. The latter approach was also used in previous studies, e.g., the assimilation of PBL height data from radiosonde and aircraft in the Real Time Mesoscale Analysis (RTMA) system for a dispersion modelling study ([13]); the PBL height assimilation study using lidar PBL height data at Greensburg, Kansas for a field campaign ([12]). The PBL height assimilation from multiple observing systems in this study allows us to take advantage of the diverse PBL height data that provide much better global coverage collectively under different meteorological conditions and with different temporal and spatial scales. As all the PBL heights are tightly coupled with the PBL thermodynamic variables, the strong correlations, which are provided by the 4D ensemble forecast, enable PBL height data from various sources to interact and combine coherently and provide additional information for PBL temperature and moisture fields. The results of comparisons among PBL height data from different sources and the evaluation of the model PBL height definitions with the PBL height data will be presented, and the PBL height data synergy strategies and preliminary results will also be discussed at the conference.

Y. Zhu↗

Tropical intraseasonal oscillation and its prediction by the NMC operational model

Results are presented of an investigation of the tropical intraseasonal oscillation (ISO) and its impact on the extended-range forecast in the NMC operational model during Phase II (14 December 1986-31 March 1987) of the Dynamical Extended Range Forecast. Based on principal component analysis of the velocity potential and streamfunction, evidence was found of tropical-extratropical interaction associated with the ISO. The NMC model possess significant forecast skills for the principal streamfunction and velocity potential modes up to the first ten days. Results of the error growth analysis suggest that the principal modes of velocity potential have large errors comparable to the model random errors. By comparison, the initial errors in the streamfunction are much smaller. The error growth for both tropical and extratropical modes are found to be significantly suppressed during periods of strong ISO relative to periods of weak ISO. The increase in extratropical forecast skill is likely due to (1) the model's ability to better capture ISO signals in the tropics and (2) the increased coupling between the tropics and extratropics during periods of strong ISO.

Lau, K.-M.↗

Improving Reanalyses Using TRMM and SSM/I-Derived Precipitation and Total Precipitable Water Observations

Global reanalyses currently contain significant errors in the primary fields of the hydrological cycle such as precipitation, evaporation, moisture, and the related cloud fields, especially in the tropics. The Data Assimilation Office (DAO) at the NASA Goddard Space Flight Center has been exploring the use of rainfall and total precipitable water (TPW) observations from the Tropical Rainfall Measuring Mission (TRMM) Microwave Imager (TMI) and the Special Sensor Microwave/ Imager (SSM/I) instruments to improve these fields in reanalyses. The DAO has developed a "1+1"D procedure to assimilate 6-hr averaged rainfall and TPW into the Goddard Earth Observing System (GEOS) Data Assimilation System (DAS). The algorithm is based on a 6-hr time integration of a column version of the GEOS DAS. The "1+1" designation refers to one spatial dimension plus one temporal dimension. The scheme minimizes the least-square differences between the satellite-retrieved rain rates and those produced by the column model over the 6-hr analysis window. The control variables are analysis increments of moisture within the Incremental Analysis Update (IAU) framework of the GEOS DAS. This 1+1D scheme, in its generalization to four dimensions, is related to the standard 4D variational assimilation but differs in its choice of the control variable. Instead of estimating the initial condition at the beginning of the assimilation cycle, it estimates the constant IAU forcing applied over a 6-hr assimilation cycle. In doing so, it imposes the forecast model as a weak constraint in a manner similar to the variational continuous assimilation techniques. We present results from an experiment in which the observed rain rate and TPW are assumed to be "perfect". They show that assimilating the TMI and SSM/I-derived surface precipitation and TPW observations improves not only the precipitation and moisture fields but also key climate parameters directly linked to convective activities such as clouds, the outgoing longwave radiation, and the large-scale circulation in the tropics. In particular, assimilating these data types reduce the state-dependent systematic errors in the assimilated products. The improved analysis also leads to a better short-range forecast, but the impact is modest compared with improvements in the time-averaged fields. These results suggest that, in the presence of biases and other errors of the forecast model, it is possible to improve the time-averaged "climate content" in the assimilated data without comparable improvements in the short-range forecast skill. Results of this experiment provide a useful benchmark for evaluating error covariance models for optimal use of these data types.

Hou, Arthur Y.↗

Data Assimilation and Regional Forecasts using Atmospheric InfraRed Sounder (AIRS) Profiles

In data sparse regions, remotely-sensed observations can be used to improve analyses, which in turn should lead to better forecasts. One such source comes from the Atmospheric Infrared Sounder (AIRS), which, together with the Advanced Microwave Sounding Unit (AMSU), provides temperature and moisture profiles with an accuracy comparable to that of radionsondes. The purpose of this poster is to describe a procedure to optimally assimilate AIRS thermodynamic profiles, obtained from the version 5.0 Earth Observing System (EOS) science team retrieval algorithm, into a regional configuration of the Weather Research and Forecasting (WRF) model using WRF-Var. The poster focuses on development of background error covariances for the regional domain and background field type, a methodology for ingesting AIRS profiles as separate over-land and over-water retrievals with different error characteristics, and utilization of level-by-level quality indicators to select only the highest quality data. The assessment of the impact of the AIRS profiles on WRF-Var analyses will focus on intelligent use of the quality indicators, optimized tuning of the WRF-Var, and comparison of analysis soundings to radiosondes. The analyses are used to conduct a month-long series of regional forecasts over the continental U.S. The long-term impact of AIRS profiles on forecast will be assessed against NAM analyses and stage IV precipitation data.

Zabodsky, Brad↗

Data Assimilation and Regional Forecasts Using Atmospheric InfraRed Sounder (AIRS) Profiles

In data sparse regions, remotely-sensed observations can be used to improve analyses, which in turn should lead to better forecasts. One such source comes from the Atmospheric Infrared Sounder (AIRS), which together with the Advanced Microwave Sounding Unit (AMSU), provides temperature and moisture profiles with an accuracy comparable to that of radiosondes. The purpose of this paper is to describe a procedure to optimally assimilate AIRS thermodynamic profiles--obtained from the version 5.0 Earth Observing System (EOS) science team retrieval algorithm-into a regional configuration of the Weather Research and Forecasting (WRF) model using WRF-Var. The paper focuses on development of background error covariances for the regional domain and background field type, a methodology for ingesting AIRS profiles as separate over-land and over-water retrievals with different error characteristics, and utilization of level-by-level quality indicators to select only the highest quality data. The assessment of the impact of the AIRS profiles on WRF-Var analyses will focus on intelligent use of the quality indicators, optimized tuning of the WRF-Var, and comparison of analysis soundings to radiosondes. The analyses will be used to conduct a month-long series of regional forecasts over the continental U.S. The long-tern1 impact of AIRS profiles on forecast will be assessed against verifying radiosonde and stage IV precipitation data.

Chou, Shih-Hung↗

GMAO Seasonal Forecast Ensemble Exploration

GMAO Sub/Seasonal prediction system (S2S) has recently been upgraded. A complete set (1981-2016) of 9-months hindcasts for the previous and current versions (S2S-1.0 and S2S-2.1 respectively) allows for the evaluation of the forecast skill and a study of various characteristics of the ensemble forecasts in particular. We compared the intra-seasonal, interannual and intra-ensemble SST variability of the two systems against the observed. Focusing on the ENSO SST indices, we analyzed the consistency of the forecasts ensembles by studying rank histograms and comparing the ensemble spread with the standard error of the estimate.The S2S-2.1 ensemble appears to be more consistent with observations in Niño1+2 region compared to S2S-1.0, while in the central equatorial Pacific ocean this measure is comparably good for both systems. The S2S-1.0 system tends to be under dispersive, while the new system is under dispersive only at very short lead times, but tends to be over dispersive at long leads and for forecasts verifying in spring in Niño 3.4 region.Overall, the new system has greater skill in predicting ENSO. The evaluation techniques tested here will be applied for testing of the next generation sub/seasonal forecast system under development.

Borovikov, Anna↗