Results for “forecast error” — Page 15

NASA NTRS2014

Assimilation of MODIS Snow Cover Through the Data Assimilation Research Testbed and the Community Land Model Version 4

To improve snowpack estimates in Community Land Model version 4 (CLM4), the Moderate Resolution Imaging Spectroradiometer (MODIS) snow cover fraction (SCF) was assimilated into the Community Land Model version 4 (CLM4) via the Data Assimilation Research Testbed (DART). The interface between CLM4 and DART is a flexible, extensible approach to land surface data assimilation. This data assimilation system has a large ensemble (80-member) atmospheric forcing that facilitates ensemble-based land data assimilation. We use 40 randomly chosen forcing members to drive 40 CLM members as a compromise between computational cost and the data assimilation performance. The localization distance, a parameter in DART, was tuned to optimize the data assimilation performance at the global scale. Snow water equivalent (SWE) and snow depth are adjusted via the ensemble adjustment Kalman filter, particularly in regions with large SCF variability. The root-mean-square error of the forecast SCF against MODIS SCF is largely reduced. In DJF (December-January-February), the discrepancy between MODIS and CLM4 is broadly ameliorated in the lower-middle latitudes (2345N). Only minimal modifications are made in the higher-middle (4566N) and high latitudes, part of which is due to the agreement between model and observation when snow cover is nearly 100. In some regions it also reveals that CLM4-modeled snow cover lacks heterogeneous features compared to MODIS. In MAM (March-April-May), adjustments to snowmove poleward mainly due to the northward movement of the snowline (i.e., where largest SCF uncertainty is and SCF assimilation has the greatest impact). The effectiveness of data assimilation also varies with vegetation types, with mixed performance over forest regions and consistently good performance over grass, which can partly be explained by the linearity of the relationship between SCF and SWE in the model ensembles. The updated snow depth was compared to the Canadian Meteorological Center (CMC) data. Differences between CMC and CLM4 are generally reduced in densely monitored regions.

data assimilation↗

NASA NTRS1996

GPS Based Attitude Determination for Spacecraft: System Engineering Design Study and Ground Testbed Results

By differencing carrier phase measurements from multiple antennas, a global positioning systems (GPS) reciever can determine the attitude of a coordinate frame defined by the antenna baselines. This paper examines the potential role of such a capability within spacecraft avionics. The applications served by current GPS capabilities are identified. Architectural options are considered, and a baseline which satisfies the needs of most applications is defined. The majority of this paper then focuses on the prototyping of this baseline architecture within the Jet Propulsion Laboratory's (JPL's) Flight System Testbed (FST). The test setup is described, and test results are presented. The paper closes with an analysis of the limiting factors in the GPS based altitude determination error budget, a forecast of future capabilities, and a discussion of the advances that will be required to achieve those capabilities.

GPS↗

DOE OSTI2024

Evidential Deep Learning for Probabilistic Modelling of Extreme Storm Events

Uncertainty quantification (UQ) methods play an important role in reducing errors in weather forecasting. Conventional approaches in UQ for weather forecasting rely on generating an ensemble of forecasts from physics-based simulations to estimate the uncertainty. However, it is computationally expensive to generate many forecasts to predict real-time extreme weather events. Evidential Deep Learning (EDL) is an uncertainty-aware deep learning approach designed to provide confidence about its predictions using only one forecast. It treats learning as an evidence acquisition process where more evidence is interpreted as increased predictive confidence. We apply EDL to storm forecasting using real-world weather datasets and compare its performance with traditional methods. Our findings indicate that EDL not only reduces computational overhead but also enhances predictive uncertainty. This method opens up novel opportunities in research areas such as climate risk assessment, where quantifying the uncertainty about future climate is crucial.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS2001

Error Estimation of An Ensemble Statistical Seasonal Precipitation Prediction Model

This NASA Technical Memorandum describes an optimal ensemble canonical correlation forecasting model for seasonal precipitation. Each individual forecast is based on the canonical correlation analysis (CCA) in the spectral spaces whose bases are empirical orthogonal functions (EOF). The optimal weights in the ensemble forecasting crucially depend on the mean square error of each individual forecast. An estimate of the mean square error of a CCA prediction is made also using the spectral method. The error is decomposed onto EOFs of the predictand and decreases linearly according to the correlation between the predictor and predictand. Since new CCA scheme is derived for continuous fields of predictor and predictand, an area-factor is automatically included. Thus our model is an improvement of the spectral CCA scheme of Barnett and Preisendorfer. The improvements include (1) the use of area-factor, (2) the estimation of prediction error, and (3) the optimal ensemble of multiple forecasts. The new CCA model is applied to the seasonal forecasting of the United States (US) precipitation field. The predictor is the sea surface temperature (SST). The US Climate Prediction Center's reconstructed SST is used as the predictor's historical data. The US National Center for Environmental Prediction's optimally interpolated precipitation (1951-2000) is used as the predictand's historical data. Our forecast experiments show that the new ensemble canonical correlation scheme renders a reasonable forecasting skill. For example, when using September-October-November SST to predict the next season December-January-February precipitation, the spatial pattern correlation between the observed and predicted are positive in 46 years among the 50 years of experiments. The positive correlations are close to or greater than 0.4 in 29 years, which indicates excellent performance of the forecasting model. The forecasting skill can be further enhanced when several predictors are used.

Shen, Samuel S. P.↗

NASA NTRS2018

Evaluation of Near-Surface Air Temperature from Reanalysis over the United States and Ukraine: Application to Winter Wheat Yield Forecasting

In this work we evaluate the near-surface air temperature datasets from the ERA-Interim, JRA55, MERRA2, NCEP1, and NCEP2 reanalysis projects. Reanalysis data were first compared to observations from weather stations located on wheat areas of the United States and Ukraine, and then evaluated in the context of a winter wheat yield forecast model. Results from the comparison with weather station data showed that all datasets performed well (r2>0.95) and that more modern reanalysis such as ERAI had lower errors (RMSD ~ 0.9) than the older, lower resolution datasets like NCEP1 (RMSD ~ 2.4). We also analyze the impact of using surface air temperature data from different reanalysis products on the estimations made by a winter wheat yield forecast model. The forecast model uses information of the accumulated Growing Degree Day (GDD) during the growing season to estimate the peak NDVI signal. When the temperature data from the different reanalysis projects were used in the yield model to compute the accumulated GDD and forecast the winter wheat yield, the results showed smaller variations between obtained values, with differences in yield forecast error of around 2% in the most extreme case. These results suggest that the impact of temperature discrepancies between datasets in the yield forecast model get diminished as the values are accumulated through the growing season.

GSOD↗

DOE OSTI2025

Uncertainty-Guided Prediction Horizon of Phase-Resolved Ocean Wave Forecasting Under Data Sparsity: Experimental and Numerical Evaluation

Accurate short-term wave forecasting is critical for the safe and efficient operation of marine structures that rely on real-time, phase-resolved ocean wave information for control and monitoring purposes (e.g., digital twins). These systems often depend on environmental sensors (e.g., waverider buoys, wave-sensing LIDAR). Challenges arise when upstream sensor data are missing, sparse, or phase-shifted due to drift. This study investigates the performance of two machine learning models, time-series dense encoder (TiDE) and long short-term memory (LSTM), for forecasting phase-resolved ocean surface elevations under varying degrees of data degradation. We introduce the τ-trimming algorithm, which adapts the prediction horizon based on uncertainty thresholds derived from historical forecasts. Numerical wave tank (NWT) and wave basin experiments are used to benchmark model performance under short- and long-term data masking, spatially coarse sensor grids, and upstream phase shifts. Results show under a 50% probability of upstream data loss, the τ-trimmed TiDE model achieves a 46% reduction in error at the most upstream target, compared to 22% for LSTM. Furthermore, phase misalignment in upstream data introduces a near-linear increase in forecast error. Under moderate model settings, a ±3 s misalignment increases the mean absolute error by approximately 0.5 m, while the same error is accumulated at ±4 s using the more conservative approach. These findings inform the design of resilient, uncertainty-aware wave forecasting systems suited for realistic offshore sensing environments.

42 ENGINEERING↗

DOE OSTI2021

Five-day track forecast skills of WRF model for the western North Pacific tropical cyclones

In this study, the characteristics of simulated tropical cyclones (TCs) over the western North Pacific by a regional model (the WRF Model) are verified. We utilize 12-km horizontal grid spacing, and simulations are integrated for 5 days from model initialization. A total of 125 forecasts are divided into five clusters through the k-means clustering method. The TCs in the cluster 1 and 2 (group 1), which includes many TCs moving northward in the subtropical region, generally have larger track errors than for TCs in cluster 3 and 4 (group 2). The optimal steering vector is used to examine the difference in the track forecast skill between these two groups. The bias in the steering vector between the model and analysis data is found to be more substantial for group 1 TCs than group 2 TCs. The larger steering vector difference for group 1 TCs indicates that environmental fields tend to be poorly simulated in group 1 TC cases. Furthermore, the residual terms, including the storm-scale process, asymmetric convection distribution, or beta-related effect, are also larger for group 1 TCs than group 2 TCs. Therefore, it is probable that the large track forecast error for group 1 TCs is a result of unreasonable simulations of environmental wind fields and residual processes in the midlatitudes.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Initialized Earth system prediction from subseasonal to decadal timescales

Initialized Earth system predictions are made by starting a numerical prediction model in a state as consistent as possible to observations, and running it forward in time for up to ten years. Skillful predictions at time slices from subseasonal to seasonal (S2S), seasonal to interannual (S2I) and seasonal to decadal (S2D) offer information useful for various stakeholders, from agriculture to water resource management, and human and infrastructure safety. In this Review, we examine the processes influencing predictability, and discuss estimates of skill across S2S, S2I and S2D timescales. There are encouraging signs that skillful predictions can be made: at S2S timescales, there has been some skill in predicting the Madden-Julian Oscillation and North Atlantic Oscillation; at S2I in predicting the El Niño-Southern Oscillation; and at S2D, in predicting variability in North Atlantic sea surface temperatures. However, challenges remain, and future work must prioritise reducing model error, more effectively communicating forecasts to users, and increasing process and mechanistic understanding that could increase predictive skill and, in turn, confidence. As numerical models progress towards Earth system models, initialized predictions are expanding to include prediction of sea-ice, air pollution, terrestrial and ocean biochemistry which can bring clear benefit to society and various stakeholders.

climate prediction↗

NASA NTRS1989

Biases and nonsystematic errors in NMC MRF predictions of momentum and zonal winds

The period of study considered by Rosen et al. (1987) for M forecasts is extended and the source of errors in these forecasts is examined. Time series of daily values of MRF forecasted minus the observed M are presented for forecast lead times of 2, 5, and 10 days from December 1985 through November 1988. A graph is presented of the covariance between errors in the angular momentum per unit mass forecasted at a 10-day lag, and those in the forecasted global angular momentum for the same period.

Rosen, Richard D.↗

DOE OSTI2022

The Simulation and Design of an On-Chip Superconducting Millimetre Filter-Bank Spectrometer

Abstract Superconducting on-chip filter banks provide a scalable, space saving solution to create imaging spectrometers at millimetre and submillimetre wavelengths. We present an easy to realise, lithographed superconducting filter design with a high tolerance to fabrication error. Using a capacitively coupled $$\lambda /2$$ λ / 2 microstrip resonator to define a narrow ( $$\lambda /\Delta \lambda = 300$$ λ / Δ λ = 300 ) spectral pass band, the filtered output of a given spectrometer channel directly connects to a lumped-element kinetic inductance detector. We show the tolerance analysis of our design, demonstrating $$<11\%$$ < 11 % change in filter quality factor to any one realistic fabrication error and a full filter-bank efficiency forecast to be 50% after accounting for fabrication errors and dielectric loss tangent.

Robson, G. (ORCID:0000000315279326)↗

NASA NTRS1990

Tropical Pacific moisture variability

The objectives are to describe synoptic scale variability of moisture over the tropical Pacific Ocean and the systems leading to this variability; implement satellite analysis procedures in support of this effort, and to incorporate additional satellite information into operational analysis forecast systems at the National Meteorological Center (NMC). Composite satellite radiance patterns describe features detectable well before the development of synoptic scale tropical plumes. These typical features were extracted from historical files of Tiros Operational Vertical Sounder (TOVS) radiance observations for a pair of tropical plumes which developed during January 1989. Signals were inserted into the NMC operational medium range forecast model and a suite of model integrations were conducted. Many of the 48 h model errors of the historical forecasts were eliminated by the inclusion of more complete satellite observations. Three studies in satellite radiance analysis progressed. An analysis which blended TOVS moisture channels, OLR observations and European Center for Medium Weather Forecasts (ECMWF) model analysis to generate fields of total precipitable water comparable to those estimated from Scanning Multichannel Microwave Radiometer (SMMR) mu-wave observations. This study demonstrated that a 10 y climatology of precipitable water over the oceans is feasible, using available infrared observations (OLR and TOVS) and model analysis (ECMWF, NMC or similar quality). The estimates are sensitive to model quality and the estimating model must be updated with operational model changes. Coe developed a set of tropical plume and ITCZ composites from TOVS observations, and from NMC and ECMWF analyses which had been passed through a radiative transfer model to simulate TOVS radiances. The composites have been completed as well as many statistical diagnostics of individual TOVS channels. Analysis of the computations is commencing. Chung has initiated a study of the differences between TOVS observed vapor structure during El Nino Southern Oscillation (ENSO) (1983) and non-ENSO (1984) years. Preliminary diagnosis demonstrates gross moisture changes between warm and cold sea surface temperature episodes.

Mcguirk, James P.↗

NASA NTRSDate not supplied

Evaluating GXS Impact in the Context of International Coordination

The proposed NOAA/NASA Geostationary eXtended Observations (GeoXO) program plans to include a hyperspectral infrared (IR) sounder on its central satellite. Expected to launch in the mid-2030s, the GeoXO Sounder (GXS) will join international counterparts in a geostationary orbit. Ahead of launch, the NASA Global Modeling and Assimilation Office (GMAO) assessed the potential effectiveness of GXS both as a single GEO IR sounder and as part of a global ring of such instruments, including those already being built by international agencies. Using an observing system simulation experiment (OSSE) framework, GXS was assessed from a global numerical weather prediction (NWP) perspective. The ability of GXS, both alone and as part of a global ring of GEO sounders, to improve weather prediction of thermodynamic variables was evaluated globally and regionally. Compared to a control, GXS dominated regional analysis and forecast improvements, and contributed significantly to global increases in forecast skill. However, more sustained global improvements on the order of 4 days rely on international partnerships. Using the FSOI metric over CONUS, the GXS observations provide the strongest radiance impact on the moist energy error norm reduction. Additionally, GXS shows the capability to improve hurricane forecast track errors, resulting in improved forecast warnings. Overall, the persistent atmospheric profile information from GXS over much of the western hemisphere provide an opportunity to improve the representation of weather systems and their forecasts.

Erica McGrath-Spangler↗

NASA NTRSDate not supplied

Evaluating the Impact of Geostationary Sounders in the Context of International Coordination

The proposed NOAA/NASA Geostationary eXtended Observations (GeoXO) program plans to include a hyperspectral infrared (IR) sounder (GXS) on its central satellite, joining international counterparts. Ahead of launch, the NASA Global Modeling and Assimilation Office (GMAO) assessed the potential effectiveness of GXS both as a lone sounder in a GEO orbit and as part of a global ring of such instruments. Using an observing system simulation experiment (OSSE) framework from a global numerical weather prediction (NWP) perspective, the ability of GXS and the global ring to improve weather prediction of thermodynamic variables was assessed both globally and regionally. GXS dominated regional analysis and forecast improvements and contributed significantly to global increases in forecast skill. However, more sustained global improvements on the order of 4 days rely on international partnerships. Over CONUS, the FSOI metric showed the GXS observations provide the strongest radiance impact on the moist energy error norm reduction. Additionally, GXS shows the capability to improve hurricane forecast track errors, resulting in improved forecast warnings. Overall, the persistent atmospheric profile information from GXS over much of the western hemisphere provide an opportunity to improve the representation of weather systems and their forecasts.

Erica L. McGrath-Spangler↗

NASA NTRSDate not supplied

Evaluating the Impact of Geostationary Sounders in the Context of International Coordination

The proposed NOAA/NASA Geostationary eXtended Observations (GeoXO) program plans to include a hyperspectral infrared (IR) sounder (GXS) on its central satellite, joining international counterparts. Ahead of launch, the NASA Global Modeling and Assimilation Office (GMAO) assessed the potential effectiveness of GXS both as a lone sounder in a GEO orbit and as part of a global ring of such instruments. Using an observing system simulation experiment (OSSE) framework from a global numerical weather prediction (NWP) perspective, the ability of GXS and the global ring to improve weather prediction of thermodynamic variables was assessed both globally and regionally. GXS dominated regional analysis and forecast improvements and contributed significantly to global increases in forecast skill. However, more sustained global improvements on the order of 4 days rely on international partnerships. Over CONUS, the FSOI metric showed the GXS observations provide the strongest radiance impact on the moist energy error norm reduction. Additionally, GXS shows the capability to improve hurricane forecast track errors, resulting in improved forecast warnings. Overall, the persistent atmospheric profile information from GXS over much of the western hemisphere provide an opportunity to improve the representation of weather systems and their forecasts.

Erica McGrath-Spangler↗

NASA NTRSDate not supplied

Evaluating GXS Impact in the Context of International Coordination

The proposed NOAA/NASA Geostationary eXtended Observations (GeoXO) program plans to include a hyperspectral infrared (IR) sounder on its central satellite. Expected to launch in the mid-2030s, the GeoXO Sounder (GXS) will join international counterparts in a geostationary orbit. Ahead of launch, the NASA Global Modeling and Assimilation Office (GMAO) assessed the potential effectiveness of GXS both as a single GEO IR sounder and as part of a global ring of such instruments, including those already being built by international agencies. Using an observing system simulation experiment (OSSE) framework, GXS was assessed from a global numerical weather prediction (NWP) perspective. The ability of GXS, both alone and as part of a global ring of GEO sounders, to improve weather prediction of thermodynamic variables was evaluated globally and regionally. Compared to a control, GXS dominated regional analysis and forecast improvements, and contributed significantly to global increases in forecast skill. However, more sustained global improvements on the order of 4 days rely on international partnerships. Using the FSOI metric over CONUS, the GXS observations provide the strongest radiance impact on the moist energy error norm reduction. Additionally, GXS shows the capability to improve hurricane forecast track errors, resulting in improved forecast warnings. Overall, the persistent atmospheric profile information from GXS over much of the western hemisphere provide an opportunity to improve the representation of weather systems and their forecasts.

Erica McGrath-Spangler↗

NASA NTRS2014

Development, Validation, and Application of OSSEs at NASA-GMAO

The GMAO OSSE framework has two general classes of applications. One is to estimate the potential improvements to weather forecasting and analysis by using new proposed instruments that are not as yet built or deployed. This exploits the simulated nature of the OSSE. The other is to assess various aspects of the GMAO data assimilation system. This exploits the availability of truth provided by the OSSE. Two examples of the first class of application will be offered. One concerns deployment of constellations of passive MW sounders on small CUBESATs placed in very low orbits. The other concern is increasing the frequency of radiosonde observations to 4-times daily at all current stations. Several examples of the second class will also be presented. One is an estimation of analysis error characteristics. Another is a comparison between covariances directly determined from explicitly known background errors and those estimated by computing differences between lagged forecasts using the NMC-method prior to tuning. A third is a comparison of effects of model and observation errors on analysis and forecast skill. The last is an examination of spectra of forecast errors in a study of predictability. This latter is an ongoing study.

OSSE↗

NASA NTRS2000

A New Eddy Dissipation Rate Formulation for the Terminal Area PBL Prediction System(TAPPS)

The TAPPS employs the MASS model to produce mesoscale atmospheric simulations in support of the Wake Vortex project at Dallas Fort-Worth International Airport (DFW). A post-processing scheme uses the simulated three-dimensional atmospheric characteristics in the planetary boundary layer (PBL) to calculate the turbulence quantities most important to the dissipation of vortices: turbulent kinetic energy and eddy dissipation rate. TAPPS will ultimately be employed to enhance terminal area productivity by providing weather forecasts for the Aircraft Vortex Spacing System (AVOSS). The post-processing scheme utilizes experimental data and similarity theory to determine the turbulence quantities from the simulated horizontal wind field and stability characteristics of the atmosphere. Characteristic PBL quantities important to these calculations are determined based on formulations from the Blackadar PBL parameterization, which is regularly employed in the MASS model to account for PBL processes in mesoscale simulations. The TAPPS forecasts are verified against high-resolution observations of the horizontal winds at DFW. Statistical assessments of the error in the wind forecasts suggest that TAPPS captures the essential features of the horizontal winds with considerable skill. Additionally, the turbulence quantities produced by the post-processor are shown to compare favorably with corresponding tower observations.

Charney, Joseph J.↗

NASA NTRS1988

Lagged average predictions in a predictability experiment

Lagged average predictions are examined here within the context of an idealized predictability experiment. Lagged predictions contribute to making better forecasts than the forecasts obtained from using only the latest initial state. Analytic models suggest that lagged predictions contribute the greatest amount when the error growth rates are small. Little dependence upon the magnitude of the intial error is found if the growth rates remain constant. It is also shown how lagged average forecasts can be used to predict the error. Discriminating forecasts made only when the error is predicted to be small are shown to have much better than average skill.

Roads, John O.↗