SEARCH · Engineering Papers

Results for “Forecast verification/skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

6 records

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Deep Learning Experiments for Tropical Cyclone Intensity Forecasts

Reducing tropical cyclone (TC) intensity forecast errors is a challenging task that has interested the operational forecasting and research community for decades. To address this, we developed a deep learning (DL)-based multilayer perceptron (MLP) TC intensity prediction model. The model was trained using the global Statistical Hurricane Intensity Prediction Scheme (SHIPS) predictors to forecast the change in TC maximum wind speed for the Atlantic basin. In the first experiment, a 24-h forecast period was considered. To overcome sample size limitations, we adopted a leave one year out (LOYO) testing scheme, where a model is trained using data from all years except one and then evaluated on the year that is left out. When tested on 2010–18 operational data using the LOYO scheme, the MLP outperformed other statistical–dynamical models by 9%–20%. Additional independent tests in 2019 and 2020 were conducted to simulate real-time operational forecasts, where the MLP model again outperformed the statistical–dynamical models by 5%–22% and achieved comparable results as HWFI. The MLP model also correctly predicted more rapid intensification events than all the four operational TC intensity models compared. In the second experiment, we developed a lightweight MLP for 6-h intensity predictions. When coupled with a synthetic TC track model, the lightweight MLP generated realistic TC intensity distribution in the Atlantic basin. Therefore, the MLP-based approach has the potential to improve operational TC intensity forecasts, and will also be a viable option for generating synthetic TCs for climate studies.

58 GEOSCIENCES↗

NASA NTRS2021

Asymmetry in Subseasonal Surface Air Temperature Forecast Error with Respect to Soil Moisture Initialization

Soil moisture (W) helps control evapotranspiration (ET), and ET variations can in turn have a distinct impact on 2-m air temperature (T2M), given that increases in evaporative cooling encourage reduced temperatures. Soil moisture is accordingly linked to T2M, and realistic soil moisture initialization has, in previous studies, been shown to improve the skill of subseasonal T2M forecasts. The relationship between soil moisture and evapotranspiration, however, is distinctly nonlinear, with ET tending to increase with soil moisture in drier conditions and to be insensitive to soil moisture variations in wetter conditions. Here, through an extensive analysis of subseasonal forecasts produced with a state-of-the-art seasonal forecast system, this nonlinearity is shown to imprint itself on T2M forecast error in the conterminous United States in two unique ways: (i) the T2M forecast bias (relative to independent observations) induced by a negative precipitation bias tends to be larger for dry initializations, and (ii) on average, the unbiased root-mean-square error (ubRMSE) tends to be larger for dry initializations. Such findings can aid in the identification of forecasts of opportunity; taken a step further, they suggest a pathway for improving bias correction and uncertainty estimation in subseasonal T2M forecasts by conditioning each on initial soil moisture state.

Air Temperature↗

DOE OSTI2022

Advances in the Application and Utility of Subseasonal-to-Seasonal Predictions

The subseasonal-to-seasonal (S2S) predictive time scale, encompassing lead times ranging from 2 weeks to a season, is at the frontier of forecasting science. Forecasts on this time scale provide opportunities for enhanced application-focused capabilities to complement existing weather and climate services and products. There is, however, a “knowledge–value” gap, where a lack of evidence and awareness of the potential socioeconomic benefits of S2S forecasts limits their wider uptake. To address this gap, here we present the first global community effort at summarizing relevant applications of S2S forecasts to guide further decision-making and support the continued development of S2S forecasts and related services. Focusing on 12 sectoral case studies spanning public health, agriculture, water resource management, renewable energy and utilities, and emergency management and response, we draw on recent advancements to explore their application and utility. These case studies mark a significant step forward in moving from potential to actual S2S forecasting applications. We show that by placing user needs at the forefront of S2S forecast development—demonstrating both skill and utility across sectors—this dialogue can be used to help promote and accelerate the awareness, value, and cogeneration of S2S forecasts. We also highlight that while S2S forecasts are increasingly gaining interest among users, incorporating probabilistic S2S forecasts into existing decision-making operations is not trivial. Nevertheless, S2S forecasting represents a significant opportunity to generate useful, usable, and actionable forecast applications for and with users that will increasingly unlock the potential of this forecasting time scale.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Attribution of North American Subseasonal Precipitation Prediction Skill

The skill of NOAA’s official monthly U.S. precipitation forecasts (issued in the middle of the prior month) has historically been low, having shown modest skill over the southern United States, but little or no skill over large portions of the central United States. The goal of this study is to explain the seasonal and regional variations of the North American subseasonal (weeks 3–6) precipitation skill, specifically the reasons for its successes and its limitations. The performances of multiple recent-generation model reforecasts over 1999–2015 in predicting precipitation are compared to uninitialized simulation skill using the atmospheric component of the forecast systems. This parallel analysis permits attribution of precipitation skill to two distinct sources: one due to slowly evolving ocean surface boundary states and the other to faster time-scale initial atmospheric weather states. A strong regionality and seasonality in precipitation forecast performance is shown to be analogous to skill patterns dictated by boundary forcing constraints alone. The correspondence is found to be especially high for the North American pattern of the maximum monthly skill that is achieved in the reforecast. The boundary forcing of most importance originates from tropical Pacific SST influences, especially those related to El Niño–Southern Oscillation. Furthermore, we discuss physical constraints that may limit monthly precipitation skill and interpret the performance of existing models in the context of plausible upper limits.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Lidar-Based Evaluation of HRRR Performance in California’s Diablo Range

The performance of the NOAA High-Resolution Rapid Refresh (HRRR) model for capturing low-level winds near a wind energy production site during summer 2019 is evaluated. This study catalogs the ability of HRRR to predict boundary layer dynamics relevant to wind energy interests over complex terrain, which has presented challenges for weather and energy forecasting. Performance is evaluated by comparing HRRR output to wind-profiling Doppler lidars at Lawrence Livermore National Laboratory Site 300. HRRR captured the diurnal profile of horizontal winds in the observed 150-m layer, despite strong underpredictions (∼4 m s −1 ) during evening and nighttime hours. These underpredictions may be a result of local speedup flows observed by the lidars, which were unresolved in HRRR due to their small spatial extent. HRRR bias magnitude relative to observations was found to be minimal during days with synoptic-scale troughs and strong 850-hPa geopotential gradients, while bias magnitude was maximal during days with synoptic ridging and weak 850-hPa geopotential gradients. To translate wind speed predictions to energy forecasting, generic turbine models were used to estimate power generation for turbines characteristic of the nearby Altamont Pass Wind Resource Area. Results show that HRRR-based energy estimates predicted daytime power generation adequately relative to lidar-based estimates with an 18-h lead time (bias magnitude < 0.4 MW from 0900 to 1400 LT) but overpredicted power during the rest of the diurnal cycle (bias > 1 MW). These results demonstrate conditions under which HRRR performs well for wind energy applications in complex terrain, while highlighting biases that require further investigation to support usage of a high-resolution model for wind energy forecasts.

Boundary layer↗

NASA NTRS2022

Observation Impact and Information Retention in the Lower Troposphere of the GMAO GEOS Data Assimilation System

In this study, we have assessed the effectiveness of the use of existing observing systems in the lower troposphere in the GEOS hybrid–4DEnVar data assimilation system through a set of observing system experiments. The results show that microwave radiances have a large impact in the Southern Hemisphere and Tropical ocean, but the large influence is mostly observed above 925 hPa and dissipates relatively quickly with longer forecast lead times. Conventional data information holds better in the forecast ranging from the surface to 100 hPa, depending on the field evaluated, in the Northern Hemisphere and lowest model levels in the Tropics. Infrared radiances collectively have much less impact in the lower troposphere. Removing surface observations has small but persistent impact on specific humidity in the upper atmosphere, but small or negligible impact on planetary boundary layer (PBL) height and temperature. The model responses to the incremental analysis update (IAU) forcing are also analyzed. In the IAU assimilation window, the physics responds strongly to the IAU forcing in the lower troposphere, and the changes of physics tendency in the lower troposphere and hydrodynamics tendency in the mid- and upper troposphere are viewed as beneficial to the reduction of state error covariance. In the subsequent forecast, the model tendencies continue to deviate further from the original free forecast with forecast lead times around 300–400 hPa, but physics tendency has showed signs of returning to its original free forecast mechanisms at 1-day forecast in the lower troposphere.

GEOS↗