Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “forecast error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

Forecasting Lightning Threat using Cloud-resolving Model Simulations

As numerical forecasts capable of resolving individual convective clouds become more common, it is of interest to see if quantitative forecasts of lightning flash rate density are possible, based on fields computed by the numerical model. Previous observational research has shown robust relationships between observed lightning flash rates and inferred updraft and large precipitation ice fields in the mixed phase regions of storms, and that these relationships might allow simulated fields to serve as proxies for lightning flash rate density. It is shown in this paper that two simple proxy fields do indeed provide reasonable and cost-effective bases for creating time-evolving maps of predicted lightning flash rate density, judging from a series of diverse simulation case study events in North Alabama for which Lightning Mapping Array data provide ground truth. One method is based on the product of upward velocity and the mixing ratio of precipitating ice hydrometeors, modeled as graupel only, in the mixed phase region of storms at the -15\dgc\ level, while the second method is based on the vertically integrated amounts of ice hydrometeors in each model grid column. Each method can be calibrated by comparing domainwide statistics of the peak values of simulated flash rate proxy fields against domainwide peak total lightning flash rate density data from observations. Tests show that the first method is able to capture much of the temporal variability of the lightning threat, while the second method does a better job of depicting the areal coverage of the threat. A blended solution is designed to retain most of the temporal sensitivity of the first method, while adding the improved spatial coverage of the second. Weather Research and Forecast Model simulations of selected North Alabama cases show that this model can distinguish the general character and intensity of most convective events, and that the proposed methods show promise as a means of generating quantitatively realistic fields of lightning threat. However, because models tend to have more difficulty in correctly predicting the instantaneous placement of storms, forecasts of the detailed location of the lightning threat based on single simulations can be in error. Although these model shortcomings presently limit the precision of lightning threat forecasts from individual runs of current generation models, the techniques proposed herein should continue to be applicable as newer and more accurate physically-based model versions, physical parameterizations, initialization techniques and ensembles of cloud-allowing forecasts become available.

McCaul, E. W., Jr.↗

Experiments with a three-dimensional statistical objective analysis scheme using FGGE data

A three-dimensional (3D), multivariate, statistical objective analysis scheme (referred to as optimum interpolation or OI) has been developed for use in numerical weather prediction studies with the FGGE data. Some novel aspects of the present scheme include: (1) a multivariate surface analysis over the oceans, which employs an Ekman balance instead of the usual geostrophic relationship, to model the pressure-wind error cross correlations, and (2) the capability to use an error correlation function which is geographically dependent. A series of 4-day data assimilation experiments are conducted to examine the importance of some of the key features of the OI in terms of their effects on forecast skill, as well as to compare the forecast skill using the OI with that utilizing a successive correction method (SCM) of analysis developed earlier. For the three cases examined, the forecast skill is found to be rather insensitive to varying the error correlation function geographically. However, significant differences are noted between forecasts from a two-dimensional (2D) version of the OI and those from the 3D OI, with the 3D OI forecasts exhibiting better forecast skill. The 3D OI forecasts are also more accurate than those from the SCM initial conditions. The 3D OI with the multivariate oceanic surface analysis was found to produce forecasts which were slightly more accurate, on the average, than a univariate version.

Baker, Wayman E.↗

Spatio-temporal Fourier Transformer for Long-term Dynamics Prediction (StFT) v1.0

We propose a novel machine learning model spatio-temporal Fourier transformer (StFT) to emulate long-term dynamics of multi-scale and multi-physics systems. Our method StFT overcomes the limitations of rapid error accumulation, particularly in long-term forecasting of systems characterized by complex and coupled dynamics. StFT achieves outstanding accuracy and computational efficiency by effectively capturing multi-scale interactions, and quantify the uncertainties inherent in the predictions. Our model leverages a structured hierarchy of StFT blocks, and explicitly captures dynamics across both macro- and micro- spatial scales. Evaluations conducted on three benchmark datasets (plasma, fluid, and atmospheric dynamics) demonstrate the advantages of our approach over state-of-the-art ML methods.

Bai, Zhe [Lawrence Berkeley National Laboratory (L↗

Optimizing Prediction Error for Time-dependent Solar Radiation Modeling

Numerical weather forecasting models and statistical methods have found wide use to help power companies estimate renewable output, but better methods are needed, particularly for extended forecasts. Machine learning approaches have been used here as well, but so far a major limitation is the ability to also predict the corresponding uncertainty in a forecast. Here we show that both can be done and demonstrate this using a long-term-short memory neural network where the difference between predicted and ground truth data are used to train a model for the corresponding forecast uncertainties.

97 MATHEMATICS AND COMPUTING↗

The effects of tropical wind data on the prediction of ultralong waves

The influence of tropical wind data on the prediction of planetary waves were studied. Two assimilation experiments were performed, one with and one without FGGE tropical winds. The planetary wave error was then analyzed in 72 h forecasts from the initial conditions provided by the two assimilations.

Baker, W. E.↗

Theoretical Modeling for Numerical Weather Prediction

The goal is to utilize predictability theory and numerical experimentation to identify and understand some of the dynamical processes which must be modeled more realistically if large-scale numerical weather predictions are to be improved. The emphasis is on the use of relatively simple models to exlore the properties of physically comprehensive general circulation models (GCM's). A global linear quasi-geostrophic model and the Goddard Laboratory for Atmospheric Sciences (GLAS) GCM were used to investigate several mechanisms which are responsible for the decay of large-scale forecast skill in mid-latitude numerical weather predictions. Five-day forecasts for an ensemble of cases were made using First GARP Global Experiment data. It was found that forecast skill depends crucially on the specification of the stationary forcing. A lack of stationary forcing leads to spurious westwad propagation of the ultralong waves. Forecasts made with stationary forcings derived from climatological data are superior to those using forcings inferred from observations immediately preceding the forecast period. Interhemispheric forecast differences were analyzed, and the model errors were compared to errors of a simple persistence-damped-to-climatology scheme and to errors of the GLAS GCM.

Somerville, R. C. J.↗

ENSO Bred Vectors in Coupled Ocean-Atmosphere General Circulation Models

The breeding method has been implemented in the NASA Seasonal-to-Interannual Prediction Project (NSIPP) Coupled General Circulation Model (CGCM) with the goal of improving operational seasonal to interannual climate predictions through ensemble forecasting and data assimilation. The coupled instability as cap'tured by the breeding method is the first attempt to isolate the evolving ENSO instability and its corresponding global atmospheric response in a fully coupled ocean-atmosphere GCM. Our results show that the growth rate of the coupled bred vectors (BV) peaks at about 3 months before a background ENSO event. The dominant growing BV modes are reminiscent of the background ENSO anomalies and show a strong tropical response with wind/SST/thermocline interrelated in a manner similar to the background ENSO mode. They exhibit larger amplitudes in the eastern tropical Pacific, reflecting the natural dynamical sensitivity associated with the presence of the shallow thermocline. Moreover, the extratropical perturbations associated with these coupled BV modes reveal the variations related to the atmospheric teleconnection patterns associated with background ENSO variability, e.g. over the North Pacific and North America. A similar experiment was carried out with the NCEP/CFS03 CGCM. Comparisons between bred vectors from the NSIPP CGCM and NCEP/CFS03 CGCM demonstrate the robustness of the results. Our results strongly suggest that the breeding method can serve as a natural filter to identify the slowly varying, coupled instabilities in a coupled GCM, which can be used to construct ensemble perturbations for ensemble forecasts and to estimate the coupled background error covariance for coupled data assimilation.

Yang, S. C.↗

The WRF-Solar Ensemble Prediction System: Development, Test, and Validation

Providing reliable probabilistic solar radiation information is needed to improve management of the uncertainty and variability of solar generation. Thus, guidance on how to develop skillful and accurate ensemble forecasts is essential and it will ultimately contribute to integration of high amounts of solar energy on the grid. A team from the National Renewable Energy Laboratory and the National Center for Atmospheric Research had been collaborating to develop the WRF-Solar ensemble prediction system (WRF-Solar EPS) in the past three years to produce probabilistic solar irradiance forecasts and better predict solar energy by quantifying forecast uncertainty. The WRF-Solar EPS basically generates ensemble members for solar irradiance based on stochastic perturbations to provide intraday and day-ahead probabilistic forecasts. This study will present main research steps in developing the WRF-Solar EPS including: (a) tangent linear analysis for identifying key input variables of six WRF-Solar modules significantly related to predicting of cloud and solar irradiance, (b) combining stochastic perturbation technique with the WRF-Solar model, and (c) ensemble calibration method to decrease error and uncertainty of ensemble-based solar forecasts. The capability of WRF-Solar EPS is now updated to the most recent version of standard WRF model. This presentation will summarize comprehensive results from the evaluation of forecasts against the National Solar Radiation Data Base as well as ground-measured observations. Moreover, we will introduce the user's guide for WRF-Solar EPS (e.g., parameters to configure stochastic perturbations) and future extension of this research.

day-ahead forecast↗

Cloud Influence on ERA5 and AMPS Surface Downwelling Longwave Radiation Biases in West Antarctica

The surface downwelling longwave radiation component (LW[down arrow]) is crucial for the determination of the surface energy budget and has significant implications for the resilience of ice surfaces in the polar regions. Accurate model evaluation of this radiation component requires knowledge about the phase, vertical distribution, and associated temperature of water in the atmosphere, all of which control the LW[down arrow] signal measured at the surface. In this study, we examine the LW[down arrow] model errors found in the Antarctic Mesoscale Prediction System (AMPS) operational forecast model and the ERA5 reanalysis model relative to observations from the AWARE campaign at McMurdo Station and the West Antarctic Ice Sheet (WAIS) Divide. The errors are calculated separately for observed clear-sky conditions, ice-cloud occurrences, and liquid-bearing cloud layer (LBCL) occurrences. The analysis results show a tendency in both models at each site to underestimate the LW[down arrow] during clear sky conditions, high error variability (standard deviations > 20 W/m[exp2]) during any type of cloud occurrence, and negative LW biases when LBCLs are observed (bias magnitudes > 15 W/m[exp2] in tenuous LBCL cases; > 43 W/m[exp2] in optically thick/opaque LBCLs instances). We suggest that a generally dry and liquid-deficient atmosphere responsible for the identified LW[down arrow] biases in both models is the result of excessive ice formation and growth, which could stem from model initial and lateral boundary conditions, microphysics scheme, aerosol representation, and/or limited vertical resolution.

Israel Silber↗

An error analysis of basic kinematic quantities

A description is presented of the computational procedures used to obtain spatial fields of relative vorticity, advection of vorticity, horizontal divergence, and vertical motion. An investigation is conducted of the effectiveness of these procedures to reduce the effects of deliberately introduced random errors, giving attention to the confidence which can be placed on values of the derived parameters. It is concluded that fields of 500 mb vorticity and 700 mb vertical velocity, which are frequently used in synoptic scale forecasting schemes, show minimal effects of the deliberately introduced errors. Vorticity advection is found to be the most sensitive term to input data errors. Large fluctuations in fields of this parameter are evident both statistically and qualitatively.

Berecek, E. M.↗

One-Step Ahead Prediction of Thermal Mixing Tee Sensors with Long Short Term Memory (LSTM) Neural Networks

High-temperature advanced reactors under development, such as sodium fast reactors (SFR) and molten salt cooled reactors (MSCR), are expected to offer lower levelized cost of energy (LCOE) compared to existing light water reactor (LWR’s). In the existing light water reactors (LWR’s), operation and maintenance (O&M) expenses constitute the largest fraction of the total operating cost. Some of the O&M costs are related maintenance of sensors which can fail due to exposure to harsh environment in a reactor. The O&M costs of Advanced Reactor (AR)’s are expected to constitute a significant fraction of the total cost as well, because of high temperature and radiation level in AR are likely to cause material fatigue and premature failure of sensors and components. The O&M costs in AR’s could be reduced through integration of advanced informatics of performance-related sensors into a digital twin designed for reactor monitoring. For example, machine learning (ML) could be employed for real-time validation and correction of performance-related sensors, and reducing the number of performance-related physical sensor units through virtual sensing. As part of the effort, we investigate real-time validation of thermal hydraulic sensors through one-step ahead forecasting of sensor values using long short-term memory (LSTM) recurrent neural networks (RNN). The sensors are installed in a flow loop containing a thermal mixing tee, which is a common experimental model to study thermal fatigue in a thermal hydraulic loop. In addition, nonlinear transients generated in a thermal mixing tee constitute a good challenge data set for training and validation of ML algorithms. Sensors in this study include thermocouples, flow meters, and optical fibers for distributed temperature sensing. In one experiment, measurement data sets were obtained for a loop was filled with water, and in another experiment, measurements were performed on a loop filled with liquid metal Galinstan. We have also conducted preliminary investigation of one-step ahead prediction of fiber optics-based distributed temperature sensing with LSTM networks. In predicting fiber-based temperature measurements, we treated each gauge pitch of the fiber as an independent sensor. Accuracy of one-step ahead forecasting was estimated by calculating root mean square error (RMSE) for the test segment of time series of each sensor. RMSE’s for temperature sensors in water loop were, for the most part, lower than for the same sensors in Galinstan loop. The RMSE’s for flow meters were similar for both loops. The RMSE’s for distributed temperature measured with the fiber optic sensor were similar to those of the point sensors. Results of this study demonstrated the capability of LSTM one-step ahead forecasting with RMSE comparable to uncertainty in sensor measurements.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Scale-Dependent Value of QPF for Real-Time Streamflow Forecasting

Incorporating rainfall forecasts into a real-time streamflow forecasting system extends the forecast lead time. Since quantitative precipitation forecasts (QPFs) are subject to substantial uncertainties, questions arise on the trade-off between the time horizon of the QPF and the accuracy of the streamflow forecasts. This study explores the problem systematically, exploring the uncertainties associated with QPFs and their hydrologic predictability. The focus is on scale dependence of the trade-off between the QPF time horizon, basin-scale, space-time scale of the QPF, and streamflow forecasting accuracy. To address this question, the study first performs a comprehensive independent evaluation of the QPFs at 140 U.S. Geological Survey (USGS) monitored basins with a wide range of spatial scales (~10 – 40,000 km 2 ) over the state of Iowa in the Midwestern United States. The study uses High-Resolution Rapid Refresh (HRRR) and Global Forecasting System (GFS) QPFs for short and medium-range forecasts, respectively. Using Multi-Radar Multi-Sensor (MRMS) quantitative precipitation estimate (QPE) as a reference, the results show that the rainfall-to-rainfall QPF errors are scale-dependent. The results from the hydrologic forecasting experiment show that both QPFs illustrate clear value for real-time streamflow forecasting at longer lead times in the short- to medium-range relative to the no-rain streamflow forecast. The value of QPFs for streamflow forecasting is particularly apparent for basin sizes below 1,000 km 2 . The space-time scale, or reference time t r ) (ratio of forecast lead time to basin travel time) ~ 1 depicts the largest streamflow forecasting skill with a systematic decrease in forecasting accuracy for t r > 1.

54 ENVIRONMENTAL SCIENCES↗

Analyzing the Impact of CryoSat-2 Ice Thickness Initialization on Seasonal Arctic Sea Ice Prediction

Twin 5-month seasonal forecast experiments are performed to predict the September 2018 minimum ice extent using the fully coupled Navy Earth System Prediction Capability (ESPC). In the control run, ensemble forecasts are initialized from the operational US Navy Global Ocean Forecasting System (GOFS) 3.1 for the ocean and sea ice but do not assimilate ice thickness data. Another set of forecasts are initialized from the same GOFS 3.1 fields but with sea ice thickness derived from CryoSat-2 (CS2). The Navy ESPC ensemble mean September 2018 minimum sea ice extent initialized with GOFS 3.1 ice thickness was over-predicted by 0.68 M sq.km (5.27 M sq.km) versus the ensemble set of forecasts initialized with CS2 ice thickness that had an error of 0.40 M sq.km (4.99 M sq.km), a 56% reduction in error. The September mean Integrated Ice Edge Error (IIEE) shows a 19% improvement for the entire Arctic with the CS2 data versus the control run. Comparison against Upward Looking Sonar (ULS) ice thickness in the Beaufort Sea reveals a lower bias and RMSE with the CS2 forecasts at all three moorings. Ice concentration at these locations is also improved, but neither set of experiments show ice free conditions as observed at moorings A and D.

time-lagged ensembles↗

Improving Air Quality Forecasts with AURA Observations

Past studies have identified model initial and boundary conditions as sources of reducible errors in air-quality simulations. In particular, improving the initial condition improves the accuracy of short-term forecasts as it allows for the impact of local emissions to be realized by the model and improving boundary conditions improves long range transport through the model domain, especially in recirculating anticyclones. During the August 2006 period, we use AURA/OMI ozone measurements along with MODIS and CALIPSO aerosol observations to improve the initial and boundary conditions of ozone and Particulate Matter. Assessment of the model by comparison of the control run and satellite assimilation run to the IONS06 network of ozonesonde observations, which comprise the densest ozone sounding campaign ever conducted in North America, to AURA/TES ozone profile measurements, and to the EPA ground network of ozone and PM measurements will show significant improvement in the CMAQ calculations that use AURA initial and boundary conditions. Further analyses of lightning occurrences from ground and satellite observations and AURA/OMI NO2 column abundances will identify the lightning NOx signal evident in OMI measurements and suggest pathways for incorporating the lightning and NO2 data into the CMAQ simulations.

Newchurch, M. J.↗

AIRS Impact on the Analysis and Forecast Track of Tropical Cyclone Nargis in a Global Data Assimilation and Forecasting System

Tropical cyclones in the northern Indian Ocean pose serious challenges to operational weather forecasting systems, partly due to their shorter lifespan and more erratic track, compared to those in the Atlantic and the Pacific. Moreover, the automated analyses of cyclones over the northern Indian Ocean, produced by operational global data assimilation systems (DASs), are generally of inferior quality than in other basins. In this work it is shown that the assimilation of Atmospheric Infrared Sounder (AIRS) temperature retrievals under partial cloudy conditions can significantly impact the representation of the cyclone Nargis (which caused devastating loss of life in Myanmar in May 2008) in a global DAS. Forecasts produced from these improved analyses by a global model produce substantially smaller track errors. The impact of the assimilation of clear-sky radiances on the same DAS and forecasting system is positive, but smaller than the one obtained by ingestion of AIRS retrievals, possibly due to poorer coverage.

Reale, O.↗

A New Objective Technique for Verifying Mesoscale Numerical Weather Prediction Models

This report presents a new objective technique to verify predictions of the sea-breeze phenomenon over east-central Florida by the Regional Atmospheric Modeling System (RAMS) mesoscale numerical weather prediction (NWP) model. The Contour Error Map (CEM) technique identifies sea-breeze transition times in objectively-analyzed grids of observed and forecast wind, verifies the forecast sea-breeze transition times against the observed times, and computes the mean post-sea breeze wind direction and speed to compare the observed and forecast winds behind the sea-breeze front. The CEM technique is superior to traditional objective verification techniques and previously-used subjective verification methodologies because: It is automated, requiring little manual intervention, It accounts for both spatial and temporal scales and variations, It accurately identifies and verifies the sea-breeze transition times, and It provides verification contour maps and simple statistical parameters for easy interpretation. The CEM uses a parallel lowpass boxcar filter and a high-order bandpass filter to identify the sea-breeze transition times in the observed and model grid points. Once the transition times are identified, CEM fits a Gaussian histogram function to the actual histogram of transition time differences between the model and observations. The fitted parameters of the Gaussian function subsequently explain the timing bias and variance of the timing differences across the valid comparison domain. Once the transition times are all identified at each grid point, the CEM computes the mean wind direction and speed during the remainder of the day for all times and grid points after the sea-breeze transition time. The CEM technique performed quite well when compared to independent meteorological assessments of the sea-breeze transition times and results from a previously published subjective evaluation. The algorithm correctly identified a forecast or observed sea-breeze occurrence or absence 93% of the time during the two- month evaluation period from July and August 2000. Nearly all failures in CEM were the result of complex precipitation features (observed or forecast) that contaminated the wind field, resulting in a false identification of a sea-breeze transition. A qualitative comparison between the CEM timing errors and the subjectively determined observed and forecast transition times indicate that the algorithm performed very well overall. Most discrepancies between the CEM results and the subjective analysis were again caused by observed or forecast areas of precipitation that led to complex wind patterns. The CEM also failed on a day when the observed sea- breeze transition affected only a very small portion of the verification domain. Based on the results of CEM, the RAMS tended to predict the onset and movement of the sea-breeze transition too early and/or quickly. The domain-wide timing biases provided by CEM indicated an early bias on 30 out of 37 days when both an observed and forecast sea breeze occurred over the same portions of the analysis domain. These results are consistent with previous subjective verifications of the RAMS sea breeze predictions. A comparison of the mean post-sea breeze winds indicate that RAMS has a positive wind-speed bias for .all days, which is also consistent with the early bias in the sea-breeze transition time since the higher wind speeds resulted in a faster inland penetration of the sea breeze compared to reality.

Case, Jonathan L.↗

A Comparison of Infectious Disease Forecasting Methods across Locations, Diseases, and Time

Accurate infectious disease forecasting can inform efforts to prevent outbreaks and mitigate adverse impacts. This study compares the performance of statistical, machine learning (ML), and deep learning (DL) approaches in forecasting infectious disease incidences across different countries and time intervals. We forecasted three diverse diseases: campylobacteriosis, typhoid, and Q-fever, using a wide variety of features (n = 46) from public datasets, e.g., landscape, climate, and socioeconomic factors. We compared autoregressive statistical models to two tree-based ML models (extreme gradient boosted trees [XGB] and random forest [RF]) and two DL models (multi-layer perceptron and encoder–decoder model). The disease models were trained on data from seven different countries at the region-level between 2009–2017. Forecasting performance of all models was assessed using mean absolute error, root mean square error, and Poisson deviance across Australia, Israel, and the United States for the months of January through August of 2018. The overall model results were compared across diseases as well as various data splits, including country, regions with highest and lowest cases, and the forecasted months out (i.e., nowcasting, short-term, and long-term forecasting). Overall, the XGB models performed the best for all diseases and, in general, tree-based ML models performed the best when looking at data splits. There were a few instances where the statistical or DL models had minutely smaller error metrics for specific subsets of typhoid, which is a disease with very low case counts. Feature importance per disease was measured by using four tree-based ML models (i.e., XGB and RF with and without region name as a feature). The most important feature groups included previous case counts, region name, population counts and density, mortality causes of neonatal to under 5 years of age, sanitation factors, and elevation. This study demonstrates the power of ML approaches to incorporate a wide range of factors to forecast various diseases, regardless of location, more accurately than traditional statistical approaches.

59 BASIC BIOLOGICAL SCIENCES↗

Machine-Learning-Driven, Site-Specific Weather Forecasting for Grid-Interactive Efficient Buildings: Preprint

Emerging grid-interactive efficient buildings (GEBs) have great potential to provide much-needed demand flexibility to electric grids while fulfilling their own control targets by co-optimizing smart appliances, solar photovoltaics, electric vehicles, and energy storage at buildings. To enable the optimal operation of GEBs, site-specific weather information—such as temperature, solar irradiance, relative humidity, and wind speed—is crucial; however, this information is generally unavailable or expensive to obtain. This paper develops advanced machine learning methods to provide precise weather forecasts for individual building sites using readily available weather station data. Support vector regression and artificial neural networks have been employed to learn the spatiotemporal correlations between the weather conditions at nearby weather stations and the individual building site. The proposed site-specific weather forecasting methods have been validated using 1-year actual weather measurement data collected in the Denver metro area. Results show that the developed machine-learning-driven methods can accurately forecast the temperature at the target building site 1 hour ahead with mean absolute error less than 0.72°C and a 48% improvement over the persistence method. Site-specific weather forecasts will improve the understanding of the microclimate effect and its impact on building energy consumption. This information will drive efficiency upgrades and adjustments of building control strategies to improve energy savings and increase flexibility in building loads.

30 DIRECT ENERGY CONVERSION↗