SEARCH · Engineering Papers

Results for “forecast error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

All sources NASA NTRS DOE OSTI

NASA NTRS1994

Suboptimal schemes for atmospheric data assimilation based on the Kalman filter

This work is directed toward approximating the evolution of forecast error covariances for data assimilation. The performance of different algorithms based on simplification of the standard Kalman filter (KF) is studied. These are suboptimal schemes (SOSs) when compared to the KF, which is optimal for linear problems with known statistics. The SOSs considered here are several versions of optimal interpolation (OI), a scheme for height error variance advection, and a simplified KF in which the full height error covariance is advected. To employ a methodology for exact comparison among these schemes, a linear environment is maintained, in which a beta-plane shallow-water model linearized about a constant zonal flow is chosen for the test-bed dynamics. The results show that constructing dynamically balanced forecast error covariances rather than using conventional geostrophically balanced ones is essential for successful performance of any SOS. A posteriori initialization of SOSs to compensate for model - data imbalance sometimes results in poor performance. Instead, properly constructed dynamically balanced forecast error covariances eliminate the need for initialization. When the SOSs studied here make use of dynamically balanced forecast error covariances, the difference among their performances progresses naturally from conventional OI to the KF. In fact, the results suggest that even modest enhancements of OI, such as including an approximate dynamical equation for height error variances while leaving height error correlation structure homogeneous, go a long way toward achieving the performance of the KF, provided that dynamically balanced cross-covariances are constructed and that model errors are accounted for properly. The results indicate that such enhancements are necessary if unconventional data are to have a positive impact.

Todling, Ricardo↗

DOE OSTI2023

Multi-layered Energy Management Framework for Extreme Fast Charging Stations Considering Demand Charges, Battery Degradation, and Forecast Uncertainties

To achieve a cost-effective and expeditious charging experience for extreme fast charging station (XFCS) owners and electric vehicle (EV) users, the optimal operation of XFCS is crucial. It is however challenging to simultaneously manage the profit from energy arbitrage, the cost of demand charges, and the degradation of a battery energy storage system (BESS) under uncertainties. This paper, therefore, proposes a multi-layered multi-time scale energy flow management framework for an XFCS by considering long- and short-term forecast uncertainties, monthly demand charges reduction, and BESS life degradation. In the proposed approach, an upper scheduling layer (USL) ensures the overall operation economy and yields optimal scheduling of the energy resources on a rolling horizon basis, thereby considering the long-term forecast errors. A lower dispatch layer (LDL) takes the short-term forecast errors into account during the real-time operation of the XFCS. Per the latest research, monthly demand charges can be as high as 90% of the total monthly bills for EV fast charging stations; to this end, this paper takes the first attempt at the reduction of demand charges cost by considering the trade-off between the energy cost and monthly demand charges. Contrasting literature, this work allocates an energy reserve in the BESS stored energy to deal with the impact of short-term forecast errors on the optimized real-time operation of the XFCS. Moreover, degradation modeling considers the trade-off between short-term benefits and long-term BESS life degradation. As a result, case studies and a comparative analysis prove the efficacy of the proposed framework.

24 POWER TRANSMISSION AND DISTRIBUTION↗

NASA NTRS2019

Assessing the Impact of Observations in a Multi-Year Reanalysis (MERRA-2)

Operational and quasi-operational weather prediction centers have been routinely assessing the contribution from various observing systems to reducing errors in short-range forecasts for a number of years now. The original technique, Forecast Sensitivity-based Observation Impact (FSOI), involves definition of a forecast error measure and evaluation of sensitivities with respect to changes in the observations that require adjoint operators of both the underlying tangent linear model and corresponding analysis technique. The present work applies FSOI to reanalysis and aims at providing an expanded view of the contribution of various observing systems over nearly 40 years of assimilation. Specifically, this study uses MERRA-2 given that its supporting software includes all ingredients necessary to calculate FSOI. Part of this work shows how the quality of forecasts improves over the course of the reanalysis, and examines forecast sensitivities relevant to FSOI. The assessment here finds, for example, that: conventional observations are a major player in reducing forecast error throughout the 40 years of reanalysis, even when their volume reduces from 45\% in the earlier periods to about 5% in the modern era; satellite radiances, especially microwave instruments are major contributors to error reduction from the early single platform TIROS-N days to the current multi-platform scenario, though their fractional contribution reduces slightly from the early 2000's onward after the increased availability of wind observation from aircraft and atmospheric motion vectors, and the introduction of GPSRO; infrared instruments play a secondary role to microwave but are significant still, with the peculiar result of fractional impacts contribution from modern hyperspectral instruments being roughly similar to those from early infrared instruments. The dependence of results on the chosen error measure is emphasized throughout.

Todling, Ricardo↗

NASA NTRS2019

Assessing the Impact of Observations in a Multi-Year Reanalysis

Operational and quasi-operational weather prediction centers have been routinely assessing the contribution from various observing systems to reducing errors in short-range forecasts for a number of years now. The original technique, Forecast Sensitivity Observation Impact (FSOI), involves definition of a forecast error measure and evaluation of sensitivities with respect to changes in the observing system that require adjoint operators of both the underlying tangent linear model and corresponding analysis technique. The present work applies FSOI to Reanalysis and aims at providing an expanded view of the contribution of various observing systems over nearly 40 years of assimilation. Specifically, this study uses MERRA-2 given that its supporting software includes all ingredients necessary to calculate FSOI. Part of this work shows how the quality of forecasts improves over the course of the reanalysis, and examines forecast sensitivities relevant to FSOI. The assessment here finds, for example, that: conventional observations are a major player in reducing forecast error throughout the 40 years of reanalysis, even when their volume reduces from 45% in the earlier periods to about 5% in the modern era; satellite radiances, especially microwave instruments are major contributors to error reduction from the early single platform TIROS-N days to the current multi-platform scenario; infrared instruments play a secondary role to microwave but are significant still, with the peculiar result of fractional impacts contribution from modern hyperspectral instruments being roughly similar to those from early infrared instruments. The dependence of results on the chosen error measure is emphasized throughout.

Fabio L R Diniz↗

DOE OSTI2022

Machine Learning Derived Dynamic Operating Reserve Requirements in High-Renewable Power Systems

Accurately forecasting wind and solar power output poses challenges for deeply decarbonized electricity systems. Grid operators must commit resources to provide reserves to ensure reliable operations in the face of forecast errors, a process which can increase fuel consumption and emissions. We apply neural network-based machine learning to expand the usefulness of median point forecast data by creating probabilistic distributions of short-term uncertainty in demand, wind, and solar forecasts that adapt to prevailing grid conditions. Machine learning derived estimates of forecast errors compare favorably to estimates based on incumbent methods. Reserves derived from machine learning are usually smaller than values derived using incumbent methods, which enables fuel savings during most hours. Machine learning reserves are generally larger than incumbent reserves during times of higher forecast error, potentially improving system reliability. Performance is tested using multi-stage production simulation modeling of the California Independent System Operator (CAISO) system. Machine learning reserves provide production cost and greenhouse gas (GHG) emission reductions of approximately 0.3% relative to historical 2019 requirements. Savings in the 2030 timeframe are highly dependent on battery storage capacity. At lower levels of battery capacity, savings of 0.4% from machine learning reserves are shown. Significant quantities of battery storage are expected to be added to meet California's resource adequacy needs and GHG reduction targets. Addition of these batteries saturate reserve needs and results in minimal within-hour balancing costs in 2030.

24 POWER TRANSMISSION AND DISTRIBUTION↗

NASA NTRS1987

Error growth and predictability in operational ECMWF forecasts

The forecast error growth in the 100-day ECMWF data set of 10-day forecasts previously utilized by Lorenz (1982) is studied, separating the square of the error into systematic and random components. The nature of the errors is analyzed in the spherical harmonics wavenumber domain, and a new parametrization and its application to global errors are presented. The wavenumber dependence of the error growth is studied.

Dalcher, Amnon↗

DOE OSTI2022

Assessing the WRF-Solar Model Performance Using Satellite-Derived Irradiance from the National Solar Radiation Database

Abstract WRF-Solar is a numerical weather prediction model specifically designed to meet the increasing demand for accurate solar irradiance forecasting. The model provides flexibility in the representation of the aerosol–cloud–radiation processes. This flexibility can be argued to make it more difficult to improve the model’s performance because of the necessity of inspecting different configurations. To alleviate this situation, WRF-Solar has a reference configuration to use as a benchmark in sensitivity experiments. However, the scarcity of high-quality ground observations is a handicap to accurately quantify the model performance. An alternative to ground observations are satellite irradiance retrievals. Herein we analyze the adequacy of the National Solar Radiation Database (NSRDB) to validate the WRF-Solar performance using high-quality global horizontal irradiance (GHI) observations across the contiguous United States (CONUS). Based on the sufficient performance of NSRDB, we further analyze the WRF-Solar forecast errors across the CONUS, the growth of the forecasting errors as a function of the lead time, and sensitivities to the grid spacing and the representation of the radiative effects of unresolved clouds. Our results based on WRF-Solar forecasts spanning 2018 reveal a 7% median degradation of the mean absolute error (MAE) from the first to the second daytime period. Reducing the grid spacing from 9 to 3 km leads to a 4% improvement in the MAE, whereas activating the radiative effects of unresolved clouds is desirable over most of the CONUS even at 3 km of grid spacing. A systematic overestimation of the GHI is found. These results illustrate the potential of GHI retrievals to contribute to increasing the WRF-Solar performance.

14 SOLAR ENERGY↗

NASA NTRS1991

Simplification of the Kalman filter for meteorological data assimilation

The paper proposes a new statistical method of data assimilation that is based on a simplification of the Kalman filter equations. The forecast error covariance evolution is approximated simply by advecting the mass-error covariance field, deriving the remaining covariances geostrophically, and accounting for external model-error forcing only at the end of each forecast cycle. This greatly reduces the cost of computation of the forecast error covariance. In simulations with a linear, one-dimensional shallow-water model and data generated artificially, the performance of the simplified filter is compared with that of the Kalman filter and the optimal interpolation (OI) method. The simplified filter produces analyses that are nearly optimal, and represents a significant improvement over OI.

Dee, Dick P.↗

NASA NTRS1985

Application of lagged averaged forecasting to medium range forecasting

The lagged average forecast (LAF) method for predicting and compensating for forecast error growth is applied to two 100 day samples of 10 day forecasts at the 500 mb altitude for winter-summer 1980-81. The LAF parameterizes the forecast error growth in order to weight the forecast with regression calculations. A 5 day LAF forecast was generated for a 10 day forecast made with a 1681 d.o.f. model which produced predictions using a truncated spherical harmonic expansion. A 100 day data set was employed, with the first 90 days serving for LAF forecasts for the model forecast. Significant improvements were obtained in the model forecast when the LAF weightings were introduced into the model variables.

Dalcher, A.↗

NASA NTRS2003

Comparison of Flow-Dependent and Static Error Correlation Models in the DAO Ozone Data Assimilation System

In a data assimilation system the forecast error covariance matrix governs the way in which the data information is spread throughout the model grid. Implementation of a correct method of assigning covariances is expected to have an impact on the analysis results. The simplest models assume that correlations are constant in time and isotropic or nearly isotropic. In such models the analysis depends on the dynamics only through assumed error standard deviations. In applications to atmospheric tracer data assimilation this may lead to inaccuracies, especially in regions with strong wind shears or high gradient of potential vorticity, as well as in areas where no data are available. In order to overcome this problem we have developed a flow-dependent covariance model that is based on short term evolution of error correlations. The presentation compares performance of a static and a flow-dependent model applied to a global three- dimensional ozone data assimilation system developed at NASA s Data Assimilation Office. We will present some results of validation against WMO balloon-borne sondes and the Polar Ozone and Aerosol Measurement (POAM) III instrument. Experiments show that allowing forecast error correlations to evolve with the flow results in positive impact on assimilated ozone within the regions where data were not assimilated, particularly at high latitudes in both hemispheres and in the troposphere. We will also discuss statistical characteristics of both models; in particular we will argue that including evolution of error correlations leads to stronger internal consistency of a data assimilation ,

Wargan, K.↗

DOE OSTI2025

Improving seasonal precipitation forecasts in the Western United States through statistical downscaling

Abstract Seasonal precipitation forecasts in the western United States are critical resources for water resource management, especially during winter. While current seasonal forecasting systems provide monthly precipitation forecasts operationally, their coarse resolution limits their effectiveness in capturing the localized precipitation patterns and snowpack conditions essential for water resource managers in the mountainous regions. Here, analog statistical downscaling is demonstrated as an effective approach to enhance the spatial resolution of operational seasonal forecasts provided by the North American Multi-Model Ensemble. Downscaling was performed by building an analog ‘library’, in which corresponding model forecasts and observed values during the training period were stored. In the testing period, unseen model forecasts referenced the closest historical forecast from the analog library and applied the corresponding observational value for each point. This analysis indicates that downscaled products can capture localized features more accurately than the original coarse resolution forecasts, reducing forecast error across the western United States. Moreover, downscaling individual ensemble members—rather than downscaling the ensemble mean—further reduces forecasting error for their multi-model ensemble mean products. The greatest error reductions in the downscaled product, measured by root mean squared error (RMSE), were observed at low to mid-elevations (500–2000 meters), with 50%–70% improvement relative to the original forecasts. In the higher elevations (2000 meters and above), changes in RMSE relative to the original forecast were limited to 10%–30% improvements. The improvement is more substantial for forecast systems with 10 ensemble members compared to that with 4 members, but this relationship does not hold for the system with 24 ensemble members. These findings show that analog statistical downscaling can effectively address the spatial limitations of seasonal precipitation forecasts with minimal computational cost, providing a valuable framework for enhancing coarse resolution forecasting products while providing insights into the timing of ensemble mean calculations during the downscaling process.

Vernon, B. (ORCID:0009000891670689)↗

NASA NTRSDate not supplied

Complementarities of GEO and LEO IR Sounders for Numerical Weather Prediction in an OSSE Framework

Preparations are underway for the United States’ weather satellite program and the expected advancements in the coming decade. Among these changes is the launch of the proposed NOAA/NASA Geostationary eXtended Observations (GeoXO) Sounder (GXS), coordinated with international counterparts, to form a global ring of hyperspectral infrared (IR) sounders. Coincident with the progress of IR sounders from GEO platforms, the future of low Earth orbit (LEO) sounders is being re-envisioned after decades of beneficial impact in numerical weather prediction (NWP) systems. To address questions about the utility of the two platform types in concert, the Global Modeling and Assimilation Office (GMAO) Observing System Simulation Experiment (OSSE) framework was used to examine the roles of GEO and LEO sounders and their impact on forecast error reduction. Overall, inclusion of both types of platforms in the satellite program produces the largest forecast error reduction with LEO sounders having a strong impact on global skill and GEO sounders providing the most benefit on the scale of targeted regions.

Erica McGrath-Spangler↗

NASA NTRS2003

Satellite Detection of Precipitation over the North Pacific

Intense extratropical winter cyclones often impact the West Coast of North America with strong winds and heavy precipitation. Several times during a winter season, short-term forecasts (24 - 48 hours) of these storms are seriously deficient with central pressure errors in the 10's of hPa and surface low position errors in the 100's of km. For example, 48-hr sea level pressure errors (forecast - observation) at buoy 46005 off the Oregon coast for the 2001 - 2002 winter season is plotted. In addition, two times the standard deviation (determined from pressure errors from the last four winter seasons) are also shown. It is evident from this figure that large forecast errors (i.e. greater than 10 hPa) occurred about 10 times this past winter at buoy 46005 with three events where the errors were 20 hPa. Beside large forecast errors of sea level pressure, numerical forecasts of precipitation for land falling cyclones can also be flawed. This is due in large part to the lack of accurate precipitation information over the ocean. Therefore, remote sensing techniques are the only viable option for obtaining accurate information on the distribution and intensity of precipitation over the North Pacific. Due to the radiative characteristics of precipitation sized hydrometeors at microwave frequencies, microwave sensors are able to detect precipitation over oceanic regions. Past studies have demonstrated the utility of passive microwave rainrate data for locating intense rainfall in rapidly deepening cyclones, in detecting developing polar mesocyclones and in determining frontal bands. There are currently many sources of microwave rainrate data: the Special Sensor Microwave Imager (SSM/I) (currently flying on three platforms), the Advanced Microwave Sounding Unit (AMSU-B) (currently flying on NOAA-15, NOAA-16, and NOAA-17), and the Tropical Rainfall Measuring Mission Microwave Imager (TMI). Data will soon be available from the Advanced Microwave Radiometer-EOS (AMSR-E) on the Aqua platform. In this paper, we present a new technique for mapping rainrate distributions over the North Pacific utilizing rainrate estimates from several microwave sensors and upper-tropospheric winds derived from geosynchronous satellite IR data. The goal of this work is to develop a way to obtain high temporal and spatial rainfall information over the North Pacific. This information will be used to support the verification of model derived precipitation distributions and to support the analysis of in situ measurements of rainfall during the Improvement of Microphysical Parameterization through Observational Verification Experiment (IMPROVE) field campaigns.

Smith, Jeremy↗

DOE OSTI2025

Quantifying and simulating the weather forecast uncertainty for advanced building control

Weather forecast uncertainty is unavoidable despite technological advancements. Accurately quantifying and modelling this uncertainty is essential for developing and comparing advanced building controllers. In this study, we present a structured approach using a first-order autoregressive model (AR(1)) to model uncertainty in ambient temperature and global solar irradiation (GHI) forecasts. We analyzed weather data from four cities and employed Jensen–Shannon divergence (JSD) to evaluate the similarity between synthetic and actual forecast errors. The average JSD values for temperature are 0.027 (Berkeley), 0.021 (Leuven), 0.018 (Berlin), and 0.008 (Oslo), and for GHI, the average JSD values are 0.016 (Berkeley), 0.058 (Leuven), and 0.013 (Berlin). The low JSD values indicate a high similarity between the synthetic and real forecast error distributions. Further, our approach successfully generates synthetic weather forecasts that mirror the statistical properties of actual forecasts. The implementation of our method for uncertain forecast generation is being added to the BOPTEST framework.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Operation-adversarial scenario generation

This paper proposes a modified conditional generative adversarial network (cGAN) model to generate net load scenarios for power systems that are statistically credible, conditioned by given labels (e.g., seasons), and, at the same time, “stressful” to the system operations and dispatch decisions. The measure of stress used in this paper is based on the operating cost increases due to net load changes. The proposed operation-adversarial cGAN (OA-cGAN) internalizes a DC optimal power flow model and seeks to maximize the operating cost and achieve a worst-case data generation. The training and testing stages employed in the proposed OA-cGAN use historical day-ahead net load forecast errors and has been implemented for the realistic NYISO 11-zone system. In conclusion, our numerical experiments demonstrate that the generated operation-adversarial forecast errors lead to more cost-effective and reliable dispatch decisions.

42 ENGINEERING↗

NASA NTRS1981

Applications systems verification and transfer project. Volume 1: Operational applications of satellite snow cover observations: Executive summary

Both LANDSAT and NOAA satellite data were used in improving snowmelt runoff forecasts. When the satellite snow cover data were tested in both empirical seasonal runoff estimation and short term modeling approaches, a definite potential for reducing forecast error was evident. A cost benefit analysis run in conjunction with the snow mapping indicated a $36.5 million annual benefit accruing from a one percent improvement in forecast accuracy using the snow cover data for the western United States. The annual cost of employing the system would be $505,000. The snow mapping has proven that satellite snow cover data can be used to reduce snowmelt runoff forecast error in a cost effective manner once all operational satellite data are available within 72 hours after acquisition. Executive summaries of the individual snow mapping projects are presented.

Rango, A.↗

NASA NTRS2005

A Posteriori Correction of Forecast and Observation Error Variances

Proposed method of total observation and forecast error variance correction is based on the assumption about normal distribution of "observed-minus-forecast" residuals (O-F), where O is an observed value and F is usually a short-term model forecast. This assumption can be accepted for several types of observations (except humidity) which are not grossly in error. Degree of nearness to normal distribution can be estimated by the symmetry or skewness (luck of symmetry) a(sub 3) = mu(sub 3)/sigma(sup 3) and kurtosis a(sub 4) = mu(sub 4)/sigma(sup 4) - 3 Here mu(sub i) = i-order moment, sigma is a standard deviation. It is well known that for normal distribution a(sub 3) = a(sub 4) = 0.

Rukhovets, Leonid↗

DOE OSTI2022

Insights into Methodologies and Operational Details of Resource Adequacy Assessment: A Case Study with Application to a Broader Flexibility Framework

Assessing and maintaining resource adequacy (RA) is a core pillar of power systems. However, recent changes in the physical makeup of these systems and the conditions under which these systems must operate have yielded a renewed interest in the methods, metrics, and assumptions that underpin RA assessments. In this paper, we systematically explore a wide range of RA modeling dimensions, including: the objective function and level of operational detail in the underlying model formulation; the quantity (look-ahead) and quality (accuracy) of data that is available for making operational decisions within those models; and the physical configuration of solar photovoltaics (PV) with battery storage hybrid resources. We apply a set of probabilistic RA tools and production cost modeling tools to a realistic test system based loosely on a future Electric Reliability Council of Texas power system dominated by solar PV resources. Under the assumptions of our system and models, we find that multi-stage probabilistic assessments may provide a more robust evaluation of RA by capturing a wider range of operational and system interactions, but this comes at a computational cost of 1-2 orders of magnitude longer run time depending on the specific configuration. In addition, the information on thermal generator availability impacts RA performance by an order of magnitude more than solar resource forecasts, which is driven by the comparatively larger magnitude of thermal outages than solar forecast errors within our test system. Lastly, the flexibility provided by hybrid and other resources can help reduce system load-shedding event frequencies and enable the system to be more robust to inaccurate forecast information, and alternative hybrid inverter sizes can impact RA levels by 1-2 orders of magnitude. Our results point to the importance of a broader flexibility framework to describe the interaction between (1) flexibility "supply" from both physical resource capabilities and operational constraints considered in the modeling, and (2) flexibility "demand" from forecast errors, thermal generator outages, and other sources of uncertainty, as well as their RA impacts. Results are likely sensitive to the system buildout explored; future work could consider additional system configurations and conditions.

ENERGY PLANNING, POLICY, AND ECONOMY,POWER TRANSMI↗