Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “forecast error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
NASA NTRS2022

Improving Multiday Solar Wind Speed Forecasts

We analyze the residual errors for the Wang-Sheeley-Arge (WSA) solar wind speed forecasts as a function of the photospheric magnetic field expansion factor (fp) and the minimum separation angle (d) in the photosphere between the footpoints of open field lines and the nearest coronal hole boundary. We find the map of residual speed errors are systematic when examined as a function of fp and d. We use these residual error maps to apply corrections to the model speeds. We test this correction approach using 3-day lead time speed forecasts for an entire year of observations and model results. Our methods can readily be applied to develop corrections for the remaining WSA forecast lead times which range from 1 to 7 days in 1-day increments. Since the solar wind density, temperature, and the interplanetary magnetic field strength all correlate well with the solar wind speed, the improved accuracy of solar wind speed forecasts enables the production of multiday forecasts of the solar wind density, temperature, pressure, and interplanetary field strength, and geophysical indices. These additional parameters would expand the usefulness of Air Force Data Assimilative Photospheric Flux Transport-WSA forecasts for space weather clients.

H A Elliot↗
NASA NTRS1981

Optimal interpolation and the Kalman filter

The estimation theory of stochastic-dynamic systems is described and used in a numerical study of optimal interpolation. The general form of data assimilation methods is reviewed. The Kalman-Bucy, KB filter, and optimal interpolation (OI) filters are examined for effectiveness in performance as gain matrices using a one-dimensional form of the shallow-water equations. Control runs in the numerical analyses were performed for a ten-day forecast in concert with the OI method. The effects of optimality, initialization, and assimilation were studied. It was found that correct initialization is necessary in order to localize errors, especially near boundary points. Also, the use of small forecast error growth rates over data-sparse areas was determined to offset inaccurate modeling of correlation functions near boundaries.

Cohn, S.↗
DOE OSTI2022

Investigation of Stochastic Unit Commitment to Enable Advanced Flexibility Measures for High Shares of Solar PV

As the share of solar photovoltaics (PV) in the power system increases, there is a growing need for flexibility from multiple, possibly interdependent sources to adjust to PV's variability, uncertainty, and diurnal dependence. This paper investigates how stochastic unit commitment leveraging probabilistic solar forecasts can support other flexibility measures under high solar shares. We consider two flexibility measures relevant to day-ahead scheduling: battery energy time-shifting and solar ancillary service provision. Unit commitment and economic dispatch simulations are conducted on a realistic test system based on Texas using day-ahead solar trajectories. The benefits of the two flexibility measures are pronounced when the instantaneous solar share is high, offering cost savings of 10%-20% in the spring. For a Texas-sized system, this translates to hundreds of millions of dollars in cost savings once the installed PV capacity enables instantaneous solar shares regularly exceeding 40%. Using probabilistic forecasts also greatly increases the reliability of upward reserve provision from solar PV, reducing unserved reserves by 50%-100%. Both day-ahead forecast resolution and errors can impact system reliability at high solar shares, but the stochastic formulation has significant value, mitigating reliability impacts on over-forecast days.

ancillary services↗
DOE OSTI2022

Occlusion-Perturbed Deep Learning for Probabilistic Solar Forecasting via Sky Images

Solar forecasting is shifting to the probabilistic paradigm due to the inherent uncertainty within the solar resource. Input uncertainty quantification is one of the widely used and best-performing ways to model solar uncertainty. However, compared to other sources of inputs, such as numerical weather prediction models, pure sky image-based probabilistic solar forecasting lags behind. In this research, an occlusion-perturbed convolutional neural network, named the PSolarNet, is developed. The PSolarNet provides very short-term deterministic forecasts, forecast scenarios, and probabilistic forecasts of the global horizontal irradiance from sky image sequences. Case studies based on 6 years of open-source data show that the developed PSolarNet is able to generate accurate 10-minute ahead deterministic forecasts with a 5.62% normalized root mean square error, realistic and diverse forecast scenarios with a 0.966 average correlation with the actual time series, and reliable and sharp probabilistic forecasts with a 2.77% normalized continuous ranked probability score.

Bayesian model averaging↗
DOE OSTI2022

Occlusion-Perturbed Deep Learning for Probabilistic Solar Forecasting via Sky Images: Preprint

Solar forecasting is shifting to the probabilistic paradigm due to the inherent uncertainty within the solar resource. Input uncertainty quantification is one of the widely used and best-performing ways to model solar uncertainty. However, compared to other sources of inputs, such as numerical weather prediction models, pure sky image-based probabilistic solar forecasting lags behind. In this research, an occlusion-perturbed convolutional neural network, named the PSolarNet, is developed. The PSolarNet provides very short-term deterministic forecasts, forecast scenarios, and probabilistic forecasts of the global horizontal irradiance from sky image sequences. Case studies based on 6 years of open-source data show that the developed PSolarNet is able to generate accurate 10-minute ahead deterministic forecasts with a 5.62% normalized root mean square error, realistic and diverse forecast scenarios with a 0.966 average correlation with the actual time series, and reliable and sharp probabilistic forecasts with a 2.77% normalized continuous ranked probability score.

Bayesian model averaging↗
NASA NTRS2019

Global analysis and forecasts of carbon monoxide on Mars

Spatial and temporal variations in the Martian carbon monoxide (CO) cycle have been investigated through combining Compact Reconnaissance Imaging Spectrometer for Mars (CRISM) retrievals of carbon monoxide mixing ratio and Mars Climate Sounder (MCS) temperature profiles with a Martian global circulation model (GCM) to produce the first global reanalysis of the Martian CO cycle. The reanalysis reduces the root mean square error between the forecast and CRISM CO retrievals by a factor of 2–4, dependent on the time of year. Forecasts initiated from the reanalysis show an improved match to standalone CRISM CO retrievals from northern winter solstice to northern summer solstice, indicating the benefit of data assimilation in simulating the CO abundance. The northern summer solstice CO minimum between 10°S – 50°S in the CRISM CO retrievals is found to be caused by a suppression of CO-enriched air leaking from the Hellas and Argyre basins, and is also strongly influenced by the amount of carbon dioxide condensing at the time. The GCM is the first reported to simulate the local CO minimum however it is weaker in strength, as CO-enriched air is also released northward in the area of Argyre basin in the GCM because of a shifted boundary between the southern polar vortex and mid-latitudes. The reanalysis, as a result of the assimilation of MCS temperature profiles, indicates that the polar vortex boundary is northward of Argyre basin and hence no northerly transport of CO-enriched air should be present over this location. Differences in local CO abundance between the reanalysis and GCM are also evident in spatio-temporal regions where no nearby CRISM CO retrievals are available as a result of alterations in local circulation and the sublimation/condensation of carbon dioxide through the combined assimilation of CRISM CO retrievals alongside MCS temperature profiles, illustrating how constraints can be imposed indirectly on the CO cycle through the powerful technique of data assimilation.

James A. Holmes↗
NASA NTRS2023

Robustness of Observing System Simulation Experiments

Observing System Simulation Experiments (OSSEs) are used to investigate the potential performance of proposed new instruments on numerical weather prediction (NWP). As OSSEs involve a framework in which the atmosphere and observations are all completely simulated, it is necessary to perform validation of the OSSE to ensure that it is sufficiently realistic to provide useful experimental results. A common issue that affects the forecast skill and observation impacts is the tendency of OSSEs to have insufficient model error compared to NWP in the real world. In this work, two versions of the National Aeronautics and Space Administration Global Modeling and Assimilation Office (NASA/GMAO) NWP OSSE framework are compared, with the newer framework having more simulated forecast model error than the older framework due to changes to the NWP system. The performance of the updated OSSE is validated against corresponding behavior of the same NWP system in the real world in terms of the simulated observations, the analysis increments, forecast error, and observation impacts. OSSE results of analysis and forecast impacts for three proposed new observation systems are also compared between the older and newer frameworks to evaluate the robustness of the OSSE experiments and the role of model error in observation impacts. These three new instruments are the Geostationary eXtended Observations (GeoXO) hyperspectral infrared sounder (GXS), the Midwave Infrared Sounding of Temperature and humidity in a Constellation for Winds (MISTiC Winds) atmospheric motion vectors, and additional Global Navigation Satellite System Radio Occultations (GNSS-RO).

Observing System Simulation Experiments↗
DOE OSTI2021

Machine learning based algorithms for uncertainty quantification in numerical weather prediction models

Complex numerical weather prediction models incorporate a variety of physical processes, each described by multiple alternative physical schemes with specific parameters. The selection of the physical schemes and the choice of the corresponding physical parameters during model configuration can significantly impact the accuracy of model forecasts. There is no combination of physical schemes that works best for all times, at all locations, and under all conditions. It is therefore of considerable interest to understand the interplay between the choice of physics and the accuracy of the resulting forecasts under different conditions. This paper demonstrates the use of machine learning techniques to study the uncertainty in numerical weather prediction models due to the interaction of multiple physical processes. The first problem addressed herein is the estimation of systematic model errors in output quantities of interest at future times, and the use of this information to improve the model forecasts. The second problem considered is the identification of those specific physical processes that contribute most to the forecast uncertainty in the quantity of interest under specified meteorological conditions. In order to address these questions we employ two machine learning approaches, random forests and artificial neural networks. The discrepancies between model results and observations at past times are used to learn the relationships between the choice of physical processes and the resulting forecast errors. Numerical experiments are carried out with the Weather Research and Forecasting (WRF) model. The output quantity of interest is the model precipitation, a variable that is both extremely important and very challenging to forecast. The physical processes under consideration include various micro-physics schemes, cumulus parameterizations, short wave, and long wave radiation schemes. The experiments demonstrate the strong potential of machine learning approaches to aid the study of model errors.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Causes of Missing Snowmelt Following Drought

Abstract Water management in snowy mountainous regions hinges on forecasting snowmelt runoff. However, droughts are altering snowpack‐runoff relationships with ongoing debate about the driving mechanisms. For example, in 2021 in California, less than half of predicted streamflow arrived. Mechanisms proposed for this “missing” streamflow included changes in evapotranspiration ( ET ), rainfall, and subsurface moisture conditions. Here, we demonstrate that ET in drought years generates dry subsurface conditions that reduce runoff in subsequent years. A model including this legacy of depleted moisture storage reduced median error in 2021 forecasts from 60% to 20% at 15 minimally disturbed basins and from 18% to 2% at 6 water supply basins in the Sierra Nevada (basins range in area from 5 to 23,051 km 2 and mean annual precipitation from 814 to 1,549 mm). Our findings indicate that the relationship between snowpack and runoff will evolve as plant ecosystems respond to climate change and alter subsurface water storage dynamics.

Lapides, Dana A.↗
NASA NTRS1999

Massively Parallel Assimilation of TOGA/TAO and Topex/Poseidon Measurements into a Quasi Isopycnal Ocean General Circulation Model Using an Ensemble Kalman Filter

A massively parallel ensemble Kalman filter (EnKF)is used to assimilate temperature data from the TOGA/TAO array and altimetry from TOPEX/POSEIDON into a Pacific basin version of the NASA Seasonal to Interannual Prediction Project (NSIPP)ls quasi-isopycnal ocean general circulation model. The EnKF is an approximate Kalman filter in which the error-covariance propagation step is modeled by the integration of multiple instances of a numerical model. An estimate of the true error covariances is then inferred from the distribution of the ensemble of model state vectors. This inplementation of the filter takes advantage of the inherent parallelism in the EnKF algorithm by running all the model instances concurrently. The Kalman filter update step also occurs in parallel by having each processor process the observations that occur in the region of physical space for which it is responsible. The massively parallel data assimilation system is validated by withholding some of the data and then quantifying the extent to which the withheld information can be inferred from the assimilation of the remaining data. The distributions of the forecast and analysis error covariances predicted by the ENKF are also examined.

Keppenne, Christian L.↗
NASA NTRS2011

Evaluation of an Airborne Spacing Concept, On-Board Spacing Tool, and Pilot Interface

The number of commercial aircraft operations is predicted to increase in the next ten years, creating a need for improved operational efficiency. Two areas believed to offer significant increases in efficiency are optimized profile descents and dependent parallel runway operations. It is envisioned that during both of these types of operations, flight crews will precisely space their aircraft behind preceding aircraft at air traffic control assigned intervals to increase runway throughput and maximize the use of existing infrastructure. This paper describes a human-in-the-loop experiment designed to study the performance of an onboard spacing algorithm and pilots ratings of the usability and acceptability of an airborne spacing concept that supports dependent parallel arrivals. Pilot participants flew arrivals into the Dallas Fort-Worth terminal environment using one of three different simulators located at the National Aeronautics and Space Administration s (NASA) Langley Research Center. Scenarios were flown using Interval Management with Spacing (IM-S) and Required Time of Arrival (RTA) control methods during conditions of no error, error in the forecast wind, and offset (disturbance) to the arrival flow. Results indicate that pilots delivered their aircraft to the runway threshold within +/- 3.5 seconds of their assigned arrival time and reported that both the IM-S and RTA procedures were associated with low workload levels. In general, pilots found the IM-S concept, procedures, speeds, and interface acceptable; with 92% of pilots rating the procedures as complete and logical, 218 out of 240 responses agreeing that the IM-S speeds were acceptable, and 63% of pilots reporting that the displays were easy to understand and displayed in appropriate locations. The 22 (out of 240) responses, indicating that the commanded speeds were not acceptable and appropriate occurred during scenarios containing wind error and offset error. Concerns cited included the occurrence of multiple speed changes within a short time period, speed changes required within twenty miles of the runway, and an increase in airspeed followed shortly by a decrease in airspeed. Within this paper, appropriate design recommendations are provided, and the need for continued, iterative human-centered design is discussed.

Swieringa, Kurt↗
DOE OSTI2023

Improving the Representation of Hydropower in Production Cost Models

One of the challenges of a high-renewable, low-carbon system is that grid operators will no longer be able to count on fossil-fired generation should wind miss its forecast or modeling errors create shortage issues, and this change has operational and reliability implications that affect variable renewable energy integration. Hydropower can help in that it can provide many of the services that have been traditionally provided by fossil generation. However, getting the most from hydropower can be challenging in that its capabilities vary with time and are affected by other water users' needs, two complexities that are not well represented in most of today's production cost models (PCMs). This work is an early step in addressing these gaps and making the most of hydropower's capabilities.

cost model↗
NASA NTRS1986

Analysis/forecast experiments with a flow-dependent correlation function using FGGE data

The use of a flow-dependent correlation function to improve the accuracy of an optimum interpolation (OI) scheme is examined. The development of the correlation function for the OI analysis scheme used for numerical weather prediction is described. The scheme uses a multivariate surface analysis over the oceans to model the pressure-wind error cross-correlation and it has the ability to use an error correlation function that is flow- and geographically-dependent. A series of four-day data assimilation experiments, conducted from January 5-9, 1979, were used to investigate the effect of the different features of the OI scheme (error correlation) on forecast skill for the barotropic lows and highs. The skill of the OI was compared with that of a successive correlation method (SCM) of analysis. It is observed that the largest difference in the correlation statistics occurred in barotropic and baroclinic lows and highs. The comparison reveals that the OI forecasts were more accurate than the SCM forecasts.

Baker, W. E.↗
NASA NTRS1990

Small error dynamics and the predictability of atmospheric flows

In this paper, linear small-error theory is applied to the study of weather predictability. A simple baroclinic shear model and a barotropic channel model with a localized jet are used as examples. It is shown that increase in error on synoptic forecast time scales is controlled by rapidly growing perturbations that are not of normal mode form. Unpredictable regimes are not necessarily associated with larger exponential growth rates than are relatively more predictable regimes. Model problems illustrating baroclinic and barotropic dynamics suggest that asymptotic measures of divergence in phase space, while applicable in the limit of infinite time, may not be appropriate over time intervals addressed by present synoptic forecast.

Farrell, Brian F.↗
NASA NTRS2002

Sensitivity Studies for Assimilated Ozone Profiles

An ozone data assimilation system at the NASA/Goddard Data Assimilation Office (DAO) produces three-dimensional global ozone fields. They are obtained by assimilating ozone retrieved from the Solar Backscatter UltraViolet/2 (SBUV/2) instrument and the Earth Probe Total Ozone Mapping Spectrometer (EP TOMS) measurements into an off-line parameterized chemistry and transport model. In this talk we focus on the quality of lower stratospheric assimilated ozone profiles. Ozone in the lower stratosphere plays a key role in the forcing of climate. A biased ozone field in this region will adversely impact calculations of the stratosphere-troposphere exchange and, when used as a first guess in retrievals, the values determined from satellite observations. The SBUV/2 ozone data have a coarse vertical resolution with increased uncertainty below the ozone maximum, and TOMS provides only total ozone columns. Thus, the assimilated ozone profiles in the lower stratosphere are only weakly constrained by the incoming SBUV and TOMS data. Consequently, the assimilated ozone distribution should be sensitive to changes in inputs to the statistical analysis scheme. We investigate the sensitivity of assimilated ozone profiles to changes in a variety of system inputs: TOMS and SBUV/2 data selection, forecast and observations error covariance models, inclusion or omission of a parameterized chemistry model, and different versions of DAO assimilated wind fields used to drive the transport model. Comparisons of assimilated ozone fields with independent observations, primarily ozone sondes, are used to determine the impact of each of these changes.

Stajner, Ivanka↗
NASA NTRS2003

Sensitivity of the Assimilated Ozone in the UTLS to Model and Data Selection Changes

This presentation will discuss the sensitivity of assimilated ozone fields in the upper troposphere and lower stratosphere (UTLS) to a number of factors, focusing mainly on aspects of data selection and the prediction model. This is important, because assimilation represents an attempt to construct our best estimates of the true ozone field; however, inaccuracies in the UTLS ozone distribution translate into an uncertainty in factors such as the calculated radiative forcing of climate or the inferred stratosphere-troposphere exchange (STE) of ozone. The 3D ozone data assimilation system, from NASA's Global Modeling and Assimilation Office (GMAO), combines observations of total ozone column and stratospheric profiles with predictions from an off-line, parameterized chemistry and transport model (pCTM) to produce six-hourly, global analyses. The first experiments discussed assimilate ozone retrievals from the Earth-Probe Total Ozone Mapping Spectrometer (EPTOMS) and stratospheric profiles from the Solar Backscatter UltraViolet/2 (SBUV/2) instrument. The SBUV/2 ozone data have a coarse vertical resolution, with increased uncertainty below the ozone maximum, and TOMS provides only total ozone columns. Thus, the assimilated ozone profiles in the UTLS region are only weakly constrained by the incoming SBUV and TOMS data. Consequently, the assimilated ozone distribution should be sensitive to changes in inputs to the statistical analysis scheme. Sensitivity studies have been conducted to examine the responses to TOMS and SBUV/2 data selection, modifications of the forecast and observation error covariance models, and the model formulation (turning off chemistry or using different wind analyses in the pCTM). The second set of experiments includes an additional data type: ozone retrieved from infrared limb-emission by MIPAS on Envisat. These data offer not only improved vertical resolution in the stratosphere, but also give measurements in the polar night. Comparisons of the assimilated ozone fields from both sets of experiments with independent observations, primarily ozone sondes, are used to determine the impact of each of these changes. It is shown that many of the changes have a significant impact on the UTLS ozone estimates. Implications for interpretation of STE and radiative forcing of climate are discussed.

Pawson, Steven↗
NASA NTRS2013

Regional Climate and Variability of the Summertime Continental United States in Reanalyses

Understanding climate variability at regional scales is an important for research and societal needs. Atmospheric retrospective-analyses (or reanalyses) integrate multitudes of observing systems with numerical models to produce continuous data that include variables not easily observed, if at all. The breadth of variables as well as observational influence included in reanalyses make them ideal for investigating climate variability. In this paper, we assess NASA s Modern Era Retrospective-analysis for Research and Application (MERRA) regional variability in North America, specifically the United States, in conjunction with current satellite data reanalyses. Emphasis is placed on summertime precipitation because 1) it is a difficult parameter to capture in the most difficult season, 2) significant observational resources exist to benchmark comparisons, and 3) accurate assessment of precipitation variability is crucial to a multitude of sectors and applications. Likewise, we have also begun to evaluate surface air temperature. While precipitation biases are identified, year to year variability of the precipitation variations, in many cases, are quite reasonable. However, some spurious long term trends and sudden shifts in the time series are also identified. In surface air temperature, analysis of station observations provides ERA Interim a clear overall advantage. However, in a number of regions, all the reanalyses are quite comparable in variability and trend. In other regions, significant precipitation biases may occur, which has implications for the ancillary process data in a reanalysis, such as surface fluxes. We also characterize the reanalyses ability to capture variability related to ENSO. In general, the summertime variations of precipitation in the reanalyses are more highly correlated (positively) to ENSO (using ENSO34) than are the observations. The Northwestern US shows the largest positive correlations to ENSO34, and reanalyses agree with that, and correlate highly with the gauge observations there. Additional evaluation of the data assimilation using the MERRA Gridded Innovations and Observations (GIO) data, which consists of the assimilated observations as well as forecast an analysis error fields. This work represents an initial evaluation of using the MERRA reanalysis to study regional climate variations of the United States, and identifying its applied limitations

Bosilovich, M G.↗
NASA NTRS2014

Assimilation of Freeze - Thaw Observations into the NASA Catchment Land Surface Model

The land surface freeze-thaw (F-T) state plays a key role in the hydrological and carbon cycles and thus affects water and energy exchanges and vegetation productivity at the land surface. In this study, we developed an F-T assimilation algorithm for the NASA Goddard Earth Observing System, version 5 (GEOS-5) modeling and assimilation framework. The algorithm includes a newly developed observation operator that diagnoses the landscape F-T state in the GEOS-5 Catchment land surface model. The F-T analysis is a rule-based approach that adjusts Catchment model state variables in response to binary F-T observations, while also considering forecast and observation errors. A regional observing system simulation experiment was conducted using synthetically generated F-T observations. The assimilation of perfect (error-free) F-T observations reduced the root-mean-square errors (RMSE) of surface temperature and soil temperature by 0.206 C and 0.061 C, respectively, when compared to model estimates (equivalent to a relative RMSE reduction of 6.7 percent and 3.1 percent, respectively). For a maximum classification error (CEmax) of 10 percent in the synthetic F-T observations, the F-T assimilation reduced the RMSE of surface temperature and soil temperature by 0.178 C and 0.036 C, respectively. For CEmax=20 percent, the F-T assimilation still reduces the RMSE of model surface temperature estimates by 0.149 C but yields no improvement over the model soil temperature estimates. The F-T assimilation scheme is being developed to exploit planned operational F-T products from the NASA Soil Moisture Active Passive (SMAP) mission.

GEOS5↗