Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “forecast error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Error latency estimation using functional fault modeling

A complete modeling of faults at gate level for a fault tolerant computer is both infeasible and uneconomical. Functional fault modeling is an approach where units are characterized at an intermediate level and then combined to determine fault behavior. The applicability of functional fault modeling to the FTMP is studied. Using this model a forecast of error latency is made for some functional blocks. This approach is useful in representing larger sections of the hardware and aids in uncovering system level deficiencies.

Manthani, S. R.↗

A Canonical Ensemble Correlation Prediction Model for Seasonal Precipitation Anomaly

This report describes an optimal ensemble forecasting model for seasonal precipitation and its error estimation. Each individual forecast is based on the canonical correlation analysis (CCA) in the spectral spaces whose bases are empirical orthogonal functions (EOF). The optimal weights in the ensemble forecasting crucially depend on the mean square error of each individual forecast. An estimate of the mean square error of a CCA prediction is made also using the spectral method. The error is decomposed onto EOFs of the predictand and decreases linearly according to the correlation between the predictor and predictand. This new CCA model includes the following features: (1) the use of area-factor, (2) the estimation of prediction error, and (3) the optimal ensemble of multiple forecasts. The new CCA model is applied to the seasonal forecasting of the United States precipitation field. The predictor is the sea surface temperature.

Shen, Samuel S. P.↗

Chapter 13: Errors and Uncertainties Associated with Quasi-Global Satellite Precipitation Products

Measuring precipitation on a global scale is only possible from satellite platforms. Satellite precipitation estimates are based on geosynchronous infrared sensors on geostationary satellites, characterized by high sampling frequency, and polar-orbiting microwave sensors on low-Earth-orbiting satellites with less-frequent sampling. Assessing satellite product performance is fundamental to infer the reliability of such estimates and effectively use them in water resources management, extreme event characterization, disease control, or weather forecasting. Nevertheless, errors and uncertainties associated with satellite precipitation products are often masked due to temporal and spatial sampling, as well as bias-corrections against a reference dataset. Moreover, the verification of satellite precipitation products is easier over land areas, where rain gauges and ground radars are available as benchmark, but extremely limited over the oceans. Substantial work still remains to better quantify relative and absolute errors and uncertainties within satellite-based precipitation products over land and oceans.

Viviana Maggioni↗

Predicting tropical cyclone intensity using satellite measured equivalent blackbody temperatures of cloud tops

A regression technique was developed to forecast 24 hour changes of the maximum winds for weak (maximum winds less than or equal to 65 Kt) and strong (maximum winds greater than 65 Kt) tropical cyclones by utilizing satellite measured equivalent blackbody temperatures around the storm alone and together with the changes in maximum winds during the preceding 24 hours and the current maximum winds. Independent testing of these regression equations shows that the mean errors made by the equations are lower than the errors in forecasts made by the peristence techniques.

Gentry, R. C.↗

Severe weather prediction studies

A numerical forecast model is described which uses three-dimensional primitive equations to predict the evolution of the wind, temperature and moisture fields along with the subsynoptic-scale convective activity. There are 15 vertical levels set on a longitude-latitude horizontal grid. In this study, the horizontal grid distance is 70 km (0.625 deg latitude and 0.816 deg longitude at 40 deg N) and the time step is 90 sec. Orography is included and terrain coordinates are adopted. The forecast model is used to test two tornado-producing storms with very different synoptic structures. A 12 hr forecast is carried out for both cases. The rms errors of the forecast indicate much smaller errors in the middle troposphere than in the lower troposphere. The results demonstrate that a rather fine-mesh limited-area numerical model is capable of providing a valuable short-range forecast of the circulation and the mesoscale precipitation features.

Chang, C.-B.↗

Coordinated Ramping Product and Regulation Reserve Procurements in CAISO and MISO using Multi-Scale Probabilistic Solar Power Forecasts (Pro2R)

How can probabilistic solar forecasts lower costs and improve reliability for independent system operator (ISO) markets? We tackle this question in three steps. First, we enhance an existing solar forecasting system to provide well-calibrated hours-ahead probabilistic forecasts. We then relate the degree of uncertainty in those forecasts to error distributions for net load ramps for the California ISO (CAISO) using statistical and machine learning methods. Projected net load errors conditioned on solar uncertainty are translated into flexible ramp requirements that therefore reflect real-time meteorological and solar conditions, improving on typical ISO procedures. Finally, a multi-period look-ahead production cost model quantifies how conditional ramp requirements can a) decrease operating costs by lowering requirements compared to often conservative unconditional methods, and b) reduce generation scarcity events and consequently improve reliability by increasing flexibility requirements at times when unconditional forecast-based requirements understate actual ramp uncertainty. In addition to the products just described (quantification of solar uncertainty, its translation into requirements for ramp capability product, and quantification of the benefits of more accurate ramp requirements), this project also developed a visualization system that alerts system operators of ramp and uncertainty conditions within the network based on solar forecasts. The system is called Resource Forecast and Ramp Visualization for Situational Awareness (RaVIS). These four products represent significant advances in the state-of-the-art of probabilistic solar forecasting, development of weather-informed reserve requirements, production costing methods for estimating the benefits of more accurate reserve requirements, and visualization of system status, respectively. Yet the products are also practical and can be immediately implemented, potentially enabling system operators to save millions of dollars in ramp product procurement costs per year.

14 SOLAR ENERGY↗

Redshift evolution and covariances for joint lensing and clustering studies with DESI Y1

ABSTRACT Galaxy–galaxy lensing (GGL) and clustering measurements from the Dark Energy Spectroscopic Instrument Year 1 (DESI Y1) data set promise to yield unprecedented combined-probe tests of cosmology and the galaxy–halo connection. In such analyses, it is essential to identify and characterize all relevant statistical and systematic errors. We forecast the covariances of DESI Y1 GGL + clustering measurements and the systematic bias due to redshift evolution in the lens samples. Focusing on the projected clustering and GGL correlations, we compute a Gaussian analytical covariance, using a suite of N-body and lognormal simulations to characterize the effect of the survey footprint. Using the DESI one percent survey data, we measure the evolution of galaxy bias parameters for the DESI luminous red galaxy (LRG) and bright galaxy survey (BGS) samples. We find mild evolution in the LRGs in $0.4 < z < 0.8$, subdominant to the expected statistical errors. For BGS, we find less evolution for brighter absolute magnitude cuts, at the cost of reduced sample size. We find that for a redshift bin width $\Delta z = 0.1$, evolution effects on DESI Y1 GGL is negligible across all scales, all fiducial selection cuts, all fiducial redshift bins. Galaxy clustering is more sensitive to evolution due to the bias squared scaling. Nevertheless the redshift evolution effect is insignificant for clustering above the 1-halo scale of $0.1h^{-1}$ Mpc. For studies that wish to reliably access smaller scales, additional treatment of redshift evolution is likely needed. This study serves as a reference for GGL and clustering studies using the DESI Y1 sample.

79 ASTRONOMY AND ASTROPHYSICS↗

Assessment of Geo-Kompsat-2A Atmospheric Motion Vector Data and Its Assimilation Impact in the GEOS Atmospheric Data Assimilation System

Korea’s second geostationary meteorological satellite, Geo-Kompsat-2A (Geostationary-Korean Multi-Purpose Satellite-2A, GK2A), was successfully launched on 4 December 2018. GK2Agenerates Atmospheric Motion Vectors (AMVs) every 10 min in the full disk area. This data hasbeen disseminated via Global Telecommunication System (GTS) since 25 October 2019. This articleevaluates the quality of GK2A AMVs in the Goddard Earth Observing System (GEOS) atmosphericdata assimilation system (ADAS). The data show slow wind speed biases at 200–300 hPa and 600–800hPa in the northern and southern hemispheres. These biases are caused by observation heightassignment errors near jet streams. The Equivalent Blackbody Temperature (EBBT) method of GK2Atends to assign clouds at higher altitude, which mainly causes slow wind speed biases, especially inthe lower atmosphere. The IR/WV intercept method of GK2A assigns clouds slightly lower in theatmospheric layers below the altitude of 400 hPa, which causes positive biases. Quality control (QC)criteria to select the most suitable GK2A AMV data for assimilation are presented based on thesequality assessments. A new QC criterion utilizing height errors within the GEOS ADAS is introducedto exclude data with slow wind speed biases and large errors. GEOS forecast accuracy is slightlyimproved after assimilating GK2A AMVs along with other conventional, radiance, and satellitewinds which include AMVs made by the Himawari-8 satellite in nearly the same observational areaof GK2A. Additionally, the present work shows that GEOS forecasts can be significantly improved,especially in the tropics and southern hemisphere after assimilating GK2A data in the absence ofHimawari-8 AMVs. This study demonstrates that GK2A AMV data is a valuable data source toenhance the robustness of GEOS ADAS.

Atmospheric Motion Vectors↗

Short-term electricity load forecasting: Application-driven evaluation of machine learning models across spatial and temporal scales

As we transition towards a decarbonized economy, the integration of variable renewable energy resources and new demands (e.g., electric vehicles, heat pumps) into the electricity grid places unprecedented pressure on grid operators to effectively anticipate and manage peak load. In this context, machine learning algorithms are proving to be indispensable for accurate short-term load forecasting, a crucial task to address these challenges. This study benchmarks 6 machine learning algorithms, including three neural networks and three tree-based algorithms, across various levels of spatial aggregation and time horizons (1, 4, 8, 24, and 48 h). The central contribution of this work is the comparison and analysis of load forecasting models not only based on statistical metrics, but also based on a novel error metric, which evaluates the cost implications of forecast errors for power system stakeholders. Results show that tree-based models outperform neural networks, based on statistical metrics, and yield less skewed error distributions for most spatial scales. However, through the lens of the novel error metric, neural networks are the more competitive choice, especially for forecast horizons that exceed 8 h. The study concludes with actionable recommendations to grid operators and highlights the need for the development of error metrics that link forecasting accuracy to operational costs. To promote transparency and open science, the datasets and Python code are open-sourced via a supplementary repository.

Houben, Nikolaus↗

Reserve and energy scarcity pricing in United States power markets: A comparative review of principles and practices

Here, errors in forecasting load and renewable-based generation in restructured power systems mean that independent system operators (ISOs) must procure sufficient operating reserves to keep the real-time operation of the system reliable and secure. But when procured reserves turn out to be insufficient in real-time due to the lack of resource capacity or ramp capability, operators often set higher prices for reserves and energy to encourage more supply, and to motivate consumers to decrease usage or shift it to other times. This procedure, which is called scarcity or shortage pricing, is a core feature of U.S. electricity markets. It is receiving increased attention from market designers and stakeholders because scarcity will become more important for spot price formation in the future with the increased penetration of zero-marginal cost renewables, and the shrinking role of fuel costs in setting prices. Scarcity pricing is implemented in various ways by different ISOs. These differences have practical implications for the level of prices and incentives for investment, operations, and demand modification. In this paper, general approaches and specific calculation procedures for reserve and energy scarcity pricing practices and calculations across the seven ISO-based U.S. power markets are reviewed and compared. A consistent terminology is used to facilitate the comparison. Current scarcity pricing practices are grouped into three approaches: (1) imposing an adder after the spot market is run; (2) including stepwise demand curves within market clearing procedures for non-contingency reserve products (e.g., the novel flexiramp product), which tends to yield longer right tails for energy scarcity premium curves; and (3) having stepwise demand curves for traditional contingency reserve products only, which results in shorter right tails in energy scarcity curves. A generic numerical example is presented to highlight the large practical differences among the reserve scarcity pricing approaches and specific implementations. To further investigate factors that contribute the most to demand curves differences among ISOs, a sensitivity analysis is performed. This analysis shows that the largest source of differences among the curves is the scarcity prices assumed in the case of severe scarcity, while the number of steps used and whether flexiramp is considered also yields important differences in scarcity prices. As renewable penetration increases, it will become increasingly crucial to employ administrative demand curves so that spot prices more effectively motivate supply and demand adjustments exactly when and where they are needed. This study shows that the different assumptions yield very different scarcity premiums for reserves and energy, and are likely to provide divergent incentives for resources to respond to shortages. It is concluded that to promote market efficiency, a reserve shortage demand curve should have at least three features: inclusion of the marginal value of reserve products at each shortage level, consideration of the magnitude and probability of supply contingencies, and avoidance of abrupt price discontinuities that can cause excessively volatile market outcomes.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Meteorological data collection via ERTS-A data retransmission facilities

The author has identified the following significant results. Two meteorological data acquisition systems were built to support hydrometeorological programs related to flow forecasting. Data errors were detected in the stream level formation; these errors were caused by sensor difficulties.

Vockeroth, R. E.↗

Interval Management with Spacing to Parallel Dependent Runways (IMSPIDR) Experiment and Results

An area in aviation operations that may offer an increase in efficiency is the use of continuous descent arrivals (CDA), especially during dependent parallel runway operations. However, variations in aircraft descent angle and speed can cause inaccuracies in estimated time of arrival calculations, requiring an increase in the size of the buffer between aircraft. This in turn reduces airport throughput and limits the use of CDAs during high-density operations, particularly to dependent parallel runways. The Interval Management with Spacing to Parallel Dependent Runways (IMSPiDR) concept uses a trajectory-based spacing tool onboard the aircraft to achieve by the runway an air traffic control assigned spacing interval behind the previous aircraft. This paper describes the first ever experiment and results of this concept at NASA Langley. Pilots flew CDAs to the Dallas Fort-Worth airport using airspeed calculations from the spacing tool to achieve either a Required Time of Arrival (RTA) or Interval Management (IM) spacing interval at the runway threshold. Results indicate flight crews were able to land aircraft on the runway with a mean of 2 seconds and less than 4 seconds standard deviation of the air traffic control assigned time, even in the presence of forecast wind error and large time delay. Statistically significant differences in delivery precision and number of speed changes as a function of stream position were observed, however, there was no trend to the difference and the error did not increase during the operation. Two areas the flight crew indicated as not acceptable included the additional number of speed changes required during the wind shear event, and issuing an IM clearance via data link while at low altitude. A number of refinements and future spacing algorithm capabilities were also identified.

Baxley, Brian T.↗

The Use of Red Green Blue Air Mass Imagery to Investigate the Role of Stratospheric Air in a Non-convective Wind Event

Non-convective wind events commonly occur with passing extratropical cyclones and have significant societal and economic impacts. Since non-convective winds often occur in the absence of specific phenomena such as a thunderstorm, tornado, or hurricane, the public are less likely to heed high wind warnings and continue daily activities. Thus non-convective wind events result in as many fatalities as straight line thunderstorm winds. One physical explanation for non-convective winds includes tropopause folds. Improved model representation of stratospheric air and associated non-convective wind events could improve non-convective wind forecasts and associated warnings. In recent years, satellite data assimilation has improved skill in forecasting extratropical cyclones; however errors still remain in forecasting the position and strength of extratropical cyclones as well as the tropopause folding process. The goal of this study is to determine the impact of assimilating satellite temperature and moisture retrieved profiles from hyperspectral infrared (IR) sounders (i.e. Atmospheric Infrared Sounder (AIRS), Cross-track Infrared and Microwave Sounding Suite (CrIMSS), and Infrared Atmospheric Sounding Interferometer (IASI)) on the model representation of the tropopause fold and an associated high wind event that impacted the Northeast United States on 09 February 2013. Model simulations using the Advanced Research Weather Research and Forecasting Model (ARW) were conducted on a 12-km grid with cycled data assimilation mimicking the operational North American Model (NAM). The results from the satellite assimilation run are compared to a control experiment (without hyperspectral IR retrievals), Modern Era-Retrospective Analysis for Research and Applications (MERRA) reanalysis, and Rapid Refresh analyses.

Berndt, E. B.↗

The Impact of the Assimilation of Hyperspectral Infrared Retrieved Profiles on Advanced Weather and Research Model Simulations of a Non-Convective Wind Event

Non-convective wind events commonly occur with passing extratropical cyclones and have significant societal and economic impacts. Since non-convective winds often occur in the absence of specific phenomena such as a thunderstorm, tornado, or hurricane, the public are less likely to heed high wind warnings and continue daily activities. Thus non-convective wind events result in as many fatalities as straight line thunderstorm winds. One physical explanation for non-convective winds includes tropopause folds. Improved model representation of stratospheric air and associated non-convective wind events could improve non-convective wind forecasts and associated warnings. In recent years, satellite data assimilation has improved skill in forecasting extratropical cyclones; however errors still remain in forecasting the position and strength of extratropical cyclones as well as the tropopause folding process. The goal of this study is to determine the impact of assimilating satellite temperature and moisture retrieved profiles from hyperspectral infrared (IR) sounders (i.e. Atmospheric Infrared Sounder (AIRS), Cross-track Infrared and Microwave Sounding Suite (CrIMSS), and Infrared Atmospheric Sounding Interferometer (IASI)) on the model representation of the tropopause fold and an associated high wind event that impacted the Northeast United States on 09 February 2013. Model simulations using the Advanced Research Weather Research and Forecasting Model (ARW) were conducted on a 12-km grid with cycled data assimilation mimicking the operational North American Model (NAM). The results from the satellite assimilation run are compared to a control experiment (without hyperspectral IR retrievals), Modern Era-Retrospective Analysis for Research and Applications (MERRA) reanalysis, and Rapid Refresh analyses.

Berndt, Emily↗

Impact of the Assimilation of Hyperspectral Infrared Profiles on Advanced Weather and Research Model Simulations of a Non-Convective Wind Event

Non-convective wind events commonly occur with passing extratropical cyclones and have significant societal and economic impacts. Since non-convective winds often occur in the absence of specific phenomena such as a thunderstorm, tornado, or hurricane, the public are less likely to heed high wind warnings and continue daily activities. Thus non-convective wind events result in as many fatalities as straight line thunderstorm winds. One physical explanation for non-convective winds includes tropopause folds. Improved model representation of stratospheric air and associated non-convective wind events could improve non-convective wind forecasts and associated warnings. In recent years, satellite data assimilation has improved skill in forecasting extratropical cyclones; however errors still remain in forecasting the position and strength of extratropical cyclones as well as the tropopause folding process. The goal of this study is to determine the impact of assimilating satellite temperature and moisture retrieved profiles from hyperspectral infrared (IR) sounders (i.e. Atmospheric Infrared Sounder (AIRS), Cross-track Infrared and Microwave Sounding Suite (CrIMSS), and Infrared Atmospheric Sounding Interferometer (IASI)) on the model representation of the tropopause fold and an associated high wind event that impacted the Northeast United States on 09 February 2013. Model simulations using the Advanced Research Weather Research and Forecasting Model (ARW) were conducted on a 12-km grid with cycled data assimilation mimicking the operational North American Model (NAM). The results from the satellite assimilation run are compared to a control experiment (without hyperspectral IR retrievals), North American Regional Reanalysis (NARR) reanalysis, and Rapid Refresh analyses.

Berndt, Emily B.↗

Impact of the Assimilation of Hyperspectral Infrared Retrieved Profiles on Advanced Weather and Research Model Simulations of a Non-Convective Wind Event

Non-convective wind events commonly occur with passing extratropical cyclones and have significant societal and economic impacts. Since non-convective winds often occur in the absence of specific phenomena such as a thunderstorm, tornado, or hurricane, the public are less likely to heed high wind warnings and continue daily activities. Thus non-convective wind events result in as many fatalities as straight line thunderstorm winds. One physical explanation for non-convective winds includes tropopause folds. Improved model representation of stratospheric air and associated non-convective wind events could improve non-convective wind forecasts and associated warnings. In recent years, satellite data assimilation has improved skill in forecasting extratropical cyclones; however errors still remain in forecasting the position and strength of extratropical cyclones as well as the tropopause folding process. The goal of this study is to determine the impact of assimilating satellite temperature and moisture retrieved profiles from hyperspectral infrared (IR) sounders (i.e. Atmospheric Infrared Sounder (AIRS), Cross-track Infrared and Microwave Sounding Suite (CrIMSS), and Infrared Atmospheric Sounding Interferometer (IASI)) on the model representation of the tropopause fold and an associated high wind event that impacted the Northeast United States on 09 February 2013. Model simulations using the Advanced Research Weather Research and Forecasting Model (ARW) were conducted on a 12-km grid with cycled data assimilation mimicking the operational North American Model (NAM). The results from the satellite assimilation run are compared to a control experiment (without hyperspectral IR retrievals), Modern Era-Retrospective Analysis for Research and Applications (MERRA) reanalysis, and Rapid Refresh analyses.

Berndt, E. B.↗

Impact of the Assimilation of Hyperspectral Infrared Retrieved Profiles on Advanced Weather and Research Model Simulations of a Non-Convective Wind Event

Non-convective wind events commonly occur with passing extratropical cyclones and have significant societal and economic impacts. Since non-convective winds often occur in the absence of specific phenomena such as a thunderstorm, tornado, or hurricane, the public are less likely to heed high wind warnings and continue daily activities. Thus non-convective wind events result in as many fatalities as straight line thunderstorm winds. One physical explanation for non-convective winds includes tropopause folds. Improved model representation of stratospheric air and associated non-convective wind events could improve non-convective wind forecasts and associated warnings. In recent years, satellite data assimilation has improved skill in forecasting extratropical cyclones; however errors still remain in forecasting the position and strength of extratropical cyclones as well as the tropopause folding process. The goal of this study is to determine the impact of assimilating satellite temperature and moisture retrieved profiles from hyperspectral infrared (IR) sounders (i.e. Atmospheric Infrared Sounder (AIRS), Cross-track Infrared and Microwave Sounding Suite (CrIMSS), and Infrared Atmospheric Sounding Interferometer (IASI)) on the model representation of the tropopause fold and an associated high wind event that impacted the Northeast United States on 09 February 2013. Model simulations using the Advanced Research Weather Research and Forecasting Model (ARW) were conducted on a 12-km grid with cycled data assimilation mimicking the operational North American Model (NAM). The results from the satellite assimilation run are compared to a control experiment (without hyperspectral IR retrievals), 32-km North American Regional Reanalysis (NARR) interpolated to a 12-km grid, and 13-km Rapid Refresh analyses.

Berndt, E. B.↗