Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “forecast error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37
All sourcesNASA NTRSDOE OSTI
NASA NTRS2012

Comparative Analysis of Upper Ocean Heat Content Variability from Ensemble Operational Ocean Analyses

Upper ocean heat content (HC) is one of the key indicators of climate variability on many time-scales extending from seasonal to interannual to long-term climate trends. For example, HC in the tropical Pacific provides information on thermocline anomalies that is critical for the longlead forecast skill of ENSO. Since HC variability is also associated with SST variability, a better understanding and monitoring of HC variability can help us understand and forecast SST variability associated with ENSO and other modes such as Indian Ocean Dipole (IOD), Pacific Decadal Oscillation (PDO), Tropical Atlantic Variability (TAV) and Atlantic Multidecadal Oscillation (AMO). An accurate ocean initialization of HC anomalies in coupled climate models could also contribute to skill in decadal climate prediction. Errors, and/or uncertainties, in the estimation of HC variability can be affected by many factors including uncertainties in surface forcings, ocean model biases, and deficiencies in data assimilation schemes. Changes in observing systems can also leave an imprint on the estimated variability. The availability of multiple operational ocean analyses (ORA) that are routinely produced by operational and research centers around the world provides an opportunity to assess uncertainties in HC analyses, to help identify gaps in observing systems as they impact the quality of ORAs and therefore climate model forecasts. A comparison of ORAs also gives an opportunity to identify deficiencies in data assimilation schemes, and can be used as a basis for development of real-time multi-model ensemble HC monitoring products. The OceanObs09 Conference called for an intercomparison of ORAs and use of ORAs for global ocean monitoring. As a follow up, we intercompared HC variations from ten ORAs -- two objective analyses based on in-situ data only and eight model analyses based on ocean data assimilation systems. The mean, annual cycle, interannual variability and longterm trend of HC have been analyzed

Xue, Yan↗
NASA NTRS2021

Bias-Correcting Carbon Fluxes Derived From Land-Surface Satellite Data for Retrospective and Near Real-Time Assimilation Systems

The ability to monitor and understand natural and anthropogenic variability in atmospheric carbon dioxide(CO2) is a growing need of many stakeholders across the world. Systems that assimilate satellite observations, given their short latency and dense spatial coverage, into high resolution global models are valuable, if not essential, tools for addressing this need. A notable drawback of modern assimilation systems is the long latency of many vital in-put datasets, e.g., inventories, in situ measurements, and re-processed remote-sensing data can trail the current date by months to years. This paper describes techniques for bias-correcting surface fluxes derived from satellite observations of the Earth’s surface to be consistent with constraints from inventories and in situ CO2 datasets. The techniques are applicable in both short-term forecasts and retrospective simulations, thus taking advantage of the coverage and short latency of satellite data while reproducing the major features of long-term inventory and in situ records. Our approach begins with a standard collection of diagnostic fluxes which incorporate a variety of remote-sensing driver data, viz. vegetation indices, fire radiative power, and nighttime lights. We then apply an empirical sink so that global budgets of the diagnostic fluxes match given atmospheric and oceanic growth rates for each year. This step removes coherent, systematic flux errors that produce biases inCO2which mask the signals an assimilation system hopes to capture. Depending on the simulation mode, the empirical sink uses different choices of atmospheric growth rates: estimates based on observations in retrospective mode and projections based on seasonal fore-casts of sea surface temperature in forecasting mode. The retrospective fluxes, when used in simulations with NASA’s Goddard Earth Observing System (GEOS), reproduce marine boundary layer measurements with comparable skill to those using fluxes from a modern inversion system. The forecasted fluxes show promising accuracy in their application to the analysis of changes in the carbon cycle as they occur.

CO2↗
DOE OSTI2020

Mesoscale to Microscale Simulations over Complex Terrain with the Immersed Boundary Method in the Weather Research and Forecasting Model

Improvements to the Weather Research and Forecasting (WRF) Model are made to enable multiscale simulations over highly complex terrain with dynamically downscaled boundary conditions from the mesoscale to the microscale. Over steep terrain, the WRF Model develops numerical errors that are due to grid deformation of the terrain-following coordinates. An alternative coordinate system, the immersed boundary method (IBM), has been implemented into WRF, allowing for simulations over highly complex terrain; however, the new coordinate system precluded nesting within mesoscale simulations using WRF’s native terrain-following coordinates. Here, the immersed boundary method and WRF’s grid-nesting framework are modified to seamlessly work together. This improved framework for the first time allows for large-eddy simulation over complex (urban) terrain with IBM to be nested within a typical mesoscale WRF simulation. Simulations of the Joint Urban 2003 field campaign in Oklahoma City, Oklahoma, are performed using a multiscale five-domain nested configuration, spanning horizontal grid resolutions from 6 km to 2 m. These are compared with microscale-only simulations with idealized lateral boundary conditions and with observations of wind speed/direction and SF 6 concentrations from a controlled release from intensive observation period 3. The multiscale simulation, which is configured independent of local observations, shows similar model skill predicting wind speed/direction and improved skill predicting SF 6 concentrations when compared with the idealized simulations, which require use of observations to set mean flow conditions. Use of this improved multiscale framework shows promise for enabling large-eddy simulation over highly complex terrain with dynamically downscaled boundary conditions from mesoscale models.

42 ENGINEERING↗
NASA NTRS1987

A study of the feasibility of using sea and wind information from the ERS-1 satellite. Part 1: Wind scatterometer data

The use of scatterometer and altimeter data in wind and wave assimilation, and the benefits this offers for quality assurance and validation of ERS-1 data were examined. Real time use of ERS-1 data was simulated through assimilation of Seasat scatterometer data. The potential for quality assurance and validation is demonstrated by documenting a series of substantial problems with the scatterometer data, which are known but took years to establish, or are new. A data impact study, and an analysis of the performance of ambiguity removal algorithms on real and simulated data were conducted. The impact of the data on analyses and forecasts is large in the Southern Hemisphere, generally small in the Northern Hemisphere, and occasionally large in the Tropics. Tests with simulated data give more optimistic results than tests with real data. Errors in ambiguity removal results occur in clusters. The probabilities which can be calculated for the ambiguous wind directions on ERS-1 contain more information than is given by a simple ranking of the directions.

Anderson, D.↗
NASA NTRS1983

Statistical theory for estimating sampling errors of regional radiation averages based on satellite measurements

The processes which determine the weather and climate are driven by the radiation received by the earth and the radiation subsequently emitted. A knowledge of the absorbed and emitted components of radiation is thus fundamental for the study of these processes. In connection with the desire to improve the quality of long-range forecasting, NASA is developing the Earth Radiation Budget Experiment (ERBE), consisting of a three-channel scanning radiometer and a package of nonscanning radiometers. A set of these instruments is to be flown on both the NOAA-F and NOAA-G spacecraft, in sun-synchronous orbits, and on an Earth Radiation Budget Satellite. The purpose of the scanning radiometer is to obtain measurements from which the average reflected solar radiant exitance and the average earth-emitted radiant exitance at a reference level can be established. The estimate of regional average exitance obtained will not exactly equal the true value of the regional average exitance, but will differ due to spatial sampling. A method is presented for evaluating this spatial sampling error.

Smith, G. L.↗
DOE OSTI2021

Meta-uncertainty for particle image velocimetry

Uncertainty quantification for Particle Image Velocimetry (PIV) is critical for comparing experimentally measured flow fields with Computational Fluid Dynamics (CFD) results, and model design and validation. However, PIV features a complex measurement chain with coupled, non-linear error sources, and quantifying the uncertainty is challenging. Multiple assessments show that none of the current methods can reliably measure the actual uncertainty across a wide range of experiments, and estimates can vary. Because the current methods differ in assumptions regarding the measurement process and calculation procedures, it is not clear which method is best to use for an experiment where the error distribution is unknown. To address this issue, we propose a method to estimate an uncertainty method's sensitivity and reliability, termed the Meta-Uncertainty. The novel approach is automated, local, and instantaneous, and based on perturbation of the recorded particle images. We developed an image perturbation scheme based on adding random unmatched particles to the interrogation window pair considering the signal-to-noise (SNR) of the correlation plane. Each uncertainty scheme's response to several trials of random particle addition is used to estimate a reliability metric, defined as the rate of change of the inter-quartile range (IQR) of the uncertainties with increasing levels of particle addition. We also propose applying the meta-uncertainty as a weighting metric to combine uncertainty estimates from individual schemes, based on ideas from the consensus forecasting literature. We use planar and stereo PIV measurements across a range of canonical flows to assess the performance of the uncertainty schemes. Further, a novel method is introduced to assess an uncertainty scheme's performance based on a quantile comparison of the error and uncertainty distributions, generalizing the current method of comparing the RMS of the two distributions. Here, the results show that the combined uncertainty method outperforms the individual methods, and this work establishes the meta-uncertainty as a useful reliability assessment tool for PIV uncertainty quantification.

47 OTHER INSTRUMENTATION↗
NASA NTRS1985

Oceanographic and meteorological research based on the data products of SEASAT

Reservations were expressed concerning the sum of squares wind recovery algorithm and the power law model function. The SAS sum of squares (SOS) method for recovering winds from backscatter data leads to inconsistent results when V pol and H pol winds are compared. A model function that does not use a power law and that accounts for sea surface temperature is needed and is under study both theoretically and by means of the SASS mode 4 data. Aspects of the determination of winds by means of scatterometry and of the utilization of vector wind data for meteorological forecasts are elaborated. The operational aspect of an intermittent assimilation scheme currently utilized for the specification of the initial value field is considered with focus on quantifying the absolute 12-hour linear displacement error of the movement of low centers.

Pierson, W. J., Jr.↗
NASA NTRS1985

Response of the GLA fourth order model to changes in horizontal resolution and terrain heights

The effects the selection of the orographic data for the boundary conditions has on results of simulations with the NASA-Goddard Laboratory for Atmospherics fourth order GCM were examined. Two different lower boundary conditions were compared in generating preliminary weather forecasts: mean areally averaged heights, and an enhanced significant height orography for rugged terrain. The latter condition was developed to emphasize the effects the tallest peaks in a given region have on the atmospheric flow by considering only the highest 1/3 of the 1 deg x 1 deg values in the averaging process. Simulations were carried out for five 10 day forecasts with a 4 deg lat x 5 deg long resolution and six with a horizontal grid resolution of 2 deg lat by 2.5 deg long, three with each boundary condition. The rms errors of the sea level pressure and the 500 mb geopotential heights were calculated. The mean errors decreased after the second or third day with the enhanced significant height orography.

Pfaendtner, J.↗
NASA NTRS1987

Hydrostatic temperature calculations

Comparisons are made between hydrostatically computed temperatures and ambient temperatures associated with nine different data sources, including analyses, forecasts and conventional observations. Five-day averages and the day-to-day variations in the root-mean-square temperature differences are presented. Several different numerical and interpolation procedures are examined. Error correction and a constrained optimum procedure that minimizes ambient minus calculated hydrostatic temperature differences are introduced. Systematic differences between ambient and hydrostatic temperatures are found to be associated with the sinoptic situation. When compared with ambient temperatures, hydrostatic temperatures at 500 mb tend to be too warm at or in front of a trough and too cold behind the trough. In the vertical direction, for the eight-level configuration tested, the average hydrostatic temperatures are too cold at low levels (850, 700 mb) and too warm at upper levels, (300, 250 mb).

Raymond, William H.↗
NASA NTRS2019

Soil Moisture Data Assimilation

Accurate knowledge of soil moisture at the continental scale is important for improving predictions of weather, agricultural productivity and natural hazards, but observations of soil moisture at such scales are limited to indirect measurements, either obtained through satellite remote sensing or from meteorological networks. Land surface models simulate soil moisture processes, using observation-based meteorological forcing data, and auxiliary information about soil, terrain and vegetation characteristics. Enhanced estimates of soil moisture and other land surface variables, along with their uncertainty, can be obtained by assimilating observations of soil moisture into land surface models. These assimilation results are of direct relevance for the initialization of hydro-meteorological ensemble forecasting systems. The success of the assimilation depends on the choice of the assimilation technique, the nature of the model and the assimilated observations, and, most importantly, the characterization of model and observation error. Systematic differences between satellite-based microwave observations or satellite-retrieved soil moisture and their simulated counterparts require special attention. Other challenges include inferring root-zone soil moisture information from observations that pertain to a shallow surface soil layer, propagating information to unobserved areas and downscaling of coarse information to finer-scale soil moisture estimates. This chapter summarizes state-of-the-art solutions to these issues with conceptual data assimilation examples, using techniques ranging from simplified optimal interpolation to spatial ensemble Kalman filtering. In addition, operational soil moisture assimilation systems are discussed that support numerical weather prediction at ECMWF and provide value-added soil moisture products for the NASA Soil Moisture Active Passive mission.

radar backscatter↗
NASA NTRS2021

The Arya Crop Yield Forecasting Algorithm: Application to the Main Wheat Exporting Countries

Wheat is the most important commodity traded in the international food market. Thus, accurate and timely information on wheat production can help mitigate food price fluctuations. Within the existing operational regional and global scale agricultural monitoring systems that provide information on global crop yield and area forecasts, there are still fundamental gaps: #1. Lack of quantitative Earth Observation (EO) derived crop information, #2. Lack of global but detailed (national or subnational level) and timely crop production forecasts and #3. Lack of information on forecast uncertainties. In this study we present the Agriculture Remotely-sensed Yield Algorithm (ARYA) an EO-based method, advancing the state of EO data application and usage (addressing gap #1) to forecast wheat yield. The algorithm is based on the evolution of the Difference Vegetation Index (DVI) using MODIS data at 1km resolution and the Growing Degree Days (GDD) from reanalysis data. Additionally, we explore how Land Surface Temperature (LST) can be included into the model and whether this parameter adds any value to the model performance when combined with the optical information. ARYA is implemented at the national and subnational level to forecast winter wheat yield in the main wheat exporting countries of US, Russia, Ukraine, France, Germany, Australia and Argentina from 2001 to 2019 (covering over 70% of wheat exports globally) in a timely manner by providing daily forecasts (addressing gap #2). The results show that ARYA provides yield estimations with RMSE’s within 0.3 ± 0.1 t/ha at national level and 0.6 ± 0,1 t/ha at subnational level after Day Of the Year (DOY) 140 (mid May) in the Northern Hemisphere and DOY 280 (beginning of October) in the Southern Hemisphere. This means that ARYA can provide crop yield estimates of wheat yield with 5-15 % error at national and 7-20 % error at subnational level starting from 2 to 2.5 months prior to harvest.

Agriculture↗
DOE OSTI2023

Regional Medium-Term Hourly Electricity Demand Forecasting Based on LSTM

This paper aims to forecast high-resolution (hourly) aggregated load for a certain region in the medium term (a few days to over a year). One region is defined as some places with similar climate characteristics because the climate influences people's daily lifestyles and hence the electric usage. We decom- pose the electric usage records into two parts: base load and seasonal load. Considering both temperature and time factors, different deep learning methods are adopted to characterize them. The first goal of our approach is to predict the peak load which is critical for power system planning. Furthermore, our proposed forecast method can provide the depiction of the hourly load profile to provide customized load curves for high- level real-time applications. The proposed method is tested on real-world historical data collected by CAISO, BPA, and PACW. The experimental results show that trained by three years of data, our method could reduce the prediction error for one-year lead hourly load below 5% MAPE, and predict the occurrence of the peak load for next year in CAISO with an error within three days. Furthermore, as a byproduct, an interesting observation on the impact of COVID-19 on human life was made and discussed based on these case studies.

deep learning↗
DOE OSTI2021

Assimilation of a Coordinated Fleet of Uncrewed Aircraft System Observations in Complex Terrain: EnKF System Design and Preliminary Assessment

Abstract Uncrewed aircraft system (UAS) observations collected during the 2018 Lower Atmospheric Process Studies at Elevation—a Remotely Piloted Aircraft Team Experiment (LAPSE-RATE) field campaign were assimilated into a high-resolution configuration of the Weather Research and Forecasting Model using an ensemble Kalman filter. The benefit of UAS observations was assessed for a terrain-driven (drainage and upvalley) flow event that occurred within Colorado’s San Luis Valley (SLV) using independent observations. The analysis and prediction of the strength, depth, and horizontal extent of drainage flow from the Saguache Canyon and the subsequent transition to upvalley and up-canyon flow were improved relative to that obtained both without data assimilation (benchmark) and when only surface observations were assimilated. Assimilation of UAS observations greatly improved the analyses of vertical variations in temperature, relative humidity, and winds at multiple locations in the northern portion of the SLV, with reductions in both bias and the root-mean-square error of roughly 40% for each variable relative to the benchmark run. Despite these noted improvements, some biases remain that were tied to measurement error and/or the impact of the boundary layer parameterization on vertically spreading the observations, both of which require further exploration. The results presented here highlight how observations obtained with a fleet of profiling UAS improve limited-area, high-resolution analyses and short-term forecasts in complex terrain.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Regional Medium-Term Hourly Electricity Demand Forecasting Based on LSTM: Preprint

This paper aims to forecast high-resolution (hourly) aggregated load for a certain region in the medium term (a few days to over a year). One region is defined as some places with similar climate characteristics because the climate influences people's daily lifestyles and hence the electric usage. We decompose the electric usage records into two parts: base load and seasonal load. Considering both temperature and time factors, different deep-learning methods are adopted to characterize them. The first goal of our approach is to predict the peak load which is critical for power system planning. Furthermore, our proposed forecast method can provide the depiction of the hourly load profile to provide customized load curves for high-level real-time applications. The proposed method is tested on real-world historical data collected by CAISO, BPA, and PACW. The experimental results show that trained by three years of data, our method could reduce the prediction error for a one-year lead hourly load below 5% MAPE, and predict the occurrence of the peak load for next year in CAISO with an error within three days. Furthermore, as a byproduct, an interesting observation on the impact of COVID-19 on human life was made and discussed based on these case studies.

deep learning↗
DOE OSTI2024

Reduced‐Order Probabilistic Emulation of Physics‐Based Ring Current Models: Application to RAM‐SCB Particle Flux

Abstract In this work, we address the computational challenge of large‐scale physics‐based simulation models for the ring current. Reduced computational cost allows for significantly faster than real‐time forecasting, enhancing our ability to predict and respond to dynamic changes in the ring current, valuable for space weather monitoring and mitigation efforts. Additionally, it can also be used for a comprehensive investigation of the system. Thus, we aim to create an emulator for the Ring current‐Atmosphere interactions Model with Self‐Consistent magnetic field (RAM‐SCB) particle flux that not only improves efficiency but also facilitates forecasting with reliable estimates of prediction uncertainties. The probabilistic emulator is built upon the methodology developed by Licata and Mehta (2023), https://doi.org/10.1029/2022sw003345 . A novel discrete sampling is used to identify 30 simulation periods over 20 years of solar and geomagnetic activity. Focusing on a subset of particle flux, we use Principal Component Analysis for dimensionality reduction and Long Short‐Term Memory (LSTM) neural networks to perform dynamic modeling. Hyperparameter space was explored extensively resulting in about 5% median symmetric accuracy across all data sets for one‐step dynamic prediction. Using a hierarchical ensemble of LSTMs, we have developed a reduced‐order probabilistic emulator (ROPE) tailored for time‐series forecasting of particle flux in the ring current. This ROPE offers accurate predictions of omnidirectional flux at a single energy with no pitch angle information, providing robust predictions on the test set with an error score below 11% and calibration scores under 8% with bias under 2% providing a significant speed up as compared to the full RAM‐SCB run.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Airport Delay Prediction with Temporal Fusion Transformers

Since flight delay hurts passengers, airlines, and airports, its prediction becomes crucial for the decision-making of all stakeholders in the aviation industry and thus has been attempted by various previous research. However, previous delay predictions are often categorical and at a highly aggregated level. To improve that, this study proposes to apply the novel Temporal Fusion Transformer model and predict numerical airport arrival delays at quarter hour level for U.S. top 30 airports. Inputs to our model include airport demand and capacity forecasts, historic airport operation efficiency information, airport wind and visibility conditions, as well as en-route weather and traffic conditions. The results show that our model achieves satisfactory performance measured by small prediction errors on the test set. In addition, the interpretability analysis of the model outputs identifies the important input factors for delay prediction.

Liu, Ke [University of California Berkeley]↗
NASA NTRS2009

Improving Regional Forecast by Assimilating Atmospheric InfraRed Sounder (AIRS) Profiles into WRF Model

In data sparse regions, remotely-sensed observations can be used to improve analyses and produce improved forecasts. One such source comes from the Atmospheric InfraRed Sounder (AIRS), which together with the Advanced Microwave Sounding Unit (AMSU), represents one of the most advanced space-based atmospheric sounding systems. The purpose of this paper is to describe a procedure to optimally assimilate high resolution AIRS profile data into a regional configuration of the Advanced Research WRF (ARW) version 2.2 using WRF-Var. The paper focuses on development of background error covariances for the regional domain and background type, and an optimal methodology for ingesting AIRS temperature and moisture profiles as separate overland and overwater retrievals with different error characteristics. The AIRS thermodynamic profiles are derived from the version 5.0 Earth Observing System (EOS) science team retrieval algorithm and contain information about the quality of each temperature layer. The quality indicators were used to select the highest quality temperature and moisture data for each profile location and pressure level. The analyses were then used to conduct a month-long series of regional forecasts over the continental U.S. The long-term impacts of AIRS profiles on forecast were assessed against verifying NAM analyses and stage IV precipitation data.

Chou, Shih-Hung↗