Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical forecasting”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Recent Developments in DAO's Finite-Volume Data Assimilation System

The Physical-space/Finite-volume Data Assimilation System (fvDAS) is the next generation global atmospheric data assimilation system in development at the Data Assimilation Office at NASA's Goddard Space Flight Center. It is based on a new finite-volume general circulation model jointly developed by NASA and NCAR and on the Physical-Space Statistical Analysis System (PSAS) developed at the DAO. The data assimilation method implemented in CODAS incorporates a simplified version of the model bias estimation and correction algorithm, as described by Dee and da Silva (1998). In this talk we will briefly describe the general system formulation, and focus on the impact of 3 data types recently introduced, namely: 1) cloud tracks winds from the Multi-angle Imaging Spectrometer by the US Air Force, and 3) temperature and moisture information derived from GPS refractivity occultation measurements. The impact of these data types on observation-minus-6hr forecast (O-F) statistics, as well as 5-day forecast skills will be discussed. In addition we will assess the impact of cloud assimilation on top of the atmosphere radiation fields estimated from CERES measurements.

daSilva, Arlindo↗

DAO's Next Generation Physical-Space/Finite-Volume Data Assimilation System: Formulation and Initial Evaluation

The Physical-space/Finite-volume Data Assimilation System (fvDAS) is the next generation global atmospheric data assimilation system in development at the Data Assimilation Office at NASA's Goddard Space Flight Center. It is based on a new finite-volume general circulation model jointly developed by NASA and NCAR, and on the Physical-Space Statistical Analysis System (PSAS) developed at the DAO. In this talk we will describe the general system formulation, the adaptive quality control and general aspects of the error covariance modeling. The NASA-NCAR GCM is a completely new model which replaces the CEOs GCM used in the previous GEOS-1/2/3 Data Assimilation systems. A particular configuration of adaptive Statistical Quality Control and the Physical-space Statistical Analysis System (PSAS) are currently implemented in DAO's operational Data Assimilation System. However, the unique finite-volume formulation of the NASA-NCAR GCM, combined with the generality of the observation-space formulation of PSAS, provides for a very simple and accurate model-analysis interface. The system assimilates a variety of conventional and satellite observations. In particular, TOVS Level 1B radiances are assimilated using a 1-D variational scheme, both in clear sky and cloudy conditions. Computationally, the fvDAS runs approximately 10 times faster than the operational GEOS-Terra system. We will show that the next-generation fvDAS has much improved observation-minus-6hr forecast (O-F) statistics, as well as 5-day forecast skills. Top of the atmosphere radiation fields are in closer agreement with CERES measurements, with realistic precipitation and moisture fields. We will also show that the finite-volume formulation of the fvDAS produce assimilated fields which are more suitable for driving constituent transport models.

daSilva, A.↗

The GISS sounding temperature impact test

The impact of DST 5 and DST 6 satellite sounding data on mid-range forecasting was studied. The GISS temperature sounding technique, the GISS time-continuous four-dimensional assimilation procedure based on optimal statistical analysis, the GISS forecast model, and the verification techniques developed, including impact on local precipitation forecasts are described. It is found that the impact of sounding data was substantial and beneficial for the winter test period, Jan. 29 - Feb. 21. 1976. Forecasts started from initial state obtained with the aid of satellite data showed a mean improvement of about 4 points in the 48 and 772 hours Sub 1 scores as verified over North America and Europe. This corresponds to an 8 to 12 hour forecast improvement in the forecast range at 48 hours. An automated local precipitation forecast model applied to 128 cities in the United States showed on an average 15% improvement when satellite data was used for numerical forecasts. The improvement was 75% in the midwest.

Halem, M.↗

Optimization of Airport Runway Configuration with Forecast-Augmented Offline Reinforcement Learning

Runway configuration Management (RCM) governs the optimal utilization of runways based on variables such as traffic and meteorological conditions, making it a daunting task in air traffic management due to its dependency on volatile operational and environmental factors. This paper improves upon our previous work [1] on using offline model-free reinforcement learning for creating a Runway Configuration Assistance (RCA) decision-support tool. A novel integration of forecast data from LAMP (Localized Aviation Model Output Statistics Program) and TAF (Terminal Area Forecast) is introduced, enhancing the tool’s accuracy and also its adaptability to quick wind changes. The performance is evaluated using two major US airports, Charlotte Douglas International Airport (CLT) and Denver International Airport (DEN). To counter scalability issues presented by the addition of discrete forecast variables, we transitioned to a continuous state space model, ensuring scalability and inclusion of longer forecast data. The results of our experiments reflect significant improvements in the RCA tool’s prediction accuracy.

Sumanth Nethi↗

Upgrade Summer Severe Weather Tool

The goal of this task was to upgrade to the existing severe weather database by adding observations from the 2010 warm season, update the verification dataset with results from the 2010 warm season, use statistical logistic regression analysis on the database and develop a new forecast tool. The AMU analyzed 7 stability parameters that showed the possibility of providing guidance in forecasting severe weather, calculated verification statistics for the Total Threat Score (TTS), and calculated warm season verification statistics for the 2010 season. The AMU also performed statistical logistic regression analysis on the 22-year severe weather database. The results indicated that the logistic regression equation did not show an increase in skill over the previously developed TTS. The equation showed less accuracy than TTS at predicting severe weather, little ability to distinguish between severe and non-severe weather days, and worse standard categorical accuracy measures and skill scores over TTS.

Watson, Leela↗

Some experiments on the effect of remote sounding temperatures upon weather forecasting

A time-continuous statistical method is presented for the four dimensional assimilation of remote sounding temperatures based on radiance measurements from polar orbiting satellites. This method is applied to DST 6 data from the NOAA 4 and Nimbus 6 satellites. The state of the atmosphere throughout the test period was determined using a varying amount of satellite data from the NOAA 4 satellite only, from Nimbus 6 only, and from both satellites together. The methods tested included different variations of the statistical method, as well as more traditional methods. It is concluded that satellite derived temperature data can have a modest, but statistically significant positive impact on numerical weather prediction in the two to three day range, and that this impact is highly sensitive to the quantity of data available and to the assimilation method used.

Halem, M.↗

Forecasts of time averages with a numerical weather prediction model

Forecasts of time averages of 1-10 days in duration by an operational numerical weather prediction model are documented for the global 500 mb height field in spectral space. Error growth in very idealized models is described in order to anticipate various features of these forecasts and in order to anticipate what the results might be if forecasts longer than 10 days were carried out by present day numerical weather prediction models. The data set for this study is described, and the equilibrium spectra and error spectra are documented; then, the total error is documented. It is shown how forecasts can immediately be improved by removing the systematic error, by using statistical filters, and by ignoring forecasts beyond about a week. Temporal variations in the error field are also documented.

Roads, J. O.↗

Statistical significance test for transition matrices of atmospheric Markov chains

Low-frequency variability of large-scale atmospheric dynamics can be represented schematically by a Markov chain of multiple flow regimes. This Markov chain contains useful information for the long-range forecaster, provided that the statistical significance of the associated transition matrix can be reliably tested. Monte Carlo simulation yields a very reliable significance test for the elements of this matrix. The results of this test agree with previously used empirical formulae when each cluster of maps identified as a distinct flow regime is sufficiently large and when they all contain a comparable number of maps. Monte Carlo simulation provides a more reliable way to test the statistical significance of transitions to and from small clusters. It can determine the most likely transitions, as well as the most unlikely ones, with a prescribed level of statistical significance.

Vautard, Robert↗

Statistical Short-Range Guidance for Peak Wind Speed Forecasts at Edwards Air Force Base, CA

The peak winds near the surface are an important forecast element for space shuttle landings. As defined in the Flight Rules (FR), there are peak wind thresholds that cannot be exceeded in order to ensure the safety of the shuttle during landing operations. The National Weather Service Spaceflight Meteorology Group (SMG) is responsible for weather forecasts for all shuttle landings, and is required to issue surface average and 10-minute peak wind speed forecasts. They indicate peak winds are a challenging parameter to forecast. To alleviate the difficulty in making such wind forecasts, the Applied Meteorology Unit (AMU) developed a PC-based graphical user interface (GUI) for displaying peak wind climatology and probabilities of exceeding peak wind thresholds for the Shuttle Landing Facility (SLF) at Kennedy Space Center (KSC; Lambert 2003). However, the shuttle occasionally may land at Edwards Air Force Base (EAFB) in southern California when weather conditions at KSC in Florida are not acceptable, so SMG forecasters requested a similar tool be developed for EAFB.

Dreher, Joseph G.↗

Statistical Short-Range Guidance for Peak Wind Speed Forecasts at Edwards Air Force Base, CA

The peak winds near the surface are an important forecast element for Space Shuttle landings. As defined in the Shuttle Flight Rules (FRs), there are peak wind thresholds that cannot be exceeded in order to ensure the safety of the shuttle during landing operations. The National Weather Service Spaceflight Meteorology Group (SMG) is responsible for weather forecasts for all shuttle landings. They indicate peak winds are a challenging parameter to forecast. To alleviate the difficulty in making such wind forecasts, the Applied Meteorology Unit (AMTJ) developed a personal computer based graphical user interface (GUI) for displaying peak wind climatology and probabilities of exceeding peak-wind thresholds for the Shuttle Landing Facility (SLF) at Kennedy Space Center. However, the shuttle must land at Edwards Air Force Base (EAFB) in southern California when weather conditions at Kennedy Space Center in Florida are not acceptable, so SMG forecasters requested that a similar tool be developed for EAFB. Marshall Space Flight Center (MSFC) personnel archived and performed quality control of 2-minute average and 10-minute peak wind speeds at each tower adjacent to the main runway at EAFB from 1997- 2004. They calculated wind climatologies and probabilities of average peak wind occurrence based on the average speed. The climatologies were calculated for each tower and month, and were stratified by hour, direction, and direction/hour. For the probabilities of peak wind occurrence, MSFC calculated empirical and modeled probabilities of meeting or exceeding specific 10-minute peak wind speeds using probability density functions. The AMU obtained and reformatted the data into Microsoft Excel PivotTables, which allows users to display different values with point-click-drag techniques. The GUT was then created from the PivotTables using Visual Basic for Applications code. The GUI is run through a macro within Microsoft Excel and allows forecasters to quickly display and interpret peak wind climatology and likelihoods in a fast-paced operational environment. A summary of how the peak wind climatologies and probabilities were created and an overview of the GUT will be presented.

Dreher, Joseph↗

Seasonal Drought Prediction in East Africa: Can National Multi-Model Ensemble Forecasts Help?

The increasing food and water demands of East Africa's growing population are stressing the region's inconsistent water resources and rain-fed agriculture. As recently as in 2011 part of this region underwent one of the worst famine events in its history. Timely and skillful drought forecasts at seasonal scale for this region can inform better water and agro-pastoral management decisions, support optimal allocation of the region's water resources, and mitigate socio-economic losses incurred by droughts. However seasonal drought prediction in this region faces several challenges. Lack of skillful seasonal rainfall forecasts; the focus of this presentation, is one of those major challenges. In the past few decades, major strides have been taken towards improvement of seasonal scale dynamical climate forecasts. The National Centers for Environmental Prediction's (NCEP) National Multi-model Ensemble (NMME) is one such state-of-the-art dynamical climate forecast system. The NMME incorporates climate forecasts from 6+ fully coupled dynamical models resulting in 100+ ensemble member forecasts. Recent studies have indicated that in general NMME offers improvement over forecasts from any single model. However thus far the skill of NMME for forecasting rainfall in a vulnerable region like the East Africa has been unexplored. In this presentation we report findings of a comprehensive analysis that examines the strength and weakness of NMME in forecasting rainfall at seasonal scale in East Africa for all three of the prominent seasons for the region. (i.e. March-April-May, July-August-September and October-November- December). Simultaneously we also describe hybrid approaches; that combine statistical approaches with NMME forecasts; to improve rainfall forecast skill in the region when raw NMME forecasts lack in skill.

Shukla, Shraddhanand↗

Seasonal Drought Prediction in East Africa: Can National Multi-Model Ensemble Forecasts Help?

The increasing food and water demands of East Africa's growing population are stressing the region's inconsistent water resources and rain-fed agriculture. As recently as in 2011 part of this region underwent one of the worst famine events in its history. Timely and skillful drought forecasts at seasonal scale for this region can inform better water and agro-pastoral management decisions, support optimal allocation of the region's water resources, and mitigate socio-economic losses incurred by droughts. However seasonal drought prediction in this region faces several challenges. Lack of skillful seasonal rainfall forecasts; the focus of this presentation, is one of those major challenges. In the past few decades, major strides have been taken towards improvement of seasonal scale dynamical climate forecasts. The National Centers for Environmental Prediction's (NCEP) National Multi-model Ensemble (NMME) is one such state-of-the-art dynamical climate forecast system. The NMME incorporates climate forecasts from 6+ fully coupled dynamical models resulting in 100+ ensemble member forecasts. Recent studies have indicated that in general NMME offers improvement over forecasts from any single model. However thus far the skill of NMME for forecasting rainfall in a vulnerable region like the East Africa has been unexplored. In this presentation we report findings of a comprehensive analysis that examines the strength and weakness of NMME in forecasting rainfall at seasonal scale in East Africa for all three of the prominent seasons for the region. (i.e. March-April-May, July-August-September and October-November- December). Simultaneously we also describe hybrid approaches; that combine statistical approaches with NMME forecasts; to improve rainfall forecast skill in the region when raw NMME forecasts lack in skill.

Shukla, Shraddhanand↗

Evaluation of the synoptic and mesoscale predictive capabilities of a mesoscale atmospheric simulation system

The overall performance characteristics of a limited area, hydrostatic, fine (52 km) mesh, primitive equation, numerical weather prediction model are determined in anticipation of satellite data assimilations with the model. The synoptic and mesoscale predictive capabilities of version 2.0 of this model, the Mesoscale Atmospheric Simulation System (MASS 2.0), were evaluated. The two part study is based on a sample of approximately thirty 12h and 24h forecasts of atmospheric flow patterns during spring and early summer. The synoptic scale evaluation results benchmark the performance of MASS 2.0 against that of an operational, synoptic scale weather prediction model, the Limited area Fine Mesh (LFM). The large sample allows for the calculation of statistically significant measures of forecast accuracy and the determination of systematic model errors. The synoptic scale benchmark is required before unsmoothed mesoscale forecast fields can be seriously considered.

Koch, S. E.↗

Integrated Logistics Support Analysis of the International Space Station Alpha, Background and Summary of Mathematical Modeling and Failure Density Distributions Pertaining to Maintenance Time Dependent Parameters

The process of predicting the values of maintenance time dependent variable parameters such as mean time between failures (MTBF) over time must be one that will not in turn introduce uncontrolled deviation in the results of the ILS analysis such as life cycle costs, spares calculation, etc. A minor deviation in the values of the maintenance time dependent variable parameters such as MTBF over time will have a significant impact on the logistics resources demands, International Space Station availability and maintenance support costs. There are two types of parameters in the logistics and maintenance world: a. Fixed; b. Variable Fixed parameters, such as cost per man hour, are relatively easy to predict and forecast. These parameters normally follow a linear path and they do not change randomly. However, the variable parameters subject to the study in this report such as MTBF do not follow a linear path and they normally fall within the distribution curves which are discussed in this publication. The very challenging task then becomes the utilization of statistical techniques to accurately forecast the future non-linear time dependent variable arisings and events with a high confidence level. This, in turn, shall translate in tremendous cost savings and improved availability all around.

Sepehry-Fard, F.↗

Medium range lagged average forecasts

In this work, the application of the lagged average forecasting (LAF) technique to operational forecasts of the ECMWF is reported. The ECMWF data consist of two 100-day samples of 10-day forecasts of 500-mb geopotential height for winter 1980/81 and summer 1981. the LAF ensemble includes the latest operational forecast, and also forecast for the same verification time started one or more days earlier than the latest one. The focus is on the following two issues: (1) does ensemble averaging improve forecast skill and (2) is the dispersion of the ensemble useful in predicting forecast skill. The LAF technique was used to produce 3, 5, 7, 8, and 9 day forecasts of the 500-mb height field. The results show that the statistically filtered LAF is a marked improvment upon the operational forecast after 5 days. It is found that on a global scale, forecast skill is weakly correlated with the dispersion of the ensemble, as measured by the rms difference between the operational forecast and the statistically filtered LAF.

Dalcher, Amnon↗

Use of three-cornered hat error estimates in MERRA-2 to guide an improved reanalysis-Part 1

The three-cornered hat (3CH) method estimates the uncertainties of three different co-located model or observational data sets (Anthes and Rieckh, 2018; Sjoberg et al., 2021). Rieckh et al. (2021) used the 3CH method to compare the random error statistics of different global forecast and reanalysis models, as well as radio occultation (RO) and radiosonde observations. That study showed that the MERRA-2 reanalysis, while having smaller errors in the stratosphere than its predecessor MERRA, had larger errors in the troposphere than many of the other data sets analyzed. The MERRA-2 errors were particularly large in the tropics. In a collaborative effort between UCAR’s COSMIC (Constellation Observing System for Meteorology, Ionosphere and Meteorology) program and NASA’s Global Modeling and Assimilation Office (GMAO), we carried out further 3CH error diagnostics to help isolate the causes of these larger errors and help guide the development of an improved reanalysis. This presentation summarizes random error statistics associated with MERRA-2, ECMWF’s ERA5 reanalysis, and COSMIC-2 (C2) RO observations. We compute 3CH error variance estimates of refractivity, as well as temperature and specific humidity using UCAR’s COSMIC Data Analysis and Archive Center (CDAAC) improved 1D-variational (1D-Var) retrieval (wetPf2) over 15 latitude bands from 45S to 45N. The 1D-Var retrievals of specific humidity and temperature for C2 use NCEP’s Global Forecast System (GFS) as the background. Anthes et al. (2021) showed that it gives accurate estimates of temperature and specific humidity in the tropics and subtropics, even in the challenging environment of intense Hurricane Dorian (2019). This presentation confirms the previous results that MERRA-2 has significantly larger errors in the tropics and subtropics than either C2 or ERA5. Its errors are larger between 30S and 30N compared to 30-45 N-S latitudes, and are also larger over land compared to oceans. Most of the MERRA-2 refractivity errors come from specific humidity, except over land below 3 km where temperature errors are large. These results suggest that moist convection and atmospheric boundary layer physics in MERRA-2 may be responsible for a significant part of the higher uncertainties. These results are being used to guide GMAO in developing an improved next-generation reanalysis, as shown in a companion presentation submitted to this conference (El Akkraoui et al., 2021), which extends this study and describes improvements to MERRA-2 leading to the next GMAO reanalysis.

Jeremiah Sjoberg↗

Impact of Satellite Sea Surface Salinity Observations on ENSO Predictions from the GMAO S2S Forecast System

Sea surface salinity (SSS) observations from space allow us to investigate if improved estimates of near-surface density stratification and associated mixing can positively impact seasonal to interannual variability of tropical Pacific Ocean dynamics as well as dynamical ENSO forecasts. For the first part of the presentation, we utilize our intermediate-complexity coupled model. Baseline experiments assimilate satellite sea level (multi-satellite gridded AVISO, 2013), SST (Reynolds et al., 2004), and in situ subsurface temperature and salinity observations (GTSPP NODC, 2006). These baseline experiments are then compared with experiments that additionally assimilate Aquarius (V5.0 Lilly and Lagerloef, 2008) and SMAP (V4.0 Fore et al., 2016) SSS. Twelve-month forecasts are initialized for each month from September 2011 to September 2017. For initialization of the coupled forecast, the positive impact of SSS assimilation is brought about by surface freshening near the eastern edge of the western Pacific warm pool and density changes that lead to shallower mixed layer between 10S-5N. This pattern enhances air/sea interaction and amplifies the equatorial Kelvin wave signal. We find that including satellite SSS significantly improves NINO3.4 sea surface temperature anomaly validation over most forecast lead times. We next assess how different satellite SSS products impact the validation of ENSO forecasts. SMAP V4 reduces the salty bias in the western Pacific and so is an improvement upon SMAP V2 and SMOS V2 (Boutin et al., 2017) has similar validation characteristics as a combination of Aquarius and SMAP V4. Next we shift to present results from the NASA GMAO Sub-seasonal to seasonal (S2S_v2.1) production coupled model (i.e. the same model that contributes ENSO forecasts to the North American Multi-Model Ensemble Experiment). From March to June 2015, the availability of two overlapping satellite SSS instruments, Aquarius and SMAP, allows a unique opportunity to compare and contrast forecasts initialized with the benefit of these two satellite SSS observation types. We assess the impact of satellite sea surface salinity (SSS) observations on dynamical ENSO forecasts for the big 2015 El Nino event. We will present distinct experiments for the overlap period that include 1) freely evolving SSS (i.e. no satellite SSS as the production system), 2) Aquarius, and 3) SMAP initialization. Our results show that using Aquarius slightly improves validation of the reanalysis (including sea level and temperature statistics). Our production system without SSS assimilation generated too warm forecasts for the 2015 El Nino from March initial conditions. Incorporating Aquarius into initialization of the coupled system leads to a deeper, more realistic MLD that acts to damp the downwelling Kelvin signal and slightly cool NINO3.4 SST. With Aquarius the forecasts better match the observed amplitude of the 2015 event. On the other hand, SMAP V2 relaxation generally degrades validation statistics. At forecast initialization, SMAP is much too salty within 10o of the equator, leading to deeper MLD east of 165W. This deeper MLD leads to over-damping of the downwelling signal (i.e. relative upwelling), in turn leading to relatively too cool ENSO forecasts.

Hackert, E.↗

Impact of GMI All-Sky Radiance Assimilation in the NASA GEOS Forecast System

The assimilation of cloud- and precipitation-affected ("all-sky") radiances has become an important focus of development at most numerical weather prediction centers. Efforts at the Global Modeling and Assimilation Office (GMAO) have focused on all-sky assimilation of GPM Microwave Imager (GMI) radiances, which became operational in the GEOS real-time production system in July 2018. Implementation of the all-sky capability required several upgrades to the GEOS hybrid 4D-EnVar assimilation infrastructure including the addition of control variables for cloud liquid, cloud ice, rain and snow, enhancements to the radiative transfer model, new hybrid background and observational error models, and modified quality control and bias correction procedures. This talk describes the impact of GMI all-sky radiance assimilation on GEOS analyses and forecasts as determined from examination of various metrics including statistics of background departures and analysis increments, forecast skill scores, and forecast sensitivity observation impact (FSOI) calculations. It is shown that in addition to the hydrometeors themselves, the initial wind, temperature and pressure fields all undergo significant dynamic adjustment in response to the analyzed cloud and precipitation features. Assimilation of GMI radiances leads to improved forecasts of lower tropospheric wind, temperature and humidity, especially in the tropics. The largest forecast improvements occur during the first 48 hours, with diminishing impact thereafter. However, combining GMI all-sky assimilation with improvements to the GEOS model physics as in the recent implementation of the real-time production system, extends these forecast improvements well in to the medium range. FSOI results based on a 24-hr moist global energy norm show that GMI radiances provide nearly uniform beneficial impact throughout the tropics, with more mixed impacts in the subtropics. While the overall impact of GMI is smaller than that of other, much more numerous microwave and hyperspectral infrared radiance types, its impact is among the largest of all radiance types on a per-observation basis.

Gelaro, Ron↗