Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical forecasting”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Adaptation of Mesoscale Weather Models to Local Forecasting

Methodologies have been developed for (1) configuring mesoscale numerical weather-prediction models for execution on high-performance computer workstations to make short-range weather forecasts for the vicinity of the Kennedy Space Center (KSC) and the Cape Canaveral Air Force Station (CCAFS) and (2) evaluating the performances of the models as configured. These methodologies have been implemented as part of a continuing effort to improve weather forecasting in support of operations of the U.S. space program. The models, methodologies, and results of the evaluations also have potential value for commercial users who could benefit from tailoring their operations and/or marketing strategies based on accurate predictions of local weather. More specifically, the purpose of developing the methodologies for configuring the models to run on computers at KSC and CCAFS is to provide accurate forecasts of winds, temperature, and such specific thunderstorm-related phenomena as lightning and precipitation. The purpose of developing the evaluation methodologies is to maximize the utility of the models by providing users with assessments of the capabilities and limitations of the models. The models used in this effort thus far include the Mesoscale Atmospheric Simulation System (MASS), the Regional Atmospheric Modeling System (RAMS), and the National Centers for Environmental Prediction Eta Model ( Eta for short). The configuration of the MASS and RAMS is designed to run the models at very high spatial resolution and incorporate local data to resolve fine-scale weather features. Model preprocessors were modified to incorporate surface, ship, buoy, and rawinsonde data as well as data from local wind towers, wind profilers, and conventional or Doppler radars. The overall evaluation of the MASS, Eta, and RAMS was designed to assess the utility of these mesoscale models for satisfying the weather-forecasting needs of the U.S. space program. The evaluation methodology includes objective and subjective verification methodologies. Objective (e.g., statistical) verification of point forecasts is a stringent measure of model performance, but when used alone, it is not usually sufficient for quantifying the value of the overall contribution of the model to the weather-forecasting process. This is especially true for mesoscale models with enhanced spatial and temporal resolution that may be capable of predicting meteorologically consistent, though not necessarily accurate, fine-scale weather phenomena. Therefore, subjective (phenomenological) evaluation, focusing on selected case studies and specific weather features, such as sea breezes and precipitation, has been performed to help quantify the added value that cannot be inferred solely from objective evaluation.

Manobianco, John T.↗

Market Analysis of the Subsonic Single Aft Engine (SUSAN) Transport Aircraft Concept

This paper presents a detailed market analysis of the U.S. domestic aviation market in support of the NASA subsonic single aft engine (SUSAN) regional aircraft concept. The current scoping of the SUSAN concept is intended to compete in the medium to large (160-180 seats) narrow body market, with range capabilities of up to 2,500 nautical miles, and expected fuel burn reduction up to 40% relative to conventional 2 engine aircraft. Recent historical trends suggest growth in aviation passenger demand will continue to be met by the narrow body fleet of aircraft; however, a comprehensive review is required to understand how these current fleet trends could evolve in the future. Moreover, estimating and forecasting the potential market size is the critical first step when developing a new aircraft concept to determine commercial viability. To assist in the trade space exploration of the SUSAN concept, a generalized traffic and fleet forecast of the U.S. aviation market is conducted. Using publicly available aviation data from the U.S. Bureau of Transportation Statistics and passenger demand forecasts from FAA, a multinomial logit model is estimated to predict the composition of the future fleet by aircraft size. These fleet forecasts are then used as inputs for a fleet evolution model to provide required operational forecasts at the aircraft specific level. Forecast scenarios with and without the SUSAN concept are compared, and a breakeven analysis is performed to evaluate the commercial viability of the SUSAN aircraft from an operating cost perspective. Results from the multinomial logit fleet forecast indicate the narrow body size category of 150+ seats dominating the market, comprising 87% of the future revenue passenger miles market share in 2050 (up from 60% in 2019). Forecast scenarios with the SUSAN concept see a maximum cumulative decline in fuel cost of 20% by 2050, while a breakeven analysis shows competitive advantage of the SUSAN aircraft, due to expected fuel burn reduction, at moderate levels of increased maintenance and capital costs.

Jacob M. Wishart↗

Recent Developments in DAO's Finite-Volume Data Assimilation System

The Physical-space/Finite-volume Data Assimilation System (fvDAS) is the next generation global atmospheric data assimilation system in development at the Data Assimilation Office at NASA's Goddard Space Flight Center. It is based on a new finite-volume general circulation model jointly developed by NASA and NCAR and on the Physical-Space Statistical Analysis System (PSAS) developed at the DAO. The data assimilation method implemented in CODAS incorporates a simplified version of the model bias estimation and correction algorithm, as described by Dee and da Silva (1998). In this talk we will briefly describe the general system formulation, and focus on the impact of 3 data types recently introduced, namely: 1) cloud tracks winds from the Multi-angle Imaging Spectrometer by the US Air Force, and 3) temperature and moisture information derived from GPS refractivity occultation measurements. The impact of these data types on observation-minus-6hr forecast (O-F) statistics, as well as 5-day forecast skills will be discussed. In addition we will assess the impact of cloud assimilation on top of the atmosphere radiation fields estimated from CERES measurements.

daSilva, Arlindo↗

DAO's Next Generation Physical-Space/Finite-Volume Data Assimilation System: Formulation and Initial Evaluation

The Physical-space/Finite-volume Data Assimilation System (fvDAS) is the next generation global atmospheric data assimilation system in development at the Data Assimilation Office at NASA's Goddard Space Flight Center. It is based on a new finite-volume general circulation model jointly developed by NASA and NCAR, and on the Physical-Space Statistical Analysis System (PSAS) developed at the DAO. In this talk we will describe the general system formulation, the adaptive quality control and general aspects of the error covariance modeling. The NASA-NCAR GCM is a completely new model which replaces the CEOs GCM used in the previous GEOS-1/2/3 Data Assimilation systems. A particular configuration of adaptive Statistical Quality Control and the Physical-space Statistical Analysis System (PSAS) are currently implemented in DAO's operational Data Assimilation System. However, the unique finite-volume formulation of the NASA-NCAR GCM, combined with the generality of the observation-space formulation of PSAS, provides for a very simple and accurate model-analysis interface. The system assimilates a variety of conventional and satellite observations. In particular, TOVS Level 1B radiances are assimilated using a 1-D variational scheme, both in clear sky and cloudy conditions. Computationally, the fvDAS runs approximately 10 times faster than the operational GEOS-Terra system. We will show that the next-generation fvDAS has much improved observation-minus-6hr forecast (O-F) statistics, as well as 5-day forecast skills. Top of the atmosphere radiation fields are in closer agreement with CERES measurements, with realistic precipitation and moisture fields. We will also show that the finite-volume formulation of the fvDAS produce assimilated fields which are more suitable for driving constituent transport models.

daSilva, A.↗

The GISS sounding temperature impact test

The impact of DST 5 and DST 6 satellite sounding data on mid-range forecasting was studied. The GISS temperature sounding technique, the GISS time-continuous four-dimensional assimilation procedure based on optimal statistical analysis, the GISS forecast model, and the verification techniques developed, including impact on local precipitation forecasts are described. It is found that the impact of sounding data was substantial and beneficial for the winter test period, Jan. 29 - Feb. 21. 1976. Forecasts started from initial state obtained with the aid of satellite data showed a mean improvement of about 4 points in the 48 and 772 hours Sub 1 scores as verified over North America and Europe. This corresponds to an 8 to 12 hour forecast improvement in the forecast range at 48 hours. An automated local precipitation forecast model applied to 128 cities in the United States showed on an average 15% improvement when satellite data was used for numerical forecasts. The improvement was 75% in the midwest.

Halem, M.↗

Data-Driven Transition Path Analysis Yields a Statistical Understanding of Sudden Stratospheric Warming Events in an Idealized Model

Abstract Atmospheric regime transitions are highly impactful as drivers of extreme weather events, but pose two formidable modeling challenges: predicting the next event (weather forecasting) and characterizing the statistics of events of a given severity (the risk climatology). Each event has a different duration and spatial structure, making it hard to define an objective “average event.” We argue here that transition path theory (TPT), a stochastic process framework, is an appropriate tool for the task. We demonstrate TPT’s capacities on a wave–mean flow model of sudden stratospheric warmings (SSWs) developed by Holton and Mass, which is idealized enough for transparent TPT analysis but complex enough to demonstrate computational scalability. Whereas a recent article (Finkel et al. 2021) studied near-term SSW predictability, the present article uses TPT to link predictability to long-term SSW frequency. This requires not only forecasting forward in time from an initial condition, but also backward in time to assess the probability of the initial conditions themselves. TPT enables one to condition the dynamics on the regime transition occurring, and thus visualize its physical drivers with a vector field called the reactive current . The reactive current shows that before an SSW, dissipation and stochastic forcing drive a slow decay of vortex strength at lower altitudes. The response of upper-level winds is late and sudden, occurring only after the transition is almost complete from a probabilistic point of view. This case study demonstrates that TPT quantities, visualized in a space of physically meaningful variables, can help one understand the dynamics of regime transitions.

Meteorology & Atmospheric Sciences↗

Optimization of Airport Runway Configuration with Forecast-Augmented Offline Reinforcement Learning

Runway configuration Management (RCM) governs the optimal utilization of runways based on variables such as traffic and meteorological conditions, making it a daunting task in air traffic management due to its dependency on volatile operational and environmental factors. This paper improves upon our previous work [1] on using offline model-free reinforcement learning for creating a Runway Configuration Assistance (RCA) decision-support tool. A novel integration of forecast data from LAMP (Localized Aviation Model Output Statistics Program) and TAF (Terminal Area Forecast) is introduced, enhancing the tool’s accuracy and also its adaptability to quick wind changes. The performance is evaluated using two major US airports, Charlotte Douglas International Airport (CLT) and Denver International Airport (DEN). To counter scalability issues presented by the addition of discrete forecast variables, we transitioned to a continuous state space model, ensuring scalability and inclusion of longer forecast data. The results of our experiments reflect significant improvements in the RCA tool’s prediction accuracy.

Sumanth Nethi↗

Upgrade Summer Severe Weather Tool

The goal of this task was to upgrade to the existing severe weather database by adding observations from the 2010 warm season, update the verification dataset with results from the 2010 warm season, use statistical logistic regression analysis on the database and develop a new forecast tool. The AMU analyzed 7 stability parameters that showed the possibility of providing guidance in forecasting severe weather, calculated verification statistics for the Total Threat Score (TTS), and calculated warm season verification statistics for the 2010 season. The AMU also performed statistical logistic regression analysis on the 22-year severe weather database. The results indicated that the logistic regression equation did not show an increase in skill over the previously developed TTS. The equation showed less accuracy than TTS at predicting severe weather, little ability to distinguish between severe and non-severe weather days, and worse standard categorical accuracy measures and skill scores over TTS.

Watson, Leela↗

Some experiments on the effect of remote sounding temperatures upon weather forecasting

A time-continuous statistical method is presented for the four dimensional assimilation of remote sounding temperatures based on radiance measurements from polar orbiting satellites. This method is applied to DST 6 data from the NOAA 4 and Nimbus 6 satellites. The state of the atmosphere throughout the test period was determined using a varying amount of satellite data from the NOAA 4 satellite only, from Nimbus 6 only, and from both satellites together. The methods tested included different variations of the statistical method, as well as more traditional methods. It is concluded that satellite derived temperature data can have a modest, but statistically significant positive impact on numerical weather prediction in the two to three day range, and that this impact is highly sensitive to the quantity of data available and to the assimilation method used.

Halem, M.↗

Forecasts of time averages with a numerical weather prediction model

Forecasts of time averages of 1-10 days in duration by an operational numerical weather prediction model are documented for the global 500 mb height field in spectral space. Error growth in very idealized models is described in order to anticipate various features of these forecasts and in order to anticipate what the results might be if forecasts longer than 10 days were carried out by present day numerical weather prediction models. The data set for this study is described, and the equilibrium spectra and error spectra are documented; then, the total error is documented. It is shown how forecasts can immediately be improved by removing the systematic error, by using statistical filters, and by ignoring forecasts beyond about a week. Temporal variations in the error field are also documented.

Roads, J. O.↗

Statistical significance test for transition matrices of atmospheric Markov chains

Low-frequency variability of large-scale atmospheric dynamics can be represented schematically by a Markov chain of multiple flow regimes. This Markov chain contains useful information for the long-range forecaster, provided that the statistical significance of the associated transition matrix can be reliably tested. Monte Carlo simulation yields a very reliable significance test for the elements of this matrix. The results of this test agree with previously used empirical formulae when each cluster of maps identified as a distinct flow regime is sufficiently large and when they all contain a comparable number of maps. Monte Carlo simulation provides a more reliable way to test the statistical significance of transitions to and from small clusters. It can determine the most likely transitions, as well as the most unlikely ones, with a prescribed level of statistical significance.

Vautard, Robert↗

A High‐Resolution Tropical Mesoscale Convective System Reanalysis (TMeCSR)

Abstract Modern global reanalysis products have greatly accelerated meteorological research in synoptic‐to‐planetary‐scale phenomena. However, their use in studying tropical mesoscale convective systems (MCSs) and their regional‐to‐global impact has mostly been limited to supplying initial and boundary conditions for MCS‐resolving simulations and providing information about the large‐scale environments of MCSs. These limitations are due to difficulties in resolving tropical MCS dynamics in the relatively low‐resolution global models and that tropical MCSs often occur over poorly observed regions. In this work, a Tropical MCS‐resolving Reanalysis product (TMeCSR) was created over a region with frequent tropical MCSs. This region spans the tropical Indian Ocean, tropical continental Asia, Maritime Continent, and Western Pacific. TMeCSR is produced by assimilating all‐sky infrared radiances from geostationary satellites and other conventional observations into an MCS‐resolving regional model using the Ensemble Kalman Filter. The resulting observation‐constrained high‐resolution (9‐km grid spacing) data set is available hourly during the boreal summer (June‐August) of 2017, during which widespread severe flooding occurred. Comparisons of TMeCSR and European Center for Medium Range Weather Forecast Reanalysis version 5 (ERA5) against independent satellite retrievals indicate that TMeCSR's cloud and multiscale rain fields are better than those of ERA5. Furthermore, TMeCSR better captured the diurnal variability of rainfall and the statistical characteristics of MCSs. Forecasts initialized from TMeCSR also have more accurate rain and clouds than those initialized from ERA5. The TMeCSR and ERA5 forecasts have similar performances with respect to sounding and surface observations. These results indicate that TMeCSR is a promising MCS‐resolving data set for tropical MCS studies.

Chan, Man‐Yau↗

Statistical Short-Range Guidance for Peak Wind Speed Forecasts at Edwards Air Force Base, CA

The peak winds near the surface are an important forecast element for space shuttle landings. As defined in the Flight Rules (FR), there are peak wind thresholds that cannot be exceeded in order to ensure the safety of the shuttle during landing operations. The National Weather Service Spaceflight Meteorology Group (SMG) is responsible for weather forecasts for all shuttle landings, and is required to issue surface average and 10-minute peak wind speed forecasts. They indicate peak winds are a challenging parameter to forecast. To alleviate the difficulty in making such wind forecasts, the Applied Meteorology Unit (AMU) developed a PC-based graphical user interface (GUI) for displaying peak wind climatology and probabilities of exceeding peak wind thresholds for the Shuttle Landing Facility (SLF) at Kennedy Space Center (KSC; Lambert 2003). However, the shuttle occasionally may land at Edwards Air Force Base (EAFB) in southern California when weather conditions at KSC in Florida are not acceptable, so SMG forecasters requested a similar tool be developed for EAFB.

Dreher, Joseph G.↗

Statistical Short-Range Guidance for Peak Wind Speed Forecasts at Edwards Air Force Base, CA

The peak winds near the surface are an important forecast element for Space Shuttle landings. As defined in the Shuttle Flight Rules (FRs), there are peak wind thresholds that cannot be exceeded in order to ensure the safety of the shuttle during landing operations. The National Weather Service Spaceflight Meteorology Group (SMG) is responsible for weather forecasts for all shuttle landings. They indicate peak winds are a challenging parameter to forecast. To alleviate the difficulty in making such wind forecasts, the Applied Meteorology Unit (AMTJ) developed a personal computer based graphical user interface (GUI) for displaying peak wind climatology and probabilities of exceeding peak-wind thresholds for the Shuttle Landing Facility (SLF) at Kennedy Space Center. However, the shuttle must land at Edwards Air Force Base (EAFB) in southern California when weather conditions at Kennedy Space Center in Florida are not acceptable, so SMG forecasters requested that a similar tool be developed for EAFB. Marshall Space Flight Center (MSFC) personnel archived and performed quality control of 2-minute average and 10-minute peak wind speeds at each tower adjacent to the main runway at EAFB from 1997- 2004. They calculated wind climatologies and probabilities of average peak wind occurrence based on the average speed. The climatologies were calculated for each tower and month, and were stratified by hour, direction, and direction/hour. For the probabilities of peak wind occurrence, MSFC calculated empirical and modeled probabilities of meeting or exceeding specific 10-minute peak wind speeds using probability density functions. The AMU obtained and reformatted the data into Microsoft Excel PivotTables, which allows users to display different values with point-click-drag techniques. The GUT was then created from the PivotTables using Visual Basic for Applications code. The GUI is run through a macro within Microsoft Excel and allows forecasters to quickly display and interpret peak wind climatology and likelihoods in a fast-paced operational environment. A summary of how the peak wind climatologies and probabilities were created and an overview of the GUT will be presented.

Dreher, Joseph↗

Seasonal Drought Prediction in East Africa: Can National Multi-Model Ensemble Forecasts Help?

The increasing food and water demands of East Africa's growing population are stressing the region's inconsistent water resources and rain-fed agriculture. As recently as in 2011 part of this region underwent one of the worst famine events in its history. Timely and skillful drought forecasts at seasonal scale for this region can inform better water and agro-pastoral management decisions, support optimal allocation of the region's water resources, and mitigate socio-economic losses incurred by droughts. However seasonal drought prediction in this region faces several challenges. Lack of skillful seasonal rainfall forecasts; the focus of this presentation, is one of those major challenges. In the past few decades, major strides have been taken towards improvement of seasonal scale dynamical climate forecasts. The National Centers for Environmental Prediction's (NCEP) National Multi-model Ensemble (NMME) is one such state-of-the-art dynamical climate forecast system. The NMME incorporates climate forecasts from 6+ fully coupled dynamical models resulting in 100+ ensemble member forecasts. Recent studies have indicated that in general NMME offers improvement over forecasts from any single model. However thus far the skill of NMME for forecasting rainfall in a vulnerable region like the East Africa has been unexplored. In this presentation we report findings of a comprehensive analysis that examines the strength and weakness of NMME in forecasting rainfall at seasonal scale in East Africa for all three of the prominent seasons for the region. (i.e. March-April-May, July-August-September and October-November- December). Simultaneously we also describe hybrid approaches; that combine statistical approaches with NMME forecasts; to improve rainfall forecast skill in the region when raw NMME forecasts lack in skill.

Shukla, Shraddhanand↗

Seasonal Drought Prediction in East Africa: Can National Multi-Model Ensemble Forecasts Help?

The increasing food and water demands of East Africa's growing population are stressing the region's inconsistent water resources and rain-fed agriculture. As recently as in 2011 part of this region underwent one of the worst famine events in its history. Timely and skillful drought forecasts at seasonal scale for this region can inform better water and agro-pastoral management decisions, support optimal allocation of the region's water resources, and mitigate socio-economic losses incurred by droughts. However seasonal drought prediction in this region faces several challenges. Lack of skillful seasonal rainfall forecasts; the focus of this presentation, is one of those major challenges. In the past few decades, major strides have been taken towards improvement of seasonal scale dynamical climate forecasts. The National Centers for Environmental Prediction's (NCEP) National Multi-model Ensemble (NMME) is one such state-of-the-art dynamical climate forecast system. The NMME incorporates climate forecasts from 6+ fully coupled dynamical models resulting in 100+ ensemble member forecasts. Recent studies have indicated that in general NMME offers improvement over forecasts from any single model. However thus far the skill of NMME for forecasting rainfall in a vulnerable region like the East Africa has been unexplored. In this presentation we report findings of a comprehensive analysis that examines the strength and weakness of NMME in forecasting rainfall at seasonal scale in East Africa for all three of the prominent seasons for the region. (i.e. March-April-May, July-August-September and October-November- December). Simultaneously we also describe hybrid approaches; that combine statistical approaches with NMME forecasts; to improve rainfall forecast skill in the region when raw NMME forecasts lack in skill.

Shukla, Shraddhanand↗

Evaluation of the synoptic and mesoscale predictive capabilities of a mesoscale atmospheric simulation system

The overall performance characteristics of a limited area, hydrostatic, fine (52 km) mesh, primitive equation, numerical weather prediction model are determined in anticipation of satellite data assimilations with the model. The synoptic and mesoscale predictive capabilities of version 2.0 of this model, the Mesoscale Atmospheric Simulation System (MASS 2.0), were evaluated. The two part study is based on a sample of approximately thirty 12h and 24h forecasts of atmospheric flow patterns during spring and early summer. The synoptic scale evaluation results benchmark the performance of MASS 2.0 against that of an operational, synoptic scale weather prediction model, the Limited area Fine Mesh (LFM). The large sample allows for the calculation of statistically significant measures of forecast accuracy and the determination of systematic model errors. The synoptic scale benchmark is required before unsmoothed mesoscale forecast fields can be seriously considered.

Koch, S. E.↗

Integrated Logistics Support Analysis of the International Space Station Alpha, Background and Summary of Mathematical Modeling and Failure Density Distributions Pertaining to Maintenance Time Dependent Parameters

The process of predicting the values of maintenance time dependent variable parameters such as mean time between failures (MTBF) over time must be one that will not in turn introduce uncontrolled deviation in the results of the ILS analysis such as life cycle costs, spares calculation, etc. A minor deviation in the values of the maintenance time dependent variable parameters such as MTBF over time will have a significant impact on the logistics resources demands, International Space Station availability and maintenance support costs. There are two types of parameters in the logistics and maintenance world: a. Fixed; b. Variable Fixed parameters, such as cost per man hour, are relatively easy to predict and forecast. These parameters normally follow a linear path and they do not change randomly. However, the variable parameters subject to the study in this report such as MTBF do not follow a linear path and they normally fall within the distribution curves which are discussed in this publication. The very challenging task then becomes the utilization of statistical techniques to accurately forecast the future non-linear time dependent variable arisings and events with a high confidence level. This, in turn, shall translate in tremendous cost savings and improved availability all around.

Sepehry-Fard, F.↗