Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical forecasting”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24

Mark Twain National Forest Ecological Forecasting: Utilizing NASA Earth Observations to Classify Ground Cover Types in the Mark Twain National Forest

The Mark Twain National Forest (MTNF) encompasses 1.5 million acres of public land in the Ozarks region of southeastern Missouri. The industrial boom between the 1880s and 1920s had devastating effects on the shortleaf pine (Pinus echinata),Missouri’s only native pine species. The combination of fire suppression on this fire-dependent species and timber harvest of mature pine stands inhibited the development of pine seedlings and promoted the establishment of hardwood stands. Partners at the US Forest Service’s MTNF are currently involved in restoration efforts in two ranger districts, which includes removing invasive eastern red cedar (Juniperus virginiana) and prescribed burning. To expand spatial coverage for the MTNF beyond in situ observation sites, the NASA DEVELOP team analyzed land cover change from 1986 through 2019 and forecasted changes based on a ‘business-as-usual' scenario out to 2040. The team incorporated remotely sensed data from Landsat 5 Thematic Mapper (TM) and Landsat 8 Operational Land Imager (OLI) into the random trees supervised classification tool in ArcGIS Pro. This tool spectrally separated pixels into five distinct land cover classes and produced classifications for 1986 and 2019, with kappa statistics of 0.87 and 0.81, respectively. Overall, there was a net decrease in conifer and meadow land cover between 1986 and 2019 along with a net increase in water, developed, and deciduous land cover. The team used TerrSet’s Land Change Modeler to forecast land cover through 2040. Results showed an increase in coniferous land cover and a decrease in deciduous cover, indicating a high probability that current restoration efforts will produce the intended effect.

DEVELOP Tech Paper↗

Meeting Global Health Needs via Infectious Disease Forecasting: Development of a Reliable Data-Driven Framework

Infectious diseases (IDs) have a significant detrimental impact on global health. Timely and accurate ID forecasting can result in more informed implementation of control measures and prevention policies. To meet the operational decision-making needs of real-world circumstances, we aimed to build a standardized, reliable, and trustworthy ID forecasting pipeline and visualization dashboard that is generalizable across a wide range of modeling techniques, IDs, and global locations. We forecasted 6 diverse, zoonotic diseases (brucellosis, campylobacteriosis, Middle East respiratory syndrome, Q fever, tick-borne encephalitis, and tularemia) across 4 continents and 8 countries. We included a wide range of statistical, machine learning, and deep learning models (n=9) and trained them on a multitude of features (average n=2326) within the One Health landscape, including demography, landscape, climate, and socioeconomic factors. The pipeline and dashboard were created in consideration of crucial operational metrics—prediction accuracy, computational efficiency, spatiotemporal generalizability, uncertainty quantification, and interpretability—which are essential to strategic data-driven decisions. While no single best model was suitable for all disease, region, and country combinations, our ensemble technique selects the best-performing model for each given scenario to achieve the closest prediction. For new or emerging diseases in a region, the ensemble model can predict how the disease may behave in the new region using a pretrained model from a similar region with a history of that disease. The data visualization dashboard provides a clean interface of important analytical metrics, such as ID temporal patterns, forecasts, prediction uncertainties, and model feature importance across all geographic locations and disease combinations. As the need for real-time, operational ID forecasting capabilities increases, this standardized and automated platform for data collection, analysis, and reporting is a major step forward in enabling evidence-based public health decisions and policies for the prevention and mitigation of future ID outbreaks.

60 APPLIED LIFE SCIENCES↗

Evaluation of the Relative Contribution of Observing Systems in Reanalyses: Aircraft Temperature Bias and Analysis Innovations

Reanalyses have become important sources of data in weather and climate research. While observations are the most crucial component of the systems, few research projects consider carefully the multitudes of assimilated observations and their impact on the results. This is partly due to the diversity of observations and their individual complexity, but also due to the unfriendly nature of the data formats. Here, we discuss the NASA Modern-Era Retrospective analysis for Research and Applications (MERRA) and a companion dataset, the Gridded Innovations and Observations (GIO). GIO is simply a post-processing of the assimilated observations and their innovations (forecast error and analysis error) to a common spatio-temporal grid, following that of the MERRA analysis fields. This data includes in situ, retrieved and radiance observations that are assimilated and used in the reanalysis. While all these disparate observations and statistics are in a uniform easily accessible format, there are some limitations. Similar observations are binned to the grid, so that multiple observations are combined in the gridding process. The data is then implicitly thinned. Some details in the meta data may also be lost (e.g. aircraft or station ID). Nonetheless, the gridded observations should provide easy access to all the observations input to the reanalysis. To provide an example of the GIO data, a case study evaluating observing systems over the United States and statistics is presented, and demonstrates the evaluation of the observations and the data assimilation. The GIO data is used to collocate 200mb Radiosonde and Aircraft temperature measurements from 1979-2009. A known warm bias of the aircraft measurements is apparent compared to the radiosonde data. However, when larger quantities of aircraft data are available, they dominate the analysis and the radiosonde data become biased against the forecast. When AMSU radiances become available the radiosonde and aircraft analysis and forecast error take on an annual cycle. While this supports results of previous work that recommend bias corrections for the aircraft measurements, the interactions with AMSU radiances will also require further investigation. This also provides an example for reanalysis users in examining the available observations and their impact on the analysis. GIO data is presently available alongside the MERRA reanalysis.

Bosilovich, Michael G.↗

Short-term nodal load forecasting based on machine learning techniques

This paper introduces an advanced Short-term Nodal Load Forecasting (STNLF) method that forecasts nodal load profiles for the next day in power systems, based on the combined use of three machine learning techniques. Least Absolute Shrinkage and Selection Operator (LASSO) is employed to reduce the number of features for a single nodal load forecasting. Principal Component Analysis (PCA) is used to capture the features of historical loads in low-dimensional space compared to the original high-dimensional load space where features are barely possible to depict. Additionally, Bayesian Ridge Regression (BRR) is utilized to decide the parameters of the prediction model from a statistics perspective. Tests based on modified PJM load data demonstrate the effectiveness of the proposed STNLF method compared to the state-of-the-art General Regression Neural Network (GRNN) method. Moreover, the reliability of the day-ahead Unit Commitment (UC) solution is shown to have been improved, based on the forecasted load data using the proposed STNLF method.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Tilted lidar profiling: Development and testing of a novel scanning strategy for inhomogeneous flows

The most common profiling techniques for the atmospheric boundary layer based on a monostatic Doppler wind lidar rely on the assumption of horizontal homogeneity of the flow. This assumption breaks down in the presence of either natural or human-made obstructions that can generate significant flow distortions. The need to deploy ground-based lidars near operating wind turbines for the American WAKE experimeNt (AWAKEN) spurred a search for novel profiling techniques that could avoid the influence of the flow modifications caused by the wind farms. With this goal in mind, two well-established profiling scanning strategies have been retrofitted to scan in a tilted fashion and steer the beams away from the more severely inhomogeneous region of the flow. Results from a field test at the National Renewable Energy Laboratory's 135-m meteorological tower show that the accuracy of the horizontal mean flow reconstruction is insensitive to the tilt of the scan, although higher-order wind statistics are severely deteriorated at extreme tilts mainly due to geometrical error amplification. A numerical study of the AWAKEN domain based on the Weather Research and Forecasting Model and large-eddy simulation are also conducted to test the effectiveness of tilted profiling. It is shown that a threefold reduction of the error on inflow mean wind speed can be achieved for a lidar placed at the base of the turbine using tilted profiling.

17 WIND ENERGY↗

Optimizing the use of remotely sensed atmospheric data through four-dimensional data assimilation

Results with the GLA interactive forecast-retrieval-assimilation system, which directly uses satellite radiance data in the assimilation cycle, are presented. Forecasts made from initial conditions derived with this system are shown to be more skillful than those whose initial conditions came from a comparable assimilation using statistically based temperature soundings, or ones using no sounding data at all. Examples are also given of additional parameters which are produced through the physical inversion of the satellite radiance data during the interactive assimilation cycle. These are potentially useful for analysis purposes.

Pfaendtner, J.↗

Application of an Ensemble Smoother to Precipitation Assimilation

Assimilation of precipitation in a global modeling system poses a special challenge in that the observation operators for precipitation processes are highly nonlinear. In the variational approach, substantial development work and model simplifications are required to include precipitation-related physical processes in the tangent linear model and its adjoint. An ensemble based data assimilation algorithm "Maximum Likelihood Ensemble Smoother (MLES)" has been developed to explore the ensemble representation of the precipitation observation operator with nonlinear convection and large-scale moist physics. An ensemble assimilation system based on the NASA GEOS-5 GCM has been constructed to assimilate satellite precipitation data within the MLES framework. The configuration of the smoother takes the time dimension into account for the relationship between state variables and observable rainfall. The full nonlinear forward model ensembles are used to represent components involving the observation operator and its transpose. Several assimilation experiments using satellite precipitation observations have been carried out to investigate the effectiveness of the ensemble representation of the nonlinear observation operator and the data impact of assimilating rain retrievals from the TMI and SSM/I sensors. Preliminary results show that this ensemble assimilation approach is capable of extracting information from nonlinear observations to improve the analysis and forecast if ensemble size is adequate, and a suitable localization scheme is applied. In addition to a dynamically consistent precipitation analysis, the assimilation system produces a statistical estimate of the analysis uncertainty.

Zhang, Sara↗

Dynamics and Predictability of Hurricane Humberto (2007) Revealed from Ensemble Analysis and Forecasting

This study uses short-range ensemble forecasts initialized with an Ensemble-Kalman filter to study the dynamics and predictability of Hurricane Humberto, which made landfall along the Texas coast in 2007. Statistical correlation is used to determine why some ensemble members strengthen the incipient low into a hurricane and others do not. It is found that deep moisture and high convective available potential energy (CAPE) are two of the most important factors for the genesis of Humberto. Variations in CAPE result in as much difference (ensemble spread) in the final hurricane intensity as do variations in deep moisture. CAPE differences here are related to the interaction between the cyclone and a nearby front, which tends to stabilize the lower troposphere in the vicinity of the circulation center. This subsequently weakens convection and slows genesis. Eventually the wind-induced surface heat exchange mechanism and differences in landfall time result in even larger ensemble spread. 1

Sippel, Jason A.↗

When to vaccinate for seasonal influenza: check the peak forecast

Background Seasonal influenza infects 5-20% of people every year in the United States, resulting in hospitalizations, deaths, and adverse economic impacts. To mitigate these impacts, influenza vaccines are developed and distributed annually; however, growing evidence suggests that vaccine effectiveness (VE) wanes over the course of a flu season. Delaying influenza vaccination for older adults has attracted attention as a potential public health strategy. However, given the uncertainties in seasonal peak, vaccine effectiveness, and waning rates, postponing vaccination could also lead to increased morbidity, motivating an evaluation of a range of potential scenarios. The aim of this study was to investigate favorable age group-specific vaccination schedules that could lead to the greatest disease burden reduction. Methods We systematically investigated a broad range of vaccination start times for five age groups under six combinations of initial effectiveness and waning rates, based on influenza cases and vaccine uptake data from 10 influenza seasons. We defined the most favorable vaccination schedule as the one that resulted in the greatest reduction in disease burden. Results In scenarios with fast waning, all age groups benefit from delaying vaccination regardless of initial VE and peak timing. In scenarios with slower waning, results are mixed. For the ≥65 group, high initial VE and slow waning suggests that in early-peaking seasons, early vaccination most effectively reduces disease burden, while in late-peaking seasons delaying vaccination is most effective. For the ≥65 group in medium and low initial VE, and slow waning scenarios, delaying vaccination appears to prevent the greatest number of cases, regardless of whether the season peaks early or late. Conclusion The most favorable vaccination schedule is sensitive to changes in initial VE, waning rate, and peak timing. Given estimates of these quantities from statistical and immunological models and observations, our methods can inform vaccination recommendations in order to most effectively reduce the annual disease burden caused by seasonal influenza. Specifically, accurate peak timing forecasts for the upcoming season have the potential to guide decisions on when to vaccinate.

59 BASIC BIOLOGICAL SCIENCES↗

Suboptimal schemes for atmospheric data assimilation based on the Kalman filter

This work is directed toward approximating the evolution of forecast error covariances for data assimilation. The performance of different algorithms based on simplification of the standard Kalman filter (KF) is studied. These are suboptimal schemes (SOSs) when compared to the KF, which is optimal for linear problems with known statistics. The SOSs considered here are several versions of optimal interpolation (OI), a scheme for height error variance advection, and a simplified KF in which the full height error covariance is advected. To employ a methodology for exact comparison among these schemes, a linear environment is maintained, in which a beta-plane shallow-water model linearized about a constant zonal flow is chosen for the test-bed dynamics. The results show that constructing dynamically balanced forecast error covariances rather than using conventional geostrophically balanced ones is essential for successful performance of any SOS. A posteriori initialization of SOSs to compensate for model - data imbalance sometimes results in poor performance. Instead, properly constructed dynamically balanced forecast error covariances eliminate the need for initialization. When the SOSs studied here make use of dynamically balanced forecast error covariances, the difference among their performances progresses naturally from conventional OI to the KF. In fact, the results suggest that even modest enhancements of OI, such as including an approximate dynamical equation for height error variances while leaving height error correlation structure homogeneous, go a long way toward achieving the performance of the KF, provided that dynamically balanced cross-covariances are constructed and that model errors are accounted for properly. The results indicate that such enhancements are necessary if unconventional data are to have a positive impact.

Todling, Ricardo↗

Can Simple Metrics Identify the Process(es) Driving Extreme Precipitation?

This work seeks an automatic algorithm to determine the primary meteorological cause(s) of individual extreme precipitation events. Such determinations have been made before, but required a by-hand analysis of each separate event. This is very time-consuming and the field would benefit from an automatic process. This is especially relevant when comparing different datasets to determine which ones most closely hew towards reality. This paper tests three simple metrics over the continental United States using the European Center for Medium-Range Weather Forecasting’s (ECMWF) atmospheric reanalysis (ERA5). The metrics tested measure and compare the strength of three meteorological processes associated with extreme precipitation: fronts, convection, and cyclones. A multivariate statistical technique as well as individual case studies show evidence that the three meteorological processes of interest cannot be isolated from one another using these simple physical metrics. This shows the difficulty in finding “pure” cases of these precipitation-generating processes and suggests approaching these processes with an eye toward mixed-type events.

Swenson, Leif M. (ORCID:0000000199708735)↗

Intraseasonal oscillation of convective activity in the tropical Southern Hemisphere - May 1984-April 1986

This paper studies the intraseasonal oscillation of convection and related variables in the Southern Hemisphere tropics utilizing European Centre for Medium-range Weather Forecasts analyses of 1984 to 1986. One aspect of the research was that the original, unfiltered, time series of various variables was first analyzed to determine if a statistically significant signal occurred on the intraseasonal time scale. The analysis showed that two variables, outgoing longwave radiation and velocity potential at 200 hPa, provided the best evidence of an intraseasonal oscillation. The oscillation propagated eastward, and the convective activity for both years was more intense over the Indian Ocean-Indonesia-western Pacific region than elsewhere.

Vincent, Dayton G.↗

Perspectives on Forced Predictability

This talk addresses the relationships between weather and El Nino/Southern Oscillation (ENSO) and various other low frequency atmospheric variations such as the Pacific/North American pattern. We focus, in particular, on the predictability of extreme wintertime precipitation events over the continental United States. We first examine fifty years of daily precipitation observations and quantify the leading patterns of winter weather variability. These weather systems, familiar to operational weather forecasters, account for many of the major flooding events on the west coast as well as the major winter snowstorms along the east coast. We next examine the statistics of these storm systems with a particular focus on the occurrence of extreme events. The leading weather systems show varying degrees of linkages to low frequency atmospheric variability. We show, for example, that on seasonal time scales the probability of occurrence of certain types of west coast storms is strongly enhanced by El Nino, while it is reduced during winters with an anomalous trough to the west of the dateline. ENSO also has a strong impact on storms that develop over the Gulf of Mexico and affect much of the eastern United States, with enhanced storminess during El Nino, and reduced storminess during La Nina conditions. We conclude with an example of how well current climate models are able to reproduce the basic linkages between weather and low frequency variability.

Schubert, S.↗

Developing Empirical Lightning Cessation Forecast Guidance for the Cape Canaveral Air Force Station and Kennedy Space Center

This research addresses the 45th Weather Squadron's (45WS) need for improved guidance regarding lightning cessation at Cape Canaveral Air Force Station and Kennedy Space Center (KSC). KSC's Lightning Detection and Ranging (LDAR) network was the primary observational tool to investigate both cloud-to-ground and intracloud lightning. Five statistical and empirical schemes were created from LDAR, sounding, and radar parameters derived from 116 storms. Four of the five schemes were unsuitable for operational use since lightning advisories would be canceled prematurely, leading to safety risks to personnel. These include a correlation and regression tree analysis, three variants of multiple linear regression, event time trending, and the time delay between the greatest height of the maximum dBZ value to the last flash. These schemes failed to adequately forecast the maximum interval, the greatest time between any two flashes in the storm. The majority of storms had a maximum interval less than 10 min, which biased the schemes toward small values. Success was achieved with the percentile method (PM) by separating the maximum interval into percentiles for the 100 dependent storms.

LDAR (LIGHTNING DETECTION AND RANGING)↗

Physics-based Induced Earthquake Forecasting: Process Understanding, and Hazards Mitigation

Disposal of saltwater co-produced with oil and gas is linked to elevated seismicity in the Central and Midwest US. There is a concern that these events may lead to widespread damage and an overall increase in seismicity. Thus an improved understanding of the spatially and temporally variable deformation and stress field associated with fluid injection operation is critically necessary for evaluating time-varying seismic hazards. Despite the improvements in seismic monitoring capacity and the resulting decrease in the magnitude detection threshold, estimates of induced earthquake probability remain elusive due to insufficient models incapable of accounting for the complex physics governing the process of induced seismicity. The proposed research effort will comprehensively analyze, integrate, and interpret geodetic, injection, and seismic data in the vicinity of the injection sites in Oklahoma to resolve the 4-dimensional distribution of pore pressure and stress in the shallow crust. This project, in particular, is focused on exploring the statistical relation between injection operation and increased earthquake hazard. The amplitude of and the extent to which pore pressure changes are determined by some factors, in particular, the hydrogeological properties of the rocks, such as diffusivity. Thus the available deformation data will be used to constrain hydrogeological properties of the medium, to accurately resolve the evolution of crustal stresses due to fluid injection. Having the time-varying models of stress changes, a statistical framework will be implemented to estimate the time-dependent probability of large earthquakes on the nearby fault systems. These data and models help to improve seismic hazard estimates and aid in constructing operational-induced earthquake forecast models. This information can also be integrated into the updated U.S. National Seismic Hazard Map, which local communities and authorities use in their earthquake risk estimates and mitigation efforts.

58 GEOSCIENCES↗

Large‐Scale Statistically Meaningful Patterns (LSMPs) Associated With Precipitation Extremes Over Northern California

Abstract We analyze large‐scale statistically meaningful patterns (LSMPs) that precede extreme precipitation (PEx) events over Northern California (NorCal). We find LSMPs by applying k‐means clustering to the two leading principal components of daily 500 hPa geopotential height anomalies two days before the onset, from October to March during 1948–2015. Statistical significance testing based on Monte Carlo simulations suggests a minimum of four statistically distinguished LSMP clusters. The four LSMP clusters are characterized as Northwest continental negative height anomaly, Eastward positive “Pacific‐North American Pattern (PNA),” Westward negative “PNA,” and Prominent Alaskan ridge. These four clusters, shown in multiple variables, evolve very differently and have differing links to the Arctic and tropical Pacific regions. Using binary forecast skill measures and a new copula‐based framework for predicting PEx events, we find LSMP indices that are useful predictors of NorCal PEx events, with moisture‐based variables being the best predictors of PEx events at least 6 days before the onset, and the lower atmospheric variables being better than their upper atmospheric counterparts any day in advance tested. To ensure statistical rigor, the LSMPs analyzed here (with the modified acronym) include local tests of both significance and consistency, which are not always featured in the literature on large‐scale meteorological patterns.

54 ENVIRONMENTAL SCIENCES↗

The Influence of Synoptic Scales on Low-frequency Modes of Variability

Model analysis and predictablity studies using an equivalent barotropic empirical orthogonal function (EOF) model described in Schubert (1984b) are dicussed. An extensive set of 10-day forecasts was produced for the 12 component version of the model. Comparisons with observed data show apparently useful forecasts for individual winters. However, when averaged over 10 winters, the improvement over persistence was marginal and only one of the EOF's (resembling North Atlantic blocking) showed a statistically significant improvement. These results suggest the need for a more realistic model which includes shorter time scale baroclinic processes and spatial modes capable of efficiently representing the characteristic structures associated with baroclinic instability.

Schubert, S. D.↗

A Synopsis of AIRS Global-Mean Clear-Sky Radiance Trends From 2003 to 2020

Atmospheric Infrared Sounder (AIRS) aboard the National Aeronautics and Space Administration (NASA) Aqua satellite has been operating since September 2002. Its information content, superb instrument performance, and dense sampling pattern make the AIRS radiances an invaluable data set for climate studies. The trends of global-mean, nadir-view, clear-sky AIRS radiances from 2003 to 2020 are studied here, together with the counterparts of synthetic radiances based on two reanalyzes, European Centre for Medium-Range Weather Forecasts Reanalysis V5 (ECMWF ERA5) and NASA Goddard Earth Observing System V5.4.1 (GEOS-5.4.1; a reanalysis product without assimilation of hyperspectral radiances such as AIRS). The AIRS observation shows statistically significant negative trends in most of its CO2 channels, positive but non-significant trends in the channels over the window regions, and statistically significant positive trends in some of its H2O channels. The best agreements between observed and simulated radiance trends are seen over the CO2 tropospheric channels, while the observed and simulated trends over the CO2 stratospheric channels are opposite. ERA5 results largely agree with the AIRS observation over the H2O channels. The comparison in the H2O channels helps reveal a data continuity issue in the GEOS-5.4.1. Contributions from individual variables to the radiance trends are also assessed by performing separate simulations. This study provides the first synopsis of the global-mean trend of AIRS radiances over all its thermal-IR channels.

CO2↗