Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Statistical forecasting”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

TPSAS-NF1676L-17064-DND

A statistical analysis of runway incursion (RI) events was conducted to ascertain relevance to the top ten challenges of the National Aeronautics and Space Administration Aviation Safety Program (AvSP). The information contained in the RI database was found to contain data that may be relevant to several of the AvSP top ten challenges. When combined with other data from the FAA documenting air traffic volume from calendar year 2000 through 2011, the structure of a predictive model emerges that can be used to forecast the frequency of RI events at various airports for various classes of aircraft and under various environmental conditions.

Runway incursions↗

One-level modeling for diagnosing surface winds over complex terrain. II - Applicability to short-range forecasting

The Alpert and Getenio (1988) modification of the Mass and Dempsey (1985) one-level sigma-surface model was used to study four synoptic events that included two winter cases (a Cyprus low and a Siberian high) and two summer cases. Results of statistical verification showed that the model is not only capable of diagnosing many details of surface mesoscale flow, but might also be useful for various applications which require operative short-range prediction of the diurnal changes of high-resolution surface flow over complex terrain, for example, in locating wildland fires, determining the dispersion of air pollutants, and predicting changes in wind energy or of surface wind for low-level air flights.

Alpert, P.↗

Modeling the impact of COVID-19 on air quality in southern California: implications for future control policies

Abstract. In response to the coronavirus disease of 2019 (COVID-19), California issued statewide stay-at-home orders, bringing about abrupt and dramatic reductions in air pollutant emissions. This crisis offers us an unprecedented opportunity to evaluate the effectiveness of emission reductions in terms of air quality. Here we use the Weather Research and Forecasting model with Chemistry (WRF-Chem) in combination with surface observations to study the impact of the COVID-19 lockdown measures on air quality in southern California. Based on activity level statistics and satellite observations, we estimate the sectoral emission changes during the lockdown. Due to the reduced emissions, the population-weighted concentrations of fine particulate matter (PM2.5) decrease by 15 % in southern California. The emission reductions contribute 68 % of the PM2.5 concentration decrease before and after the lockdown, while meteorology variations contribute the remaining 32 %. Among all chemical compositions, the PM2.5 concentration decrease due to emission reductions is dominated by nitrate and primary components. For O3 concentrations, the emission reductions cause a decrease in rural areas but an increase in urban areas; the increase can be offset by a 70 % emission reduction in anthropogenic volatile organic compounds (VOCs). These findings suggest that a strengthened control on primary PM2.5 emissions and a well-balanced control on nitrogen oxides and VOC emissions are needed to effectively and sustainably alleviate PM2.5 and O3 pollution in southern California.

54 ENVIRONMENTAL SCIENCES↗

Atmospheric and oceanographic research review, 1978

Research activities related to global weather, ocean/air interactions, and climate are reported. The global weather research is aimed at improving the assimilation of satellite-derived data in weather forecast models, developing analysis/forecast models that can more fully utilize satellite data, and developing new measures of forecast skill to properly assess the impact of satellite data on weather forecasting. The oceanographic research goal is to understand and model the processes that determine the general circulation of the oceans, focusing on those processes that affect sea surface temperature and oceanic heat storage, which are the oceanographic variables with the greatest influence on climate. The climate research objective is to support the development and effective utilization of space-acquired data systems in climate forecast models and to conduct sensitivity studies to determine the affect of lower boundary conditions on climate and predictability studies to determine which global climate features can be modeled either deterministically or statistically.

Source record↗

Comment on the Predicted Size of Cycle 23 Based on the Inferred Three-Cycle Quasi-Periodicity of the Planetary Index Ap

Recently, Ahluwalia [1998] reviewed the solar and geomagnetic data for the last 6 decades and remarked that these data "indicate the existence of a three-solar-activity-cycle quasi-periodicity in them." Futhermore, on the basis of this inferred quasi-periodicity, he asserted that cycle 23 represents the initial cycle in a new 3-cycle string, implying that it "will be more modest (a la cycle 17) with an annual mean sunspot number count of 119.3 +/- 30 at the maximum," a prediction that is considerably below the consensus prediction of 160 +/- 30 by Joselyn et al. [1997] and of similar predictions by others based on a variety of predictive techniques. Several major sticking points of Ahluwalia's presentation, however, must be redressed, and these issues form the basis of this comment. In particular, it is shown that Ahluwalia used inappropriate values of the Ap index in his analysis, that the inferred 3-cycle relationship which Ahluwalia claims for both Ap and SSN does not exist for the previous 6-cycle interval (prior to cycle 17) for SSN, that his inferred fit is only of marginal statistical significance (having r = 0.81), and that two alternative precursor fits (both with r = 0.96 or greater) exist which strongly suggest that R max for cycle 23 will be much larger than forecast by Ahluwalia (namely, about 168-187). Thus, caution must be exercised in accepting Ahluwalia's findings.

Hathaway, David H.↗

TPSAS-NF1676L-33626-DND

NASA is conducting a series of computational experiments to quantify atmospheric effects on low noise sonic booms. In the current study, simulated cruise nearfield pressure data from NASA?s X-59 Quiet Supersonic Technology aircraft was propagated from the aircraft to the ground at four cardinal headings through five years of realistic atmospheric profiles at 30 locations across the eastern USA. Statistical design of experiments was used to select the locations where primary sonic thump carpet widths (CW) and metric levels at the ground were computed. Atmospheric profiles were taken from the Climate Forecast System Reanalysis database, which contains reanalyzed atmospheric profiles four times daily. Decision tree analyses were performed to determine relative importance of predictors for CW and metric levels. Predictors included were latitude, longitude, date, time of day, season, climate, aircraft heading, and ground elevation. Results of this study indicate the propagation resolution needed to adequately characterize the distributions of CW and ground metric data, i.e., necessary separation distance between propagation locations and total number of atmospheres through which to propagate. This resolution will be used for a follow-on study of simulated X-59 carpets across the entire US mainland.

Will Doebler↗

The Impact of ENSO on Extratropical Low Frequency Noise in Seasonal Forecasts

This study examines the uncertainty in forecasts of the January-February-March (JFM) mean extratropical circulation, and how that uncertainty is modulated by the El Nino/Southern Oscillation (ENSO). The analysis is based on ensembles of hindcasts made with an Atmospheric General Circulation Model (AGCM) forced with sea surface temperatures observed during; the 1983 El Nino and 1989 La Nina events. The AGCM produces pronounced interannual differences in the magnitude of the extratropical seasonal mean noise (intra-ensemble variability). The North Pacific, in particular, shows extensive regions where the 1989 seasonal mean noise kinetic energy (SKE), which is dominated by a "PNA-like" spatial structure, is more than twice that of the 1983 forecasts. The larger SKE in 1989 is associated with a larger than normal barotropic conversion of kinetic energy from the mean Pacific jet to the seasonal mean noise. The generation of SKE due to sub-monthly transients also shows substantial interannual differences, though these are much smaller than the differences in the mean flow conversions. An analysis of the Generation of monthly mean noise kinetic energy (NIKE) and its variability suggests that the seasonal mean noise is predominantly a statistical residue of variability resulting from dynamical processes operating on monthly and shorter times scales. A stochastically-forced barotropic model (linearized about the AGCM's 1983 and 1989 base states) is used to further assess the role of the basic state, submonthly transients, and tropical forcing, in modulating the uncertainties in the seasonal AGCM forecasts. When forced globally with spatially-white noise, the linear model generates much larger variance for the 1989 base state, consistent with the AGCM results. The extratropical variability for the 1989 base state is dominanted by a single eigenmode, and is strongly coupled with forcing over tropical western Pacific and the Indian Ocean, again consistent with the AGCM results. Linear calculations that include forcing from the AGCM variance of the tropical forcing and submonthly transients show a small impact on the variability over the Pacific/North American region compared with that of the base state differences.

Schubert, Siegfried D.↗

An Empirical Cumulus Parameterization Scheme for a Global Spectral Model

Realistic vertical heating and drying profiles in a cumulus scheme is important for obtaining accurate weather forecasts. A new empirical cumulus parameterization scheme based on a procedure to improve the vertical distribution of heating and moistening over the tropics is developed. The empirical cumulus parameterization scheme (ECPS) utilizes profiles of Tropical Rainfall Measuring Mission (TRMM) based heating and moistening derived from the European Centre for Medium- Range Weather Forecasts (ECMWF) analysis. A dimension reduction technique through rotated principal component analysis (RPCA) is performed on the vertical profiles of heating (Q1) and drying (Q2) over the convective regions of the tropics, to obtain the dominant modes of variability. Analysis suggests that most of the variance associated with the observed profiles can be explained by retaining the first three modes. The ECPS then applies a statistical approach in which Q1 and Q2 are expressed as a linear combination of the first three dominant principal components which distinctly explain variance in the troposphere as a function of the prevalent large-scale dynamics. The principal component (PC) score which quantifies the contribution of each PC to the corresponding loading profile is estimated through a multiple screening regression method which yields the PC score as a function of the large-scale variables. The profiles of Q1 and Q2 thus obtained are found to match well with the observed profiles. The impact of the ECPS is investigated in a series of short range (1-3 day) prediction experiments using the Florida State University global spectral model (FSUGSM, T126L14). Comparisons between short range ECPS forecasts and those with the modified Kuo scheme show a very marked improvement in the skill in ECPS forecasts. This improvement in the forecast skill with ECPS emphasizes the importance of incorporating realistic vertical distributions of heating and drying in the model cumulus scheme. This also suggests that in the absence of explicit models for convection, the proposed statistical scheme improves the modeling of the vertical distribution of heating and moistening in areas of deep convection.

Rajendran, K.↗

Reliable statistics-based detection and investigation of anomalies in a SMART valve system

Reliable anomaly detection and diagnosis are critical for the safe operation of complex engineered systems. This study presents a unified framework that integrates statistical, model-based, and data-driven techniques for anomaly detection and investigation, demonstrated on SMART valve systems in hybrid energy applications. Four detection methods—mean deviation, seasonal extreme studentized deviate, ARIMA forecasting, and matrix profiling—were implemented and compared. Matrix profiling was particularly effective in revealing subtle deviations and hidden relationships among variables. Anomaly investigation was performed by analyzing variable-level and grouped signal profiles, with system topology incorporated to distinguish primary faults from propagated effects. Grouping signals by type enhanced interpretability, enabling accurate localization of anomalies across multi-dimensional datasets. Experimental results confirmed the framework's capability to consistently detect and isolate anomalies while providing actionable insights into system interdependencies. The proposed methodology offers a robust, interpretable, and scalable solution for condition monitoring, with potential applications in safety-critical domains such as nuclear energy, aerospace, and process industries.

ARIMA models↗

Robust Medium-Voltage Distribution System State Estimation using Multi-Source Data

Due to the lack of sufficient online measurements for distribution system observability, pseudo-measurements from short-term load or distributed renewable energy resources (DERs) forecasting are used. However, the accuracy of them is low and thus significantly limits the performance of distribution system state estimation (DSSE). In this paper, a robust DSSE that integrates multi-source measurement data is proposed. Specifically, the historical low-voltage (LV) side smart meters are used to forecast load and DERs injections via the support vector machine (SVM) with optimally tuned parameters. By contrast, the online smart meters at LV side are utilized to derive equivalent power injections at the MV/LV transformers, yielding more accurate pseudo-measurements compared to the forecasted injections. Furthermore, to deal with bad data caused by communication loss, instrumental errors and cyber attacks, robust DSSE that relies on generalized maximum-likelihood (GM)-estimation criterion is developed. The projection statistics are developed to adjust the weights of each measurement, leading to better balance between pseudo- and real-time measurements. Numerical results conducted on modified IEEE 33-bus system with DG integration demonstrate the effectiveness and robustness of the proposed method.

distribution system state estimation↗

Roadmap and Benchmarking: Privacy in Federated Load Forecasting

Data-driven techniques for energy demand forecasting continue to emerge with promising impacts on distribution grid planning. However, the development of robust and generalizable machine learning models requires that representative high quality training data are available. Distributed energy resources have begun to embed intelligence, gathering large amounts of data on customer demand, behavior, and household devices that are connected to the grid. Though utilities aggregate meter-level demand data for load shaping, demand response, outage management, reliability planning, and billing applications, there lies an inherent privacy concern in sharing consumption data that may identify individual consumer behavioral patterns. Hence, while sharing the data is crucial, the private sensitive customer data must be safeguarded from being exposed or manipulated. In this study, we propose a roadmap for implementing a based privacy preserving framework to support the advancement of data-driven analytics in data-sensitive distributed energy resources environments. The roadmap incorporates federated learning–a distributed training framework, differential privacy–a statistical framework that provides guarantees to safeguard the leakage of sensitive data, secure multiparty computation and homomorphic encryption– techniques for encrypting model gradients and applying secure aggregation on the server. Moreover, we perform baseline experiments on the federated short-term load forecasting (STLF) task using open-source residential load profile datasets, offering insights into the challenges of integrating differential privacy into federated learning.

Abebe, Waqwoya [Oak Ridge National Laboratory (ORN↗

Cluster cosmology without cluster finding

ABSTRACT We propose that observations of supermassive galaxies contain cosmological statistical constraining power similar to conventional cluster cosmology, and we provide promising indications that the associated systematic errors are comparably easier to control. We consider a fiducial spectroscopic and stellar mass complete sample of galaxies drawn from the Dark Energy Spectroscopic Instrument (DESI) and forecast how constraints on Ωm–σ8 from this sample will compare with those from number counts of clusters based on richness λ. At fixed number density, we find that massive galaxies offer similar constraints to galaxy clusters. However, a mass-complete galaxy sample from DESI has the potential to probe lower halo masses than standard optical cluster samples (which are typically limited to λ ≳ 20 and Mhalo ≳ 1013.5 M⊙ h−1); additionally, it is straightforward to cleanly measure projected galaxy clustering wp for such a DESI sample, which we show can substantially improve the constraining power on Ωm. We also compare the constraining power of M*-limited samples to those from larger but mass-incomplete samples [e.g. the DESI Bright Galaxy Survey (BGS) sample]; relative to a lower number density M*-limited samples, we find that a BGS-like sample improves statistical constraints by 60 per cent for Ωm and 40 per cent for σ8, but this uses small-scale information that will be harder to model for BGS. Our initial assessment of the systematics associated with supermassive galaxy cosmology yields promising results. The proposed samples have a ∼10 per cent satellite fraction, but we show that cosmological constraints may be robust to the impact of satellites. These findings motivate future work to realize the potential of supermassive galaxies to probe lower halo masses than richness-based clusters and to potentially avoid persistent systematics associated with optical cluster finding.

(cosmology): large-scale structure of Universe↗

A Nowcasting Approach for Low-Earth-Orbiting Hyperspectral Infrared Soundings within the Convective Environment

Low-Earth-orbiting (LEO) hyperspectral infrared (IR) sounders have significant yet untapped potential for characterizing thermodynamic environments of convective initiation and ongoing convection. While LEO soundings are of value to weather forecasters, the temporal resolution needed to resolve the rapidly evolving thermodynamics of the convective environment is limited. Here, we have developed a novel nowcasting methodology to extend snapshots of LEO soundings forward in time up to 6 h to create a product available within National Weather Service systems for user assessment. Our methodology is based on parcel forward-trajectory calculations from the satellite-observing time to generate future soundings of temperature (T) and specific humidity (q) at regularly gridded intervals in space and time. The soundings are based on NOAA-Unique Combined Atmospheric Processing System (NUCAPS) retrievals from the Suomi National Polar-Orbiting Partnership (Suomi NPP) and NOAA-20 satellite platforms. The tendencies of derived convective available potential energy (CAPE) and convective inhibition (CIN) are evaluated against gridded, hourly accumulated rainfall obtained from the Multi-Radar Multi-Sensor (MRMS) observations for 24 hand-selected cases over the contiguous United States. Areas with forecast increases in CAPE (reduced CIN) are shown to be associated with areas of precipitation. The increases in CAPE and decreases in CIN are largest for areas that have the heaviest precipitation and are statistically significant compared to areas without precipitation. These results imply that adiabatic parcel advection of LEO satellite sounding snapshots forward in time are capable of identifying convective initiation over an expanded temporal scale compared to soundings used only during the LEO satellite overpass time.

54 ENVIRONMENTAL SCIENCES↗

helios: An R package to process heating and cooling degrees for GCAM

helios is an open-source R package that estimates population-weighted heating and cooling degree-hours (HDH and CDH) and degree-days (HDD and CDD) at various temporal (e.g., energy dispatch segments, monthly, yearly) and spatial scales (e.g., U.S. states, global political regions, countries). The degree hour and degree day outputs from helios are used to inform electricity demand load in the Global Change Analysis Model (GCAM) as well as in GCAM-USA (which is the version of GCAM with U.S. state-level details). helios uses a workflow with four steps: processing raw data; calculating heating and cooling degrees; visualizing performance diagnostics; and outputing results in various formats. There are two sources of widely-used climate data compatible with helios: (1) hourly climate data with 12-km resolution that are dynamically downscaled with the Weather Research and Forecasting (WRF) model and projected using a thermal global warming (TGW) approach; and (2) daily climate data with 0.5-degree resolution from the Coupled Model Intercomparison Project (CMIP) that is bias-adjusted and statistical downscaled by the Inter-Sectoral Impact Model Intercomparison Project (ISIMIP). In summary, helios is a model that standardizes methodology of heating and cooling degrees-hours and degree-days using publicly available data and advance the understanding of the impact of spatial and temporal temperature variability on building energy services.

97 MATHEMATICS AND COMPUTING↗

An error analysis of basic kinematic quantities

A description is presented of the computational procedures used to obtain spatial fields of relative vorticity, advection of vorticity, horizontal divergence, and vertical motion. An investigation is conducted of the effectiveness of these procedures to reduce the effects of deliberately introduced random errors, giving attention to the confidence which can be placed on values of the derived parameters. It is concluded that fields of 500 mb vorticity and 700 mb vertical velocity, which are frequently used in synoptic scale forecasting schemes, show minimal effects of the deliberately introduced errors. Vorticity advection is found to be the most sensitive term to input data errors. Large fluctuations in fields of this parameter are evident both statistically and qualitatively.

Berecek, E. M.↗

A Nowcasting Approach for Low Earth Orbit Hyperspectral Infrared Soundings Within the Convective Environment

Low Earth orbit (LEO) hyper-spectral infrared (IR) sounders have significant yet untapped potential for characterizing thermodynamic environments of convective initiation and ongoing convection. While LEO soundings are of value to weather forecasters, the temporal resolution needed to resolve the rapidly evolving thermodynamics of the convective environment is limited. We have developed a novel nowcasting methodology to extend snapshots of LEO soundings forward in time up to six hours to create a product available within National Weather Service systems for user assessment. Our methodology is based on parcel forward-trajectory calculations from the satellite observing time to generate future soundings of temperature (T) and specific humidity (q) at regularly gridded intervals in space and time. The soundings are based on NOAA-Unique Combined Atmospheric Processing System (NUCAPS) retrievals from the Suomi NPP and NOAA-20 satellite platforms. The tendencies of derived convective available potential energy (CAPE) and convective inhibition (CIN) are evaluated against gridded, hourly accumulated rainfall obtained from the Multi-Radar Multi-Sensor (MRMS) observations for 24 hand-selected cases over the Contiguous United States. Areas with forecast increases in CAPE (reduced CIN) are shown to be associated with areas of precipitation. The increases in CAPE and decreases in CIN are largest for areas that have the heaviest precipitation and are statistically significant compared to areas without precipitation. These results imply that adiabatic parcel advection of LEO satellite sounding snapshots forward in time are capable of identifying convective initiation over an expanded temporal scale compared to soundings used only during the LEO satellite overpass time.

North America↗

Photo-z outlier self-calibration in weak lensing surveys

Calibrating photometric redshift errors in weak lensing surveys with external data is extremely challenging. In this work, we show that both Gaussian and outlier photo-z parameters can be self-calibrated from the data alone. This comes at no cost for the neutrino masses, curvature and dark energy equation of state w0, but with a 65% degradation when both w0 and wa are varied. We perform a realistic forecast for the Vera Rubin Observatory (VRO) Legacy Survey of Space and Time (LSST) 3× 2 analysis, combining cosmic shear, projected galaxy clustering and galaxy - galaxy lensing. We confirm the importance of marginalizing over photo-z outliers. We examine a subset of internal cross-correlations, dubbed "null correlations", which are usually ignored in 3× 2 analyses. Despite contributing only ~ 10% of the total signal-to-noise, these null correlations improve the constraints on photo-z parameters by up to an order of magnitude. Using the same galaxy sample as sources and lenses dramatically improves the photo-z uncertainties too. Together, these methods add robustness to any claim of detected new Physics, and reduce the statistical errors on cosmology by 15% and 10% respectively. Finally, including CMB lensing from an experiment like Simons Observatory or CMB-S4 improves the cosmological and photo-z posterior constraints by about 10%, and further improves the robustness to systematics. To give intuition on the Fisher forecasts, we examine in detail several toy models that explain the origin of the photo-z self-calibration. Our Fisher code LaSSI (Large-Scale Structure Information), which includes the effect of Gaussian and outlier photo-z, shear multiplicative bias, linear galaxy bias, and extensions to LCDM, is publicly available at \href{https://github.com/EmmanuelSchaan/LaSSI}{https://github.com/EmmanuelSchaan/LaSSI}.

79 ASTRONOMY AND ASTROPHYSICS↗

The Influence of Observation Errors on Analysis Error and Forecast Skill Investigated with an Observing System Simulation Experiment

The Global Modeling and Assimilation Office (GMAO) observing system simulation experiment (OSSE) framework is used to explore the response of analysis error and forecast skill to observation quality. In an OSSE, synthetic observations may be created that have much smaller error than real observations, and precisely quantified error may be applied to these synthetic observations. Three experiments are performed in which synthetic observations with magnitudes of applied observation error that vary from zero to twice the estimated realistic error are ingested into the Goddard Earth Observing System Model (GEOS-5) with Gridpoint Statistical Interpolation (GSI) data assimilation for a one-month period representing July. The analysis increment and observation innovation are strongly impacted by observation error, with much larger variances for increased observation error. The analysis quality is degraded by increased observation error, but the change in root-mean-square error of the analysis state is small relative to the total analysis error. Surprisingly, in the 120 hour forecast increased observation error only yields a slight decline in forecast skill in the extratropics, and no discernable degradation of forecast skill in the tropics.

Observation Error↗