Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “time series prediction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Chapter 7: Predictive Analytics in Future Power Systems: A Panorama and State-of-the-Art of Deep Learning Applications

The challenges surrounding the optimal operation of power systems are growing in various dimensions, due in part to increasingly distributed energy resources and a progression towards large-scale transportation electrification. Currently, the increasing uncertainties associated with both renewable energy generation and demand are largely being managed by increasing operational reserves - potentially at the cost of suboptimal economic conditions - in order to maintain the reliability of the system. This chapter looks at the big picture role of forecasting in power systems from generation to consumption and provides a comprehensive review of traditional approaches for forecasting generation and load in various contexts. This chapter then takes a deep dive into the state-of-the-art machine learning and deep learning approaches for power systems forecasting. Furthermore, a case study of multi-time-horizon solar irradiance forecasting using deep learning is discussed in detail. Smart grids form the backbone of the future interdependent networks. For addressing the challenges associated with the operations of smart grid, development and wide adoption of machine learning and deep learning algorithms capable of producing better forecasting accuracies is urgently needed. Along with exploring the implementation and benefits of these approaches, this chapter also considers the strengths and limitations of deep learning algorithms for power systems forecasting applications. This chapter, thus, provides a panoramic view of state-of-the-art of predictive analytics in power systems in the context of future smart grid operations.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Accelerating cavity fault prediction using deep learning at Jefferson Laboratory

Abstract Accelerating cavities are an integral part of the continuous electron beam accelerator facility (CEBAF) at Jefferson Laboratory. When any of the over 400 cavities in CEBAF experiences a fault, it disrupts beam delivery to experimental user halls. In this study, we propose the use of a deep learning model to predict slowly developing cavity faults. By utilizing pre-fault signals, we train a long short-term memory-convolutional neural network binary classifier to distinguish between radio-frequency (RF) signals during normal operation and RF signals indicative of impending faults. We optimize the model by adjusting the fault confidence threshold and implementing a multiple consecutive window criterion to identify fault events, ensuring a low false positive rate. Results obtained from analysis of a real dataset collected from the accelerating cavities simulating a deployed scenario demonstrate the model’s ability to identify normal signals with 99.99% accuracy and correctly predict 80% of slowly developing faults. Notably, these achievements were achieved in the context of a highly imbalanced dataset, and fault predictions were made several hundred milliseconds before the onset of the fault. Anticipating faults enables preemptive measures to improve operational efficiency by preventing or mitigating their occurrence.

43 PARTICLE ACCELERATORS↗

An Efficient Three-Dimensional CFD-Based Numerical Wave Tank for a Wave Energy Converter in Extreme Irregular Waves

A numerical wave tank approach for computational fluid dynamics (CFD) modelling of an extreme irregular seastate is presented. The technique couples a potential flow solution with a CFD solver for more efficient numerical predictions. This method has recently become attractive both for the research community and the industry working with offshore structures. The model is used to determine the response of a submerged pressure differential wave energy converter (WEC) in a fully nonlinear irregular wave condition using the high-fidelity CFD code, STAR-CCM+. Potential flow based numerical models are commonly used to predict motions and performance of wave energy converters. Wave kinematics can deviate from potential flow predictions for extreme wave conditions; the excitation loads on an absorber can also be increasingly influenced by viscous effects, not predicted by potential flow engineering level models. In these extreme conditions, a Reynolds-averaged Navier-Stokes CFD model can better predict motions and loads for a WEC. Long time series with varying random seed numbers can be used to identify singular extreme wave events from a stochastic irregular sea state. This approach simulates a more realistic wave series for a given sea state than a regular wave or a focused wave. However, it is computationally infeasible to run these long time series for three-dimensional (3D) CFD simulations. In this work, two-dimensional (2D) CFD simulations with a long domain allow the full development of an extreme nonlinear wave condition. The results are used to identify extreme events from a 50-year storm condition for the PacWave site off the coast of Oregon. A relatively short time window including this extreme event is then mapped to a 3D simulation using a user defined wave methodology. Convergence studies for domain length, wave forcing lengths, and time before the extreme event were conducted.

CFD↗

Evolution of solitary density waves in stellar winds of early-type stars: A simple explanation of discrete absorption component behavior

We model the evolution of a density shell propagating through the stellar wind of an early-type star, in order to investigate the effects of such shells on UV P Cygni line profiles. Unlike previous treatments, we solve the mass, momentum, and energy conservation equations, using an explicit time-differencing scheme, and present a parametric study of the density, velocity, and temperature response. Under the assumed conditions, relatively large spatial scale, large-amplitude density shells propagate as stable waves through the supersonic portion of the wind. Their dynamical behavior appears to mimic propagating 'solitary waves,' and they are found to accelerate at the same rate as the underlying steady state stellar wind (i.e., the shell rides the wind). These hydrodynamically stable structures quantitatively reproduce the anomalous 'discrete absorption component' (DAC) behavior observed in the winds of luminous early-type stars, as illustrated by comparisons of model predictions to an extensive International Ultraviolet Explorer (IUE) time series of spectra of zeta Puppis (O4f). From these comparisons, we find no conclusive evidence indicative of DACs accelerating at a significantly slower rate than the underlying stellar wind, contrary to earlier reports. In addition, these density shells are found to be consistent within the constraints set by the IR observations. We conclude that the concept of propagating density shells should be seriously reconsidered as a possible explanation of the DAC phenomenon in early-type stars.

Waldron, Wayne L.↗

Skillful Forecasts of Basic Hydrological Quantities Through the Application of SMAP-Based Soil Moisture Retrievals

The top five centimeters of soil lie at the interface between the atmosphere and land; hydrological variations in the atmosphere communicate themselves to the land largely through this layer, and vice-versa. The estimates of near-surface soil moisture provided by the SMAP mission are thus central to studies of hydrological variability. In fact, recent analyses show that the hydrological variability captured in the SMAP soil moisture retrievals can be parlayed into useful hydrological predictions at various leads (weekly out to seasonal). Specifically, at a given location, using the antecedent time series of SMAP Level 2 soil moisture retrievals up to the start of a forecast, skillful predictions can be made of surface soil moisture anomalies at a 1-week lead, of evapotranspiration stress anomalies at a ~1 month lead, and of streamflow anomalies at a multi-month lead. The skill is derived in part from soil moisture memory (along with the interpretation of deeper soil moisture from the surface measurements) and from joint analyses, outside the forecast period, of the SMAP retrievals with existing observational hydrological datasets.

soil moisture retrievals↗

An Efficient Three-Dimensional CFD-Based Numerical Wave Tank for a Wave Energy Converter in Extreme Irregular Waves: Preprint

A numerical wave tank approach for computational fluid dynamics (CFD) modelling of an extreme irregular seastate is presented. The technique couples a potential flow solution with a CFD solver for more efficient numerical predictions. This method has recently become attractive both for the research community and the industry working with offshore structures. The model is used to determine the response of a submerged pressure differential wave energy converter (WEC) in a fully nonlinear irregular wave condition using the high fidelity CFD code, STAR-CCM+. Potential flow based numerical models are commonly used to predict motions and performance of wave energy converters. Wave kinematics can deviate from potential flow predictions for extreme wave conditions; the excitation loads on an absorber can also be increasingly influenced by viscous effects, not captured in engineering level models. In these extreme conditions, a Reynolds-averaged Navier-Stokes CFD model can better predict motions and loads for a WEC. Long time series with varying random seed numbers can be used to identify singular extreme wave events from a stochastic irregular sea state. This approach simulates a more realistic wave series for a given sea state than a regular wave or a focused wave. However, it is computationally infeasible to run these long time series for three-dimensional (3D) CFD simulations. In this work, two-dimensional (2D) CFD simulations with a long domain allow the full development of an extreme nonlinear wave condition. The results are used to identify extreme events from a 50-year storm condition for the PacWave site off the coast of Oregon. A relatively short time window including this extreme event is then mapped to a 3D simulation using a user defined wave methodology. Convergence studies for domain length, wave forcing lengths, and time before the extreme event were conducted.

cfd↗

Prediction of the SYM-H Index Using a Bayesian Deep Learning Method With Uncertainty Quantification

We propose a novel deep learning framework, named SYMHnet, which employs a graph neural network and a bidirectional long short-term memory network to cooperatively learn patterns from solar wind and interplanetary magnetic field parameters for short-term forecasts of the SYM-H index based on 1- and 5-min resolution data. SYMHnet takes, as input, the time series of the parameters' values provided by NASA's Space Science Data Coordinated Archive and predicts, as output, the SYM-H index value at time point t + w hours for a given time point t where w is 1 or 2. By incorporating Bayesian inference into the learning framework, SYMHnet can quantify both aleatoric (data) uncertainty and epistemic (model) uncertainty when predicting future SYM-H indices. Experimental results show that SYMHnet works well at quiet time and storm time, for both 1- and 5-min resolution data. The results also show that SYMHnet generally performs better than related machine learning methods. For example, SYMHnet achieves a forecast skill score (FSS) of 0.343 compared to the FSS of 0.074 of a recent gradient boosting machine (GBM) method when predicting SYM-H indices (1 hr in advance) in a large storm (SYM-H = -393 nT) using 5-min resolution data. When predicting the SYM-H indices (2 hr in advance) in the large storm, SYMHnet achieves an FSS of 0.553 compared to the FSS of 0.087 of the GBM method. In addition, SYMHnet can provide results for both data and model uncertainty quantification, whereas the related methods cannot.

79 ASTRONOMY AND ASTROPHYSICS↗

Remaining Flying Time Prediction Implementing Battery Prognostics Framework for Electric UAV's

In this paper the problem of building trust in the online safety prediction of an fixed wing small electric unmanned aerial vehicles (e-UAV) for remaining flying time is addressed. A series of flight tests are described to verify the performance of the remaining flying time prediction algorithm. The estimate of remaining flying time is used to activate an alarm when the predicted remaining time falls below a threshold of two minutes. This updates the pilot to transition to the landing sequence of the flight profile. A second alarm is activated when the battery state of charge (SOC) falls below a specified safety limit threshold. This SOC threshold is the point at which the battery energy reserve would no longer safely support enough aborted landing attempts. During the test flights, the motor system is operated with the same predefined timed airspeed profile for each test. To test the robustness of the developed prediction algorithm, partial tests were performed with and remaining were performed without a simulated power train fault. To simulate a partial power train fault in the e-UAV the pilot engages a resistor bank at a specified time during the test flight. The flying time prediction system is agnostic of the pilot's activation of the fault and must adapt to the vehicle's state. The time at which the limit threshold on battery SOC is reached, it is then used to measure the accuracy of the remaining flying time predictions. This is demonstrated through comparing results from two battery models being developed. Accuracy requirements for the alarms are considered and the results discussed.

Kulkarni, Chetan↗

A species’ response to spatial climatic variation does not predict its response to climate change

The dominant paradigm for assessing ecological responses to climate change assumes that future states of individuals and populations can be predicted by current, species-wide performance variation across spatial climatic gradients. However, if the fates of ecological systems are better predicted by past responses to in situ climatic variation through time, this current analytical paradigm may be severely misleading. Empirically testing whether spatial or temporal climate responses better predict how species respond to climate change has been elusive, largely due to restrictive data requirements. Here, we leverage a newly collected network of ponderosa pine tree-ring time series to test whether statistically inferred responses to spatial versus temporal climatic variation better predict how trees have responded to recent climate change. When compared to observed tree growth responses to climate change since 1980, predictions derived from spatial climatic variation were wrong in both magnitude and direction. This was not the case for predictions derived from climatic variation through time, which were able to replicate observed responses well. Future climate scenarios through the end of the 21st century exacerbated these disparities. These results suggest that the currently dominant paradigm of forecasting the ecological impacts of climate change based on spatial climatic variation may be severely misleading over decadal to centennial timescales.

54 ENVIRONMENTAL SCIENCES↗

BASIN-3D: A brokering framework to integrate diverse environmental data

Diverse observational and simulation datasets are needed to understand and predict complex ecosystem behavior over seasonal to decadal and century time-scales. Integration of these datasets poses a major barrier towards advancing environmental science, particularly due to differences in the structure and formats of data provided by various sources. Here, we describe BASIN-3D (Broker for Assimilation, Synthesis and Integration of eNvironmental Diverse, Distributed Datasets), a data integration framework designed to dynamically retrieve and transform heterogeneous data from different sources into a common format to provide an integrated view. BASIN-3D enables users to adopt a standardized approach for data retrieval and avoid customizations for the data type or source. We demonstrate the value of BASIN-3D with two use cases that require integration of data from regional to watershed spatial scales. The first application uses the BASIN-3D Python library to integrate time-series hydrological and meteorological data to provide standardized inputs to analytical and machine learning codes in order to predict the impacts of hydrological disturbances on large river corridors of the United States. The second application uses the BASIN-3D Django framework to integrate diverse time-series data in a mountainous watershed in East River, Colorado, United States to enable scientific researchers to explore and download data through an interactive web portal. Thus, BASIN-3D can be used to support data integration for both web-based tools, as well as data analytics using Python scripting and extensions like Jupyter notebooks. The framework is expected to be transferable to and useful for many other field and modeling studies.

Varadharajan, C↗

Detecting Inter-Annual Variations in the Phenology of Evergreen Conifers Using Long-Term MODIS Vegetation Index Time Series

Long-term observations of vegetation phenology can be used to monitor the response of terrestrial ecosystems to climate change. Satellite remote sensing provides the most efficient means to observe phenological events through time series analysis of vegetation indices such as the Normalized Difference Vegetation Index (NDVI). This study investigates the potential of a Photochemical Reflectance Index (PRI), which has been linked to vegetation light use efficiency, to improve the accuracy of MODIS-based estimates of phenology in an evergreen conifer forest. Timings of the start and end of the growing season (SGS and EGS) were derived from a 13-year-long time series of PRI and NDVI based on a MAIAC (multi-angle implementation of atmospheric correction) processed MODIS dataset and standard MODIS NDVI product data. The derived dates were validated with phenology estimates from ground-based flux tower measurements of ecosystem productivity. Significant correlations were found between the MAIAC time series and ground-estimated SGS (R (sup 2) equals 0.36-0.8), which is remarkable since previous studies have found it difficult to observe inter-annual phenological variations in evergreen vegetation from satellite data. The considerably noisier NDVI product could not accurately predict SGS, and EGS could not be derived successfully from any of the time series. While the strongest relationship overall was found between SGS derived from the ground data and PRI, MAIAC NDVI exhibited high correlations with SGS more consistently (R (sup 2) is greater than 0.6 in all cases). The results suggest that PRI can serve as an effective indicator of spring seasonal transitions, however, additional work is necessary to confirm the relationships observed and to further explore the usefulness of MODIS PRI for detecting phenology.

Ulsig, Laura↗

Predicting Air Traffic Management Initiatives Using Supervised Learning

Terminal Traffic Management Initiatives (TMIs) such as Ground Stops (GS) and Ground Delay Programs (GDP) are implemented to manage excess demand or lowered capacity at an airport. Air Traffic Flow Management (TFM) specialists identify situations such as aviation constraints, current and forecasted weather conditions, airport demand and capacity, and initiate TMIs for safe and orderly movement of air traffic. In this paper, we outline supervised learning techniques that can be used to predict and recommend TMIs at an airport based on current weather and airport conditions. Our research involves building classic Machine Learning (ML) models such as Logistic Regression, K-Nearest Neighbor, Random Forest and XGBoost, as well as Long short-term memory (LSTM) networks. We trained the models on 3-year historical data (weather, airport demand, capacity and TMIs) from Newark (EWR) airport which was selected based on its higher TMI implementation rates and varied weather conditions. Although Random Forest and XGBoost algorithms are able to predict if a TMI is needed or not, they have difficulty in predicting specific program type. For this purpose, we found that LSTM time-series forecasting models performed better as they also learn from past TMI program type sequences. This study also lays down the foundation for advanced modeling techniques and architectures to predict TMIs in advance for future periods. The ability to predict TMIs in advance will be highly beneficial to the traffic controllers and managers as this will help them to prepare for and manage TMIs more efficiently.

Manoj Agrawal↗

Challenging problems of quality assurance and quality control (QA/QC) of meteorological time series data

Abstract Representativeness and quality of collected meteorological data impact accuracy and precision of climate, hydrological, and biogeochemical analyses and predictions. We developed a comprehensive Quality Assurance (QA) and Quality Control (QC) statistical framework, consisting of three major phases: Phase I—Preliminary data exploration, i.e., processing of raw datasets, with the challenging problems of time formatting and combining datasets of different lengths and different time intervals; Phase II—QA of the datasets, including detecting and flagging of duplicates, outliers, and extreme data; and Phase III—the development of time series of a desired frequency, imputation of missing values, visualization and a final statistical summary. The paper includes two use cases based on the time series data collected at the Billy Barr meteorological station (East River Watershed, Colorado), and the Barro Colorado Island (BCI, Panama) meteorological station. The developed statistical framework is suitable for both real-time and post-data-collection QA/QC analysis of meteorological datasets.

54 ENVIRONMENTAL SCIENCES↗

Development of the GeoNEX Level 2G Products: Exploiting the Diurnal Variability of TOA Reflectance in Atmospheric Correction

This study develops a new atmospheric correction algorithm to generate the Level 2G products, in particular the gap-filled Surface Reflectance at 10-minute time steps, for the Geostationary-NASA Earth Exchange (GeoNEX) project. The algorithm is based on the MODIS MAIAC (Multi-Angle Implementation of Atmospheric Correction) framework but with significant modifications to exploit angular/temporal information from the diurnal variability of the GeoNEX L1G TOA (Top-of-Atmosphere) reflectance. The algorithm starts by evaluating the roughness/smoothness of the diurnal time series of the TOA reflectance. Because rapid changes in TOA reflectance are generally caused by passing clouds or shadows, rough segments of the time series are automatically filtered out while the smooth segments are further tested for brightness and temperature to identify clear-sky and snow-free observations. Next the algorithm runs the MAIAC RTM (Radiative Transfer Model) to retrieve the Ross-Thick-Li-Sparse (RTLS) BRDF model parameters and the daily-mean atmospheric optical depth (AOD) that allow the RTM to optimally simulate the observed diurnal variability of clear-sky TOA reflectance. Once the initial RTLS parameters are retrieved after the algorithm’s burn-in period, they are used as the prior information to predict the AOD level for the next days, while the subsequent clear-sky observations are used to make necessary adjustments to the RTLS parameters in an continuous fashion. This “prediction-analysis” cycle is then iterated to process the full time series of the L1G data, skipping only total-cloudy days or when surface snow is detected. We tested the algorithm over a list of selected AERONET sites. The retrieved results (the daily mean AOD and the RTLS parameters) reasonably agree with the ground-based measurements. Importantly, the results indicate that the diurnal cycles of surface reflectance are continuous functions of the illumination-view geometry. Thus we can use the retrieved RTLS model to accurately fill in data gaps on partial cloudy days. Also, our algorithm is totally independent from the traditional approaches based on the use of spectral band ratios between the shortwave infrared (e.g., 2.2µm) and the visible (e.g., 0.47µm and 0.64µm) bands. Our results thus demonstrate that the high-frequent diurnal geostationary observations contain unique information that helps us improve atmospheric correction of remote sensing data.

GeoNEX↗

Machine learning surrogate of physics-based building-stock simulator for end-use load forecasting

Building energy models are used to simulate heat and mass transfer and estimate end-use load in buildings. With the proliferation of solar photovoltaics on residential and commercial buildings, increasingly, buildings are expected to provide grid services, for which accurate and computationally efficient building energy simulations and end-use load prediction are imperative. Existing building energy simulation tools, however, have significant computational overhead that make them less practical in real-time deployment for optimization, design, uncertainty quantification and control in building energy management systems. Here this article presents a data-driven machine learning model based on light gradient boosting method (LightGBM) as a surrogate for a physics-based simulator for residential buildings to predict end-use load. The machine learning based surrogate model accounts for time-series related variables, seasonality and trend component of end-use load, and history of end-use load. The accuracy of the surrogate model is assessed on the prediction of the load profiles of 100 different houses in Cook County, Illinois, USA. The LightGBM surrogate model is shown to reduce the root-mean-squared error by 53% relative to a reference decision tree (DT) based model reported previously in the literature. Moreover, the model predicts the load spikes and high-ramp rate events throughout the year which are often the Achilles heel of other models in the literature. The machine learning based surrogate model is demonstrated to be computationally efficient, with a ten-fold reduction in the computational time compared to a physics-based building energy simulation, and suitable for uncertainty analysis and real-time control of building characteristics in response to uncertainty.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Comparison of measured and predicted sea surface spectra of short waves

Reliable sea surface slope time series, using a laseroptical receiver system deployed on a wave follower, are analyzed to yield slope frequency spectra of the ocean surface up to 300 Hz. The results show significant differences when compared with the Pierson and Stacy (1973) model. An epirical model is proposed in this paper that is consistent with the observed slope spectra. The newly proposed model is compared with other more recently advanced shortwave spectral models.

Shemdin, O. H.↗

Generalized and Mechanistic PV Module Performance Prediction From Computer Vision and Machine Learning on Electroluminescence Images

Electroluminescence (EL) imaging of photovoltiac (PV) modules offers high-speed, high-resolution information about device performance, affording opportunities for greater insight and efficiency in module characterization across manufacturing, research and development, and power plant operations and management. Predicting module electrical properties from EL image features is a critical step toward these applications. In this article, we demonstrate quantification of both generalized and performance mechanism-specific EL image features, using pixel intensity-based and machine learning classification algorithms. From EL image features, we build predictive models for PV module power and series resistance, using time-series current-voltage (I-V) and EL data obtained stepwise on five brands of modules spanning three Si cell types through two accelerated exposures: damp heat (DH) (85°C/85% RH) and thermal cycling (TC) (IEC 61215). Overall, 195 pairs of EL images and I-V characteristics were analyzed, yielding 11700 individual PV cell images. A convolutional neural network was built to classify cells by the severity of busbar corrosion with high accuracy (95%). Generalized power predictive models estimated the maximum power of PV modules from EL images with high confidence and an adjusted-R 2 of 0.88, across all module brands and cell types in extended DH and TC exposures. Mechanistic degradation prediction was demonstrated by quantification of busbar corrosion in EL images of three module brands in DH, and subsequent modeling of series resistance using these mechanism-specific EL image features. For modules exhibiting busbar corrosion, we demonstrated series resistance predictive models with adjusted-R 2 of up to 0.73.

14 SOLAR ENERGY↗

Toward Malaria Risk Prediction in Afghanistan Using Remote Sensing

Malaria causes more than one million deaths every year worldwide, with most of the mortality in Sub-Saharan Africa. It is also a significant public health concern in Afghanistan, with approximately 60% of the population, or nearly 14 million people, living in a malaria-endemic area. Malaria transmission has been shown to be dependent on a number of environmental and meteorological variables. For countries in the tropics and the subtropics, rainfall is normally the most important variable, except for regions with high altitude where temperature may also be important. Afghanistan s diverse landscape contributes to the heterogeneous malaria distribution. Understanding the environmental effects on malaria transmission is essential to the effective control of malaria in Afghanistan. Provincial malaria data gathered by Health Posts in 23 provinces during 2004-2007 are used in this study. Remotely sensed geophysical parameters, including precipitation from TRMM, and surface temperature and vegetation index from MODIS are used to derive the empirical relationship between malaria cases and these geophysical parameters. Both neural network methods and regression analyses are used to examine the environmental dependency of malaria transmission. And the trained models are used for predicting future transmission. While neural network methods are intrinsically more adaptive for nonlinear relationship, the regression approach lends itself in providing statistical significance measures. Our results indicate that NDVI is the strongest predictor. This reflects the role of irrigation, instead of precipitation, in Afghanistan for agricultural production. The second strongest prediction is surface temperature. Precipitation is not shown as a significant predictor, contrary to other malarious countries in the tropics or subtropics. With the regression approach, the malaria time series are modelled well, with average R2 of 0.845. For cumulative 6-month prediction of malaria cases, the average provincial accuracy reaches 91%. The developed predictive and early warning capabilities support the Third Strategic Approach of the WHO EMRO Malaria Control and Elimination Plan.

Safi, N.↗