Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Time Series Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43

Time Series Evaluation of Portal Monitor Data

Radiation portal monitors screen cargo and personal vehicle traffic at international border crossings to detect and interdict illicit sources which may be present in the commerce stream. One difficulty faced by RPM systems is the prospect of false alarms, or undesired alarms due to background fluctuation, or Naturally-Occurring Radioactive Material (NORM) sources in the commerce stream. In general, NORM alarms represent a significant fraction of the nuisance alarms at international border crossings, particularly with Polyvinyl-Toluene (PVT) RPM detectors, which have only very weak spectral differentiation capability. With PVT detectors, the majority of detected photon events fall within the Compton continuum of the material, allowing for very little spectral information to be preserved [1]. Previous work has shown that these detectors can be used for limited spectroscopy, utilizing around 8 spectral bins to further differentiate some NORM and other nuisance sources [2]. NaI based systems achieve much more detailed spectral resolution from each measurement of a source, but still combine all measurements over a vehicle's occupancy in order to arrive at a spectrum to be analyzed.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

How the Open Data Policy of the Landsat Program Has Advanced Our Understanding of Environmental Change

A time series is a sequence of observations of a phenomenon taken sequentially in time. A crucial characteristic of a time series is the dependence among adjacent observations – techniques for analyzing this dependence are referred to as time series analysis. This analytical approach enables us to predict or forecast future values of a time series, study the impact of various inputs on the observed phenomenon, and examine interrelationships among related time series variables. Within the geographical sciences, time series analysis has historically been limited to coarse-resolution satellite data, as constructing time series of data suitable for studying land cover and land use dynamics, such as Landsat data, were prohibitively costly. A transformative shift occurred in 2008 when the U.S. Government decided to make free and open all past and future data collected by the Landsat satellite program. The decision brought about a paradigm shift away from analyzing individual images or observations to continuous monitoring in time. Of particular relevance to environmental remote sensing is the ability to forecast observations – if we can predict how future observations should behave, we can infer information about how the land surface is changing. In this presentation, we will examine literature examples that showcase scientific gains enabled by time series analysis of satellite data. We will delve into how the analysis of dense time series of satellite data revealed that overall rate of forest disturbance in the Amazon has increased despite a reduction in deforestation; how different types of forest degradation, previously unquantified, are now being accurately assessed in the Caucasus region; and how we now can study the highly dynamic and intricate patterns of shifting cultivation in Southeast Asia.

Pontus Olofsson↗

Modal Behavior of Hemispheric Sea Ice Covers

Recent papers have described 18-year trends and annual oscillations in the Arctic and Antarctic sea ice extents, areas, and enclosed open water areas based on a newly-formulated 18.2-year ice concentration time series. This time series includes data for the entire Arctic and Antarctic ice covers, as well as for previously defined subregions consisting of 5 sectors in the Antarctic and 9 regions in the Arctic. It was obtained by fine-tuning the sea ice algorithm tie points individually for each of the four sensors used to acquire the data. In this paper, we extend these analyses to an examination of the intrinsic modes of these time series, obtained by means of Empirical Mode Decomposition, with emphasis on periodicities greater than the annual cycle. Quasibiennial and quasiquadrennial oscillations observed with a different technique and reported earlier for the first 8.8 years of this time series were also observed in the present series. However, the intrinsic modes were not monochromatic; they feature frequency as well as amplitude modulation within their respective frequency bands. Modal periods of up to 18 years are observed, with important implications for the trend analyses published earlier. These results are compared with the oscillations in the Length-of-Day and North Atlantic Oscillation parameters similarly determined for the same 18.2-year period.

Gloersen, Per↗

Optimizing observations of drizzle onset with millimeter-wavelength radars

Cloud Doppler radars are increasingly used to study cloud and precipitation microphysical processes. Typical bulk cloud properties such as liquid or ice content are usually derived using the first three standard moments of the radar Doppler spectrum. Recent studies demonstrated the value of higher moments for the reduction of retrieval uncertainties and for providing additional insights into microphysical processes. Large effort has been undertaken, e.g., within the Atmospheric Radiation Measurement (ARM) program to ensure high quality of radar Doppler spectra. However, a systematic approach concerning the accuracy of higher moment estimates and sensitivity to basic radar system settings, such as spectral resolution, integration time and beam width, are still missing. Here In this study, we present an approach on how to optimize radar settings for radar Doppler spectra moments in the specific context of drizzle detection. The process of drizzle development has shown to be particularly sensitive to higher radar moments such as skewness. We collected radar raw data (I/Q time series) from consecutive zenith-pointing observations for two liquid cloud cases observed at the cloud observatory JOYCE in Germany. The I/Q data allowed us to process Doppler spectra and derive their moments using different spectral resolutions and integration times during identical time intervals. This enabled us to study the sensitivity of the spatiotemporal structure of the derived moments to the different radar settings. The observed signatures were further investigated using a radar Doppler forward model which allowed us to compare observed and simulated sensitivities and also to study the impact of additional hardware-dependent parameters such as antenna beam width. For the observed cloud with drizzle onset we found that longer integration times mainly modify spectral width (S w ) and skewness (S k ), leaving other moments mostly unaffected. An integration time of 2 s seems to be an optimal compromise: both observations and simulations revealed that a 10 s integration time – as it is widely used for European cloud radars – leads to a significant turbulence-induced increase of S w and reduction of S k compared to 2 s integration time. This can lead to significantly different microphysical interpretations with respect to drizzle water content and effective radius. A change from 2 s to even shorter integration times (0. 4 s) has much smaller effects on S w and S k . We also find that spectral resolution has a small impact on the moment estimations, and thus on the microphysical interpretation of the drizzle signal. Even the coarsest spectral resolution studied, 0. 08 ms -1 , seems to be appropriate for calculation moments of drizzling clouds. Moreover, simulations provided additional insight into the microphysical interpretation of the skewness signatures observed: in low (high)-turbulence conditions, only drizzle larger than 20 µm (40 µm) can generate S k values above the S k noise level (in our case 0.4). Higher S k values are also obtained in simulations when smaller beam widths are adopted.

54 ENVIRONMENTAL SCIENCES↗

Differential Coexpression Analysis Reveals Extensive Rewiring of Arabidopsis Gene Coexpression in Response to Pseudomonas syringae Infection

Plant defense responses to pathogens involve massive transcriptional reprogramming. Recently, differential coexpression analysis has been developed to study the rewiring of gene networks through microarray data, which is becoming an important complement to traditional differential expression analysis. Using time-series microarray data of Arabidopsis thaliana infected with Pseudomonas syringae, we analyzed Arabidopsis defense responses to P. syringae through differential coexpression analysis. Overall, we found that differential coexpression was a common phenomenon of plant immunity. Genes that were frequently involved in differential coexpression tend to be related to plant immune responses. Importantly, many of those genes have similar average expression levels between normal plant growth and pathogen infection but have different coexpression partners. By integrating the Arabidopsis regulatory network into our analysis, we identified several transcription factors that may be regulators of differential coexpression during plant immune responses. We also observed extensive differential coexpression between genes within the same metabolic pathways. Several metabolic pathways, such as photosynthesis light reactions, exhibited significant changes in expression correlation between normal growth and pathogen infection. Taken together, differential coexpression analysis provides a new strategy for analyzing transcriptional data related to plant defense responses and new insights into the understanding of plant-pathogen interactions.

59 BASIC BIOLOGICAL SCIENCES↗

Data-driven Identification and Prediction of Power System Dynamics Using Linear Operators

In this paper, we propose linear operator theoretic framework involving Koopman operator for the data-driven identification of power system dynamics. We explicitly account for noise in the time series measurement data and propose robust approach for data-driven approximation of Koopman operator for the identification of nonlinear power system dynamics. The identified model is used for the prediction of state trajectories in the power system. The application of the framework is illustrated using an IEEE nine bus test system.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Load Profile Inpainting for Missing Load Data Restoration and Baseline Estimation

This paper introduces a Generative Adversarial Nets (GAN) based, Load Profile Inpainting Network (Load-PIN) for restoring missing load data segments and estimating the baseline for a demand response event. The inputs are time series load data before and after the inpainting period together with explanatory variables (e.g., weather data). Here, we propose a Generator structure consisting of a coarse network and a fine-tuning network. The coarse network provides an initial estimation of the data segment in the inpainting period. The fine-tuning network consists of self-attention blocks and gated convolution layers for adjusting the initial estimations. Loss functions are specially designed for the fine-tuning and the discriminator networks to enhance both the point-to-point accuracy and realisticness of the results. We test the Load-PIN on three real-world data sets for two applications: patching missing data and deriving baselines of conservation voltage reduction (CVR) events. We benchmark the performance of Load-PIN with five existing deep-learning methods. Our simulation results show that, compared with the state-of-the-art methods, Load-PIN can handle varying-length missing data events and achieve 15-30% accuracy improvement.

14 SOLAR ENERGY↗

Location Generalizer

This software produces general location descriptions from time-series location data collected from mobile devices that record global positioning system (GPS) coordinates over time. The purpose of this software is to convert detailed location history data, which is considered personally identifiable information (PII), into non-traceable, anonymized, generic information that is useful to researchers but does not contain PII. The software is specifically designed for use with trigger-based data that describe the parked locations and dwell times of automobiles.

Smart, John↗

Efficient hemodynamic event detection utilizing relational databases and wavelet analysis

Development of a temporal query framework for time-oriented medical databases has hitherto been a challenging problem. We describe a novel method for the detection of hemodynamic events in multiparameter trends utilizing wavelet coefficients in a MySQL relational database. Storage of the wavelet coefficients allowed for a compact representation of the trends, and provided robust descriptors for the dynamics of the parameter time series. A data model was developed to allow for simplified queries along several dimensions and time scales. Of particular importance, the data model and wavelet framework allowed for queries to be processed with minimal table-join operations. A web-based search engine was developed to allow for user-defined queries. Typical queries required between 0.01 and 0.02 seconds, with at least two orders of magnitude improvement in speed over conventional queries. This powerful and innovative structure will facilitate research on large-scale time-oriented medical databases.

NASA Discipline Cardiopulmonary↗

A fast two-stage algorithm for non-negative matrix factorization in smoothly varying data

This article reports the study of algorithms for non-negative matrix factorization (NMF) in various applications involving smoothly varying data such as time or temperature series diffraction data on a dense grid of points. Utilizing the continual nature of the data, a fast two-stage algorithm is developed for highly efficient and accurate NMF. In the first stage, an alternating non-negative least-squares framework is used in combination with the active set method with a warm-start strategy for the solution of subproblems. In the second stage, an interior point method is adopted to accelerate the local convergence. The convergence of the proposed algorithm is proved. The new algorithm is compared with some existing algorithms in benchmark tests using both real-world data and synthetic data. Furthermore, the results demonstrate the advantage of the algorithm in finding high-precision solutions.

interior point method↗

STUDIES IN ASTRONOMICAL TIME SERIES ANALYSIS. VI. BAYESIAN BLOCK REPRESENTATIONS

This paper addresses the problem of detecting and characterizing local variability in time series and other forms of sequential data. The goal is to identify and characterize statistically significant variations, at the same time suppressing the inevitable corrupting observational errors. We present a simple nonparametric modeling technique and an algorithm implementing it-an improved and generalized version of Bayesian Blocks-that finds the optimal segmentation of the data in the observation interval. The structure of the algorithm allows it to be used in either a real-time trigger mode, or a retrospective mode. Maximum likelihood or marginal posterior functions to measure model fitness are presented for events, binned counts, and measurements at arbitrary times with known error distributions. Problems addressed include those connected with data gaps, variable exposure, extension to piecewise linear and piecewise exponential representations, multivariate time series data, analysis of variance, data on the circle, other data modes, and dispersed data. Simulations provide evidence that the detection efficiency for weak signals is close to a theoretical asymptotic limit derived by Arias-Castro et al. In the spirit of Reproducible Research all of the code and data necessary to reproduce all of the figures in this paper are included as supplementary material.

79 ASTRONOMY AND ASTROPHYSICS↗

Data-Driven Distribution System Load Modeling for Quasi-Static Time-Series Simulation

This paper presents a data-driven distribution system load modeling methodology targeting quasi-static time-series (QSTS) simulation. The proposed methodology is appropriate for modeling down to the level of the customer transformer, and it has three main features: 1) both load pattern diversity and intra-second load variability are considered, 2) the load profiles can be populated for multiple nodes on a circuit in such a way that the diversity factor of the feeder can be defined and tuned, and 3) the load aggregation method can be used to populate the profiles for different nodes at various load aggregation levels. Furthermore, as the foundation of the modeling methodology, variability and diversity libraries have been established based on high-resolution load data collected on customer transformers from real utility feeders. The proposed modeling methodology has been used to build load data sets for both the IEEE 123-bus feeder model and a realistic utility feeder model. The QSTS simulation results on the two evaluation feeders have demonstrated that the load data sets established from the proposed modeling methodology can effectively capture the load impact on feeder operations. For the realistic utility feeder, the effectiveness of the proposed methodology has also been validated by comparing the voltage characteristics of the feeder with modeled loads and the voltage characteristics of realistic voltage data from the same feeder.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Synthetic method of analogues for emerging infectious disease forecasting

The Method of Analogues (MOA) has gained popularity in the past decade for infectious disease forecasting due to its non-parametric nature. In MOA, the local behavior observed in a time series is matched to the local behaviors of several historical time series. The known values that directly follow the historical time series that best match the observed time series are used to calculate a forecast. This non-parametric approach leverages historical trends to produce forecasts without extensive parameterization, making it highly adaptable. However, MOA is limited in scenarios where historical data is sparse. This limitation was particularly evident during the early stages of the COVID-19 pandemic, where the emerging global epidemic had little-to-no historical data. In this work, we propose a new method inspired by MOA, called the Synthetic Method of Analogues (sMOA). sMOA replaces historical disease data with a library of synthetic data that describe a broad range of possible disease trends. This model circumvents the need to estimate explicit parameter values by instead matching segments of ongoing time series data to a comprehensive library of synthetically generated segments of time series data. We demonstrate that sMOA has competitive performance with state-of-the-art infectious disease forecasting models, out-performing 78% of models from the COVID-19 Forecasting Hub in terms of averaged Mean Absolute Error and 76% of models from the COVID-19 Forecasting Hub in terms of averaged Weighted Interval Score. Additionally, we introduce a novel uncertainty quantification methodology designed for the onset of emerging epidemics. Developing versatile approaches that do not rely on historical data and can maintain high accuracy in the face of novel pandemics is critical for enhancing public health decision-making and strengthening preparedness for future outbreaks.

97 MATHEMATICS AND COMPUTING↗

Anomalous fluctuations of vertical velocity of Earth and their possible implications for earthquakes

High-quality measurements of seismic activities around the world provide a wealth of data and information that are relevant to understanding of when earthquakes may occur. If viewed as complex stochastic time series, such data may be analyzed by methods that provide deeper insights into their nature, hence leading to better understanding of the data and their possible implications for earthquakes. In this paper, we provide further evidence for our recent proposal [P. Mansour et al., Phys. Rev. Lett. 102, 014101 (2009)] for the existence of a transition in the shape of the probability density function (PDF) of the successive detrended increments of the stochastic fluctuations of Earth's vertical velocity V{sub z}, collected by broadband stations before moderate and large earthquakes. To demonstrate the transition, we carried out extensive analysis of the data for V{sub z} for 12 earthquakes in several regions around the world, including the recent catasrophic one in Haiti. The analysis supports the hypothesis that before and near the time of an earthquake, the shape of the PDF undergoes significant and discernable changes, which can be characterized quantitatively. The typical time over which the PDF undergoes the transition is about 5-10 h prior to a moderate or large earthquake.

58 GEOSCIENCES↗

Novel Data Reduction Based on Statistical Similarity

Applications such as scientific simulations and power grid monitoring are generating so much data quickly that compression is essential to reduce storage requirement or transmission capacity. To achieve better compression, one is often willing to discard some repeated information. These lossy compression methods are primarily designed to minimize the Euclidean distance between the original data and the compressed data. But this measure of distance severely limits either reconstruction quality or compression performance. In this paper, we propose a new class of compression method by redefining the distance measure with a statistical concept known as exchangeability. This approach reduces the storage requirement and captures essential features, while reducing the storage requirement. In this paper, we report our design and implementation of such a compression method named IDEALEM. To demonstrate its effectiveness, we apply it on a set of power grid monitoring data, and show that it can reduce the volume of data much more than the best known compression method while maintaining the quality of the compressed data. Finally, in these tests, IDEALEM captures extraordinary events in the data, while its compression ratios can far exceed 100.

97 MATHEMATICS AND COMPUTING↗

Adaptive Sensing of Time Series with Application to Remote Exploration

We address the problem of adaptive informationoptimal data collection in time series. Here a remote sensor or explorer agent throttles its sampling rate in order to track anomalous events while obeying constraints on time and power. This problem is challenging because the agent has limited visibility -- all collected datapoints lie in the past, but its resource allocation decisions require predicting far into the future. Our solution is to continually fit a Gaussian process model to the latest data and optimize the sampling plan on line to maximize information gain. We compare the performance characteristics of stationary and nonstationary Gaussian process models. We also describe an application based on geologic analysis during planetary rover exploration. Here adaptive sampling can improve coverage of localized anomalies and potentially benefit mission science yield of long autonomous traverses.

artificial intelligence↗

Studies in Astronomical Time Series Analysis. VI. Bayesian Block Representations

This paper addresses the problem of detecting and characterizing local variability in time series and other forms of sequential data. The goal is to identify and characterize statistically significant variations, at the same time suppressing the inevitable corrupting observational errors. We present a simple nonparametric modeling technique and an algorithm implementing it-an improved and generalized version of Bayesian Blocks [Scargle 1998]-that finds the optimal segmentation of the data in the observation interval. The structure of the algorithm allows it to be used in either a real-time trigger mode, or a retrospective mode. Maximum likelihood or marginal posterior functions to measure model fitness are presented for events, binned counts, and measurements at arbitrary times with known error distributions. Problems addressed include those connected with data gaps, variable exposure, extension to piece- wise linear and piecewise exponential representations, multivariate time series data, analysis of variance, data on the circle, other data modes, and dispersed data. Simulations provide evidence that the detection efficiency for weak signals is close to a theoretical asymptotic limit derived by [Arias-Castro, Donoho and Huo 2003]. In the spirit of Reproducible Research [Donoho et al. (2008)] all of the code and data necessary to reproduce all of the figures in this paper are included as auxiliary material.

signal detection↗

Scalable Prediction of Energy Consumption using Incremental Time Series Clustering

Time series datasets are a canonical form of high velocity Big Data, and often generated by pervasive sensors, such as found in smart infrastructure. Performing predictive analytics on time series data can be computationally complex, and requires approximation techniques. In this paper, we motivate this problem using a real application from the smart grid domain. We propose an incremental clustering technique, along with a novel affinity score for determining cluster similarity, which help reduce the prediction error for cumulative time series within a cluster. We evaluate this technique, along with optimizations, using real datasets from smart meters, totaling ~700,000 data points, and show the efficacy of our techniques in improving the prediction error of time series data within polynomial time.

Simmhan, Yogesh↗