Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Time Series Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50

Coherent structure in solar wind C{sup 6+}/C{sup 4+} ionic composition data during the quiet-sun conditions of 2008

This analysis offers evidence of characteristic scale sizes in solar wind charge state data measured in situ for 13 quiet-Sun Carrington rotations in 2008. Using a previously established novel methodology, we analyze the wavelet power spectrum of the charge state ratio C{sup 6+}/C{sup 4+} measured in situ by ACE/SWICS for 2 hr and 12 minute cadence. We construct a statistical significance level in the wavelet power spectrum to quantify the interference effects arising from filling missing data in the time series, allowing extraction of significant power from the measured data to a resolution of 24 minutes. We analyze each wavelet power spectrum for transient coherency and global periodicities resulting from the superposition of repeating coherent structures. From the significant wavelet power spectra, we find evidence for a general upper limit on individual transient coherency of ∼10 days. We find evidence for a set of global periodicities between 4-5 hr and 35-45 days. We find evidence for the distribution of individual transient coherency scales consisting of two distinct populations. Below the ∼2 day timescale, the distribution is reasonably approximated by an inverse power law, whereas for scales ≳2 days, the distribution levels off, showing discrete peaks at common coherency scales. In addition, by organizing the transient coherency scale distributions by wind type, we find that these larger, common coherency scales are more prevalent and well defined in coronal hole wind. Finally, we discuss the implications of our results for current theories of solar wind generation and describe future work for determining the relationship between the coherent structures in our ionic composition data and the structure of the coronal magnetic field.

79 ASTRONOMY AND ASTROPHYSICS↗

Studies of extended planetary atmospheres

There was a theoretical study of physical and chemical processes in the stratosphere, later broadened to include the mesosphere. Particular emphasis was laid on testing of proposed height profiles of the eddy diffusion coefficient against observed tracer data. Eventually the effort shifted to study of ozone time series in satellite data, and interpretation in terms of aeronomical processes. Since all this work is computer-intensive, the first year of funding also contributed to the acquisition of a powerful minicomputer system, in collaboration with several other faculty members. This proved to be highly successful and cost effective.

Hunten, D. M.↗

Adaptive median filtering for preprocessing of time series measurements

A median (L1-norm) filtering program using polynomials was developed. This program was used in automatic recycling data screening. Additionally, a special adaptive program to work with asymmetric distributions was developed. Examples of adaptive median filtering of satellite laser range observations and TV satellite time measurements are given. The program proved to be versatile and time saving in data screening of time series measurements.

Paunonen, Matti↗

Role of MODIS Vegetation Phenology Products in the ForWarn System for Monitoring of Forest Disturbances in the Conterminous United States

This presentation discusses MODIS vegetation phenology products used in the ForWarn Early Warning System (EWS) tool for near real time regional forest disturbance detection and surveillance at regional to national scales. The ForWarn EWS is being developed by the USDA Forest Service NASA, ORNL, and USGS to aid federal and state forest health management activities. ForWarn employs multiple historical land surface phenology products that are derived from MODIS MOD13 Normalized Difference Vegetation Index (NDVI) data. The latter is temporally processed into phenology products with the Time Series Product Tool (TSPT) and the Phenological Parameter Estimation Tool (PPET) software produced at NASA Stennis Space Center. TSPT is used to effectively noise reduce, fuse, and void interpolate MODIS NDVI data. PPET employs TSPT-processed NDVI time series data as an input, outputting multiple vegetation phenology products at a 232 meter resolution for 2000 to 2011, including NDVI magnitude and day of year products for seven key points along the growing season (peak of growing season and the minima, 20%, and 80% of the peak NDVI for both the left and right side of growing season), cumulative NDVI integral products for the most active part of the growing season and sequentially across the growing season at 8 day intervals, and maximum value NDVI products composited at 24 day intervals in which each product date has 8 days of overlap between the previous and following product dates. MODIS NDVI phenology products are also used to compute nationwide NRT forest change products refreshed every 8 days. These include percent change in forest NDVI products that compare the current NDVI from USGS eMODIS products to historical MODIS MOD13 NDVI. For each date, three forest change products are produced using three different maximum value NDVI baselines (from the previous year, three previous years, and all previous years). All change products are output with a rainbow color table in which forests with the most severe NDVI decreases are assigned hot colors (yellow to red) and forests with prominent NDVI increases are assigned cold colors (blue tones). All mentioned products have been integrated as data layers into ForWarn s geospatial data viewer known as the U.S. Forest Change Assessment Viewer (FCAV). The latter is used to view and assess the context of the mentioned forest change products with respect to ancillary data layers, such as land cover, elevation, hydrologic features, climatic data, storm data, aerial disturbance surveys, fire data, and land ownership. The FCAV also includes a temporal NDVI profiler for viewing phenological change in multi-year NDVI associated with known or suspected regionally apparent forest disturbances (e.g., from fire and insects). ForWarn forest change products have been used to detect, track, and assess several biotic and abiotic regional forest disturbance events across the country, including ephemeral and longer lasting damage from storms, drought, and insects. Such change products are most effective for viewing severe disturbances affecting multiple MODIS pixels. MODIS vegetation phenology products contribute vital current information on forest conditions to the ForWarn system and this role is expected to grow as these products are refined and derivative products are added.

Spruce, Joseph P.↗

Estimation of stochastic volatility with long memory for index prices of FTSE Bursa Malaysia KLCI

In recent years, modeling in long memory properties or fractionally integrated processes in stochastic volatility has been applied in the financial time series. A time series with structural breaks can generate a strong persistence in the autocorrelation function, which is an observed behaviour of a long memory process. This paper considers the structural break of data in order to determine true long memory time series data. Unlike usual short memory models for log volatility, the fractional Ornstein-Uhlenbeck process is neither a Markovian process nor can it be easily transformed into a Markovian process. This makes the likelihood evaluation and parameter estimation for the long memory stochastic volatility (LMSV) model challenging tasks. The drift and volatility parameters of the fractional Ornstein-Unlenbeck model are estimated separately using the least square estimator (lse) and quadratic generalized variations (qgv) method respectively. Finally, the empirical distribution of unobserved volatility is estimated using the particle filtering with sequential important sampling-resampling (SIR) method. The mean square error (MSE) between the estimated and empirical volatility indicates that the performance of the model towards the index prices of FTSE Bursa Malaysia KLCI is fairly well.

97 MATHEMATICS AND COMPUTING↗

Biogeochemical Response to Mesoscale Physical Forcing in the California Current System

In the first part of the project, we investigated the local response of the coastal ocean ecosystems (changes in chlorophyll, concentration and chlorophyll, fluorescence quantum yield) to physical forcing by developing and deploying Autonomous Drifting Ocean Stations (ADOS) within several mesoscale features along the U.S. west coast. Also, we compared the temporal and spatial variability registered by sensors mounted in the drifters to that registered by the sensors mounted in the satellites in order to assess the scales of variability that are not resolved by the ocean color satellite. The second part of the project used the existing WOCE SVP Surface Lagrangian drifters to track individual water parcels through time. The individual drifter tracks were used to generate multivariate time series by interpolating/extracting the biological and physical data fields retrieved by remote sensors (ocean color, SST, wind speed and direction, wind stress curl, and sea level topography). The individual time series of the physical data (AVHRR, TOPEX, NCEP) were analyzed against the ocean color (SeaWiFS) time-series to determine the time scale of biological response to the physical forcing. The results from this part of the research is being used to compare the decorrelation scales of chlorophyll from a Lagrangian and Eulerian framework. The results from both parts of this research augmented the necessary time series data needed to investigate the interactions between the ocean mesoscale features, wind, and the biogeochemical processes. Using the historical Lagrangian data sets, we have completed a comparison of the decorrelation scales in both the Eulerian and Lagrangian reference frame for the SeaWiFS data set. We are continuing to investigate how these results might be used in objective mapping efforts.

Niiler, Pearn P.↗

InSAR Time Series Analysis of L-Band Wide-Swath SAR Data Acquired by ALOS-2

We present that operating at L-band (24 cm wavelength) in wide-swath modes is one of the characteristics of the new and next generation satellite synthetic aperture radar (SAR) missions. After 3 years of operation, the Japan Aerospace Exploration Agency Advanced Land Observing Satellite-2 (ALOS-2) satellite has acquired a wealth of L-band wide-swath SAR data over many areas using its ScanSAR mode. We present interferometry SAR (InSAR) time series analysis results from ALOS-2 ScanSAR data. We analyze the possible error sources in the InSAR and correct them if possible. We present different time series analysis results including azimuth frequency modulation rate error, line of sight (LOS) ionospheric phase, azimuth shift caused by the ionosphere, and LOS displacement processed using both full-aperture and burst-by -burst workflows. The final InSAR LOS displacement time series result reveals both large-scale tectonic and small-scale anthropogenic deformation components. In conclusion, the results demonstrate the potential for measuring continental or even global-scale tectonic deformation and illustrate the promise of upcoming L-band wide-swath SAR missions, such as the NASA-ISRO SAR mission.

47 OTHER INSTRUMENTATION↗

Spatial and Temporal Patterns of Global Onshore Wind Speed Distribution

Wind power, a renewable energy source, can play an important role in electrical energy generation. Information regarding wind energy potential is important both for energy related modeling and for decision-making in the policy community. While wind speed datasets with high spatial and temporal resolution are often ultimately used for detailed planning, simpler assumptions are often used in analysis work. An accurate representation of the wind speed frequency distribution is needed in order to properly characterize wind energy potential. Using a power density method, this study estimated global variation in wind parameters as fitted to a Weibull density function using NCEP/CFSR reanalysis data. The estimated Weibull distribution performs well in fitting the time series wind speed data at the global level according to R2, root mean square error, and power density error. The spatial, decadal, and seasonal patterns of wind speed distribution were then evaluated. We also analyzed the potential error in wind power estimation when a commonly assumed Rayleigh distribution (Weibull k = 2) is used. We find that the assumption of the same Weibull parameter across large regions can result in substantial errors. While large-scale wind speed data is often presented in the form of average wind speeds, these results highlight the need to also provide information on the wind speed distribution.

Zhou, Yuyu↗

The Relationship Between El Nino/La Nina Oscillations and Recent Anomaly Time Series of OLR Determined by CERES and AIRS

This paper compares recent spatial anomaly time series of OLR (Outgoing Longwave Radiation) and OLRCLR (Clear Sky OLR) as determined using CERES and AIRS observations over the time period September 2002 through June 2010. We find excellent agreement in OLR anomaly time series of both data sets in almost every detail, down to the 1 x 1 spatial grid point level. This extremely close agreement of OLR anomaly time series derived from observations by two different instruments implies that both sets of results must be highly stable. This agreement also validates to some extent the anomaly time series of the AIRS derived products used in the computation of the AIRS OLR product. The paper then examines anomaly time series of AIRS derived products over the extended time period September 2002 through April 2011. We show that OLR anomalies during this period are closely in phase with those of an El Nino index, and that the recent global and tropical mean decreases in OLR and OLRCLR are a result of a transition from an El Nino condition at the beginning of the data record to La Nina conditions toward the end of the data period. We show that the relationship between global mean, and especially tropical mean, OLR anomalies to the El Nino index can be explained by temporal changes of the distribution of mid-tropospheric water vapor and cloud cover in two spatial regions that are in direct response to El Nino/La Nina activity which occurs outside these spatial regions.

Susskind, Joel↗

Contributions to Climate Research Using the AIRS Science Team Version-5 Products

This paper compares recent spatial anomaly time series of OLR (Outgoing Longwave Radiation) and OLRCLR (Clear Sky OLR) as determined using CERES and AIRS observations over the time period September 2002 through June 2010. We find excellent agreement in OLR anomaly time series of both data sets in almost every detail, down to the 1 x 1 spatial grid point level. This extremely close agreement of OLR anomaly time series derived from observations by two different instruments implies that both sets of results must be highly stable. This agreement also validates to some extent the anomaly time series of the AIRS derived products used in the computation of the AIRS OLR product. The paper then examines anomaly time series of AIRS derived products over the extended time period September 2002 through April 2011. We show that OLR anomalies during this period are closely in phase with those of an El Nino index, and that recent global and tropical mean decreases in OLR and OLR(sub CLR) are a result of a transition from an El Nino condition at the beginning of the data record to La Nina conditions toward the end of the data period. This relationship can be explained by temporal changes of the distribution of mid-tropospheric water vapor and cloud cover in two spatial regions that are in direct response to El Nino/La Nina activity which occurs outside these spatial regions

Susskind, Joel↗

An Information Theory Approach on Deciding Spectroscopic Follow-ups

Classification and characterization of variable phenomena and transient phenomena are critical for astrophysics and cosmology. These objects are commonly studied using photometric time series or spectroscopic data. Given that many ongoing and future surveys are conducted in a time domain, and given that adding spectra provides further insights but requires more observational resources, it would be valuable to know which objects we should prioritize to have a spectrum in addition to a time series. We propose a methodology in a probabilistic setting that determines a priori which objects are worth taking a spectrum of to obtain better insights, where we focus on the insight of the type of the object (classification). Objects for which we query their spectrum are reclassified using their full spectral information. We first train two classifiers, one that uses photometric data and another that uses photometric and spectroscopic data together. Then for each photometric object we estimate the probability of each possible spectrum outcome. We combine these models in various probabilistic frameworks (strategies), which are used to guide the selection of follow-up observations. The best strategy depends on the intended use, whether it is obtaining more confidence or accuracy. For a given number of candidate objects (127, equal to 5% of the data set) for taking spectra, we improve the class prediction accuracy by 37% as opposed to 20% of a non-naive (non-random) best-baseline strategy. Our approach provides a general framework for follow-up strategies and can be extended beyond classification to include other forms of follow-ups beyond spectroscopy.

79 ASTRONOMY AND ASTROPHYSICS↗

Short-term apartment-level load forecasting using a modified neural network with selected auto-regressive features

Residential electricity load profiles and their diversity have become increasingly important to realize the benefits of Smart or Transactive Energy Networks (TENs). An important element of TENs will be practical, accurate, and implementable residential load forecasting techniques. While there have been many approaches to short-term load forecasting, few have included forecasting for individual households, partly because the high volatility and idiosyncrasies present in individual household load data can pose significant challenges. In this study, we develop a Convolutional Long Short-Term Memory-based neural network with Selected Autoregressive Features (termed a CLSAF model) to improve short-term household electricity load forecasting accuracy by employing three strategies: autoregressive features selection, exogenous features selection, and a “default” state to avoid overfitting at times of high load volatility. We include aggregations of apartments to floor and building level, because utilities may favor transactive approaches that rely on aggregator models, e.g., a cluster of consumers as opposed to an individual. We demonstrate that the CLSAF model, by virtue of its enhanced feature representation and modest computational resources, can accomplish load forecasting in a multi-family residential building across three spatial granularities (individual apartment/household, floor, and building levels), with an accuracy improvement of up to 25% compared to a persistence model. We propose a data screening technique to characterize time-series electricity-load data. This technique is suitable for integration into a TEN ecosystem and allows one to estimate confidence levels of the load forecasts to optimize computational resources and the risks associated with uncertain forecasts.

24 POWER TRANSMISSION AND DISTRIBUTION↗

On the Advantages of Using Harmonized Landsat Sentinel-2 Data for Monitoring Environmental Change

NASA coordinates the Satellite Needs Working Group, dedicated to identifying, communicating, and addressing Earth observation needs of federal agencies. In 2016, the Harmonized Landsat Sentinel-2 (HLS) dataset was formulated and implemented to fulfill multiple needs. The combination of acquisitions from the Landsat and Sentinel-2 platforms results in a global dataset of surface reflectance with a temporal resolution of two days, while retaining the geometry and 30-meter spatial resolution of Landsat data. This harmonization allows for seamless integration with the 40-year archive of Landsat data. The HLS dataset is now available on the Google Earth Engine, enabling HLS utilization in various algorithms and frameworks essential for monitoring environmental change worldwide. During this presentation, we will demonstrate and discuss the advantages of using HLS data in comparison to using separate streams of Landsat and Sentinel-2 data in existing time series-based frameworks for change monitoring. Specifically, we will explore the application of HLS for continuous monitoring of deforestation using time series-based algorithms traditionally run with Landsat data. Additionally, we will showcase the benefits of HLS data for near real-time monitoring of forest disturbance in tropical regions. These examples underscore the value and utility of the HLS dataset for environmental monitoring and analysis.

Pontus Olofsson↗

Time Series Dimension Reduction for Surrogate Models of Port Scanning Cyber Emulations

Surrogate model development is a key resource in the scientific modeling community for providing computational expedience when simulating complex systems without loss of great fidelity. The initial step to development of a surrogate model is identification of the primary governing components of the system. Principal component analysis (PCA) is a widely used data science technique that provides inspection of such driving factors, when the objective for modeling is to capture the greatest sources of variance inherent to a dataset. Although an efficient linear dimension reduction tool, PCA makes the fundamental assumption that the data is continuous and normally distributed. Thus, it provides ideal performance when these conditions are met. In the case for which cyber emulations provide realizations of a port scanning scenario, the data to be modeled follows a discrete time series function comprised of monotonically increasing piece-wise constant steps. The sources of variance are related to the timing and magnitude of these steps. Therefore, we consider using XPCA, an extension to PCA for continuous and discrete random variates. This report provides the documentation of the trade-offs between the PCA and XPCA linear dimension reduction algorithms, for the intended purpose to identify key components of greatest variance in our time series data. These components will ultimately provide the basis for future surrogate models of port scanning cyber emulations.

97 MATHEMATICS AND COMPUTING↗

Universal Fourier Attack for Time Series

A wide variety of adversarial attacks have been proposed and explored using image and audio data. These attacks are notoriously easy to generate digitally when the attacker can directly manipulate the input to a model, but are much more difficult to implement in the real world. In this paper we present a universal, time invariant attack for general time series data such that the attack has a frequency spectrum primarily composed of the frequencies present in the original data. The universality of the attack makes it fast and easy to implement as no computation is required to add it to an input, while time invariance is useful for real world deployment. Additionally, the frequency constraint ensures the attack can withstand filtering defenses. We demonstrate the effectiveness of the attack on two different classification tasks through both digital and real world experiments, and show that the attack is robust against common transform-and-compare defense pipelines.

97 MATHEMATICS AND COMPUTING↗

Oak Ridge National Laboratory Pilot Demonstration of an Attestation and Anomaly Detection Framework using Distributed Ledger Technology for Power Grid Infrastructure

This report summarizes the design and pilot demonstration of a framework called Grid Guard that was created to provide increased data and device trustworthiness to electric grid devices by leveraging distributed ledger technology (DLT), specifically blockchain. Grid Guard contains a combination of core cryptographic methods such as the secure hash algorithm (SHA), and asymmetric cryptography, private permissioned blockchain, baselining configuration data, consensus algorithm (Raft) and the Hyperledger Fabric (HLF) framework. The system implements a low energy, fast, and robust enhancement to system trustworthiness within and across electric grid systems such as substations, control centers and metering infrastructures. Blockchain is a distributed database structured that provides a practically unalterable (immutable) timeline of stored transactions. By relying on hashing and the Raft consensus algorithm, if an entity tries to illegitimately alter a record at one instance of the database the other ledger nodes are not altered. They work to cross-reference each other and easily locate any incorrectly added data and remove it. The bulk raw data is stored in an off-chain storage (outside of the blockchain ledger) and a hash of this baseline data is stored in the Blockchain ledger via hashing windows of time-series and configuration data, after aggregation and filtering. The bulk off-chain data repository is then considered to be trust-anchored using the hashes stored in the blockchain. To secure the electric grid testbed devices and data, device configuration baselines were compared to those baselines that had been previously stored in the ledger. Statistical baselines for device configurations, network communication patterns, and high-speed sensor data are calculated and then stored off-chain and hashes stored in the ledger. Measurements such as three-phase voltage and current, frequency, breaker status, protection scheme settings, network configuration settings (and other device configuration artifacts) and network traffic features (packet interarrival times) are compared every minute or other selected time windows. During phase 1 of the Grid Guard DLT project different DLT technologies were studies, and an assessment was performed on DLT technology vulnerabilities, uses, and key characteristics. DLT consensus protocols were studies (e.g., RAFT, named after Reliable, Replicated, Redundant, And Fault-Tolerant). Also, cryptography, public, private and permissioned or permissionless systems were assessed. Grid Guard implements a permissioned private DLT. Consensus algorithm selection and choice of DLT implementation depended heavily on the use-case. For this use-case, parameters were selected to measure performance and existing tools for assessment. Benchmarking was performed theoretically and practically. During phase 2 hashed transactions/blocks were inserted into the ledger every second. During phase 2 of the Grid Guard DLT project, a prototype framework was developed and demonstrated for attestation of critical substation devices and data using precision timing systems that use PTP and IRIG-B protocols) on a testbed of operational devices that emulated a distribution substation, control center, and power metering infrastructure using real Operational Technology (OT). The testbed includes OT devices such as protective relays, human machine interfaces (HMI), and power meters. To determine when to collect and compare system and network baselines, an initial examination of an anomaly detection capability to identify malicious manipulation of data streams was conducted. The resulting anomaly detection was demonstrated in a set of experiments and leveraged to trigger device artifact attestation checks. Attestation checks occur against device configuration baselines when compared with the immutable blockchain-stored baselines, which provided a cryptographically supported means by which to store baselines. The electrical substation-grid testbed was created to test the Grid Guard framework. The testbed emulates the operations of a portion of a power grid and SCADA systems as closely as possible. The testbed integrates real protocols, mainly IEC 61850 standard protocols, such as the Sampled Value (SV) and the GOOSE protocols. The testbed also supports DNP3 and other layer 2 and layer 3 protocols such as Telnet, SSH, SFTP/FTP and other proprietary protocols needed to connect to industrial control system equipment. The testbed emulates real power conditions using the OpalRT hardware-in-the-loop (HIL) device which can create fault situations that cannot be easily tested on real systems. The electrical substation-grid testbed was created using real measurement, communication, and protection devices that electrical utilities commonly use.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Universal Fourier Attack for Time Series

A wide variety of adversarial attacks have been proposed and explored using image and audio data. These attacks are notoriously easy to generate digitally when the attacker can directly manipulate the input to a model, but are much more difficult to implement in the real-world. In this paper we present a universal, time invariant attack for general time series data such that the attack has a frequency spectrum primarily composed of the frequencies present in the original data. The universality of the attack makes it fast and easy to implement as no computation is required to add it to an input, while time invariance is useful for real-world deployment. Additionally, the frequency constraint ensures the attack can withstand filtering. We demonstrate the effectiveness of the attack in two different domains, speech recognition and unintended radiated emission, and show that the attack is robust against common transform-and-compare defense pipelines.

97 MATHEMATICS AND COMPUTING↗

Response induction coil magnetometers to perturbations in orientation

© 1996-2018 Society of Exploration Geophysicists. All rights reserved. We explore the data collected by a 3-component induction coil magnetometer system with respect to motion of the instruments in earths static magnetic field. The sensitivtiy of the inductiuon coil magnetometer leads to unprecediented accuracy on tilt measurements. We model the signals observed during seismic events as being perturbations in coil orientation. In theory, these perturbations can include ground roll, ocean motion, nearby cultural seismicity, or any other field with a tilting effect. Using data from a magnetic observatory near Parkfield CA we invert several time series of coil data during different levels of seismic activity in an attempt to determine the magnitudes of rotation at which our model accurately describes the coil data. Finally, we explore the transfer function between the coils and nearby seismic instruments (accelerometers, tiltmeters, and velocity seismometers).

Kappler, K↗