Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Time Series Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

Monitoring Land Use and Degradation Using Satellite and Airborne Data

Data on the Manix Basin Area of the Mojave Desert have been collected by AVIRIS, AIRSAR, and Landsat TM. The purpose of this study is to use a fusion of a time series of satellite data with airborne data to provide a context for the airborne data. The satellite data time series will additionally help to validate the observation and analysis of time-dependent processes observed in the single AVIRIS image of fields abandoned for different periods of time.

land↗

Self-Supervised Anomaly Detection via Neural Autoregressive Flows with Active Learning

Many self-supervised methods have been proposed with the target of image anomaly detection. These methods often rely on the paradigm of data augmentation with predefined transformations such as flipping, cropping, and rotations. However, it is not straightforward to apply these techniques for non-image data, such as time series or tabular data, while the performance of the existing deep approaches has been under our expectation on tasks beyond images. In this work, we propose a novel active learning (AL) scheme that relied on neural autoregressive flows (NAF) for self-supervised anomaly detection, specifically on small-scale data. Unlike other generative models such as GANs or VAEs, flow-based models allow to explicitly learn the probability density and thus can assign accurate likelihoods to normal data which makes it usable to detect anomalies. The proposed NAF-AL method is achieved by efficiently generating random samples from latent space and transforming them into feature space along with likelihoods via invertible mapping. The samples with lower likelihoods are selected and further checked by outlier detection using Mahalanobis distance. The augmented samples incorporating with normal samples are used for training a better detector so as to approach decision boundaries. Compared with random transformations, NAF-AL can be interpreted as a likelihood-oriented data augmentation that is more efficient and robust. Extensive experiments show that our approach outperforms existing baselines on multiple time series and tabular datasets, and a real-world application in advanced manufacturing, with significant improvement on anomaly detection accuracy and robustness over the state-of-the-art.

Zhang, Jiaxin↗

Mapping Canopy Damage from Understory Fires in Amazon Forests Using Annual Time Series of Landsat and MODIS Data

Understory fires in Amazon forests alter forest structure, species composition, and the likelihood of future disturbance. The annual extent of fire-damaged forest in Amazonia remains uncertain due to difficulties in separating burning from other types of forest damage in satellite data. We developed a new approach, the Burn Damage and Recovery (BDR) algorithm, to identify fire-related canopy damages using spatial and spectral information from multi-year time series of satellite data. The BDR approach identifies understory fires in intact and logged Amazon forests based on the reduction and recovery of live canopy cover in the years following fire damages and the size and shape of individual understory burn scars. The BDR algorithm was applied to time series of Landsat (1997-2004) and MODIS (2000-2005) data covering one Landsat scene (path/row 226/068) in southern Amazonia and the results were compared to field observations, image-derived burn scars, and independent data on selective logging and deforestation. Landsat resolution was essential for detection of burn scars less than 50 ha, yet these small burns contributed only 12% of all burned forest detected during 1997-2002. MODIS data were suitable for mapping medium (50-500 ha) and large (greater than 500 ha) burn scars that accounted for the majority of all fire-damaged forest in this study. Therefore, moderate resolution satellite data may be suitable to provide estimates of the extent of fire-damaged Amazon forest at a regional scale. In the study region, Landsat-based understory fire damages in 1999 (1508 square kilometers) were an order of magnitude higher than during the 1997-1998 El Nino event (124 square kilometers and 39 square kilometers, respectively), suggesting a different link between climate and understory fires than previously reported for other Amazon regions. The results in this study illustrate the potential to address critical questions concerning climate and fire risk in Amazon forests by applying the BDR algorithm over larger areas and longer image time series.

Morton, Douglas C.↗

Comparison between the land surface response of the ECMWF model and the FIFE-1987 data

An averaged time series for the surface data for the 15 x 15 km FIFE site was prepared for the summer of 1987. Comparisons with 48-hr forecasts from the ECMWF model for extended periods in July, August, and October 1987 identified model errors in the incoming SW radiation in clear skies, the ground heat flux, the formulation of surface evaporation, the soil-moisture model, and the entrainment at boundary-layer top. The model clear-sky SW flux is too high at the surface by 5-10 percent. The ground heat flux is too large by a factor of 2 to 3 because of the large thermal capacity of the first soil layer (which is 7 cm thick), and a time truncation error. The surface evaporation was near zero in October 1987, rather than of order 70 W/sq m at noon. The surface evaporation falls too rapidly after rainfall, with a time-scale of a few days rather than the 7-10 d (or more) of the observations. On time-scales of more than a few days the specified 'climate layer' soil moisture, rather than the storage of precipitation, has a large control on the evapotranspiration. The boundary-layer-top entrainment is too low. This results in a moist bias in the boundary-layer mixing ratio of order 2 g/Kg in forecasts from an experimental analysis with nearly realistic surface fluxes; this because there is insufficient downward mixing of dry air.

Betts, Alan K.↗

Bridging Power System Protection Gaps with Data-driven Approaches

Protection is a critical function in power systems to avoid equipment damage, maintain personnel safety, and support system reliability. However, current protective relay technology cannot adequately protect equipment and personnel from effects of some events; these deficiencies are termed protection gaps. In this research, a data-driven approach is proposed to complement traditional protection technology and distinguish fault conditions from transients caused by normal operations. A convolutional neural network (CNN) based fault detection approach is implemented to achieve data translation invariance of the time-series input data. As a result, the data-driven method can accurately detect system faults despite variation and noise in the input data. In addition, using the CNN–based method avoids the complicated manual feature extraction procedure required by many traditional data-driven methods. The effectiveness of the proposed approach is tested on four kinds of protection gaps: high impedance faults, transformer/generator inter-turn faults, distribution system PV circuit faults, and the mis-operation situations of Zone 3 line protection relays operating under system stress. Finally, a transfer learning method is also proposed to address the common issue of data-driven methods for which real-world training data are scarce. Extensive study results demonstrate that the proposed approach can accurately bridge power system protection gaps.

24 POWER TRANSMISSION AND DISTRIBUTION↗

The effects of vegetation and soil hydraulic properties on passive microwave sensing of soil moisture: Data report for the 1982 fiels experiments

Field experiments to (1) study the biomass and geometrical structure properties of vegetation canopies to determine their impact on microwave emission data, and (2) to verify whether time series microwave data can be related to soil hydrologic properties for use in soil type classification. Truck mounted radiometers at 1.4 GHz and 5 GHz were used to obtain microwave brightness temperatures of bare vegetated test plots under different conditions of soil wetness, plant water content and canopy structure. Observations of soil moisture, soil temperature, vegetation biomass and other soil and canopy parameters were made concurrently with the microwave measurements. The experimental design and data collection procedures for both experiments are documented and the reduced data are presented in tabular form.

Oneill, P.↗

Mapping Urban Expansion Across North America Using Multi-Temporal Landsat and Nighttime Lights Data

Urban expansion and the associated changes in land cover have important climatic, hydrologic, biophysical and ecologic and socio-economic impacts on the environment. Yet, despite todays abundance of remote sensing data, an automated characterization of large-scale historical changes in urban spatial extent remains a challenge due to the inherent complexity and variability of the urban environment, the lack of a spectral signature unique to urban land cover, and the absence of an unambiguous definition of what is urban versus non-urban.Here we present a consistent, robust, scalable, physically- based methodology for characterization of urban expansion using Landsat observations. We use atmospherically corrected Landsat Global Land Survey time series, Web-enabled Landsat data time series, DMSP-OLS and NPP-VIIRS nighttime lights, for mapping the built-up and vegetated components of urban settlements at 30m resolution through multi- temporal standardized spectral mixture analysis. The methodology is tested and validated over the North American continent where it provides a first quantification of urban expansion and vegetation abundance changes from 1990 to 2010.

Milesi, Cristina↗

Monitoring the Flow of the Greenland Ice Sheet: the PROMICE Ice Velocity Product and Recent Updates

We present the Programme for Monitoring of the Greenland Ice Sheet (PROMICE) ice velocity product, which is a time series of ice velocity mosaics derived using offset tracking on Sentinel-1 SAR data. The time series starting in January 2016 is continuously updated with a new mosaic every 12 days and is posted at 500 m grid resolution. Within PROMICE, the ice velocity product is used directly as input to estimate the solid ice discharge from the Greenland Ice Sheet as well as to study ice dynamic processes on seasonal and multi-annual time scales. Recently, we have made changes to the processing chain due to spurious cases of slow down detected in a few glaciers in Southeast Greenland. In this contribution, we discuss how this was resolved as well as other recent improvements to the product.

Greenland ice sheet↗

An Update on the Hydrological Land Surface Data and Services at NASA GES DISC

"The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) is one of twelve NASA Earth Observing System data centers that document, process, archive and distribute data from Earth science missions and related projects. The GES DISC hosts many hydrological land surface data products including North American Land Data Assimilation System (NLDAS), Global Land Data Assimilation System (GLDAS), the Famine Early Warning Systems Network (FEWS NET) Land Data Assimilation System (FLDAS), and assimilated-Gravity Recovery and Climate Experiment (GRACE). The Land Surface Model (LSM) products contain model output, including heat fluxes, rain, snow, soil temperature, soil moisture and runoff; and observational forcing data, including surface pressure, temperature, precipitation, downward shortwave and longwave radiation, humidity, and wind. The temporal resolution of the hydrology data at the GES DISC ranges from hourly to monthly and the spatial resolution 0.1 degree to 1.0 degree. The variability of Earth’s water and energy cycles can be characterized with these spatially and temporally consistent, and quality controlled hydrological land surface data. These data could support ongoing modeling activities, and help improve our understanding of land-surface-atmosphere interactions and their impact on climate. Over the years, new data is added, and older data is reprocessed and updated. This presentation provides a summary table of the hydrological data and discusses recent updates to the data and data services at the GES DISC. New data products include (1) GRACE Global Version 3.0 drought indicators and (2) FLDAS monthly global and Central Asia daily data. Reprocessed and updated products include (1) NLDAS Version 2.0 and (2) GRACE United States Version 4.0 drought indicators. Lastly, this presentation will discuss the opportunities for accessing some of our hydrology data from the cloud. As the hydrology land surface data is moved to the cloud, users can expect faster service for longer time series, notably the hydrology data rods time series service."

Ashley Heath↗

Optical variability and pigment biomass in the Sargasso Sea as determined using deep-sea optical mooring data

A 9-month time series of optical data, composed of three separate deployments, from the Biowatt 1987 deep-sea mooring located in the oligotrophic waters of the Sargasso Sea at 32 deg N, 70 deg W, is presented. These data were analyzed using several biooptical models for the purpose of providing a continuous estimate of the spectral diffuse attenuation coefficient and pigment biomass. Results of the first 70-day deployment demonstrate the utility of optical observations as proxy measures of biological parameters, and facilitate a preliminary analysis of the temporal variations and a comparison of the present biooptical observations with concurrent physical observations. Biooptical properties exhibit variation in response to physical forcings, such as diel variations of incident solar irradiance, episodic wind forcing, advective mesoscale eddy layer depth, and succession of phytoplankton. The mooring data are discussed in the context of contemporaneous shipboard observations as well as in terms of future ocean satellite observations.

Smith, R. C.↗

Atmospheric variations - Vacillations and index cycles

Zonal indices, momentum flux, and mean and perturbation kinetic energies of the Southern Hemisphere upper troposphere, derived from the EOLE constant density balloon data set, are found to possess strong 18-23 day variations which are statistically significant to a posteriori levels. Cross-spectra and phase relationships suggest that the variation appears as a barotropic interaction between the middle latitude mean westerlies and ultra large-scale perturbations. Long-period and high-amplitude variations in energy conversion between eddy and mean kinetic energies are found which average out in the long term mean to be very small and positive, consistent with previously measured average hemispheric energetics. Furthermore, the variation is shown to possess an ultra-long wave preference. Examination of two independent data sources, time series of total ozone and stratospheric thickness data from the Selective Chopper Radiometer, suggests that the periodicity is a property of general hemispheric motion rather than just a property of the EOLE data set.

Webster, P. J.↗

Correlation studies of Pioneer Venus imagery obtained from PV experiments with near IR imagery obtained from ground-based observations during Venus inferior conjunction

The purpose of this study is to attempt to find correlations between data taken by experiments aboard the Pioneer-Venus Orbiter (PVO) and those obtained from Earth-based near-infrared (NIR) measurements of Venus during periods near inferior conjunction. Since the NIR measurements have been found to provide data on the middle atmosphere cloud morphology and motion, it is assumed that any correlations will also indicate that the PVO experiments are also documenting cloud behavior. If such correlations are found, then a further task is to attempt to study the long term behavior of the cloud features implied by the correlations. Many PVO data have been obtained over an extended period extending from 1978 until the PV demise in 1992. There exists a long, somewhat ill-conditioned time series of data that may contain valuable information on the long time, as well as short term behavior of the clouds, and, derivatively from cloud motion, atmospheric dynamics and wave activity in the Venus atmosphere. For example, determination of the zonal velocities of any OCPP (Cloud Photopolarimeter) 0.935 micron features could then be used for comparisons with data from other sources to attempt to fix the altitude region in which such features existed. A further task of this study is to attempt to correlate any features found in simultaneously obtained data, for example, the OCPP 0.365 and 0.935 micron data. The existence of such correlations may imply that data was obtained in overlapping altitude regions of the atmosphere.

Ragent, Boris↗

Investigating Access Performance of Long Time Series with Restructured Big Model Data

Data sets generated by models are substantially increasing in volume, due to increases in spatial and temporal resolution, and the number of output variables. Many users wish to download subsetted data in preferred data formats and structures, as it is getting increasingly difficult to handle the original full-size data files. For example, application research users such as those involved with wind or solar energy, or extreme weather events are likely only interested in daily or hourly model data at a single point (or for a small area) for a long time period, and prefer to have the data downloaded in a single file. With native model file structures, such as hourly data from NASA Modern-Era Retrospective analysis for Research and Applications Version-2 (MERRA-2), it may take over 10 hours for the extraction of parameters-of-interest at a single point for 30 years. The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) is exploring methods to address this particular user need. One approach is to create value-added data by reconstructing the data files. Taking MERRA-2 data as an example, we have tested converting hourly data from one-day-per-file into different data cubes, such as one-month, or one-year. Performance is compared for reading local data files and accessing data through interoperable services, such as OPeNDAP. Results show that, compared to the original file structure, the new data cubes offer much better performance for accessing long time series. We have noticed that performance is associated with the cube size and structure, the compression method, and how the data are accessed. An optimized data cube structure will not only improve data access, but also may enable better online analysis services

reanalysis↗

Effect of Electronic Shot Noise on Dynamic Measurements using Optical Techniques: Examples from Rayleigh Scattering and Unsteady PSP

Electronic shot noise is an unavoidable reality in all optical techniques that depend on measuring light intensity. For steady-state, time-averaged measurements the impact of shot noise can be easily reduced by increasing the exposure time, or by averaging over multiple-exposures. That is not the case for unsteady measurements, where time histories of light intensity variations need to be created either by high-speed photography (unsteady PSP) or via photoelectron counting (spectrally resolved Rayleigh scattering) over short time durations using a photo-multiplier tube (PMT) and photon counting electronics. Electronic shot noise introduces a fixed amount of random error, which can overwhelm the light intensity variation caused by turbulent fluctuations. Spectrum computed from such time series shows a fixed noise floor that is independent of the number of data points in the time series. For a fixed optical system, where the collected power of the luminescent light (uPSP), or the scattered light (Rayleigh) is fixed, one needs to resort to special techniques to obtain enough signal-to noise ratio (SNR). For the uPSP application it is shown that averaging of the adjacent pixels improves SNR; although this may lead to a sacrifice of spatial resolution. A second means is to increase the exposure time, which leads to a lowering of the frequency range. For the Rayleigh application, improvements of SNR can be achieved via two different cross-correlation based approaches. The first involves measuring the light intensity using two PMTs using short, contiguous gates; thereby, creating two time-series of data. The second one involves collecting one long time-series of data using one set of measurement device, followed by an odd-even splitting into two time series. When the two time-series are cross-correlated, and a power spectrum is calculated, a significant reduction in the shot noise floor can be achieved. Examples from measurements of density and velocity fluctuations spectra from two different Rayleigh setup are presented to demonstrate the process.

uPSP↗

MAD: Self-Supervised Masked Anomaly Detection Task for Multivariate Time Series

In this paper, we introduce Masked Anomaly Detection (MAD), a general self-supervised learning task for multivariate time series anomaly detection. With the increasing availability of sensor data from industrial systems, being able to detecting anomalies from streams of multivariate time series data is of significant importance. Given the scarcity of anomalies in real-world applications, the majority of literature has been focusing on modeling normality. The learned normal representations can empower anomaly detection as the model has learned to capture certain key underlying data regularities. A typical formulation is to learn a predictive model, i.e., use a window of time series data to predict future data values. In this paper, we propose an alternative self-supervised learning task. By randomly masking a portion of the inputs and training a model to estimate them using the remaining ones, MAD is an improvement over the traditional left-to-right next step prediction (NSP) task. Our experimental results demonstrate that MAD can achieve better anomaly detection rates over traditional NSP approaches when using exactly the same neural network (NN) base models, and can be modified to run as fast as NSP models during test time on the same hardware, thus making it an ideal upgrade for many existing NSP-based NN anomaly detection models.

97 MATHEMATICS AND COMPUTING↗

A Software Tool for Processing the Displacement Time Series Extracted from Raw Radar Data

The application of high-resolution radar waveform and interferometric principles recently led to the development of a microwave interferometer, suitable to simultaneously measuring the (static or dynamic) deflection of several points on a large structure. From the technical standpoint, the sensor is a Stepped Frequency Continuous Wave (SF-CW), coherent radar, operating in the K{sub u} frequency band.In the paper, the main procedures adopted to extract the deflection time series from raw radar data and to assess the quality of data are addressed, and the MATLAB toolbox developed is described. Subsequently, other functions implemented in the software tool (e.g. evaluation of the spectral matrix of the deflection time-histories, identification of natural frequencies and operational mode shapes evaluation) are described and the application to data recorded on full-scale bridges is exemplified.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗