Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “time series analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21
All sourcesNASA NTRSDOE OSTI
NASA NTRS2011

Semi-Supervised Novelty Detection with Adaptive Eigenbases, and Application to Radio Transients

We present a semi-supervised online method for novelty detection and evaluate its performance for radio astronomy time series data. Our approach uses adaptive eigenbases to combine 1) prior knowledge about uninteresting signals with 2) online estimation of the current data properties to enable highly sensitive and precise detection of novel signals. We apply the method to the problem of detecting fast transient radio anomalies and compare it to current alternative algorithms. Tests based on observations from the Parkes Multibeam Survey show both effective detection of interesting rare events and robustness to known false alarm anomalies.

anomaly detection↗
NASA NTRS2016

Optimal Reorganization of NASA Earth Science Data for Enhanced Accessibility and Usability for the Hydrology Community

A long-standing "Digital Divide" in data representation exists between the preferred way of data access by the hydrology community and the common way of data archival by earth science data centers. Typically, in hydrology, earth surface features are expressed as discrete spatial objects (e.g., watersheds), and time-varying data are contained in associated time series. Data in earth science archives, although stored as discrete values (of satellite swath pixels or geographical grids), represent continuous spatial fields, one file per time step. This Divide has been an obstacle, specifically, between the Consortium of Universities for the Advancement of Hydrologic Science, Inc. and NASA earth science data systems. In essence, the way data are archived is conceptually orthogonal to the desired method of access. Our recent work has shown an optimal method of bridging the Divide, by enabling operational access to long-time series (e.g., 36 years of hourly data) of selected NASA datasets. These time series, which we have termed "data rods," are pre-generated or generated on-the-fly. This optimal solution was arrived at after extensive investigations of various approaches, including one based on "data curtains." The on-the-fly generation of data rods uses "data cubes," NASA Giovanni, and parallel processing. The optimal reorganization of NASA earth science data has significantly enhanced the access to and use of the data for the hydrology user community.

data rods↗
NASA NTRS2017

Interpretable Categorization of Heterogeneous Time Series Data

We analyze data from simulated aircraft encounters to validate and inform the development of a prototype aircraft collision avoidance system. The high-dimensional and heterogeneous time series dataset is analyzed to discover properties of near mid-air collisions (NMACs) and categorize the NMAC encounters. Domain experts use these properties to better organize and understand NMAC occurrences. Existing solutions either are not capable of handling high-dimensional and heterogeneous time series datasets or do not provide explanations that are interpretable by a domain expert. The latter is critical to the acceptance and deployment of safety-critical systems. To address this gap, we propose grammar-based decision trees along with a learning algorithm. Our approach extends decision trees with a grammar framework for classifying heterogeneous time series data. A context-free grammar is used to derive decision expressions that are interpretable, application-specific, and support heterogeneous data types. In addition to classification, we show how grammar-based decision trees can also be used for categorization, which is a combination of clustering and generating interpretable explanations for each cluster. We apply grammar-based decision trees to a simulated aircraft encounter dataset and evaluate the performance of four variants of our learning algorithm. The best algorithm is used to analyze and categorize near mid-air collisions in the aircraft encounter dataset. We describe each discovered category in detail and discuss its relevance to aircraft collision avoidance.

Drones↗
NASA NTRS2014

Prediction of Adverse Events in Time Series Data Using ACCEPT (Adverse Condition and Critical Event Prediction Toolbox)

Abstract:An open-source toolbox called ACCEPT (Adverse Condition and Critical Event Prediction Toolbox) that operates from within the Matlab programming environment is introduced. The toolbox provides an open source, special-purpose functionality that can be used specifically for the prediction or forecasting of adverse events in time series data. It also provides a single, unifying framework in which to compare a variety of combinations of algorithmic approaches addressing this problem. The architectural framework also offers the flexibility for expansion to accommodate the newest, latest popular regression and detection methods for this particular problem, enabling the development of an infrastructure that can act as a proving ground platform for comparing new techniques to the state of the art. As such, its intention is to act as a catalyst in advancing the state of the art in technologies related to this problem. There are a variety of other toolboxes that offer similar capabilities and features, however they are either more suitable as general purpose machine learning toolboxes or are only available commercially or through agreements. ACCEPT fills that niche by offering visibility into a specific approach for addressing the adverse event prediction problem.

programming environments↗
NASA NTRSDate not supplied

Derivation and Testing of Consumptive Water Use Fraction for Specialty Crops

The Crop Consumptive Use Fraction (CCUF) expresses beneficial water use in the form of seasonal evapotranspiration of applied water (ETAW), relative to total irrigation volume. The metric is an indicator of the efficiency of agricultural water use and is a recommended component for preparation of agricultural water management plans in California. An FAO-56 based web application has been developed to facilitate retrospective evaluation of ETAW, and hence CCUF, at field level. The current application is optimized for prevailing climate in four of the state’s main growing regions: San Joaquin Valley, Sacramento Valley, Central Coast, and North Coast. User inputs include crop type, soil texture, irrigation method, daily irrigation volume, daily rainfall, and seasonal start/stop dates to define the analysis period. Time series of fractional green canopy cover (Fc), based on Landsat and Sentinel-2 Earth-resource satellite observations, are imported from NASA’s Satellite Irrigation Management Support (SIMS) system. Grass reference evapotranspiration (ETo) time series are accessed from Spatial CIMIS (California Irrigation Management Information System). Daily crop height (h) is estimated as a simple function of typical maximum height for the given crop type (from FAO-56) and Fc. A vegetation density coefficient (Kd) is derived from Fc and h. Stomatal control factors during mid-and late-season are applied to tree and vine crops. Typical values for minimum daily relative humidity and mean daily windspeed, derived from historical CIMIS weather data, are used to correct for regional deviations from standard climate (defined as RHmin=45%, windspeed =2m/s). The resulting daily basal crop coefficient (Kcb) represents the ET of a well-watered crop with minimal soil evaporation, relative to ETo. A soil water balance sub-model for the top 0.1 m is used to calculate daily evaporation coefficients (Ke). A second sub-model applies to the root zone to calculate crop water stress coefficients (Ks) and effective precipitation (Pe), which is the fraction of rainfall that is available for crop use. Those coefficients are combined with Kcb and ETo to calculate daily ETc. ETAW is then derived as cumulative ETc less cumulative Pe. For verification purposes, sensor installations were used to measure seasonal ETc in commercial fields for several annual and perennial specialty crops by soil water balance and energy balance methods. Model estimates of seasonal ETc show mean absolute error of <10% compared to the ground measurements.

Derivation↗
NASA NTRS2023

Maldives Climate II: Evaluating the Potential Impacts of Sea Level Rise on Human Development and Coastal Infrastructure

The Republic of the Maldives is a low-lying island nation in the Indian Ocean which has experienced rapid urbanization, landcover changes, and sea level rise over recent years. The growth of tourism, coastal erosion, and urbanization have all driven land reclamation efforts across many islands. As in-situ landcover change monitoring has proven difficult across the vast archipelago, the NASA DEVELOP team collaborated with the Maldives Ministry of Environment, Climate Change, and Technology; USAID; and the U.S. Department of State, to utilize Earth observations to predict sea level rise impacts on coastal infrastructure. The team used a supervised classification algorithm within Google Earth Engine to create land use maps and time series analyses of nine islands and atolls using imagery from Landsat 7 Enhanced Thematic Mapper Plus, Landsat 8 Operational Land Imager, Sentinel-2 Multispectral Instrument, and PlanetScope, covering a combined period of 2000 through 2023. Additionally, the team projected coastal inundation with a modified deterministic Bathtub model utilizing elevation data from CoastalDEM and 2050-2100 Shared Socioeconomic Pathway scenarios identified in the NASA Sea Level Rise Projection Tool. The team found that islands undergoing urban growth experienced a 23% decrease in vegetation between 2014 and 2022. Furthermore, the model predicted that 51–57% of the study area’s-built environment has a chance of inundation by 2100 under the low and high sea level scenarios. These analyses demonstrate how remote sensing can be used to both track land use changes over time and project how coastlines will be affected by sea level rise.

remote sensing↗
NASA NTRSDate not supplied

Multidimensional Data Aggregation in the Cloud with Application to Geostationary Satellite-based Air Quality Monitoring

Scientists use satellite data for studying Earth's systems, and the remote sensing data that these satellites collect are typically separated into files of a size small enough for efficient network transfer and storage. However, researchers usually prefer to analyze the data based on real-world dimensions like time, space, or elevation. To help with this, NASA's Atmospheric Science Data Center (ASDC) developed a new cloud-based tool that combines these smaller data chunks into larger, more useful datasets. The tool works on Network Common Data Form (netCDF4) and some HDF5 formatted files, and it is available as a service in NASA's Earthdata Cloud. In this presentation, we showcase this service using data from the Tropospheric Emissions: Monitoring of Pollution (TEMPO) instrument. By combining TEMPO's continuous observations over time, we create longer and more informative analysis-ready time series to facilitate the study of air quality patterns. Insights gained will provide a more comprehensive understanding of pollution sources, transport patterns, and their effects on the environment and human health.

Daniel Kaufman↗
DOE OSTI2021

Subsurface Characterization and Machine Learning Predictions at Brady Hot Springs: Preprint

Subsurface data analysis, reservoir modeling, and machine learning (ML) techniques have been applied to the Brady Hot Springs (BHS) geothermal field in Nevada, USA to further characterize the subsurface and assist with optimizing reservoir management. Hundreds of reservoir simulations have been conducted in TETRAD-G and CMG STARS to explore different injection and production fluid flow rates and allocations and to develop a training data set for ML. This process included simulating the historical injection and production since 1979 and prediction of future performance through 2040. ML networks were created and trained using TensorFlow based on multilayer perceptron (MLP), long short-term memory (LSTM), and convolutional neural network (CNN) architectures. These networks took as input selected flow rates, injection temperatures, and historical field operation data and produced estimates of future production temperatures. This approach was first successfully tested on a simplified single fracture doublet system, followed by the application to the BHS reservoir. Using an initial BHS dataset with 37 simulated scenarios, the trained and validated network predicted the production temperature for 6 production wells with the mean absolute percentage error of less than 8%. In a complementary analysis effort, the principal component analysis applied to 13 BHS geological parameters revealed that vertical fracture permeability shows the strongest correlation with fault density and fault intersection density. A new BHS reservoir model was developed considering the fault intersection density as proxy for permeability. This new reservoir model helps to explore under-exploited zones in the reservoir. A data gathering plan to obtain additional subsurface data was developed; it includes temperature surveying for three idle injection wells, at which the reservoir simulations indicate high bottom-hole temperatures. The collected data assist with calibrating the reservoir model and may lead to converting these wells to producers to access under-exploited zones in the reservoir. Data gathering activities are planned for the first quarter of 2021.

40 EE - Geothermal Technologies Office (EE-4G)↗
DOE OSTI2021

Code Artifact for: Clustering Analysis of Commercial Vehicles Using Automatically Extracted Features from Time Series Data [SWR-21-96]

This repository contains data ingestion, feature extraction, and analysis code used in NREL Technical report "Clustering Analysis of Commercial Vehicles Using Automatically Extracted Features from Time Series Data." The code is written in Python. The ETL and feature extraction code must be run in a Spark context. The analysis code can be run without Spark, provided you have pre-computed features in a CSV file. Analysis code related to the NREL Technical Report NREL/TP-2C00-74212. Includes PySpark functions to perform trip segmentation and feature extraction over big time series data in Apache Spark. Includes "domain specific" features such as Aerodynamic Speed (ft/s), Characteristic Acceleration (ft/s2), Percent Below 55 (%), Percent Zero (%), Stops Per Mile, Average Speed (mph), Maximum Speed (mph), and Speed Standard Deviation (mph). Includes Pyspark UDF to compute "domain agnostic" features using the TSFresh library. This software record also includes the analysis notebooks and code to generate the results in the previously mentioned technical report.

Perr-Sauer, Jordan↗
DOE OSTI2021

Multifractal detrended fluctuation analysis of soil radon ( 222 Rn) and thoron ( 220 Rn) time series

In this paper, we present results of Multifractal Detrended Fluctuation Analysis (MF-DFA) of soil Radon ( 222 Rn) and Thoron ( 220 Rn) time series to examine the scaling and multifractal features. Data consists of 15,692 measurements taken each over forty-minute interval. RTM 1688-2, 222 Rn/ 220 Rn electronic device has been used for measurement purposes. Seasonal periodicities have been removed from the data and MF-DFA was employed on de-seasonalized data. Original 222 Rn and 220 Rn time series have been converted into surrogate and shuffled time series. MFDFA has also been applied to the surrogate and shuffled series to examine the multifractality nature. Results of the study show that $^{222}_{Orig}Rn$, $^{222}_{Surr}Rn$ and $^{220}_{Orig}Rn$, $^{220}_{Surr}Rn$ time series are longrange positively correlated and an increase or decrease in either of radionuclide concentrations will be followed by another increase or decrease of concentrations in future measurements. The $^{220}_{Shuff}Rn$ time series has an independent or short-range dependent structure called white noise and the shuffled time series exhibit a very weak multifractality.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
NASA NTRS2009

Trends and Solar Cycle Effects in Temperature Versus Altitude From the Halogen Occultation Experiment for the Mesosphere and Upper Stratosphere

Fourteen-year time series of mesospheric and upper stratospheric temperatures from the Halogen Occultation Experiment (HALOE) are analyzed and reported. The data have been binned according to ten-degree wide latitude zones from 40S to 40N and at 10 altitudes from 43 to 80 km-a total of 90 separate time series. Multiple linear regression (MLR) analysis techniques have been applied to those time series. This study focuses on resolving their 11-yr solar cycle (or SC-like) responses and their linear trend terms. Findings for T(z) from HALOE are compared directly with published results from ground-based Rayleigh lidar and rocketsonde measurements. SC-like responses from HALOE compare well with those from lidar station data at low latitudes. The cooling trends from HALOE also agree reasonably well with those from the lidar data for the concurrent decade. Cooling trends of the lower mesosphere from HALOE are not as large as those from rocketsondes and from lidar station time series of the previous two decades, presumably because the changes in the upper stratospheric ozone were near zero during the HALOE time period and did not affect those trends.

Remsberg, Ellis E.↗
DOE OSTI2020

Numerical Validation of an Algorithm for Combined Soiling and Degradation Analysis of Photovoltaic Systems

We describe and demonstrate an open-source algorithm for simultaneously quantifying degradation and soiling of photovoltaic (PV) systems from energy-production time series data. The new analysis is based on year-on-year degradation rate analysis combined with stochastic rate and recovery soiling analysis. The algorithm is designed to fit into the workflow provided by RdTools, a Python module maintained by NREL and collaboratively developed with the community, which provides a framework and functions for degradation and loss-factor analysis of PV field data. We demonstrate the method on numerically simulated PV data sets and show that it reduces the root-mean-square error of the P50 degradation rate estimate when soiling is present.

14 SOLAR ENERGY↗
DOE OSTI2023

Generating Synthetic Time Series Photovoltaic Data with Real-World Physical Challenges and Noise for Use in Algorithm Test and Validation

The PV Fleet Data Initiative and other projects seek the develop algorithms for automated analysis of PV time series data for extraction of statistical information and other parameters of the data such as degradation rates, soiling loss information, tracker performance, clipping or curtailment, system availability and other valuable information. While there is a vast body of PV data available for application of said extraction algorithms it is difficult to validate these algorithms because the true parameters to be extracted are not known. There has been a wide use of synthetic data in the literature for algorithm validation but this synthetic data is typically very bounded by the problem or topic at hand. The PV Fleet Data Initiative project has demonstrated that real time series PV data almost always includes a host of data quality and physical problems that, in reality, any automated PV abstraction algorithm must handle appropriately. For this reason, this work describes the development of a complex synthetic PV times series data set that includes data quality and physical problems that have been experienced in real world PV data. The various quality and physical problems are documented in the synthetic data so that users can test the validity of various PV extraction algorithms as well as develop new algorithms to solve problems this data set can support.

14 SOLAR ENERGY↗
NASA NTRS1980

Verification of interim simulated atmospheric turbulence

During horizontal and near-horizontal flight of the space shuttle orbiter, the effects of atmospheric turbulence on the vehicle are crucial in establishing the space shuttle design, control, and human pilot effects. The effects of both turbulent gusts and gust gradients (shears) must be taken into account. By means of a nonrecursive turbulence simulation model, twelve simulated turbulence time series for gusts and gust gradients were generated as part of a previous investigation. The current investigation was concerned with the spectral analysis of the time series based on the use of Fourier transform theory. A comparison between the computed spectra and the corresponding von Karman theoretical spectra is also included. A basic difference is explained between the computed and theoretical spectra which was identified as a result of the comparison. Conclusions and recommendations are presented.

Tatom, F. B.↗
NASA NTRS1991

Lyapunov exponent of magnetospheric activity from AL time series

A correlation dimension analysis of the AE index indicates that the magnetosphere behaves as a low-dimensional chaotic system with a dimension close to 4. Similar techniques are used to determine if the system's behavior is due to an intrinsic sensitivity to initial conditions and thus is truly chaotic. The quantity used to measure the sensitivity to initial conditions is the Liapunov exponent. Its calculation for AL shows that it is nonzero (0.11 + or - 0.05/min). This gives the exponential rate at which initially similar configurations of the magnetosphere evolve into completely different states. Also, predictions of deterministic nonlinear models are expected to deviate from the observed behavior at the same rate.

Vassiliadis, D.↗
NASA NTRS2000

Monitoring Global Sea Level: Eustatic Variations, Local Variations, and Solid Earth Effects

Project BIFROST (Baseline Inferences for Fennoscandian Rebound Observations. Sea-level and Tectonics) combines networks of continuously operating CPS receivers in Sweden and Finland to measure ongoing crustal deformation due to glacial isostatic adjustment, (CIA). We present an analysis of data collected in the years 1993-1998. We compare the CPS determinations of three-dimensional crustal motion to predictions calculated using the high resolution Fennoscandian deglaciation model recently proposed by Lambeck et al. We find that the the maximum observed uplift rate (approx. 10 mm/ yr) and the maximum predicted uplift rate agree to better than 1 mm/ yr. The patterns of uplift also agree quite well, although differences are discernible. The chi(exp 2) difference between predicted and GPS-observed radial rates is reduced by a factor of 5-6 compared to that for the "null" (no uplift) model, depending on whether a mean difference is first removed. The north components of velocity agree at about the same relative level. whereas the agreement for the east components is worse, a problem possibly related to the lack of bias fixing. We have also compared the values for the observed radial deformation rates to those based on sea-level rates from Baltic tide gauges. The weighted RMS difference between CPS and tide-gauge rates (after removing a mean) is 0.6 mm/ yr, giving an indication of the combined accuracy of the CPS and tide-gauge measurement systems. Spectral analysis of the time series of position estimates yields spectral indices in the range -1 to -2. An EOF analysis indicates, however, that much of this power is correlated among the sites. The correlation appears to be regional and falls off only slightly with distance. Some of this correlated noise is associated with snow accumulation on the antennas or, for those antennas with radomes, on the radomes. This problem has caused us to modify the radomes used several times, leading to one of our more significant sources of uncertainty.

Davis, James L.↗