Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Time Series Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

Visualizing Clustering and Uncertainty Analysis with Multivariate Longitudinal Data

Multivariate time-series datasets are intrinsic to the study of dynamic, naturalistic behavior, such as in the applications of finance and motion video analysis. Statistical models provide the ability to identify event patterns in these data under conditions of uncertainty, but researchers must be able to evaluate how well a model uses available information in a dataset for clustering decisions and for uncertainty information. The Hidden Markov Model (HMM) is an established method for clustering time-series data, where the hidden states of the HMM are the clusters. We develop novel methods for quantifying the uncertainty of the performance of and for visualizing the clustering performance and uncertainty of fitting a HMM to multivariate time-series data. We explain the usefulness of uncertainty quantification and visualization with evaluating the performance of clustering models, as well as how information exploitation of time-series datasets can be enhanced. We implement our methods to cluster patterns of scanpaths from raw eye tracking data.

97 MATHEMATICS AND COMPUTING↗

Automated Framework for Groundwater Monitoring Using DWT with LSTM and Transformers

Environmental monitoring is critical for safeguarding public health and ecological well-being. Traditional data structuring and workflow monitoring methods consume significant time and effort, hindering timely insights and effective decision-making. Our study addresses this challenge by presenting an AI framework that automates data cleaning, structuring, and modeling processes, specifically targeting applications in groundwater monitoring. By leveraging automation for data processing and model training, our framework establishes a novel and efficient paradigm for environmental monitoring, with its potential application to the vast network of over a hundred Department of Energy Environmental Management (DoE-EM) cleanup sites across the country. It analyzes data streams from a network of groundwater Internet-of-Things (IoT) sensors deployed at the Savannah River Site (SRS) for prediction modeling. This allows human experts to focus on analysis and decision-making, ultimately leading to better environmental outcomes.The framework employs multivariate time-series forecasting methods to study and model the behavior of varying chemical analytes. The continuous learning process is enabled by utilizing deep learning techniques. It allows the framework to become more nuanced in its analysis over time, adapting to the specific characteristics of the environmental site and the evolving nature of contaminant behavior. Deep learning models known for sequence modeling, LSTM, and Transformers are employed for time series forecasting. Data processing and structuring are essential components significantly impacting the final model's performance. This hypothesis was proven by presenting a comparative analysis of model performance with processed and unprocessed data. The feature engineering approach utilized was the Discrete Wavelet Transform, which works well with time series data.

Discrete Wavelet Transform (DWT)↗

A Scalable Method for Extracting Soiling Rates from PV Production Data

We present a method for analyzing time series production data from photovoltaic systems to extract the rate at which energy yield is affected by the accumulation of dust, dirt, and other forms of soiling. We describe an approach that is based on prevailing methods which consider the change in energy production during dry periods. The method described here builds upon these methods by considering a statistical sample of soiling intervals from each site under consideration. The method enables straightforward application to a large number of sites with minimal parameterization of data-filtering requirements. Furthermore, it enables statistical confidence intervals and comparisons between sites.

14 SOLAR ENERGY↗

Building a Bilingual Google Earth Engine Dashboard to Increase Accessibility to Long-term Time Series Remote Sensing Data for Monitoring Saline System Changes in Chile’s Atacama Desert

Saline systems, consisting of salt flats, ponds, and marshes, provide vital water resources to wildlife and communities in northern Chile’s Atacama Desert, one of the driest regions in the world. Mining is extensive in the Atacama, which contains 30% of the world’s lithium reserves and is abundant in potassium and boron. The groundwater that feeds into salt marshes and ponds is extracted in large volumes for mining operations, limiting the availability of water for ecosystems. However, identifying long-term and large-scale environmental impacts from local lithium mining on the saline systems is limited by region inaccessibility and terrain variability. Open access satellite imagery and cloud computing technology has made studying Atacama saline systems feasible and allowed for collaboration across different agencies and countries. The NASA DEVELOP Program partnered with Chile’s la Universidad de La Serena and Servicio Nacional de Geología y Minería (SERNAGEOMIN) to create the Saline Analysis Tool (SalT) in Google Earth Engine (GEE). SalT is used to analyze the extent and distribution of remote saline systems in the Atacama from 1986 to the present day. The tool filters Landsat 5 Thematic Mapper (TM) and Landsat 8 Operational Land Imager (OLI) data from GEE’s data catalog and creates a single composite image per year for analysis. Additional output analyses include land cover classification, Normalized Difference Vegetation Index (NDVI) and Normalized Difference Water Index (NDWI) raster images that can be displayed on the map interface or exported. The tool can also generate time-lapse videos and charts displaying NDVI, NDWI, and land cover over time. A key feature of the tool is the use of a bilingual graphical user interface to make analysis accessible and customizable to different users’ needs—SalT provides options to select an analysis area, analysis time period, and outputs to display or export. The tool also incorporates new Earth observations as they are added to GEE’s catalog. The ability to easily visualize and analyze long-term remote sensing imagery will enable SERNAGEOMIN and la Universidad de la Serena to continually monitor changes in these saline systems and inform future land management policy.

NASA DEVELOP↗

Simultaneous compression and opacity data from time-series radiography with a Lagrangian marker

Time-resolved radiography can be used to obtain absolute shock Hugoniot states by simultaneously measuring at least two mechanical parameters of the shock, and this technique is particularly suitable for one-dimensional converging shocks where a single experiment probes a range of pressures as the converging shock strengthens. However, at sufficiently high pressures, the shocked material becomes hot enough that the x-ray opacity falls significantly. Additionally, if the system includes a Lagrangian marker such that the mass within the marker is known, this additional information can be used to constrain the opacity as well as the Hugoniot state. In the limit that the opacity changes only on shock heating, and not significantly on subsequent isentropic compression, the opacity of the shocked material can be determined uniquely. More generally, it is necessary to assume the form of the variation of opacity with isentropic compression or to introduce multiple marker layers. Alternatively, assuming either the equation of state or the opacity, the presence of a marker layer in such experiments enables the non-assumed property to be deduced more accurately than from the radiographic density reconstruction alone. An example analysis is shown for measurements of a converging shock wave in polystyrene at the National Ignition Facility.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Big Data For Operation and Maintenance Cost Reduction

The purpose of this research is to develop a first-of-a-kind framework for integrating Big Data capability into the daily activities of our current fleet of nuclear power plants. Big Data is traditionally defined as data sets with high volume, velocity, and heterogeneity, and the existing Big Data analytics capabilities are now widely popular in fields such as finance, weather, e-commerce, healthcare and sports. In the nuclear industry, while the volume and velocity of data may present computational challenges for existing analytics capabilities, data heterogeneity are seen to present the major challenge. This research project mainly focuses on incorporating the wide range of data heterogeneities in nuclear power plants into an integrated Big Data Analytics capability. The primary end-product of this project is a Big Data framework that is capable of dealing with the large volume and heterogeneity of the data found in nuclear power plants to extract timely and valuable information on equipment performance. The framework can generate system insights that are actionable relations between measurable impacts and the corresponding maintenance action plans and enable optimization of plant operation and maintenance based on the extracted information. The developed framework is capable of handling heterogeneous data including both image data and time-series sensor data. Specifically, this developed framework includes the following components. The first component is an overarching maintenance ontology which includes system insights required by maintenance optimization. The maintenance ontology interacts with other components in the developed framework. The second component handles Piping & Instrumentation Diagram (P&ID) data. It can be used to extract system components and their relations automatically from the P&IDs. This extracted information is stored in the first component, i.e., maintenance ontology, and is also used as input to the third component, i.e., a tool for generating the fault tree for the corresponding system. The generated fault tree in turn is stored in the ontology for assessing risk that is used as a criterion in maintenance policy optimization. The fourth component is a tool for inferring the parameters in the Markov degradation model for a nuclear system. It uses basic information from the ontology. The fifth component is a tool for assessing the degradation level using sensor measurement data, for example, pressure, flowrate. This tool can be used for determining corrective maintenance actions. The results obtained from components four and five are returned to the ontology. The sixth component of the framework is a tool for optimizing the maintenance policy for a nuclear system of interest. It takes certain basic information from the ontology, e.g., costs of maintenance actions and system failures, as input, and returns the optimal maintenance policy to the ontology. This tool can be used for determining predictive maintenance actions. A set of experiments have also been conducted to verify the algorithms developed in this project for nuclear system degradation monitoring. The experiments are based on four solenoid valves, similar to the ones used in nuclear power plants. The analyses based on the experimental data using two algorithms, i.e., the Randomized Window Decomposition (RWD) algorithm and the particle filtering algorithm, and the results are introduced in the report. The Big Data framework developed in this project can be used as a support tool in daily activities of plant operation and maintenance and will reduce current costs while maintaining or improving safety levels. Overall, the project will not only benefit existing reactors, however it will open new frontiers to realize the long overdue value of Big Data Analytics in the nuclear sphere.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Compendium of NASA Data Base for the Global Tropospheric Experiment's Transport and Chemical Evolution Over the Pacific (TRACE-P): DC-8 - Volume 1

This report provides a compendium of NASA aircraft data that are available from NASA's Global Tropospheric Experiment's (GTE) Transport and Chemical Evolution over the Pacific (TRACE-P) Mission. The broad goal of TRACE-P was to characterize the transit and evolution of the Asian outflow over the western Pacific. Conducted from February 24 through April 10, 2001, TRACE-P integrated airborne, satellite- and ground-based observations, as well as forecasts from aerosol and chemistry models. The format of this compendium utilizes data plots (time series) of selected data acquired aboard the NASA/Dryden DC-8 (vol. 1) and NASA/Wallops P-3B (vol. 2) aircraft during TRACE-P. The purpose of this document is to provide a representation of aircraft data that are available in archived format via NASA Langley s Distributed Active Archive Center (DAAC) and through the GTE Project Office archive. The data format is not intended to support original research/analyses, but to assist the reader in identifying data that are of interest.

Kleb, Mary M.↗

Compendium of NASA Data Base for the Global Tropospheric Experiment's Transport and Chemical Evolution Over the Pacific (TRACE-P): P-3B - Volume 2

This report provides a compendium of NASA aircraft data that are available from NASA's Global Tropospheric Experiment's (GTE) Transport and Chemical Evolution over the Pacific (TRACE-P) Mission. The broad goal of TRACE-P was to characterize the transit and evolution of the Asian outflow over the western Pacific. Conducted from February 24 through April 10, 2001, TRACE-P integrated airborne, satellite- and ground based observations, as well as forecasts from aerosol and chemistry models. The format of this compendium utilizes data plots (time series) of selected data acquired aboard the NASA/Dryden DC-8 (vol. 1) and NASA/Wallops P-3B (vol. 2) aircraft during TRACE-P. The purpose of this document is to provide a representation of aircraft data that are available in archived format via NASA Langley's Distributed Active Archive Center (DAAC) and through the GTE Project Office archive. The data format is not intended to support original research/analyses, but to assist the reader in identifying data that are of interest.

Kleb, Mary M.↗

Determining circuit model parameters from operation data for PV system degradation analysis: $\mathrm{PVPRO}$

Physics-based circuit parameters like series and shunt resistance are essential to provide insights into the degradation status of photovoltaic (PV) arrays. However, calculating these parameters typically requires a full current-voltage characteristic (I-V curve), the acquisition of which involves specific measurement devices and costly methods. Thus, I-V curves of the PV system level are often not available. Here this paper proposes a methodology (PVPRO) to estimate these I-V curve parameters using only operation (string-level DC voltage and current) and weather data (irradiance and temperature). PVPRO first performs multi-stage data pre-processing to remove noisy data. Next, the time-series DC data are used to fit an equivalent circuit single-diode model (SDM) to estimate the circuit parameters by minimizing the differences between the measured and estimated values. In this way, the time evolutions of the SDM parameters are obtained. We evaluate PVPRO on synthetic datasets and find an excellent estimation of both SDM and the key I-V parameters (e.g., open-circuit voltage, short-circuit current, maximum power, etc.) with an average relative error of 0.55%. The performance, especially the extracted degradation rate of parameters, is robust to various measurement noises and the presence of faults. In addition, PVPRO is applied to a 271 kW PV field system. The relative error between the real and estimated operation voltage and current is less than 1%, suggesting that degradation trends are well captured. PVPRO represents a promising open-source tool to extract the time-series degradation trends of key PV parameters from routine operation data.

14 SOLAR ENERGY↗

Between a Map and a Data Rod

A Digital Divide has long stood between how NASA and other satellite-derived data are typically archived (time-step arrays or maps) and how hydrology and other point-time series oriented communities prefer to access those data. In essence, the desired method of data access is orthogonal to the way the data are archived. Our approach to bridging the Divide is part of a larger NASA-supported data rods project to enhance access to and use of NASA and other data by the Consortium of Universities for the Advancement of Hydrologic Science, Inc. (CUAHSI) Hydrologic Information System (HIS) and the larger hydrology community. Our main objective was to determine a way to reorganize data that is optimal for these communities. Two related objectives were to optimally reorganize data in a way that (1) is operational and fits in and leverages the existing Goddard Earth Sciences Data and Information Services Center (GES DISC) operational environment and (2) addresses the scaling up of data sets available as time series from those archived at the GES DISC to potentially include those from other Earth Observing System Data and Information System (EOSDIS) data archives. Through several prototype efforts and lessons learned, we arrived at a non-database solution that satisfied our objectivesconstraints. We describe, in this presentation, how we implemented the operational production of pre-generated data rods and, considering the tradeoffs between length of time series (or number of time steps), resources needed, and performance, how we implemented the operational production of on-the-fly (virtual) data rods. For the virtual data rods, we leveraged a number of existing resources, including the NASA Giovanni Cache and NetCDF Operators (NCO) and used data cubes processed in parallel. Our current benchmark performance for virtual generation of data rods is about a years worth of time series for hourly data (9,000 time steps) in 90 seconds. Our approach is a specific implementation of the general optimal strategy of reorganizing data to match the desired means of access. Results from our project have already significantly extended NASA data to the large and important hydrology user community that has been, heretofore, mostly unable to easily access and use NASA data.

machine learning↗

Enhancement of Mutual Discovery, Search, and Access of Data for Users of NASA and GEOSS-Cataloged Data Systems

An ongoing NASA-funded Data Rods (time series) project has demonstrated the removal of a longstanding barrier to accessing NASA data (i.e., accessing archived time-step array data as point-time series) for selected variables of the North American and Global Land Data Assimilation Systems (NLDAS and GLDAS, respectively) and other NASA data sets. Data rods are pre-generated or generated on-the-fly (OTF), leveraging the NASA Simple Subset Wizard (SSW), a gateway to NASA data centers. Data rods Web services are accessible through the CUAHSI Hydrologic Information System (HIS) and the Goddard Earth Sciences Data and Information Services Center (GES DISC) but are not easily discoverable by users of other non-NASA data systems. An ongoing GEOSS Water Services project aims to develop a distributed, global registry of water data, map, and modeling services cataloged using the standards and procedures of the Open Geospatial Consortium and the World Meteorological Organization. Preliminary work has shown GEOSS can be leveraged to help provide access to data rods. A new NASA-funded project is extending this early work.

data access↗

Consistency in long-term observations of oceans and ice from space

Satellite remote sensing has provided powerful tools for constructing long-term records of observations of many of Earth's geophysical processes. Geophysicists studying climage change would like to construct time series of data which are as long, accurate, and consistent as possible. While technological advances continue to improve the quality of observations from space, they also present consistency problems. The scanning multichannel microwave radiometer (SMMR), which operated from October 1978 to August 1987, and the special sensor microwave imager (SSMI), which overlapped with the SMMR for nearly two months in 1987, have provided microwave radiances which have been used to monitor long-term changes in sea ice concentration and snow accumulation, among other things. Inspection has shown, however, that brightness temperatures from the two sensors over the same polar firn-covered scene can differ by as much as 14 K. Calibration corrections for polar firn have been derived; in this paper, we present calculations addressing the physics of the small frequency and viewing angle differences between the SMMR and the SSMI on microwave emission from polar scenes containing free water. We focus here only on surface emission. We use a surface scattering model and study the effects of surface roughness, snow wetness, snow density, and young sea ice concentration. We also compare data from Antarctica with our modeled results. We find that for most scenes, surface roughness dominates over the effects of frequency and viewing angle differences, but that for open long-term times series, data must be calibrated and constructed at the geophysical product level rather than at the level of measured radiances.

Zabel, I. H. H.↗

Nasa Space Flight Instruments: Cost Time Trends

Are NASA’s space flight instruments becoming cheaper or more expensive as time marches forward? After analyzing the costs of hundreds of instruments launched over the last 30 years, the short answer to this question is no… and yes. This paper gives a visual analysis of the cost time trends for various NASA space flight instrument types, such as optical, particles detectors, fields detectors and microwave instruments. In addition to the statistical approaches utilized, such as significance tests, cluster analysis and principle components analysis (PCA), we will also discuss the intangibles which are likely at play, including technological progress, NASA policy and the luck of the draw associated with mission manifests. This analysis was performed as the main driver for the NASA Instrument Cost Model (NICM) recent cost estimating model redesign. Started in 2004, the first version of NICM was based off of instruments launched from 1985-2005, or 20 years’ worth of data. As NICM hit its 10-year anniversary, we wanted to know: should NICM continue to only use the most recent 20 years’ worth of data (1995-2015)? Are instruments becoming cheaper or more expensive as time marches forward? There is evidence in favor of a drop in the median dollar-per-kg value across some instrument types, but little in others. Whereas further research is needed to substantiate, Particles and Optical-Planetary instrument types show moderate to strong evidence of a downward trend in dollar-per-kg. Further research is required to study the nature of this trend (shift, taper, cyclic, etc.). Little evidence for a similar downward trend was detected for Fields or Microwave instruments, or Optical instruments on Earth Orbiting spacecraft. We presented evidence in favor of a drop in the median dollar-per-kg value for Particles and Optical-Planetary instrument types. While similar evidence was weak at best for Fields and Microwave instruments. We can speculate as to the causes for this effect, but we are also equipped to begin to rule out, or at least prioritize, some of the suspected drivers. We observed, for Particles and Optical-Planetary instruments, that perhaps a launch manifest effect was playing part of the role in the observed decrease in dollar-per-kg over the years, noting that the more flagship class missions, which have more money to spend on their instruments, were seen in the earlier years in our data, versus the later years which were dominated by less expensive class missions. However, if this were a dominating driver, would we not have seen the downward trend in the Fields and Microwave instruments as well, which were drawn from that same launch manifest? The fact that we did not observe this helps us rule out the launch manifest effect, and other drivers, such as advances in technology, that seem to be more likely suspects. In that case, however, why would technology advances be helping the Particles and Optical-Planetary instruments only? Why would it not be impacting Optical-Earth Orbiting instruments? Further suspects were looked at as well and ruled out, such as the “Faster, Better, Cheaper”era of NASA development which did not seem to actually impact trends by instrument type on a dollar-perkg scale. VI. Future Work A. Time Series Detailed Statistical Assessment The analysis discussed above sets the foundation for a more rigorous time series analysis of the data. Time series analysis will further explore evidence to-date of time trends for the instrument types which showed the strongest indicators for a decrease in dollar-per-kg: Optical (Planetary) and Particles instruments. More than providing evidence and top-level significance tests, time series analysis would help elucidate what kind of trend that exists in the data, their significance and allow statistically based forecasting (see Figure 10)

Mrozinksi, Joseph↗

Supporting Building Portfolio Investment and Policy Decision Making through an Integrated Building Utility Data Platform

The American Recovery and Reinvestment Act stimulus funding of 2009 for smart grid projects resulted in the tripling of smart meters deployment. In 2012, the Green Button initiative provided utility customers with access to their real-time1 energy usage. The availability of finely granular data provides an enormous potential for energy data analytics and energy benchmarking. The sheer volume of time-series utility data from a large number of buildings also poses challenges in data collection, quality control, and database management for rigorous and meaningful analyses. In this paper, we will describe a building portfolio-level data analytics tool for operational optimization, business investment and policy assessment using 15-minute to monthly intervals utility data. The analytics tool is developed on top of the U.S. Department of Energy’s Standard Energy Efficiency Data (SEED) platform, an open source software application that manages energy performance data of large groups of buildings. To support the significantly large volume of granular interval data, we integrated a parallel time-series database to the existing relational database. The time-series database improves on the current utility data input, focusing on real-time data collection, storage, analytics and data quality control. The fully integrated data platform supports APIs for utility apps development by third party software developers. These apps will provide actionable intelligence for building owners and facilities managers. Unlike a commercial system, this platform is an open source platform funded by the U.S. Government, accessible to the public, researchers and other developers, to support initiatives in reducing building energy consumption.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Statistical Challenges in Modern Astronomy II

Wavelets are the central idea of a broad framework for thinking about displaying, and analyzing data - not just a new specialized technique. They are localized basis functions that provide an extremely flexible and efficient representation of time series. Current developments in the theory and application of wavelets are yielding powerful multiresolution techniques for the analysis of time series and image data. Wavelet methods can effect noise removal. characterization of stochastic behavior, depiction of power spectrum time-variations, and data compression - for time series data, image data, and data of higher dimensions. I review published applications of wavelets in astronomy.

Scargle, Jeffrey D.↗

Using Time Series Segmentation for Deriving Vegetation Phenology Indices from MODIS NDVI Data

Characterizing vegetation phenology is a highly significant problem, due to its importance in regulating ecosystem carbon cycling, interacting with climate changes, and decision-making of croplands managements. While ground based sensors, such as the AmeriFlux sensors, can provide measurements at high temporal resolution (every hour) and can be used to accurately calculate vegetation phenology indices, they are limited to only a few sites. Remote sensing data, such as the Normalized Difference Vegetation Index (NDVI), collected using the MODerate Resolution Imaging Spectroradiometer (MODIS), can provide global coverage, though at a much coarser temporal resolution (16 days). In this study we use data mining based time series segmentation methods to derive phenology indices from NDVI data, and compare it with the phenology indices derived from the AmeriFlux data using a widely used model fitting approach. Results show a significant correlation (as high as 0.60) between the indices derived from these two different data sources. This study demonstrates that data driven methods can be effectively employed to provide realistic estimates of vegetation phenology indices using periodic time series data and has the potential to be used at large spatial scales and for long-term remote sensing data.

Chandola, Varun↗