Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Time Series Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Multimodal sensor fusion framework for residential building occupancy detection

For several years now, smart building energy systems have been a research area of intensive activity. In light of the increasing need for sustainable buildings and energy systems, this trend motivates an increasing need for a solution to reduce carbon dioxide emissions and improve energy efficiency. This work proposes a high-performing and transferable occupancy detection framework that combines sensor data from different data modalities, including time series environmental data (temperature, humidity, and illuminance), image data, and acoustic energy data using ensemble method. To draw out the best prediction performance in each modality, the proposed framework was developed, including various models that were designed to learn the occupancy patterns reflected in the physical data streams. To tackle the time series environmental data, we designed two variants of an occupancy detection spatiotemporal pattern network (Occ-STPN) that performs both feature level and decision level fusion, respectively. We also propose a new metric; the fading memory mean square error (FMMSE), that provides a fair evaluation and penalization of delayed occupancy predictions. Multiple open-sourced datasets, including the Electricity Consumption and Occupancy and the University of California, Irvine's (UCI) building occupancy detection dataset, along with our own real data collected from six different houses, were used to validate the algorithms' performance. The experimental results presented herein break down the performance for each sensing modality, and a detailed analysis of the performance is also discussed.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Utah FORGE 5-2615: Laboratory Data for Insights on Hydraulic Fracture Closure and Stress Measurement

This dataset includes data from injection/fall-off experiments conducted in controlled laboratory settings. The aim is to investigate the physics governing fracture closure and the associated stress measurements during hydraulic fracturing. These time series data include flow rate, pressure, and volume measurements. These experiments were conducted as part of Utah FORGE Project 5-2615: Thermo-poromechanical Response of Fractured Rock.

15 GEOTHERMAL ENERGY↗
DOE OSTI2022

Building Analytics Tool Deployment at Scale: Benefits, Costs, and Deployment Practices

Buildings are becoming more data-rich. Building analytics tools, including energy information systems (EIS) and fault detection and diagnostic (FDD) tools, have emerged to enable building operators to translate large amounts of time-series data into actionable findings to achieve energy and non-energy benefits. To expedite data analytics adoption and facilitate technology innovation, building owners, technology developers, and researchers need reliable cost–benefit data and evidence-based guidance on deployment practices. This paper fulfills these needs with the energy use and survey data from a wide-ranging research and industry partnership program that covers thousands of buildings installed with analytics tools. The paper indicates that after two years of implementation, organizations using FDD tools and EIS tools achieved 9% and 3% median annual energy savings, respectively. The median base cost and annual recurring cost for FDD are USD 0.65 per square meter (m2) (USD 0.06 per square foot [ft2]) and USD 0.22 per m2 (USD 0.02 per ft2), and are USD 0.11 per m2 (USD 0.01 per ft2) and USD 0.11 per m2 (USD 0.01 per ft2) for EIS. The common metrics and analyses that are used in the tools to support the discovery of energy efficiency measures are summarized in detail. Two best practice examples identified to maximize the benefits of tool implementation are also presented. Opportunities to advance the state of technology include simplified data integration and management, and more efficient processes for acting on analytics outputs. Compared with previous efforts in the literature, the findings presented in this paper demonstrate the effectiveness of building analytics tools with the largest known dataset.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS1992

Digital time series analysis for flutter test data

An application of digital time series analysis to flutter test data processing was conducted. A numerical investigation was used to evaluate the method, as well as its sensitivity to noise and parameter variations. These parameters included those involved with data acquisition, as well as system response characteristics. This digital time series method was then used to predict flutter speed from subcritical response wind tunnel tests. Flutter speeds predicted from forced response, subcritical wind tunnel tests were compared to the experimental flutter speeds.

Batill, S. M.↗
DOE OSTI2026

Sensitivity Analysis of Drivers Water Shortage in the Los Angeles Region During Drought

The code and detailed step-by-step instructions for generating the model output data, processing results, and analysis and plotting are provided at https://github.com/IMMM-SFA/Ferencz_et_al_2026_ER_Water. The PyArtes model is a python adaptation of the Artes model. PyArtes uses many of the same input data and optimization model architecture as Artes. Documentation for the PyArtes model is provided in the Supplement to the paper. The primary data product are simulated monthly water shortages for indoor and outdoor demand under a large ensemble of drought scenarios (>13,000). The droughts are hypothetical and are not based on historical time series data of supply sources - though historical data did help inform ranges explored for supply parameters. Demands are informed by recent 2017-2021 water supply data. Demands used for the model can be accessed at https://github.com/IMMM-SFA/Ferencz_et_al_2026_ER_Water. Simulations resolve demand for over 90 water providers in the study region. The results report 36 months of water shortage data for each indoor and outdoor demand node. The study also developed a multilayer perceptron (MLP) neural network trained on a subset of the simulated shortage ensemble to emulate worst annual water shortage for a given set of parameter multipliers -- provided the parameter values fall within the ranges sampled in the ensemble. Emulated water shortages for synthetic ensembles are in the MLP-generated shortages folder. The MLP model was used to generate larger ensembles to support Sobol analysis that would have been extremely computationally expensive to simulate. Datasets provided in this repository*: Simulated shortages. These results are used for the analysis for Figures 5, 8, and 9 in the paper, and also to train the MLP emulator. .zip file containing outputs for the 13,312 scenario ensemble. Separate .csv files for indoor and outdoor shortage for each scenario. Rows = demand ids (~100), Columns = months (36) Units = acre-feet/month of shortage (shortage = monthly demand - supply). 1 acft = 1233.48 m^3 .csv files of aggregated shortages derived from the 13,312 ensemble Rows = scenarios (13,312), Columns = demand ids (~100) Units = acre-feet/year (either worst annual shortage or total shortage over the 3-year drought) .csv file of the parameter multipliers scenarios for the ensemble .csv file of the parameter ranges and baseline values the multipliers were applied to MLP-generated shortages. These results are used for Figures 4, 6, and 7 in the paper. mwd higher folder: scenario ensembles, emulated worst year total shortages (acft), and Sobol results Emulated shortages. Rows = scenarios, columns = demand ids, units acft Sobol results. Rows = demand ids, columns Sobol (S1, ST, or 95% confidence interval) value for each parameter mwd lower folder: scenario ensembles, emulated worst year total shortages (acft), and Sobol results same organization as mwd higher MLP performance: performance metrics (R^2, RMSE, BIAS, MAPE) for the testing subset (20% or 2,662 scenarios) and simulated vs emulated worst year shortage (acre-feet/year) for every demand node, MWD wholesale regions, and the entire study region (LAC). Supporting data for figures. Figure plotting scripts in the associated GitHub repo. These files support analysis and visualization. Geospatial Data used for plotting simulated water shortages and Sobol results. Dictionary of full names for demand nodes in the model and estimates of water supply by source type informed by Artes input files and California Urban Water Management Planning data: https://water.ca.gov/Programs/Water-Use-And-Efficiency/Urban-Water-Use-Efficiency/Urban-Water-Management-Plans *Readme files provided for each folder.

drought↗
NASA NTRS1993

Climate Sensitivity Studies of the Greenland Ice Sheet Using Satellite AVHRR, SMMR, SSM/I and in Situ Data

The feasibility of using satellite data for climate research over the Greenland ice sheet is discussed. In particular, we demonstrate the usefulness of Advanced Very High Resolution Radiometer (AVHRR) Local Area Coverage (LAC) and Global Area Coverage (GAC) data for narrow-band albedo retrieval. Our study supports the use of lower resolution AVHRR (GAC) data for process studies over most of the Greenland ice sheet. Based on LAC data time series analysis, we can resolve relative albedo changes on the order of 2-5%. In addition, we examine Scanning Multichannel Microwave Radiometer (SMMR) and Special Sensor Microwave Imager (SSM/I) passive microwave data for snow typing and other signals of climatological significance. Based on relationships between in situ measurements and horizontally polarized 19 and 37 GHz observations, wet snow regions are identified. The wet snow regions increase in aerial percentage from 9% of the total ice surface in June to a maximum of 26% in August 1990. Furthermore, the relationship between brightness temperatures and accumulation rates in the northeastern part of Greenland is described. We found a consistent increase in accumulation rate for the northeastern part of the ice sheet from 1981 to 1986.

Steffen, K.↗
DOE OSTI2025

A Data Science and Machine Learning Platform Supporting Large Particle Accelerator Control and Diagnostics Applications Final Report: SBIR Initial Phase II DE-SC0022583

The Machine Learning Data Platform (MLDP) is a product providing full-stack support for data science, Machine Learning, and Artificial Intelligence (ML/AI) applications at particle accelerator and large experimental physics facilities. It supports ML/AI applications from front-end, high-speed acquisition of heterogeneous, time-series data, through data archiving and management, to back-end analysis. The MLDP embodies a “data-science ready” platform for data analysis and ML/AI applications in diagnosis, modelling, control, and optimization of these facilities. It provides data scientists and applications a consistent, datacentric interface to archive data standardizing implementation and deployment of ML/AI algorithms to different operations configurations within the same facility, or between facilities. Being an open-source, public-domain project, the MLDP is intended for broadest possible impact by increasing accessibility and minimizing the required expertise for installation and operation. The MLDP can also be deployed at user facilities for experimental data collection, archiving, and analysis. It is capable of acquisition and archiving of heterogeneous data from experimental equipment (e.g., images, arrays, structures, etc.) along with system hardware configurations (e.g., scalars, tables), control system process variables, and any metadata required for provenance. Thus, the MLDP can manage experimental data through its entire lifecycle, from acquisition and archiving, through analysis and investigation, to release and final publication.

43 PARTICLE ACCELERATORS↗
NASA NTRS2007

Antarctic Circumpolar Current Transport Variability during 2003-05 from GRACE

Gravity Recovery and Climate Experiment (GRACE) gravity data spanning January 2003-November 2005 are used as proxies for ocean bottom pressure (BP) averaged over 1 month, spherical Gaussian caps 500 km in radius, and along paths bracketing the Antarctic Circumpolar Current's various fronts. The GRACE BP signals are compared with those derived from the Estimating the Circulation and Climate of the Ocean (ECCO) ocean modeling-assimilation system, and to a non-Boussinesq version of the Regional Ocean Model System (ROMS). The discrepancy found between GRACE and the models is 1.7 cm H2O (1 cm H2O approx. 1 hPa), slightly lower than the 1.9 cmH2O estimated by the authors independently from propagation of GRACE errors. The northern signals are weak and uncorrelated among basins. The southern signals are strong, with a common seasonality. The seasonal cycle GRACE data observed in the Pacific and Indian Ocean sectors of the ACC are consistent, with annual and semiannual amplitudes of 3.6 and 0.6 cmH2O (1.1 and 0.6 cm H2O with ECCO), the average over the full southern path peaks (stronger ACC) in the southern winter, on days of year 197 and 97 for the annual and semiannual components, respectively; the Atlantic Ocean annual peak is 20 days earlier. An approximate conversion factor of 3.1 Sv (Sv equiv 10(exp 6)cu m/s) of barotropic transport variability per cm H2O of BP change is estimated. Wind stress data time series from the Quick Scatterometer (QuikSCAT), averaged monthly, zonally, and over the latitude band 40(deg)- 65(deg)S, are also constructed and subsampled at the same months as with the GRACE data. The annual and semiannual harmonics of the wind stress peak on days 198 and 82, respectively. A decreasing trend over the 3 yr is observed in the three data types.

Gravity Recovery and Climate Experiment (GRACE)↗
NASA NTRS2006

Antarctic Circumpolar Current Transport Variability during 2003-05 from GRACE

Gravity Recovery and Climate Experiment (GRACE) gravity data spanning January 2003 - November 2005 are used as proxies for ocean bottom pressure (BP) averaged over 1 month, spherical Gaussian caps 500 km in radius, and along paths bracketing the Antarctic Circumpolar Current's various fronts. The GRACE BP signals are compared with those derived from the Estimating the Circulation and Climate of the Ocean (ECCO) ocean modeling-assimilation system, and to a non-Boussinesq version of the Regional Ocean Model System (ROMS). The discrepancy found between GRACE and the models is 1.7 cm(sub H2O) (1 cm(sub H2O) similar to 1 hPa), slightly lower than the 1.9 cm(sub H2O) estimated by the authors independently from propagation of GRACE errors. The northern signals are weak and uncorrelated among basins. The southern signals are strong, with a common seasonality. The seasonal cycle GRACE data observed in the Pacific and Indian Ocean sectors of the ACC are consistent, with annual and semiannual amplitudes of 3.6 and 0.6 cm(sub H2O) (1.1 and 0.6 cm(sub H2O) with ECCO), the average over the full southern path peaks (stronger ACC) in the southern winter, on days of year 197 and 97 for the annual and semiannual components, respectively; the Atlantic Ocean annual peak is 20 days earlier. An approximate conversion factor of 3.1 Sv ( Sv equivalent to 10(exp 6) m(exp 3) s(exp -1)) of barotropic transport variability per cm(sub H2O) of BP change is estimated. Wind stress data time series from the Quick Scatterometer (QuikSCAT), averaged monthly, zonally, and over the latitude band 40 de - 65 deg S, are also constructed and subsampled at the same months as with the GRACE data. The annual and semiannual harmonics of the wind stress peak on days 198 and 82, respectively. A decreasing trend over the 3 yr is observed in the three data types.

oceanographic regions↗
DOE OSTI2020

Leading magnetic fusion energy science into the big-and-fast data lane

To crack the code of unlimited clean energy from magnetic fusion, researchers collaborate among numerous facilities that are scattered around the globe. Probing hot fusion plasmas with sophisticated diagnostics, they routinely generate fast streams of high-dimensional time-series data. We present the adaptation of a production code-base for a plasma diagnostic to the big-and-fast data lane. The new code-base is used to stream measurements, made in Korea, into a Top-15 computing facility in the US for remote analysis. We discuss software and design choices made for this new HPC-enabled scientific workflow.

Kube, Ralph↗
DOE OSTI2022

Distribution Function Instead of Steady-State Assumption in Time-Series Simulation

The quasi-steady-state assumption in time-series simulation is inadequate to model phenomena of interest to energy system integration such as inverter clipping, sell-back of excess electricity to a utility and utility hosting capacity, and battery throughput. Researchers are working on stochastic modeling, higher-resolution time series data, and machine learning approaches to address this need. This poster describes a distribution function that allows a maximum value, minimum value, and shape to the curve that can vary within each time-step based only on data inputs at the resolution of that time step (eg. Hourly). The distribution function is not used to synthesize high-resolution data, rather scalar integrals are used to calculate the quantities of interest within each time step. The form of the distribution function shows significant reduction in error when compared to 1 minute data and commercial software employing the distribution function (HOMER Pro version 14.3 and higher) shows a much improved estimate of inverter clipping in an example.

battery↗
DOE OSTI2021

Unsupervised Power System Event Detection and Classification Using Unlabeled PMU Data

This paper proposes a novel data-driven power system event detection and classification method based on 5TB of actual PMU measurements collected from the US western interconnect. Firstly, a set of comprehensive power quality rules are proposed to pre-filter the raw data and extract the regions of interest (ROI). Six distinct event categories are defined and corresponding patterns are chosen as references. Meanwhile, detailed characteristics of patterns are summarized to enhance our understanding of the actual events. Then, the time-independent feature vectors are generated by extracting the statistical, temporal, and spectral features from the raw time-series data. Furthermore, an ensemble model is proposed to cluster the events by combining multiple K-means clustering models using a voting strategy. Besides, both system-level and PMU-level clustering models are developed. The accuracy and robustness of the event detection method are further improved through interactive evaluation of the two-level clustering results. This paper summarizes the actual characteristics of each event category and provides a reliable basis for accurate label generation. The experiments demonstrate the effectiveness of the proposed event detection and classification method.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Unsupervised Power System Event Detection and Classification Using Unlabeled PMU Data

This paper proposes a novel data-driven power system event detection and classification method based on 5TB of actual PMU measurements collected from the US western interconnect. Firstly, a set of comprehensive power quality rules are proposed to pre-filter the raw data and extract the regions of interest (ROI). Six distinct event categories are defined and corresponding patterns are chosen as references. Meanwhile, detailed characteristics of patterns are summarized to enhance our understanding of the actual events. Then, the time-independent feature vectors are generated by extracting the statistical, temporal, and spectral features from the raw time-series data. Furthermore, an ensemble model is proposed to cluster the events by combining multiple K-means clustering models using a voting strategy. Besides, both system-level and PMU-level clustering models are developed. The accuracy and robustness of the event detection method are further improved through interactive evaluation of the two-level clustering results. This paper summarizes the actual characteristics of each event category and provides a reliable basis for accurate label generation. The experiments demonstrate the effectiveness of the proposed event detection and classification method.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Anoxia begets anoxia: A positive feedback to the deoxygenation of temperate lakes

Abstract Declining oxygen concentrations in the deep waters of lakes worldwide pose a pressing environmental and societal challenge. Existing theory suggests that low deep‐water dissolved oxygen (DO) concentrations could trigger a positive feedback through which anoxia (i.e., very low DO) during a given summer begets increasingly severe occurrences of anoxia in following summers. Specifically, anoxic conditions can promote nutrient release from sediments, thereby stimulating phytoplankton growth, and subsequent phytoplankton decomposition can fuel heterotrophic respiration, resulting in increased spatial extent and duration of anoxia. However, while the individual relationships in this feedback are well established, to our knowledge, there has not been a systematic analysis within or across lakes that simultaneously demonstrates all of the mechanisms necessary to produce a positive feedback that reinforces anoxia. Here, we compiled data from 656 widespread temperate lakes and reservoirs to analyze the proposed anoxia begets anoxia feedback. Lakes in the dataset span a broad range of surface area (1–126,909 ha), maximum depth (6–370 m), and morphometry, with a median time‐series duration of 30 years at each lake. Using linear mixed models, we found support for each of the positive feedback relationships between anoxia, phosphorus concentrations, chlorophyll a concentrations, and oxygen demand across the 656‐lake dataset. Likewise, we found further support for these relationships by analyzing time‐series data from individual lakes. Our results indicate that the strength of these feedback relationships may vary with lake‐specific characteristics: For example, we found that surface phosphorus concentrations were more positively associated with chlorophyll a in high‐phosphorus lakes, and oxygen demand had a stronger influence on the extent of anoxia in deep lakes. Taken together, these results support the existence of a positive feedback that could magnify the effects of climate change and other anthropogenic pressures driving the development of anoxia in lakes around the world.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Quality-Controlled Meteorological Data from the Flood Control District of Maricopa County (FCDMC) Network, Phoenix, Arizona (1987-2024)

This dataset contains 15- or 30-minute interval meteorological data from the Flood Control District of Maricopa County (FCDMC), Arizona, USA, covering eight key variables across multiple sensor stations between 1987 and 2024. Each variable is stored as a separate CSV file, containing time-series data that have undergone rigorous quality control (QC) procedures and, where appropriate, short-gap interpolation for consistency. The quality control (QC) pipeline consisted of four sequential tests: (1) a range test to ensure all values fall within physically realistic limits, (2) a step test to identify abrupt and implausible changes between consecutive records, (3) a proximity test that validates flagged values from step test using data from nearby stations and exceedance probability thresholds, and (4) a persistence test to detect and remove periods of unrealistically constant readings. These thresholds were calibrated to Arizona’s environmental conditions and sensor specifications. After QC, short gaps (≤2 hours) were linearly interpolated to ensure consistent temporal resolution, except for wind variables. Due to a major upgrade in FCDMC’s data transmission system, only ALERT-2 protocol data (2016–2024) for wind variables are included; earlier ALERT-1 data were excluded because of irregular sampling and high missing rates. This dataset supports regional climate and infrastructure resilience studies by providing standardized, high-resolution meteorological data for the greater Phoenix metropolitan area.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Anomaly detection for MPC forecast in Fleet of Water Heaters

Among residential devices, water heaters consume 20% of home energy use in the United States. Water heaters possess the capability to store energy within their reservoirs, enabling the ability to decouple energy use from hot water use. This capability can be used to reduce energy usage and costs while also supporting grid services. This requires accurate forecasting of the parameters of the water heater such as upper and lower temperatures. In this study, we analyzed the performance and behavior of a water heater model used in the real-world to predict a control mechanism that is implemented in a smart residential neighborhood. The model forecasts are accurate in most cases but not all. In such scenarios, error correction of the model is necessary to further improve model predictive control accuracy. Anomaly detection is the first step of error correction. This study complements existing research by grouping time series data into two clusters one with anomalies and another without anomalies. To achieve this task, we explored and compared multiple unsupervised machine learning algorithms to perform clustering. Among these algorithms, Ward clustering has the lowest running time and identified the highest number of anomalies for the upper temperature limit. The proposed approach is tested based on the data collected in a neighborhood with 46 townhomes located in Atlanta, GA.

Lebakula, Viswadeep↗
NASA NTRS1987

Monitoring vegetation using Nimbus-7 scanning mutichannel microwave radiometer's data

Field studies and radiative transfer model calculations have shown that brightness temperature at high microwave frequencies is strongly affected by vegetation. The daytime observations for six consecutive years (1979 to 1984) over the Sahara, Senegalese Sahel, Burkina Fasso (Upper Volta), and U.S. Southern Great Plains at 37 GHz frequency of the Sanning Multichannel Microwave Radiometer (SMMR) on board the Nimbus-7 satellite are analyzed, and a high correlation with the normalized difference vegetation index derived from the Advanced Very High Resolution Radiometer on board the NOAA-7 satellite is found. The SMMR data appear to provide a valuable new long-term global data set for monitoring vegetation. In particular, the differing responses of vegetation (for example, annual grasses versus woody plants) to drought and the stability of the desert/steppe boundary of northern Africa might be studied using the time series data.

Choudhury, B. J.↗
DOE OSTI2020

Machine Learning Based Cavity Fault Classification and Prediction

We report on the development of machine learning models for classifying C100 superconducting radio frequency (SRF) cavity faults in the Continuous Electron Beam Accelerator Facility (CEBAF) at Jefferson Lab. CEBAF is a continuous-wave recirculating linac utilizing 418 SRF cavities to accelerate electrons up to 12 GeV through 5-passes. Of these, 96 cavities (12 cryomodules) are designed with a digital low-level RF system configured such that a cavity fault triggers waveform recordings of 17 RF signals for each of the eight cavities in the cryomodule. Subject matter experts (SME) can analyze the collected time-series data, identify which of the eight cavities faulted first, and classify the type of fault. This information is used to find trends and strategically deploy mitigations to problematic cryomodules. However, manually labeling the data is laborious and time-consuming. By leveraging machine learning, near real-time – rather than post-mortem – identification of the offending cavity and classification of the fault type has been implemented. We discuss the performance of the ML models during a recent physics run.

43 PARTICLE ACCELERATORS↗