Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Time Series Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49

Data-Driven Load Diversity and Variability Modeling for Quasi-Static Time-Series Simulation on Distribution Feeders

This paper presents a data-driven load modeling methodology for distribution system quasi-static time-series (QSTS) simulation considering both diversity and variability characteristics of distribution loads. Based on our previous work in [1]-[2], a variability library and diversity library have been established based on the realistic high-resolution data collected from actual utility feeders. Given the load profile for the start-of-circuit load of a feeder, the loads on the feeder nodes can be modeled with both diversity and variability instead of being directly scaled from the substation load profile according to the distribution allocation factors. With diversified load models, the load-induced impact on the feeder operation characteristics, such as voltage ramp and regulator operations, can be better considered in QSTS simulation. The proposed modeling methodology has been tested on both the IEEE 123-bus feeder and an actual utility feeder model, and the simulation results have demonstrated the merits of deploying the proposed load modeling methodology.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Spatial Study 2022: Surface Water Samples, Cotton Strip Degradation, and Hydrologic Sensor Data across the Yakima River Basin, Washington, USA (v3)

This dataset supports a broader study examining the drivers of spatial variability in sediment respiration rates in the Yakima River Basin. The dataset provides data and photos generated from sample collection during the same one-week period at 48 sites within multiple rivers throughout the Yakima River Basin in Washington, USA. The contents include surface water geochemistry data; river substrate grain size photos; stream depth data; manual chamber open channel respiration data; and field metadata (including qualitative information on instream and river corridor characteristics). Grain size photos can be used to improve estimates of channel substrate D50 data. The dataset also includes tensile strength and photos from cotton strip field degradation experiments; five-week sensor time series temperature, dissolved oxygen, pressure, pH, specific conductance, chlorophyll A, and turbidity data; plots of the sensor data; and R scripts used to generate the plots. Samples collected during this study were labeled as “Second Spatial Study” or “SSS.” A subset of data from the SSS samples were published in the contiguous United States (CONUS)-Scale Model-Sample (CM) study data package available at https://data.ess-dive.lbl.gov/view/doi:10.15485/1923689 that presents data from across the CONUS. SSS data published in the CM data package were not included in this data package. They include dissolved organic carbon (DOC, measured as non-purgeable organic carbon, NPOC), total nitrogen (TN), grain size, aerobic sediment respiration, dissolved oxygen (DO), and temperature. Parent IDs and Site IDs are consistent between the SSS and CM data packages, and they can be mapped directly so data across packages can be used together. Additionally, sensor data from a similar 2021 spatial study can be found at https://data.ess-dive.lbl.gov/view/doi:10.15485/1892052 and 2021 sample data can be found at https://data.ess-dive.lbl.gov/view/doi:10.15485/1898914. The 2021 spatial study had some sites in common with this 2022 spatial study. This dataset is comprised of three photo folders and one main data folder with six subfolders. The photo folders contain photographs and videos of cotton strip retrieval and sediment quadrats. The main data folder consists of (1) file-level metadata; (2) data dictionary; (3) field metadata; (4) total suspended solids (TSS) data and cotton strip tensile strength data and averages; (5) field protocol; (6) readme; (7) methods codes; (8) international generic sample number (IGSN) mapping file; (9) sensor installation methods summary; (10) stream depth and averages; and (11) Ultrameter data and averages. The Sonar subfolder consists of Sonar time-series depth data and a processing script. The BarotrollAtm, DepthHOBO, MantaRiver, miniDOT, and miniDOTManualChamber subfolders contain time-series data, plots, and summary files. All files are .csv, .pdf, .txt, .R, .Rmd, .jpg, .jpeg, .AVI, .mp4, or .mov. The data package was originally published in April 2023. It was updated in August 2023 (v2; modified files) and September 2024 (v3; modified files). See the change history section in the readme for details. We acknowledge the Yakama Nation as owners and caretakers of the lands where we collected these data. We thank the Confederated Tribes and Bands of the Yakama Nation Tribal Council and Yakama Nation Fisheries for working with us to facilitate sample collection and optimization of data usage according to their values and worldview.

54 ENVIRONMENTAL SCIENCES↗

A Data-Driven Pivot-Point-Based Time-Series Feeder Load Disaggregation Method

The load profile at a feeder-head is usually known to utility engineers while the nodal load profiles are not. However, the nodal load profiles are increasingly important for conducting time-series analysis in distribution systems. Therefore, in this paper, we present a pivot-point based, two-stage feeder load disaggregation algorithm using smart meter data. The two stages are load profile selection (LPS) and load profile allocation (LPA). In the LPS stage, a random load profile selection process is first executed to meet the load diversity requirement. Then, a few pairs of pivot points are selected as the matching targets. After that, a matching algorithm will run repetitively to select one load profile at a time for matching the reference load profile at the pivot points. In the LPA stage, the LPS selected load profiles are allocated to each load node on the feeder considering distribution transformer loading limits, load composition, and square-footage. The proposed method is validated using actual data collected in a North Carolina service area. Finally, simulation results show that the proposed method can generate a unique load shape for each load node while match the shape of their aggregated profile with the actual feeder head load profile.

42 ENGINEERING↗

University of Massachusetts Marine Renewable Energy Center Waverider Buoy Data

The compressed (.zip) file contains Datawell MK-III Directional Waverider binary and unpacked data files as well as a description of the data and manuals for the instrumentation. The data files are contained in the two directories within the zip file, "Apr_July_2012" and "Jun_Sept_2013". Time series and summary data were recorded in the buoy to binary files with extensions '.RDT' and '.SDT', respectively. These are located in the subdirectories 'Data_Raw' in each of the top-level deployment directories. '.RDT' files contain 3 days of time series (at 1.28 Hz) in 30 minute "bursts". Each '.SDT' file contains summary statistics for the month indicated computed at half-hour intervals for each burst. Each deployment directory also contains a description (in 'File.list') of the Datawell binary data files, and a figure ('Hs_vs_yearday') showing the significant wave height associated with each .RDT file (decoded from the filename). The corresponding unpacked Matlab .mat files are contained in the subdirectories 'Data_Mat'. These files have the extension '.mat' but use the root filename of the source .RDT and .SDT files.

16 TIDAL AND WAVE POWER↗

POD Model Reconstruction for Gray-Box Fault Detection

Proper orthogonal decomposition (POD) is the mathematical basis of a method of constructing low-order mathematical models for the "gray-box" fault-detection algorithm that is a component of a diagnostic system known as beacon-based exception analysis for multi-missions (BEAM). POD has been successfully applied in reducing computational complexity by generating simple models that can be used for control and simulation for complex systems such as fluid flows. In the present application to BEAM, POD brings the same benefits to automated diagnosis. BEAM is a method of real-time or offline, automated diagnosis of a complex dynamic system.The gray-box approach makes it possible to utilize incomplete or approximate knowledge of the dynamics of the system that one seeks to diagnose. In the gray-box approach, a deterministic model of the system is used to filter a time series of system sensor data to remove the deterministic components of the time series from further examination. What is left after the filtering operation is a time series of residual quantities that represent the unknown (or at least unmodeled) aspects of the behavior of the system. Stochastic modeling techniques are then applied to the residual time series. The procedure for detecting abnormal behavior of the system then becomes one of looking for statistical differences between the residual time series and the predictions of the stochastic model.

Park, Han↗

Augmenting Landsat time series with Harmonized Landsat Sentinel-2 data products: Assessment of spectral correspondence

An increase in the temporal revisit of satellite data is often sought to increase the likelihood of obtaining cloud- and shadow-free observations as well as to improve mapping of rapidly- or seasonally-changing features. Currently, as a tandem, Landsat-7 Enhanced Thematic Mapper Plus (ETM+) and −8 Operational Land Imager (OLI) provide an acquisition opportunity on an 8-day revisit interval. Sentinel-2A and -2B MultiSpectral Instrument (MSI), with a wider swath, have a 5-day revisit interval at the equator. Due to robust pre- and post-launch cross-calibration, it has been possible for NASA to produce the Harmonized Landsat Sentinel-2 (HLS) data product from Landsat-8 OLI and Sentinel-2 MSI: L30 and S30, respectively. Knowledge of the agreement of HLS outputs (especially S30) with historic Landsat surface reflectance products will inform the ability to integrate historic time-series information with new and more frequent measures as delivered by HLS. In this research, we control for acquisition date and data source to cross-compare the HLS data (L30, S30) with established Landsat-8 OLI surface-reflectance measures as delivered by the USGS (hereafter BAP, Best Available Pixel). S30 and L30 were found to have high agreement (R = 0.87–0.96) for spectral channels and an r = 0.99 for Normalized Burn Ratio (NBR) with low relative root-mean-square difference values (1.7%–3.3%). Agreement between L30 and BAP was lower, with R values ranging from 0.85 to 0.92 for spectral channels and R = 0.94 for NBR. S30 and BAP had the lowest agreement, with R values ranging from 0.71 to 0.85 for spectral channels and r = 0.90 for NBR. Comparisons indicated a stronger agreement at latitudes above 55° N. Some dependency between spectral agreement and land cover was found, with stronger correspondence for non-vegetated cover types. The level of agreement between S30 and BAP reported herein would enable integration of HLS outputs with historic Landsat data. The resulting increased temporal frequency of data allows for improvements to current cloud screening practices and increases data density and the likelihood of temporal proximity to target date for pixel compositing approaches. Furthermore, additional within-year observations will enable change products with a higher temporal fidelity and allow for the incorporation of phenological trends into land cover classification algorithms.

Michael A. Wulder↗

Analysis of Wind Power and Load Data at Multiple Time Scales

In this study we develop and apply new methods of data analysis for high resolution wind power and system load time series, to improve our understanding of how to characterize highly variable wind power output and the correlations between wind power and load. These methods are applied to wind and load data from the ERCOT region, and wind power output from the PJM and NYISO areas. We use a wavelet transform to apply mathematically well-defined operations of smoothing and differencing to the time series data. This approach produces a set of time series of the changes in wind power and load (or ?deltas?), over a range of times scales from a few seconds to approximately one hour. A number of statistical measures of these time series are calculated. We present sample distributions, and devise a method for fitting the empirical distribution shape in the tails. We also evaluate the degree of serial correlation, and linear correlation between wind and load. Our examination of the data shows clearly that the deltas do not follow a Gaussian shape; the distribution is exponential near the center and appears to follow a power law for larger fluctuations. Gaussian distributions are frequently used in modeling studies. These are likely to over-estimate the probability of small to moderate deviations. This in turn may lead to an over-estimation of the additional reserve requirement (hence the cost) for high penetration of wind. The Gaussian assumption provides no meaningful information about the real likelihood of large fluctuations. The possibility of a power law distribution is interesting because it suggests that the distribution shape for of wind power fluctuations may become independent of system size for large enough systems.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Comparison of Clustering Techniques for Residential Energy Behavior using Smart Meter Data

Current practice in whole time series clustering of residential meter data focuses on aggregated or subsampled load data at the customer level, which ignores day-to-day differences within customers. This information is critical to determine each customer’s suitability to various demand side management strategies that support intelligent power grids and smart energy management. Clustering daily load shapes provides fine-grained information on customer attributes and sources of variation for subsequent models and customer segmentation. In this paper, we apply 11 clustering methods to daily residential meter data. We evaluate their parameter settings and suitability based on 6 generic performance metrics and post-checking of resulting clusters. Finally, we recommend suitable techniques and parameters based on the goal of discovering diverse daily load patterns among residential customers. To the authors’ knowledge, this paper is the first robust comparative review of clustering techniques applied to daily residential load shape time series in the power systems’ literature.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Decadal-Scale Responses in Middle and Upper Stratospheric Ozone From SAGE II Version 7 Data

Stratospheric Aerosol and Gas Experiment (SAGE II) version 7 (v7) ozone profiles are analyzed for their decadal-scale responses in the middle and upper stratosphere for 1991 and 1992-2005 and compared with those from its previous version 6.2 (v6.2). Multiple linear regression (MLR) analysis is applied to time series of its ozone number density vs. altitude data for a range of latitudes and altitudes. The MLR models that are fit to the time series data include a periodic 11 yr term, and it is in-phase with that of the 11 yr, solar UV (Ultraviolet)-flux throughout most of the latitude/ altitude domain of the middle and upper stratosphere. Several regions that have a response that is not quite in-phase are interpreted as being affected by decadal-scale, dynamical forcings. The maximum minus minimum, solar cycle (SClike) responses for the ozone at the low latitudes are similar from the two SAGE II data versions and vary from about 5 to 2.5% from 35 to 50 km, although they are resolved better with v7. SAGE II v7 ozone is also analyzed for 1984-1998, in order to mitigate effects of end-point anomalies that bias its ozone in 1991 and the analyzed results for 1991-2005 or following the Pinatubo eruption. Its SC-like ozone response in the upper stratosphere is of the order of 4%for 1984-1998 vs. 2.5 to 3%for 1991-2005. The SAGE II v7 results are also recompared with the responses in ozone from the Halogen Occultation Experiment (HALOE) that are in terms of mixing ratio vs. pressure for 1991-2005 and then for late 1992- 2005 to avoid any effects following Pinatubo. Shapes of their respective response profiles agree very well for 1992-2005. The associated linear trends of the ozone are not as negative in 1992-2005 as in 1984-1998, in accord with a leveling off of the effects of reactive chlorine on ozone. It is concluded that the SAGE II v7 ozone yields SC-like ozone responses and trends that are of better quality than those from v6.2.

Remsberg, E. E.↗

California - Quality-Controlled Reanalysis and Observational Data for Buoy (130), Morro Bay / Derived Data

This collection provides spatiotemporally paired reanalysis and satellite data to supplement the lidar buoy observations during the California deployments. Point time series of observed and reanalysis data are provided, using inverse distance weighting to geolocate the reanalysis data to the buoy location. Gridded time series of reanalysis data are provided, covering the California coast and extending into the Pacific Ocean. Satellite data in the coastal California region are also provided. The reanalysis collection includes the Modern-Era Retrospective Analysis for Research and Applications version 2 (MERRA-2), the Climate Forecast System version 2 (CFSv2), the North American Regional Reanalysis (NARR), the European Centre for Medium-Range Weather Forecasts Reanalysis version 5 (ERA5), and the analysis system of the Rapid Refresh (RAP). The satellite data collection is that of Ribal and Young (2019). All datasets are publicly available with the sources provided in the References section.

17 WIND ENERGY↗

California - Quality-controlled Reanalysis and Observational Data for Buoy (120), Humboldt / Derived Data

This collection provides spatiotemporally paired reanalysis and satellite data to supplement the lidar buoy observations during the California deployments. Point time series of observed and reanalysis data are provided, using inverse distance weighting to geolocate the reanalysis data to the buoy location. Gridded time series of reanalysis data are provided, covering the California coast and extending into the Pacific Ocean. Satellite data in the coastal California region are also provided. The reanalysis collection includes the Modern-Era Retrospective Analysis for Research and Applications version 2 (MERRA-2), the Climate Forecast System version 2 (CFSv2), the North American Regional Reanalysis (NARR), the European Centre for Medium-Range Weather Forecasts Reanalysis version 5 (ERA5), and the analysis system of the Rapid Refresh (RAP). The satellite data collection is that of Ribal and Young (2019). All datasets are publicly available with the sources provided in the References section.

17 WIND ENERGY↗

Geophysical parameters from the analysis of laser ranging to Starlette

The University of Texas Center for Space Research (UT/CSR) research efforts covering the time period from August 1, 1990 through January 31, 1991 have concentrated on the following areas: (1) Laser Data Processing (more than 15 years of Starlette data (1975-90) have been processed and cataloged); (2) Seasonal Variation of Zonal Tides (observed Starlette time series has been compared with meteorological data-derived time series); (3) Ocean Tide Solutions . (error analysis has been performed using Starlette and other tide solutions); and (4) Lunar Deceleration (formulation to compute theoretical lunar deceleration has been verified and applied to several tidal solutions). Concise descriptions of research achievement for each of the above areas are given. Copies of abstracts for some of the publications and conference presentations are included in the appendices.

Schutz, B. E.↗

Accelerated Data Analytics for Power-System Time-Series (ADAPT) [Final Project Report]

Over the past decade, electric utilities have made significant progress in deploying networks of phasor measurement units (PMUs). The high-speed measurements provided by PMUs are valuable for offline analysis, but the sheer volume of data presents a challenge for utilities. The Accelerated Data Analytics for Power-System Time-Series (ADAPT) project was created to address this challenge by developing SciSync, an open-source software tool that enables utilities to rapidly read, process, analyze, and review grid measurements. SciSync was designed to provide the capabilities of Archive Walker, a research tool developed by PNNL, along with the reliability and performance of commercial-grade software.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Physiological and genomic evidence of cysteine degradation and aerobic hydrogen sulfide production in freshwater bacteria

The sulfur-containing amino acid cysteine is abundant in the environment, including in freshwater lakes. Biological cysteine degradation can result in hydrogen sulfide (H 2 S), a toxic and ecologically relevant compound that is a central player in biogeochemical cycling in aquatic environments. Here, we investigated the ecological significance of cysteine in oxic freshwater, using isolated cultures, controlled experiments, and multiomics. We screened bacterial isolates enriched from natural lake water for their ability to produce H 2 S when provided cysteine. We identified 29 isolates (Bacteroidota, Proteobacteria, and Actinobacteria) that produced H 2 S. To understand the genomic and genetic basis for cysteine degradation and H 2 S production, we further characterized three isolates using whole-genome sequencing (using a combination of short-read and long-read sequencing) and tracked cysteine and H 2 S levels over their growth ranges: Stenotrophomonas maltophilia (Gammaproteobacteria), S. bentonitica (Gammaproteobacteria), and Chryseobacterium piscium (Bacteroidota). Cysteine decreased and H 2 S increased, and all three genomes had genes involved in cysteine degradation. Finally, to assess the presence of these organisms and genes in the environment, we surveyed a 5-year time series of metagenomic data from the same isolation source (Lake Mendota, Madison, WI, USA) and identified their presence throughout the time series. Overall, our study shows that diverse isolated bacterial strains can use cysteine and produce H 2 S under oxic conditions, and we show evidence using metagenomic data that this process may occur more broadly in natural freshwater lakes. Future considerations of sulfur cycling and biogeochemistry in oxic environments should account for H 2 S production from the degradation of organosulfur compounds.

59 BASIC BIOLOGICAL SCIENCES↗

Data-Driven Load Diversity and Variability Modeling for Quasi-Static Time-Series Simulation on Distribution Feeders: Preprint

This paper presents a data-driven load modeling methodology for distribution system quasi-static time-series (QSTS) simulation considering both diversity and variability characteristics of distribution loads. Based on our previous work in [1]-[2], a variability library and diversity library have been established based on the realistic high-resolution data collected from actual utility feeders. Given the load profile for the start-of-circuit load of a feeder, the loads on the feeder nodes can be modeled with both diversity and variability instead of being directly scaled from the substation load profile according to the distribution allocation factors. With diversified load models, the load-induced impact on the feeder operation characteristics, such as voltage ramp and regulator operations, can be better considered in QSTS simulation. The proposed modeling methodology has been tested on both the IEEE 123-bus feeder and an actual utility feeder model, and the simulation results have demonstrated the merits of deploying the proposed load modeling methodology.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Stoichiometrically-informed symbolic regression for extracting chemical reaction mechanisms from data

A data-driven computational method is introduced to extract chemical reaction mechanisms from time series chemical concentration data. It is realized through the use of dynamic symbolic regression in which a sparse analytical form for a dynamical system is discoverable from the underlying data. We specifically develop the stoichiometrically-informed symbolic regression (SISR) method to address a standing challenge in complex chemical reaction networks: given a time-series dataset of concentrations of several components, what is the mechanism and the associated rate constants? SISR finds the optimal mechanism, kinetic equations and rate constants by combining differential optimization with a genetic optimization approach that searches a symbolic space of possible reaction mechanisms. Use of SISR in several paradigmatic examples spanning linear and nonlinear reaction schemes results in excellent agreement between true and predicted mechanisms, including when the method is applied to noisy data. The advantages of a stoichiometrically-informed approach such as SISR to address reaction discovery is illustrated through comparison with the use of generic state-of-the-art data-driven approaches.

36 MATERIALS SCIENCE↗

Analysis of brain patterns using temporal measures

A set of brain data representing a time series of neurophysiologic activity acquired by spatially distributed sensors arranged to detect neural signaling of a brain (such as by the use of magnetoencephalography) is obtained. The set of brain data is processed to obtain a dynamic brain model based on a set of statistically-independent temporal measures, such as partial cross correlations, among groupings of different time series within the set of brain data. The dynamic brain model represents interactions between neural populations of the brain occurring close in time, such as with zero lag, for example. The dynamic brain model can be analyzed to obtain the neurophysiologic assessment of the brain. Data processing techniques may be used to assess structural or neurochemical brain pathologies.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Coherent structure in solar wind C{sup 6+}/C{sup 4+} ionic composition data during the quiet-sun conditions of 2008

This analysis offers evidence of characteristic scale sizes in solar wind charge state data measured in situ for 13 quiet-Sun Carrington rotations in 2008. Using a previously established novel methodology, we analyze the wavelet power spectrum of the charge state ratio C{sup 6+}/C{sup 4+} measured in situ by ACE/SWICS for 2 hr and 12 minute cadence. We construct a statistical significance level in the wavelet power spectrum to quantify the interference effects arising from filling missing data in the time series, allowing extraction of significant power from the measured data to a resolution of 24 minutes. We analyze each wavelet power spectrum for transient coherency and global periodicities resulting from the superposition of repeating coherent structures. From the significant wavelet power spectra, we find evidence for a general upper limit on individual transient coherency of ∼10 days. We find evidence for a set of global periodicities between 4-5 hr and 35-45 days. We find evidence for the distribution of individual transient coherency scales consisting of two distinct populations. Below the ∼2 day timescale, the distribution is reasonably approximated by an inverse power law, whereas for scales ≳2 days, the distribution levels off, showing discrete peaks at common coherency scales. In addition, by organizing the transient coherency scale distributions by wind type, we find that these larger, common coherency scales are more prevalent and well defined in coronal hole wind. Finally, we discuss the implications of our results for current theories of solar wind generation and describe future work for determining the relationship between the coherent structures in our ionic composition data and the structure of the coronal magnetic field.

79 ASTRONOMY AND ASTROPHYSICS↗