Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Time Series Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

γ DORADUS PULSATIONS IN THE ECLIPSING BINARY STAR KIC 6048106

We present the Kepler photometry of KIC 6048106, which is exhibiting the O’Connell effect and multiperiodic pulsations. Including a starspot on either of the components, light-curve synthesis indicates that this system is a semi-detached Algol with a mass ratio of 0.211, an orbital inclination of 73.°9, and a large temperature difference of 2534 K. To examine in detail both the spot variations and pulsations, we separately analyzed the Kepler time-series data at the interval of an orbital period in an iterative way. The results reveal that the variable asymmetries of the light maxima can be interpreted as the changes with time of a magnetic cool spot on the secondary component. Multiple frequency analyses were performed in the outside-eclipse light residuals after removal of the binarity effects from the observed Kepler data. We detected 30 frequencies with signal to noise amplitude ratios larger than 4.0, of which six ( f {sub 2}– f {sub 6} and f {sub 10}) can be identified as high-order (17 ≤ n ≤ 25) low-degree ( ℓ = 2) gravity-mode pulsations that were stable during the observing run of 200 days. In contrast, the other frequencies may be harmonic and combination terms. For the six frequencies, the pulsation periods and pulsation constants are in the ranges of 0.352–0.506 days and 0.232–0.333 days, respectively. These values and the position on the Hertzsprung–Russell diagram demonstrate that the primary star is a γ Dor variable. The evolutionary status and the pulsation nature of KIC 6048106 are discussed.

79 ASTRONOMY AND ASTROPHYSICS↗

qFeature

This package contains statistical routines for extracting features from multivariate time-series data which can then be used for subsequent multivariate statistical analysis to identify patterns and anomalous behavior. It calculates local linear or quadratic regression model fits to moving windows for each series and then summarizes the model coefficients across user-defined time intervals for each series. These methods are domain agnostic-but they have been successfully applied to a variety of domains, including commercial aviation and electric power grid data.

Source record↗

qFeature

This package contains statistical routines for extracting features from multivariate time-series data which can then be used for subsequent multivariate statistical analysis to identify patterns and anomalous behavior. It calculates local linear or quadratic regression model fits to moving windows for each series and then summarizes the model coefficients across user-defined time intervals for each series. These methods are domain agnostic-but they have been successfully applied to a variety of domains, including commercial aviation and electric power grid data.

Source record↗

Detecting inhomogeneities in the Twentieth Century Reanalysis over the central United States

The Twentieth Century Reanalysis (20CR), which spans the 138 year period from 1871 to 2008, was intended for a variety of climate applications, including long–term trend assessment. Because over land 20CR only assimilates surface pressure observations and their count increases by an order of magnitude over the course of the record, a key question is whether the 20CR is homogenous and hence suitable for detecting climate–related changes. We use three statistical methods (Pettitt and Bai–Perron tests and segmented regression) to detect abrupt shifts in multiple hydrometeorological variable mean and uncertainty fields over the central United States. For surface air temperature and precipitation, we use the Climate Research Unit (CRU) time series data set for comparison. We find that for warm–season months, there is a consensus change point among all variables between 1940 and 1950, which is not substantiated by the CRU record. While we cannot say with certainty that these shifts in the 20CR analysis fields are artificial, our statistical analyses, coupled with a visual inspection of the underlying assimilated observational count time series, strongly point to this conclusion. Furthermore, our recommendation is therefore for users to restrict climate trend applications over the central United States to the second half century of the 20CR record, after observational density has stabilized.

54 ENVIRONMENTAL SCIENCES↗

Smart Meter Driven Segmentation: What Your Consumption Says About You

With the rollout of smart metering infrastructure at scale, demand-response (DR) programs may now be tailored based on users' consumption patterns as mined from sensed data. For issuing DR events it is key to understand the inter-temporal consumption dynamics as to appropriately segment the user population. We propose to infer occupancy states from consumption time series data using a hidden Markov model framework. Occupancy is characterized in this model by 1) magnitude, 2) duration, and 3) variability. We show that users may be grouped according to their consumption patterns into groups that exhibit qualitatively different dynamics that may be exploited for program enrollment purposes. We investigate empirically the information that residential energy consumers' temporal energy demand patterns characterized by these three dimensions may convey about their demographic, household, and appliance stock characteristics. Our analysis shows that temporal patterns in the user's consumption data can predict with good accuracy certain user characteristics. We use this framework to argue that there is a large degree of individual predictability in user consumption at a population level.

Albert, A↗

Sensitivity Analysis of Drivers Water Shortage in the Los Angeles Region During Drought

The code and detailed step-by-step instructions for generating the model output data, processing results, and analysis and plotting are provided at https://github.com/IMMM-SFA/Ferencz_et_al_2026_ER_Water. The PyArtes model is a python adaptation of the Artes model. PyArtes uses many of the same input data and optimization model architecture as Artes. Documentation for the PyArtes model is provided in the Supplement to the paper. The primary data product are simulated monthly water shortages for indoor and outdoor demand under a large ensemble of drought scenarios (>13,000). The droughts are hypothetical and are not based on historical time series data of supply sources - though historical data did help inform ranges explored for supply parameters. Demands are informed by recent 2017-2021 water supply data. Demands used for the model can be accessed at https://github.com/IMMM-SFA/Ferencz_et_al_2026_ER_Water. Simulations resolve demand for over 90 water providers in the study region. The results report 36 months of water shortage data for each indoor and outdoor demand node. The study also developed a multilayer perceptron (MLP) neural network trained on a subset of the simulated shortage ensemble to emulate worst annual water shortage for a given set of parameter multipliers -- provided the parameter values fall within the ranges sampled in the ensemble. Emulated water shortages for synthetic ensembles are in the MLP-generated shortages folder. The MLP model was used to generate larger ensembles to support Sobol analysis that would have been extremely computationally expensive to simulate. Datasets provided in this repository*: Simulated shortages. These results are used for the analysis for Figures 5, 8, and 9 in the paper, and also to train the MLP emulator. .zip file containing outputs for the 13,312 scenario ensemble. Separate .csv files for indoor and outdoor shortage for each scenario. Rows = demand ids (~100), Columns = months (36) Units = acre-feet/month of shortage (shortage = monthly demand - supply). 1 acft = 1233.48 m^3 .csv files of aggregated shortages derived from the 13,312 ensemble Rows = scenarios (13,312), Columns = demand ids (~100) Units = acre-feet/year (either worst annual shortage or total shortage over the 3-year drought) .csv file of the parameter multipliers scenarios for the ensemble .csv file of the parameter ranges and baseline values the multipliers were applied to MLP-generated shortages. These results are used for Figures 4, 6, and 7 in the paper. mwd higher folder: scenario ensembles, emulated worst year total shortages (acft), and Sobol results Emulated shortages. Rows = scenarios, columns = demand ids, units acft Sobol results. Rows = demand ids, columns Sobol (S1, ST, or 95% confidence interval) value for each parameter mwd lower folder: scenario ensembles, emulated worst year total shortages (acft), and Sobol results same organization as mwd higher MLP performance: performance metrics (R^2, RMSE, BIAS, MAPE) for the testing subset (20% or 2,662 scenarios) and simulated vs emulated worst year shortage (acre-feet/year) for every demand node, MWD wholesale regions, and the entire study region (LAC). Supporting data for figures. Figure plotting scripts in the associated GitHub repo. These files support analysis and visualization. Geospatial Data used for plotting simulated water shortages and Sobol results. Dictionary of full names for demand nodes in the model and estimates of water supply by source type informed by Artes input files and California Urban Water Management Planning data: https://water.ca.gov/Programs/Water-Use-And-Efficiency/Urban-Water-Use-Efficiency/Urban-Water-Management-Plans *Readme files provided for each folder.

drought↗

Climate Sensitivity Studies of the Greenland Ice Sheet Using Satellite AVHRR, SMMR, SSM/I and in Situ Data

The feasibility of using satellite data for climate research over the Greenland ice sheet is discussed. In particular, we demonstrate the usefulness of Advanced Very High Resolution Radiometer (AVHRR) Local Area Coverage (LAC) and Global Area Coverage (GAC) data for narrow-band albedo retrieval. Our study supports the use of lower resolution AVHRR (GAC) data for process studies over most of the Greenland ice sheet. Based on LAC data time series analysis, we can resolve relative albedo changes on the order of 2-5%. In addition, we examine Scanning Multichannel Microwave Radiometer (SMMR) and Special Sensor Microwave Imager (SSM/I) passive microwave data for snow typing and other signals of climatological significance. Based on relationships between in situ measurements and horizontally polarized 19 and 37 GHz observations, wet snow regions are identified. The wet snow regions increase in aerial percentage from 9% of the total ice surface in June to a maximum of 26% in August 1990. Furthermore, the relationship between brightness temperatures and accumulation rates in the northeastern part of Greenland is described. We found a consistent increase in accumulation rate for the northeastern part of the ice sheet from 1981 to 1986.

Steffen, K.↗

DREISS: Using State-Space Models to Infer the Dynamics of Gene Expression Driven by External and Internal Regulatory Networks

Gene expression is controlled by the combinatorial effects of regulatory factors from different biological subsystems such as general transcription factors (TFs), cellular growth factors and microRNAs. A subsystem’s gene expression may be controlled by its internal regulatory factors, exclusively, or by external subsystems, or by both. It is thus useful to distinguish the degree to which a subsystem is regulated internally or externally–e.g., how non-conserved, species-specific TFs affect the expression of conserved, cross-species genes during evolution. We developed a computational method (DREISS, dreiss.gerteinlab.org) for analyzing the Dynamics of gene expression driven by Regulatory networks, both External and Internal based on State Space models. Given a subsystem, the “state” and “control” in the model refer to its own (internal) and another subsystem’s (external) gene expression levels. The state at a given time is determined by the state and control at a previous time. Because typical time-series data do not have enough samples to fully estimate the model’s parameters, DREISS uses dimensionality reduction, and identifies canonical temporal expression trajectories (e.g., degradation, growth and oscillation) representing the regulatory effects emanating from various subsystems. To demonstrate capabilities of DREISS, we study the regulatory effects of evolutionarily conserved vs. divergent TFs across distant species. In particular, we applied DREISS to the time-series gene expression datasets of C. elegans and D. melanogaster during their embryonic development. We analyzed the expression dynamics of the conserved, orthologous genes (orthologs), seeing the degree to which these can be accounted for by orthologous (internal) versus species-specific (external) TFs. We found that between two species, the orthologs have matched, internally driven expression patterns but very different externally driven ones. This is particularly true for genes with evolutionarily ancient functions (e.g. the ribosomal proteins), in contrast to those with more recently evolved functions (e.g., cell-cell communication). This suggests that despite striking morphological differences, some fundamental embryonic-developmental processes are still controlled by ancient regulatory systems.

Biochemistry & Molecular Biology↗

A Data Science and Machine Learning Platform Supporting Large Particle Accelerator Control and Diagnostics Applications Final Report: SBIR Initial Phase II DE-SC0022583

The Machine Learning Data Platform (MLDP) is a product providing full-stack support for data science, Machine Learning, and Artificial Intelligence (ML/AI) applications at particle accelerator and large experimental physics facilities. It supports ML/AI applications from front-end, high-speed acquisition of heterogeneous, time-series data, through data archiving and management, to back-end analysis. The MLDP embodies a “data-science ready” platform for data analysis and ML/AI applications in diagnosis, modelling, control, and optimization of these facilities. It provides data scientists and applications a consistent, datacentric interface to archive data standardizing implementation and deployment of ML/AI algorithms to different operations configurations within the same facility, or between facilities. Being an open-source, public-domain project, the MLDP is intended for broadest possible impact by increasing accessibility and minimizing the required expertise for installation and operation. The MLDP can also be deployed at user facilities for experimental data collection, archiving, and analysis. It is capable of acquisition and archiving of heterogeneous data from experimental equipment (e.g., images, arrays, structures, etc.) along with system hardware configurations (e.g., scalars, tables), control system process variables, and any metadata required for provenance. Thus, the MLDP can manage experimental data through its entire lifecycle, from acquisition and archiving, through analysis and investigation, to release and final publication.

43 PARTICLE ACCELERATORS↗

Antarctic Circumpolar Current Transport Variability during 2003-05 from GRACE

Gravity Recovery and Climate Experiment (GRACE) gravity data spanning January 2003-November 2005 are used as proxies for ocean bottom pressure (BP) averaged over 1 month, spherical Gaussian caps 500 km in radius, and along paths bracketing the Antarctic Circumpolar Current's various fronts. The GRACE BP signals are compared with those derived from the Estimating the Circulation and Climate of the Ocean (ECCO) ocean modeling-assimilation system, and to a non-Boussinesq version of the Regional Ocean Model System (ROMS). The discrepancy found between GRACE and the models is 1.7 cm H2O (1 cm H2O approx. 1 hPa), slightly lower than the 1.9 cmH2O estimated by the authors independently from propagation of GRACE errors. The northern signals are weak and uncorrelated among basins. The southern signals are strong, with a common seasonality. The seasonal cycle GRACE data observed in the Pacific and Indian Ocean sectors of the ACC are consistent, with annual and semiannual amplitudes of 3.6 and 0.6 cmH2O (1.1 and 0.6 cm H2O with ECCO), the average over the full southern path peaks (stronger ACC) in the southern winter, on days of year 197 and 97 for the annual and semiannual components, respectively; the Atlantic Ocean annual peak is 20 days earlier. An approximate conversion factor of 3.1 Sv (Sv equiv 10(exp 6)cu m/s) of barotropic transport variability per cm H2O of BP change is estimated. Wind stress data time series from the Quick Scatterometer (QuikSCAT), averaged monthly, zonally, and over the latitude band 40(deg)- 65(deg)S, are also constructed and subsampled at the same months as with the GRACE data. The annual and semiannual harmonics of the wind stress peak on days 198 and 82, respectively. A decreasing trend over the 3 yr is observed in the three data types.

Gravity Recovery and Climate Experiment (GRACE)↗

Antarctic Circumpolar Current Transport Variability during 2003-05 from GRACE

Gravity Recovery and Climate Experiment (GRACE) gravity data spanning January 2003 - November 2005 are used as proxies for ocean bottom pressure (BP) averaged over 1 month, spherical Gaussian caps 500 km in radius, and along paths bracketing the Antarctic Circumpolar Current's various fronts. The GRACE BP signals are compared with those derived from the Estimating the Circulation and Climate of the Ocean (ECCO) ocean modeling-assimilation system, and to a non-Boussinesq version of the Regional Ocean Model System (ROMS). The discrepancy found between GRACE and the models is 1.7 cm(sub H2O) (1 cm(sub H2O) similar to 1 hPa), slightly lower than the 1.9 cm(sub H2O) estimated by the authors independently from propagation of GRACE errors. The northern signals are weak and uncorrelated among basins. The southern signals are strong, with a common seasonality. The seasonal cycle GRACE data observed in the Pacific and Indian Ocean sectors of the ACC are consistent, with annual and semiannual amplitudes of 3.6 and 0.6 cm(sub H2O) (1.1 and 0.6 cm(sub H2O) with ECCO), the average over the full southern path peaks (stronger ACC) in the southern winter, on days of year 197 and 97 for the annual and semiannual components, respectively; the Atlantic Ocean annual peak is 20 days earlier. An approximate conversion factor of 3.1 Sv ( Sv equivalent to 10(exp 6) m(exp 3) s(exp -1)) of barotropic transport variability per cm(sub H2O) of BP change is estimated. Wind stress data time series from the Quick Scatterometer (QuikSCAT), averaged monthly, zonally, and over the latitude band 40 de - 65 deg S, are also constructed and subsampled at the same months as with the GRACE data. The annual and semiannual harmonics of the wind stress peak on days 198 and 82, respectively. A decreasing trend over the 3 yr is observed in the three data types.

oceanographic regions↗

Leading magnetic fusion energy science into the big-and-fast data lane

To crack the code of unlimited clean energy from magnetic fusion, researchers collaborate among numerous facilities that are scattered around the globe. Probing hot fusion plasmas with sophisticated diagnostics, they routinely generate fast streams of high-dimensional time-series data. We present the adaptation of a production code-base for a plasma diagnostic to the big-and-fast data lane. The new code-base is used to stream measurements, made in Korea, into a Top-15 computing facility in the US for remote analysis. We discuss software and design choices made for this new HPC-enabled scientific workflow.

Kube, Ralph↗

RADIUS DETERMINATION OF SOLAR-TYPE STARS USING ASTEROSEISMOLOGY: WHAT TO EXPECT FROM THE KEPLER MISSION

For distant stars, as observed by the NASA Kepler satellite, parallax information is currently of fairly low quality and is not complete. This limits the precision with which the absolute sizes of the stars and their potential transiting planets can be determined by traditional methods. Asteroseismology will be used to aid the radius determination of stars observed during NASA's Kepler mission. We report on the recent asteroFLAG hare-and-hounds Exercise no. 2, where a group of 'hares' simulated data of F-K main-sequence stars that a group of 'hounds' sought to analyze, aimed at determining the stellar radii. We investigated stars in the range 9 < V < 15, both with and without parallaxes. We further test different uncertainties in T {sub eff}, and compare results with and without using asteroseismic constraints. Based on the asteroseismic large frequency spacing, obtained from simulations of 4 yr time series data from the Kepler mission, we demonstrate that the stellar radii can be correctly and precisely determined, when combined with traditional stellar parameters from the Kepler Input Catalogue. The radii found by the various methods used by each independent hound generally agree with the true values of the artificial stars to within 3%, when the large frequency spacing is used. This is 5-10 times better than the results where seismology is not applied. These results give strong confidence that radius estimation can be performed to better than 3% for solar-like stars using automatic pipeline reduction. Even when the stellar distance and luminosity are unknown we can obtain the same level of agreement. Given the uncertainties used for this exercise we find that the input log g and parallax do not help to constrain the radius, and that T {sub eff} and metallicity are the only parameters we need in addition to the large frequency spacing. It is the uncertainty in the metallicity that dominates the uncertainty in the radius.

99 GENERAL AND MISCELLANEOUS↗

Distribution Function Instead of Steady-State Assumption in Time-Series Simulation

The quasi-steady-state assumption in time-series simulation is inadequate to model phenomena of interest to energy system integration such as inverter clipping, sell-back of excess electricity to a utility and utility hosting capacity, and battery throughput. Researchers are working on stochastic modeling, higher-resolution time series data, and machine learning approaches to address this need. This poster describes a distribution function that allows a maximum value, minimum value, and shape to the curve that can vary within each time-step based only on data inputs at the resolution of that time step (eg. Hourly). The distribution function is not used to synthesize high-resolution data, rather scalar integrals are used to calculate the quantities of interest within each time step. The form of the distribution function shows significant reduction in error when compared to 1 minute data and commercial software employing the distribution function (HOMER Pro version 14.3 and higher) shows a much improved estimate of inverter clipping in an example.

battery↗

Unsupervised Power System Event Detection and Classification Using Unlabeled PMU Data

This paper proposes a novel data-driven power system event detection and classification method based on 5TB of actual PMU measurements collected from the US western interconnect. Firstly, a set of comprehensive power quality rules are proposed to pre-filter the raw data and extract the regions of interest (ROI). Six distinct event categories are defined and corresponding patterns are chosen as references. Meanwhile, detailed characteristics of patterns are summarized to enhance our understanding of the actual events. Then, the time-independent feature vectors are generated by extracting the statistical, temporal, and spectral features from the raw time-series data. Furthermore, an ensemble model is proposed to cluster the events by combining multiple K-means clustering models using a voting strategy. Besides, both system-level and PMU-level clustering models are developed. The accuracy and robustness of the event detection method are further improved through interactive evaluation of the two-level clustering results. This paper summarizes the actual characteristics of each event category and provides a reliable basis for accurate label generation. The experiments demonstrate the effectiveness of the proposed event detection and classification method.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Unsupervised Power System Event Detection and Classification Using Unlabeled PMU Data

This paper proposes a novel data-driven power system event detection and classification method based on 5TB of actual PMU measurements collected from the US western interconnect. Firstly, a set of comprehensive power quality rules are proposed to pre-filter the raw data and extract the regions of interest (ROI). Six distinct event categories are defined and corresponding patterns are chosen as references. Meanwhile, detailed characteristics of patterns are summarized to enhance our understanding of the actual events. Then, the time-independent feature vectors are generated by extracting the statistical, temporal, and spectral features from the raw time-series data. Furthermore, an ensemble model is proposed to cluster the events by combining multiple K-means clustering models using a voting strategy. Besides, both system-level and PMU-level clustering models are developed. The accuracy and robustness of the event detection method are further improved through interactive evaluation of the two-level clustering results. This paper summarizes the actual characteristics of each event category and provides a reliable basis for accurate label generation. The experiments demonstrate the effectiveness of the proposed event detection and classification method.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Anoxia begets anoxia: A positive feedback to the deoxygenation of temperate lakes

Abstract Declining oxygen concentrations in the deep waters of lakes worldwide pose a pressing environmental and societal challenge. Existing theory suggests that low deep‐water dissolved oxygen (DO) concentrations could trigger a positive feedback through which anoxia (i.e., very low DO) during a given summer begets increasingly severe occurrences of anoxia in following summers. Specifically, anoxic conditions can promote nutrient release from sediments, thereby stimulating phytoplankton growth, and subsequent phytoplankton decomposition can fuel heterotrophic respiration, resulting in increased spatial extent and duration of anoxia. However, while the individual relationships in this feedback are well established, to our knowledge, there has not been a systematic analysis within or across lakes that simultaneously demonstrates all of the mechanisms necessary to produce a positive feedback that reinforces anoxia. Here, we compiled data from 656 widespread temperate lakes and reservoirs to analyze the proposed anoxia begets anoxia feedback. Lakes in the dataset span a broad range of surface area (1–126,909 ha), maximum depth (6–370 m), and morphometry, with a median time‐series duration of 30 years at each lake. Using linear mixed models, we found support for each of the positive feedback relationships between anoxia, phosphorus concentrations, chlorophyll a concentrations, and oxygen demand across the 656‐lake dataset. Likewise, we found further support for these relationships by analyzing time‐series data from individual lakes. Our results indicate that the strength of these feedback relationships may vary with lake‐specific characteristics: For example, we found that surface phosphorus concentrations were more positively associated with chlorophyll a in high‐phosphorus lakes, and oxygen demand had a stronger influence on the extent of anoxia in deep lakes. Taken together, these results support the existence of a positive feedback that could magnify the effects of climate change and other anthropogenic pressures driving the development of anoxia in lakes around the world.

54 ENVIRONMENTAL SCIENCES↗

Time and frequency domain analyses of high-frequency hydrologic and chloride data in an east Tennessee watershed

In the realm of sustainability science, it is becoming increasingly important to understand the basal condition of a natural system as well as its long-term behavior. Research is needed to better explain the temporal scaling of water chemistry in streams and watersheds and its relationship with the hydrologic factors that influence its behavior. Persistence of dissolved chemicals in streams has been demonstrated to be linked to certain hydrologic processes, such as interaction between hydrologic units and storage in surface or sub-surface systems. In this study, spectral and wavelet analyses provided a novel theoretical basis for insights into long-term chloride behavior in an east Tennessee watershed. Temporal scaling analyses were conducted on weekly time series data of chloride collected from November 1995 to December 2005 at the West Fork of Walker Branch in Oak Ridge, Tennessee. The objectives of the study were to: evaluate chloride concentration (a conservative solute) to determine the presence of statistical persistence and the relationship of the persistence to hydrologic variables (discharge and rainfall) using time and frequency domain analyses of high-frequency hydrologic and chloride concentration data. Results demonstrated that chloride showed some level of statistical persistence that was influenced by rainfall and/or discharge. Short-term statistical persistence (less than a year) was related to the persistence of rainfall and discharge, whereas long-term statistical persistence (more than a year) was related to the persistence of discharge.

58 GEOSCIENCES↗