Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “time series analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

Post-fire time series photos from five sites across the Oak Creek watershed, Washington

This dataset supports a broader study examining wildfire impacts on hydrologic connectivity across 5 sites within the Oak Creek watershed and the resulting biogeochemical impacts. Sites were selected using the Advanced Terrestrial Simulator (ATS) hydrologic model to identify locations with varying groundwater contributions and hydrologic responses across different burn severity scenarios. The Retreat Fire burned from July 23 to August 2, 2024, affecting all five sites. This dataset provides time series game camera photos, while the broader study includes continuous water quality monitoring, biogeochemical sampling of water and soils, precipitation data, and organic matter analysis. The other data types and additional metadata (include site environmental information) can be found at https://data.ess-dive.lbl.gov/datasets/doi:10.15485/3018020. Because this study is ongoing, this data package will be updated regularly to include newly collected photos. For details on how to navigate data packages generated by this project, see https://data.ess-dive.lbl.gov/portals/PNNLRiverCorridorSFA/About. In addition to a readme, this data package also includes a file-level metadata (FLMD) file that describes each file and a data dictionary (DD) that describes all column/row headers and variable definitions. This dataset is comprised of (1) file-level metadata; (2) data dictionary; (3) field metadata; (4) readme; (5) field protocol; and (6) folders of game camera photos. The game camera photos are organized by site with subfolders by month of collection. The field metadata contains a subset of the information collected that is most relevant to photo-processing. The full set of field metadata can be found at https://data.ess-dive.lbl.gov/datasets/doi:10.15485/3018020. All files are .csv, .pdf, or .jpg.

Burn severity↗

Improving the accuracy of angular-momentum projection

A connection is established between Ullah's new method of angular-momentum projection and the conventional Hill-Wheeler method. They are studied for the case where series truncation of some sort is required. It is shown that for a particular choice of angles, the analysis simplifies greatly and at the same time leads to reduced truncation error.

Ford, W. F.↗

Prediction limits for foF2

Some of the factors limiting the prediction of foF2 are investigated using median and hourly foF2 values recorded at stations in the Australian ionosonde network. Different time and spatial scales together with different levels of solar and geomagnetic activity are considered. All data used in the analysis are displayed in a series of scatter diagrams which provide an overall view of the accuracy limits for foF2 predictions.

Wilkinson, P. J.↗

Excitation of the Earth's Chandler wobble by southern oscillation/El Nino, 1900-1979

The southern oscillation/El Nino (ENSO) is the single most prominent interannual signal in global atmospheric/oceanic fluctuations. The following question is addressed: how important is the angular momentum carried by ENSO in exciting the Earth's Chandler wobble? The question is attacked through a statistical analysis of the coherence spectra (correlation as a function of frequency) between two data sets spanning 1900 to 1979-the southern oscillation index (SOI) time series and the excitation function psi (with x-component psi sub x and y-component psi sub y) of the Chandler wobble derived from the homogeneous ILS (International Latitude Service) polar motion data. The coherence power and phase in the Chandler frequency band (approx. 0.79 to 0.89 cpy) are studied. It is found that, during 1900 to 1979 the coherence between SOI and psi sub x is significant well over the 95% confidence threshold whereas that between SOI and psi sub y is practically nil. Quantitatively, the coherence study shows that ENSO provides some 20% of the observed Chandler wobble excitation power. Since earlier investigations have shown that the total atmospheric/oceanic variation can account for the Chandler wobble excitation at about 20% level, the implication is that ENSO maybe an important (interannual) part of the atmospheric/oceanic variation that is responsible for the Chandler wobble excitation during 1900 to 1979.

Chao, B. F.↗

Assessing Sensitivity of MERRA-2 to AMSU-A in the Upper Stratosphere

Microwavetemperaturesounders provide key observationsin data assimilation, both in the 9current and historical global observing systems, as they provide the largest amount of horizontal and vertical temperature information due to their insensitivity to clouds. In the Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2),microwave sounder radiances from the Advanced Microwave Sounding Unit-A (AMSU-A)are assimilated beginning with NOAA-15and continuing through the current period. The time series of observation minus background statistics forAMSU-A channels sensitive to upper stratosphere and lower mesosphere show variabilities due to changes in AMSU-A constellation in the early AMSU-A period.Noted discrepancies are seen at the onset and exit of AMSU-A observations on the NOAA-15, NOAA-16, NOAA-17, and NASA EOS Aqua satellites.This effort characterizesthesensitivity, both in terms of the observations and the MERRA-2 analysis. Furthermore, it exploresthe use of reprocessed and inter-calibrated datasets to evaluatewhether these homogenized observations can reduce the disparity due to change in instrumental biases against the model background. The results indicate that the AMSU-A radiances used in MERRA-2 are the fundamental cause of this inter-platform sensitivitywhich can be mitigated by using reprocessed data.The results explore the importance of the reprocessing of the AMSU-A radiances as well as their inter-calibration.

MERRA-2↗

Prediction of chronic kidney disease progression using recurrent neural network and electronic health records

Chronic kidney disease (CKD) is a progressive loss in kidney function. Early detection of patients who will progress to late-stage CKD is of paramount importance for patient care. To address this, we develop a pipeline to process longitudinal electronic heath records (EHRs) and construct recurrent neural network (RNN) models to predict CKD progression from stages II/III to stages IV/V. The RNN model generates predictions based on time-series records of patients, including repeated lab tests and other clinical variables. Our investigation reveals that using a single variable, the recorded estimated glomerular filtration rate (eGFR) over time, the RNN model achieves an average area under the receiver operating characteristic curve (AUROC) of 0.957 for predicting future CKD progression. When additional clinical variables, such as demographics, vital information, lab test results, and health behaviors, are incorporated, the average AUROC increases to 0.967. In both scenarios, the standard deviation of the AUROC across cross-validation trials is less than 0.01, indicating a stable and high prediction accuracy. Our analysis results demonstrate the proposed RNN model outperforms existing standard approaches, including static and dynamic Cox proportional hazards models, random forest, and LightGBM. The utilization of the RNN model and the time-series data of previous eGFR measurements underscores its potential as a straightforward and effective tool for assessing the clinical risk of CKD patients concerning their disease progression.

60 APPLIED LIFE SCIENCES↗

Characterization of the Crab Pulsar's Timing Noise

We present a power spectral analysis of the Crab pulsar's timing noise, mainly using radio measurements from Jodrell Bank taken over the period 1982-1989, an interval bounded by sparse data sampling and a large glitch. The power spectral analysis is complicated by nonuniform data sampling and the presence of a steep red power spectrum that can distort power spectra measurement by causing severe power 'leakage'. We develop a simple windowing method for computing red noise power spectra of uniformly sampled data sets and test it on Monte Carlo generated sample realizations of red power-law noise. We generalize time-domain methods of generating power-law red noise with even integer spectral indices to the case of noninteger spectral indices. The Jodrell Bank pulse phase residuals are dense and smooth enough that an interpolation onto a uniform time series is possible. A windowed power spectrum is computed revealing a periodic or nearly periodic component with a period of 568 +/- 10 days and a l/f(exp 3) power-law noise component in pulse phase with a noise strength S(sub infinity)=(1.24 +/- 0.067) x 10(exp 16) cycles(exp 2)/sec(exp 2) over the analysis frequency range f=0.003- 0.1 cycles/day. This result deviates from past analyses which characterized the pulse phase timing residuals as either l/f(sub 4) power-law noise or a quasiperiodic process. The analysis was checked using the Deeter polynomial method of power spectrum estimation that was developed for the case of nonuniform sampling, but has lower spectral resolution. The timing noise is consistent with a torque noise spectrum rising with analysis frequency as f implying blue torque noise, a result not predicted by current models of pulsar timing noise. If the periodic or nearly periodic component is due to a binary companion, we find a mass function f(M) = (6.8 +/- 2.4) x 10(exp -16) solar mass and a companion mass, M(sub c) is greater than or equal to 3.2 solar mass assuming a Crab pulsar mass of 1.4 solar mass.

Scott, D. M.↗

Failure diagnosis and trend‐based performance losses routines for the detection and classification of incidents in large‐scale photovoltaic systems

Abstract Fault detection and classification in photovoltaic (PV) systems through real‐time monitoring is a fundamental task that ensures quality of operation and significantly improves the performance and reliability of operating systems. Different statistical and comparative approaches have already been proposed in the literature for fault detection; however, accurate classification of fault and loss incidents based on PV performance time series remains a key challenge. Failure diagnosis and trend‐based performance loss routines were developed in this work for detecting PV underperformance and accurately identifying the different fault types and loss mechanisms. The proposed routines focus mainly on the differentiation of failures (e.g., inverter faults) from irreversible (e.g., degradation) and reversible (e.g., snow and soiling) performance loss factors based on statistical analysis. The proposed routines were benchmarked using historical inverter data obtained from a 1.8 MWp PV power plant. The results demonstrated the effectiveness of the routines for detecting failures and loss mechanisms and the capability of the pipeline for distinguishing underperformance issues using anomaly detection and change‐point (CP) models. Finally, a CP model was used to extract significant changes in time series data, to detect soiling and cleaning events and to estimate both the performance loss and degradation rates of fielded PV systems.

14 SOLAR ENERGY↗

The substantial role of May soil temperature over Central Asia for summer surface air temperature variation and prediction over Northeastern China

The slowly varying soil temperature can exert local and nonlocal influences on regional climate system, and may thus provide a critical source of subseasonal-to-seasonal climate prediction. In this study, we identify that soil temperature in May over the key region of Central Asia (42 °N–50 °N, 62 °E–80 °E, KRCA) from Noah, Mosaic, CLM and ERA-interim datasets is closely linked to variations of the surface air temperature, daily maximum temperature and hot days over Northeastern China in summer (June-July-August), with correlation coefficients of regional average detrended time series ranging from 0.42 to 0.54, and all significant at the 99% confidence level for the period of 1979-2018. The possible physical mechanism behind the substantial downstream impacts of soil temperature over Central Asia are explored via diagnostical analysis combined with regional climate model experiments. Warmer soil temperature in May over the KRCA tends to cause positive anomalies of geopotential height in summer over Northeastern China through the Rossby wave propagation, and associated stronger subsidence warming, less cloud cover, more solar radiation reaching the surface, higher planetary boundary layer, and stronger thermal advection at 850 hPa, which provide favorable conditions for warmer surface air temperature particularly in the daytime as well as more hot days. Here this study further reveals that soil temperature over Central Asia in May makes important contribution to prediction of summer surface air temperature, daily maximum temperature and hot days over Northeastern China in terms of regional average time series and spatial patterns. Our findings highlight the previously-unknown substantial role of antecedent soil temperature condition over Central Asia for summer surface air temperature variation and prediction over Northeastern China.

54 ENVIRONMENTAL SCIENCES↗

Robustness of topological persistence in knowledge distillation for wearable sensor data

Topological data analysis (TDA) has shown great success in various applications involving wearable sensor data. However, there are difficulties in leveraging topological features in machine learning and wearable sensors because of the large time consumption and computational resources required to extract the features. To address this problem, knowledge distillation (KD) is utilized to generate a small model and accommodate topological features with persistence image (PI) representations from the raw time series data. Deploying topological knowledge in KD enables the student to achieve better performance compared to the one trained solely on raw time series data. However, it is not yet known if there are coherent characteristics for topological features in PI, which can aid in improving the performance during KD. In this paper, we investigate the suitability and challenges of utilizing topological features in KD for wearable sensor data, thereby contributing to the advancement of the field. Our study explores the impact of transferred topological features by comparing the Teacher-to-Student framework with Multiple Teachers-to-Student where teachers utilize both time series data and persistence images obtained by TDA as inputs. Additionally, we conduct a rigorous examination of topological knowledge effects by testing under various corruptions, knowledge types, and learning strategies in the context of human activity recognition tasks. Our analysis of topological features in KD presents the optimal strategy for incorporating these features. This study includes datasets of varying scales, window lengths, and activity classes, providing a comprehensive evaluation. Our results demonstrate that leveraging topological features in KD to enhance performance across databases.

97 MATHEMATICS AND COMPUTING↗

Experiments to validate Thermodynamics and Transport models of Strongly Coupled Dusty Plasma Matter (Final Technical Report for DE-SC0023416)

The goal of this two-year grant is to provide access to the PI to dusty plasma experimental facilities at the DOE-funded Collaborative Research Facility Magnetized Plasma Research Laboratory, Auburn University to become a user of that facility, to obtain experimental data to support another ongoing grant DE-SC0021146 (an Early Career Award to the PI that is focused on modeling of dusty plasma thermodynamics and transport processes), to generate experimental data for funding proposals, and to provide exposure to University of Memphis students to advanced experimental techniques. The following technical accomplishments were made: 1. Development of a novel Bidirectional Electrode Control Arms Assembly (BECAA) for producing perfect 2D grain layers for complex plasma experimentation. BECAA uses movable electrode arms to tilt or move the electrode in a RF discharge from outside the chamber, allowing for the manipulation of grain clouds without needing to change the plasma parameters or gas pressure. This work addresses a longstanding gap in the literature for a method to produce clusters of selectable number of grains and that are perfectly two dimensional as opposed to being only quasi-2D. 2. Experimental investigation of the structural properties of finite-N clusters with N=2 to 50. Individual particle behavior in clusters could vary from grain to grain and this study measured systematically produced clusters for two different grain sizes. Analysis (funded by another grant DE-SC0021146) is currently underway to quantify the differences between grains that are found on the surface vs. the interior of clusters, the shell structure, and the decay of correlations in position, velocity, and kinetic energy. 3. An experimental method to measure the structural entropy of clusters was developed by observing the self-induced structural transitions between various possible arrangements. In a series of heating and cooling cycles, the number of times each possible arrangement was attained was experimentally observed and used to compute the probability of existence of that arrangement, and subsequently the configurational entropy of the cluster. Analysis (funded by another grant DE-SC0021146) is currently underway to produce the entropy of clusters as a function of the number of grains and use the same to compute thermodynamic state variables for 2D complex plasma/grain clusters. 4. A preliminary experimental study of multibody collisions between N grains (N=2 – 10) was conducted. The clusters were produced using the BECAA technique and velocities were imparted to the grains using manipulation laser pulses. Analysis (funded by another grant DE-SC0021146) is currently underway to develop a theoretical framework to describe multibody collisions analogous to classical two-body interactions.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Statistical Time Series Models of Pilot Control with Applications to Instrument Discrimination

A general description of the methodology used in obtaining the transfer function models and verification of model fidelity, frequency domain plots of the modeled transfer functions, numerical results obtained from an analysis of poles and zeroes obtained from z plane to s-plane conversions of the transfer functions, and the results of a study on the sequential introduction of other variables, both exogenous and endogenous into the loop are contained.

Altschul, R. E.↗

EGS Collab Experiment 1: Time-series geochemistry data of the long-term circulation test

This submission presents the weekly geochemistry data of the long-term flow test performed within EGS Collab Experiment 1 from early 2019 to early 2020. The fluids from each producing borehole/interval (PI, PB, PDT and PST) along with the injectate were sampled roughly weekly from April 2019 to January 2020 for geochemistry analysis. The geochemical measurement was part of a long-term microbial profiling project (see details in the PNAS paper linked below). Additional background and methodologies are available in the PNAS paper linked bellow.

15 GEOTHERMAL ENERGY↗

Statistical Hypothesis Testing in Wavelet Analysis: Theoretical Developments and Applications to Indian Rainfall

Statistical hypothesis tests in wavelet analysis are methods that assess the degree to which a wavelet quantity(e.g., power and coherence) exceeds background noise. Commonly, a point-wise approach is adopted in which a wavelet quantity at every point in a wavelet spectrum is individually compared to the critical level of the point-wise test. However, because adjacent wavelet coefficients are correlated and wavelet spectra often contain many wavelet quantities, the point-wise test can produce many false positive results that occur in clusters or patches. To circumvent the point-wise test drawbacks, it is necessary to implement the recently developed area-wise, geometric, cumulative area-wise, and topological significance tests, which are reviewed and developed in this paper. To improve the computational efficiency of the cumulative area-wise test, a simplified version of the testing procedure is created based on the idea that its output is the mean of individual estimates of statistical significance calculated from the geometric test applied at a set of point-wise significance levels. Ideal examples are used to show that the geometric and cumulative area-wise tests are unable to differentiate wavelet spectral features arising from singularity-like structures from those associated with periodicities. A cumulative arc-wise test is therefore developed to strictly test for periodicities by using normalized arc length, which is defined as the number of points composing a cross section of a patch divided by the wavelet scale in question. A previously proposed topological significance test is formalized using persistent homology profiles (PHPs) measuring the number of patches and holes corresponding to the set of all point-wise significance values. Ideal examples show that the PHPs can be used to distinguish time series containing signal components from those that are purely noise. To demonstrate the practical uses of the existing and newly developed statistical methodologies, a first comprehensive wavelet analysis of Indian rainfall is also provided. An R software package has been written by the author to implement the various testing procedures.

Wind speed↗

The DESI N -body Simulation Project – II. Suppressing sample variance with fast simulations

ABSTRACT Dark Energy Spectroscopic Instrument (DESI) will construct a large and precise three-dimensional map of our Universe. The survey effective volume reaches $\sim 20\, h^{-3}\, \mathrm{Gpc}^{3}$. It is a great challenge to prepare high-resolution simulations with a much larger volume for validating the DESI analysis pipelines. AbacusSummit is a suite of high-resolution dark-matter-only simulations designed for this purpose, with $200\, h^{-3}\, \mathrm{Gpc}^{3}$ (10 times DESI volume) for the base cosmology. However, further efforts need to be done to provide a more precise analysis of the data and to cover also other cosmologies. Recently, the CARPool method was proposed to use paired accurate and approximate simulations to achieve high statistical precision with a limited number of high-resolution simulations. Relying on this technique, we propose to use fast quasi-N-body solvers combined with accurate simulations to produce accurate summary statistics. This enables us to obtain 100 times smaller variance than the expected DESI statistical variance at the scales we are interested in, e.g. $k \lt 0.3\, h\, \mathrm{Mpc}^{-1}$ for the halo power spectrum. In addition, it can significantly suppress the sample variance of the halo bispectrum. We further generalize the method for other cosmologies with only one realization in AbacusSummit suite to extend the effective volume ∼20 times. In summary, our proposed strategy of combining high-fidelity simulations with fast approximate gravity solvers and a series of variance suppression techniques sets the path for a robust cosmological analysis of galaxy survey data.

cosmology: theory↗

Single nucleotide variants drive evolutionary phage-host arms race in anaerobic carbon dioxide-converting microbiome

Microbial bioconversions are shaped by environmental perturbations and the adaptation of resident microbiomes. Prokaryotes coexist with bacteriophages, yet their coevolutionary trajectories remain underexplored. Here, we investigate the effects of a cultivation vessel leak on an anaerobic consortium performing carbon dioxide reduction. Using time-series shotgun metagenomic sequencing, we reconstruct microbial and viral genomes to track community shifts. We further apply single-nucleotide variant profiling and CRISPR array analysis to monitor viral microdiversity and host defense mechanisms. After bioaugmentation restores bioconversion efficiency, the consortium undergoes pronounced restructuring, with new dominant taxa emerging from the rare biosphere. We identify patterns consistent with phage predation selectively removing certain species, while others exhibit resilience to infection. This shift aligns with a widespread viral outbreak and a transient increased frequency of single nucleotide variants in bacterial CRISPR–Cas defense genes. Expansion of CRISPR spacers further supports that CRISPR-mediated processes influence microbial resilience. Concurrently, phages infecting resilient hosts exhibited adaptive evolution, marked by high genetic heterogeneity. Selective pressure varies across their genomes, targeting infectivity genes and protospacer-adjacent motifs. These findings highlight a dynamic evolutionary arms race driven by the selection of beneficial genetic variants, providing a mechanistic framework for multi-omics investigations, and informing biotechnological applications, including phage-based microbiome manipulation.

Ghiotto, G↗

Detecting Masquerade Attacks in Controller Area Networks Using Graph Machine Learning

Modern vehicles rely on a myriad of electronic control units (ECUs) interconnected via controller area networks (CANs) for critical operations. Despite their ubiquitous use and reliability, CANs are susceptible to sophisticated cyberattacks, particularly masquerade attacks, which inject false data that mimic legitimate messages at the expected frequency. These attacks pose severe risks such as unintended acceleration, brake deactivation, and rogue steering. Traditional intrusion detection systems (IDS) often struggle to detect these subtle intrusions due to their seamless integration into normal traffic. This paper introduces a novel framework for detecting masquerade attacks in the CAN bus using graph machine learning (ML). We hypothesize that the integration of shallow graph embeddings with time series features derived from CAN frames enhances the detection of masquerade attacks. We show that by representing CAN bus frames as message sequence graphs (MSGs) and enriching each node with contextual statistical attributes from time series, we can enhance detection capabilities across various attack patterns compared to using graph-based features only. Our method ensures a comprehensive and dynamic analysis of CAN frame interactions, improving robustness and efficiency. Extensive experiments on the ROAD dataset validate the effectiveness of our approach, demonstrating statistically significant improvements in the detection rates of masquerade attacks compared to a baseline that uses graph-based features only as confirmed by Mann-Whitney U and Kolmogorov-Smirnov tests (p < 0.05) .

Marfo, William [Univ. of Texas, El Paso, TX (Unite↗

reV (The Renewable Energy Potential Model - Open Source) [SWR-21-59, SWR-20-20 and SWR-17-34]

The Renewable Energy Potential (reV) model is a platform for the detailed assessment of renewable energy resources and their geospatial intersection with grid infrastructure and land use characteristics. The reV model currently supports photovoltaic (PV), concentrating solar power (CSP), and land-based wind turbine technologies. Modules in the reV framework function at different spatial and temporal resolutions, allowing for the assessment of resource potential, technical potential, and supply curves at varying levels of detail. The platform runs on the National Renewable Energy Laboratory’s (NREL’s) high-performance computing system, providing scalable and efficient performance from a single location up to a continent, for a single year or decades of time-series resource data. Coupled with NREL’s System Advisor Model (SAM), reV supports resource assessments from 5-minute to hourly temporal resolutions and supports the analysis of long-term (i.e., year-on-year) variability of renewable generation (e.g., interannual variability and exceedance probabilities).

Maclaurin, Galen↗