Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “time series analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Near real-time streaming analysis of big fusion data

Experiments on fusion plasmas produce high-dimensional data time series with ever-increasing magnitude and velocity, but turn-around times for analysis of this data have not kept up. For example, many data analysis tasks are often performed in a manual, ad-hoc manner some time after an experiment. In this article, we introduce the Delta framework that facilitates near real-time streaming analysis of big and fast fusion data. By streaming measurement data from fusion experiments to a high-performance compute center, Delta allows computationally expensive data analysis tasks to be performed in between plasma pulses. This article describes the modular and expandable software architecture of Delta and presents performance benchmarks of individual components as well as of an example workflow. Focusing on a streaming analysis workflow where electron cyclotron emission imaging (ECEi) data is measured at KSTAR on the National Energy Research Scientific Computing Center's (NERSC's) supercomputer we routinely observe data transfer rates of about 4 Gigabit per second. In NERSC, a demanding turbulence analysis workflow effectively utilizes multiple nodes and graphical processing units and executes them in under 5 min. We further discuss how Delta uses modern database systems and container orchestration services to provide web-based real-time data visualization. For the case of ECEi data we demonstrate how data visualizations can be augmented with outputs from machine learning models. Here, by providing session leaders and physics operators, results of higher-order data analysis using live visualizations may make more informed decisions on how to configure the machine for the next shot.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

sdt (Solar Data Tools) [SWR-25-130]

Solar Data Tools (sdt) is an open-source Python library for analyzing PV power (and irradiance) time-series data. It was developed to enable analysis of unlabeled PV data, i.e. with no model, no meteorological data, and no performance index required, by taking a statistical signal processing approach in the algorithms used in the package’s main data processing pipeline. Solar Data Tools empowers PV system fleet owners or operators to analyze system performance a hundred times faster even when they only have access to the most basic data stream—power output of the system.

Meyers-Im, Bennet [National Laboratory of the Rock↗
DOE OSTI2025

SigTime: Learning and Visually Explaining Time Series Signatures

Understanding and distinguishing temporal patterns in time series data is essential for scientific discovery and decision-making. For example, in biomedical research, uncovering meaningful patterns in physiological signals can improve diagnosis, risk assessment, and patient outcomes. However, existing methods for time series pattern discovery face major challenges, including high computational complexity, limited interpretability, and difficulty in capturing meaningful temporal structures. Here, to address these gaps, we introduce a novel learning framework that jointly trains two Transformer models using complementary time series representations: shapelet-based representations to capture localized temporal structures and traditional feature engineering to encode statistical properties. The learned shapelets serve as interpretable signatures that differentiate time series across classification labels. Additionally, we develop a visual analytics system—SigTime—with coordinated views to facilitate exploration of time series signatures from multiple perspectives, aiding in useful insights generation. We quantitatively evaluate our learning framework on eight publicly available datasets and one proprietary clinical dataset. Additionally, we demonstrate the effectiveness of our system through two usage scenarios along with the domain experts: one involving public ECG data and the other focused on preterm labor analysis.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Poster Abstract: Leveraging Large Language Models to Reveal Interpretable Cooling Behaviors from Smart Thermostat Data

Frequent heatwaves and hot summers increasingly challenge occupant comfort, health, and energy grid stability. Addressing these challenges requires a detailed understanding of household cooling behaviors, such as thermostat adjustments and adaptive responses to extreme conditions. Traditional analyses often rely on aggregated numerical metrics that overlook subtle but important household-specific variations. In this study, we introduce a generalizable methodology that integrates large language models (LLMs) with vision capabilities to enable scalable and detailed analysis of residential thermostat data. Using Ecobee's Donate Your Data (DYD) dataset—which provides five-minute records of indoor temperatures, thermostat setpoints, and HVAC runtimes—we focus on two U.S. cities with contrasting summer climates : Austin (TX) and Phoenix (AZ). Because raw time-series data are not well suited for direct LLM analysis, we transform them into visual representations, such as daily indoor temperature trajectories and weekly runtime histograms, to better capture behavioral variations. Leveraging LLMs' visual interpretation, we extract descriptive behavioral features, including temperature preferences, time-of-day cooling orientation, anticipatory versus reactive heatwave responses, and behavioral consistency. These semantic features support unsupervised clustering to identify distinct occupant archetypes at scale, revealing differences—such as morning-centric anticipatory coolers versus households that shift toward warmer setpoints during heatwaves—that can inform demand response, resilience planning, and health-aware interventions. By converting raw numerical data into interpretable behavioral patterns, this methodology enables scalable and practical analysis of occupant behavior, supporting actionable insights for comfort, resilience, and energy management.

Nihar, Kopal↗
DOE OSTI2024

Risk-Aware Framework Development for Disruption Prediction: Alcator C-Mod and DIII-D Survival Analysis

Abstract Survival regression models can achieve longer warning times at similar receiver operating characteristic performance than previously investigated models. Survival regression models are also shown to predict the time until a disruption will occur with lower error than other predictors. Time-to-event predictions from time-series data can be obtained with a survival analysis statistical framework, and there have been many tools developed for this task which we aim to apply to disruption prediction. Using the open-source Auton-Survival package we have implemented disruption predictors with the survival regression models Cox Proportional Hazards, Deep Cox Proportional Hazards, and Deep Survival Machines. To compare with previous work, we also include predictors using a Random Forest binary classifier, and a conditional Kaplan-Meier formalism. We benchmarked the performance of these five predictors using experimental data from the Alcator C-Mod and DIII-D tokamaks by simulating alarms on each individual shot. We find that developing machine-relevant metrics to evaluate models is an important area for future work. While this study finds cases where disruptive conditions are not predicted, there are instances where the desired outcome is produced. Giving the plasma control system the expected time-to-disruption will allow it to determine the optimal actuator response in real time to minimize risk of damage to the device.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2026

Three-Dimensional Grid Visualization for Planning Activities: A Dubai Case Study

National Laboratory of the Rockies (NLR), in collaboration with the Dubai Electricity and Water Authority (DEWA) and Infra-X, has undertaken the Energy Visualization Analysis Project. The aim of this project is to enhance analytical and 3D visualization capabilities for distribution network planning and renewable energy integration. As modern grid continues to evolve with large-scale solar PV deployment and emerging distributed energy resources (DERs), the ability to effectively analyze, visualize, and communicate complex grid behaviors has become increasingly critical. The project focuses on developing empirical use cases based on real distribution feeder data and engineering workflows, ensuring the outcomes are directly aligned with operational environment. Through time-series power flow simulations and nodal hosting capacity analysis, the study quantifies the impacts of high PV penetration on voltage and thermal limits within representative 11 kV feeders. These analyses identify specific nodes and conditions where DER integration challenges arise. Furthermore, a Battery Energy Storage System (BESS) optimization algorithm was applied to determine the optimal size and placement of storage systems that can mitigate network constraints and enhance hosting capacity. The comparative results between base-case and BESS-augmented scenarios clearly demonstrate improvements in network stability and load management efficiency. In parallel, the NLR team developed an immersive 3D visualization framework, enabling interactive exploration of grid simulations using commodity head-mounted display (HMD) systems. This framework transforms conventional 2D simulation data into spatially intuitive visual environments - allowing engineers to analyze feeder conditions, PV hosting potential, and BESS effects in real time. This report represents the first foundational phase in establishing a visualization-driven analytical ecosystem. It provides a methodological foundation for data integration, visualization architecture, and simulation-based decision support, paving the way for large-scale adoption of immersive visualization across DEWA's Smart Grid Initiative, R&D activities, and future network resilience studies.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Decay Curve Correction Analysis Report

The decay curve analysis that is done on the short-lived radionuclide gas samples is used to differentiate between gaseous radionuclides that have the same characteristic gamma decay energy, 511 kiloelectron-volts (keV). A sample of stack gas is isolated and the total counts in the 511 keV peak are counted repeatedly in 10-second intervals to evaluate the decay rate of the sample over time. Analysis of this decay data required a series of steps. First, a raw data report is generated by the gamma acquisition system, based on an analysis template within the acquisition software. The data report file was then loaded into Microsoft Word, and a macro was used to perform minor formatting (remove colons and insert tabs between data columns) to allow analysis within Excel. The file is then saved as a text file at this point. The text file is then uploaded into Excel and a series of macros are used to add labels, calculate radioactive decay constants, and analyze the gamma decay data using linear regression techniques. The analysis template has been used since 1998 for stack 53000303 (TA-53, building 0003, exhaust stack 03) and 2000 for stack 53000702. The overall process, including the gamma report format and the macros used in Word and Excel for processing the report, had remained unchanged until 2015. In October of 2015, staff made a change to the report template in the gamma acquisition software which resulted in an error in the calculations later performed by the Excel macro. This error was not caught until a more in-depth review of the analysis took place regarding 2020 data. This report covers a much more complete review of the issue that occurred regarding the decay curve analysis, a review of the calculations completed to correct the issue, a review of the updated decay curve analysis process, and recommendations for moving forward.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

The Habitable Zone Planet Finder Reveals a High Mass and Low Obliquity for the Young Neptune K2-25b

Using radial velocity data from the Habitable Zone Planet Finder, we have measured the mass of the Neptune-sized planet K2-25b, as well as the obliquity of its M4.5 dwarf host star in the 600–800 Myr Hyades cluster. This is one of the youngest planetary systems for which both of these quantities have been measured and one of the very few M dwarfs with a measured obliquity. Based on a joint analysis of the radial velocity data, time-series photometry from the K2 mission, and new transit light curves obtained with diffuser-assisted photometry, the planet’s radius and mass are 3.44 ± 0.12 R {sub ⊕} and 24.5{sub −5.2}{sup +5.7}M{sub ⊕}. These properties are compatible with a rocky core enshrouded by a thin hydrogen–helium atmosphere (5% by mass). We measure an orbital eccentricity of e = 0.43 ± 0.05. The sky-projected stellar obliquity is λ = 3° ± 16°, compatible with spin–orbit alignment, in contrast to other “hot Neptunes” that have been studied around older stars.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Multi-Channel Time-Frequency Analysis

This software contains models for multi-channel time series data. The models are time-frequency descriptions of the data. Also included are prediction performance evaluation tools. These models can be applied to electrophysiology data such as electrocorticography.

Kaplan, AlanD↗
DOE OSTI2023

Operator-theoretic Resilience Calculations (ORC)

This project developed operational metrics to characterize the resilience of a dynamic network in real-time from time-series data by proposing: a) Resilience ratio b) Recovery energy. Resilience analysis considers the controllability and observability and provides a real-time under- standing on resilience without creating/simulating them. The report focuses on the application of resilience metrics on the HYPERSIM data and insights obtained.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Simulation of high-frequency dissolved oxygen dynamics in a shallow estuary, the Corsica River, Chesapeake Bay

Understanding shallow water biogeochemical dynamics is a challenge in coastal regions, due to the presence of highly variable land-water interface fluxes, tight coupling with sediment processes, tidal dynamics, and diurnal variability in biogeochemical processes. While the deployment of continuous monitoring devices has improved our understanding of high-frequency (12 - 24 hours) variability and spatial heterogeneity in shallow regions, mechanistic modeling of these dynamics has lagged behind conceptual and empirical models. The inherent complexity of shallow water systems is represented in the Corsica River estuary, a small basin within the Chesapeake Bay ecosystem, where abundant monitoring data have been collected from long-term monitoring stations, continuous monitoring sensors, synoptic sensor surveys, and measurements of sediment-water fluxes. A state-of-the-art modeling system, the Semi-implicit Cross-scale Hydroscience Integrated System Model (SCHISM), was applied to the Corsica domain with a high-resolution grid and nutrient loads from the most recent version of the Chesapeake Bay watershed model. The Corsica SCHISM model reproduced observed high-frequency variability in dissolved oxygen, as well as seasonal variability in chlorophyll-a and sediment-water fluxes. Time-series signal analyses using Empirical Model Decomposition and spectral analysis revealed that the diurnal and M2 tide frequencies are the dominant high-frequency modes and physical transport contributes a larger share to dissolved oxygen budgets than biogeochemical processes on an hourly time scale. Heterogeneity and patchiness in dissolved oxygen resulting from phytoplankton distributions and geometry-driven eddies amplify the physical transport effect, and on longer time scales oxygen is controlled more by photosynthesis and respiration. Our simulation demonstrates that interactions among physical and biological dynamics generate complex high-frequency variability in water quality and non-linear reposes to nutrient loading and environmental forcing in shallow water systems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Nonlinear Photovoltaic Degradation Rates: Modeling and Comparison Against Conventional Methods

Although common practice for estimating photovoltaic (PV) degradation rate (RD) assumes a linear behavior, field data have shown that degradation rates are frequently nonlinear. This article presents a new methodology to detect and calculate nonlinear RD based on PV performance time-series from nine different systems over an eight-year period. Prior to performing the analysis and in order to adjust model parameters to reflect actual PV operation, synthetic datasets were utilized for calibration purposes. A change-point analysis is then applied to detect changes in the slopes of PV trends, which are extracted from constructed performance ratio (PR) time-series. Once the number and location of change points is found, the ordinary least squares method is applied to the different segments to compute the corresponding rates. The obtained results verified that the extracted trends from the PR time-series may not always be linear and therefore, “nonconventional” models need to be applied. All thin-film technologies demonstrated nonlinear behavior whereas nonlinearity detected in the crystalline silicon systems is thought to be due to a maintenance event. A comparative analysis between the new methodology and other conventional methods demonstrated levelized cost of energy differences of up to 6.14%, highlighting the importance of considering nonlinear degradation behavior

14 SOLAR ENERGY↗
DOE OSTI2023

Wave Detection and Tracking Within a Rotating Detonation Engine Through Object Detection

As the operational time window of experimental rotating detonation engines (RDEs) is expanded and the technology matures toward integration within gas turbines, monitoring techniques must evolve to offer computationally efficient and highly time-resolved diagnostics. In this study, computer vision object detection methodology that seeks to reduce data processing time and calculate wave velocity within drastically reduced time intervals as compared to traditional high-frame-rate RDE images analysis techniques is proposed. The adapted you-only-look-once object detection network is trained to detect individual detonation waves within single down-axis RDE images. The wave location and rotational direction detected within a frame are tracked through a series of high-speed images to calculate the frame-to-frame wave velocity with the time-step resolution of $\mathrm{20 μs}$ across a series of frames. The analysis of the annotation box size and image linearization effects is presented, demonstrating the lowest frame-to-frame velocity total uncertainty of $\mathrm{±3.8\%}$ and the highest classification speed of 9.5 frames per second using linearized images. Linearized images “unwrap” the RDE annulus pixel region to a reduced image size. Here, this new method offers great reductions in data processing times and unsteady detonation behavior insight at intervals more comparable to the timescales of detonation wave interactions via the application of machine learning to experimental RDE data.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2022

Baycal

Bayesian Model Calibration (BayCal) toolkit is a software plugin for Risk Analysis Virtual Environment (RAVEN) framework, arming at inversely quantifying the uncertainties associated with simulation model parameters based on available experiment data. BayCal seeks statistical inference of the uncertain input parameters that are consistent with the available measurement data or observed data. The unique feature of BayCal is the capability to be linked with RAVEN to build corresponding calibration workflows for complex multi-physics simulations. In addition to be able to use the machine learning capability of RAVEN to significantly reduce the computational cost of expensive simulation models, another distinctive feature of BayCal is the capability to deal with high-dimensional correlated model outputs, such as time series observations at multiple locations, via principal component analysis (PCA) technique.

Wang, Congjian↗
DOE OSTI2020

Data-driven evaluation of HVAC operation and savings in commercial buildings

Commercial buildings consumed 36% of electricity, or 1.35 trillion kWh, in the United States in 2017, and almost 30% of this energy was wasted. Much of this loss can be attributed to inefficient heating ventilation and air con­ditioning (HVAC) systems. By improving the operational conditions of HVAC, significant savings can be achieved. However, most buildings and building equipment do not use costly sub-meters to monitor and address performance issues, and on-site auditing can be expensive and insufficient. Alternatively in this study, we propose a data-driven method to identify savings opportunities using only whole building meter data and without setting foot in the building. For this purpose, we introduced two algorithms that virtually quantify the value of a thermostat setpoint setback and HVAC rescheduling. Additionally, we developed novel methods for detecting occupancy patterns and quantifying the baseload of the HVAC operation. Using a clustering algorithm, we identified those buildings for which HVAC savings was significant and further categorized the buildings based on their potential for savings. A population study of over 432 commercial buildings demonstrated a median percentage energy savings of 1.6% from a baseload reduction and 2.1% from HVAC rescheduling. Additionally, results indicate that retail buildings have the highest potential for savings among the building types studied.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Short-term apartment-level load forecasting using a modified neural network with selected auto-regressive features

Residential electricity load profiles and their diversity have become increasingly important to realize the benefits of Smart or Transactive Energy Networks (TENs). An important element of TENs will be practical, accurate, and implementable residential load forecasting techniques. While there have been many approaches to short-term load forecasting, few have included forecasting for individual households, partly because the high volatility and idiosyncrasies present in individual household load data can pose significant challenges. In this study, we develop a Convolutional Long Short-Term Memory-based neural network with Selected Autoregressive Features (termed a CLSAF model) to improve short-term household electricity load forecasting accuracy by employing three strategies: autoregressive features selection, exogenous features selection, and a “default” state to avoid overfitting at times of high load volatility. We include aggregations of apartments to floor and building level, because utilities may favor transactive approaches that rely on aggregator models, e.g., a cluster of consumers as opposed to an individual. We demonstrate that the CLSAF model, by virtue of its enhanced feature representation and modest computational resources, can accomplish load forecasting in a multi-family residential building across three spatial granularities (individual apartment/household, floor, and building levels), with an accuracy improvement of up to 25% compared to a persistence model. We propose a data screening technique to characterize time-series electricity-load data. This technique is suitable for integration into a TEN ecosystem and allows one to estimate confidence levels of the load forecasts to optimize computational resources and the risks associated with uncertain forecasts.

24 POWER TRANSMISSION AND DISTRIBUTION↗