Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Time Series Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Correction for Neutral Pressure-Driven Signal in Radiated Power Measurements on Proto-MPEX

A pinhole camera using four-channel resistive bolometers was designed and implemented on the Prototype Material Plasma Exposure eXperiment (Proto-MPEX) to measure the plasma radiated power. Quantification of the radiated power is required for comprehensive power balance assessments but faces unique challenges on linear plasma devices due to weak absolute signal, compared to typical use in toroidal fusion plasmas, and high neutral pressure changes. Around 1 mTorr, the pressure-driven signal contribution was shown to overwhelm the radiated power signal in Proto-MPEX, found to be ~3 μW . Since the pressure-driven signals could not be predicted from first principle arguments, the signals were corrected using empirical models that take two experimental pressure measurements and the raw bolometer signal to reveal the radiated power signals. Four “gas-only” Proto-MPEX shots were taken, without the radio frequency (rf) plasma discharge, to train, optimize, and validate empirical models. The data included two pressure measurements at different locations along with the bolometer signal. Multiple models were tested; partial least-squares regression with a cross correlation method to account for the time offset in the pressure measurements provided the best combination of accuracy and stability. The model was validated to have a modeling error of 0.0036 V, which was lower than 10% of the expected radiated power signal. The model was tested on a different “gas-only” shot with a complete time-series data. For plasma operation shots, the corrected bolometer measurements were compared with an absolute extreme ultraviolet photodiode measurement and similarities and differences are discussed.

Lee, Seungsup↗

Salience Assignment for Multiple-Instance Data and Its Application to Crop Yield Prediction

An algorithm was developed to generate crop yield predictions from orbital remote sensing observations, by analyzing thousands of pixels per county and the associated historical crop yield data for those counties. The algorithm determines which pixels contain which crop. Since each known yield value is associated with thousands of individual pixels, this is a multiple instance learning problem. Because individual crop growth is related to the resulting yield, this relationship has been leveraged to identify pixels that are individually related to corn, wheat, cotton, and soybean yield. Those that have the strongest relationship to a given crop s yield values are most likely to contain fields with that crop. Remote sensing time series data (a new observation every 8 days) was examined for each pixel, which contains information for that pixel s growth curve, peak greenness, and other relevant features. An alternating-projection (AP) technique was used to first estimate the "salience" of each pixel, with respect to the given target (crop yield), and then those estimates were used to build a regression model that relates input data (remote sensing observations) to the target. This is achieved by constructing an exemplar for each crop in each county that is a weighted average of all the pixels within the county; the pixels are weighted according to the salience values. The new regression model estimate then informs the next estimate of the salience values. By iterating between these two steps, the algorithm converges to a stable estimate of both the salience of each pixel and the regression model. The salience values indicate which pixels are most relevant to each crop under consideration.

Wagstaff, Kiri L.↗

Toward Forecasting Geomagnetic Storms

We present a selection of attempts to infer geomagnetic storm properties from time series data. Initially, we unsuccessfully attempt to predict the duration of a geomagnetic storm based on data preceding the onset of a geomagnetic storm. Similar techniques are also used to attempt to predict the maximum depth of a geomagnetic storm. Additionally, we present a case study in Gaussian Process regression, where we are able to accurately interpolate between geomagnetic storm parameters, but are unable to predict future storm behavior. Lastly, we describe attempts at using random forest regression with sliding windows to infer geomagnetic storm behavior at future times. These results did not provide robust forecasts of geomagnetic storm behavior, but did occasionally correctly predict a storm within the margin of error. Techniques presented in this paper include machine learning classification and regression, Gaussian Process regression, and machine learning regression with sliding windows. Many of the attempts presented in this document did not result in meaningful predictions of geomagnetic storm behavior. We hope this document can be used as a guide for future readers attempting to predict geomagnetic storm properties.

58 GEOSCIENCES↗

Graph-Based Prediction of Spatio-Temporal Vaccine Hesitancy From Insurance Claims Data

Growing vaccine hesitancy is contributing to the decline in immunization rates for highly contagious, vaccine-preventable childhood diseases. Therefore, there has been a significant interest in understanding how hesitancy is spreading at higher spatio-temporal resolutions, enabling more targeted interventions. Motivated by this, we study the problem of prediction of vaccine hesitancy at the ZIP Code level, referred to as the VaxHesitancy problem. A significant challenge for this problem is the lack of high-resolution data that indicates hesitancy. Here, we develop a hybrid VaxHesSTL framework that combines a Graph Neural Network (GNN) and a Recurrent Neural Network (RNN) to address the VaxHesitancy problem. The GNN uses a ZIP Code-level network to capture spatial signals from neighboring areas, while the RNN models the temporal dynamics present in the data. We train and evaluate VaxHesSTL using a large dataset, namely the All-Payer Claims Databases (APCD), for Virginia, consisting of insurance claims from over five million individuals for six years. We find that an aggregated contact network or graph, developed from a detailed activity-based population network, plays an important role in the performance of VaxHesSTL, compared to graph models based solely on spatial proximity. Experiments demonstrate that VaxHesSTL outperforms a range of state-of-the-art baselines, which rely solely on historical time series data without accounting for spatial relationships. Since hesitancy data at higher spatial resolution is often unavailable or hard to get, we incorporate an active learning approach with our VaxHesSTL framework to optimize the training set without compromising the prediction performance. We find that hesitancy data for only 18% of ZIP Codes selected by active learning allows us to forecast hesitancy for all the ZIP Codes in the Virginia.

60 APPLIED LIFE SCIENCES↗

Long–short-term memory encoder–decoder with regularized hidden dynamics for fault detection in industrial processes

The ability of recurrent neural networks (RNN) to model nonlinear dynamics of high dimensional process data has enabled data-driven RNN-based fault detection algorithms. Previous studies have focused on detecting faults by identifying the discrepancies in data distribution between the faulty and normal data, as reflected in prediction errors generated by RNN models. However, in industrial processes, variations in data distribution can also result from changes in normal control setpoints and compensatory control adjustments in response to disturbances, making it hard to differentiate between normal and faulty conditions. This paper proposes a fault detection method utilizing a long short-term memory (LSTM) encoder–decoder structure with regularized hidden dynamics and reversible instance normalization (RevIN) to compactly represent high-dimensional measurements for effective monitoring. During training, the hidden states of the model are regularized to form a low-dimensional latent space representation of the original multivariate time series data. As a result, the prediction errors of the latent states can be used to monitor the abnormal dynamic variations, while the reconstruction errors of the measured variables are used to monitor the abnormal static variations. Furthermore, the proposed indices can reflect operating conditions, even when the distribution of test data changes, which helps distinguish faults from normal adjustments and disturbances that controllers can settle. Here, data from numerical simulation and the Tennessee Eastman process are used to illustrate the effectiveness of the proposed fault detection method.

42 ENGINEERING↗

Recent streamflow trends across permafrost basins of North America: Datasets

Climate change impacts, including changing temperatures, precipitation, and vegetation, are widely anticipated to cause major shifts to the permafrost with resulting impacts to hydro-ecosystems across the high latitudes of the globe. However, it is challenging to examine streamflow shifts in these regions owing to a paucity of data, discontinuity of records, and other issues related to data consistency and accuracy. We looked at recent changes in streamflow over 1976-2021 in watersheds affected by varying degrees of permafrost coverage to characterize trends and drivers for a range of watersheds across North America. Data sets are described in detail in the paper associated with this data set, Bennett et al. 2023, Front. Water - Water and Critical Zone, DOI: 10.3389/frwa.2023.1099660.These data contain CSV files of the streamflow, climate, and land surface characteristics for several sites located across the high latitude regions of North America. Both observed and reanalysis data products are provided. These files can be opened using Excel or a text editor, or they can be read, and analyzed in software tools such as Python or R. A brief description of the files is below, and more details can be found in the Methods section.rabpro_stats_north_select_74_55m.csv - This file describes the observed gages used in the analysis.GF31_23_metadat.csv - This file describes the 23 permafrost systems. Columns are as described in rabpro_stats_north_select_74_55m.csv above, with rabpro_id, the id used for the timeseries file mapping in GF31_23_time_series.csv.GF31_23_time_series.csv - This file contains the time series data for the stations described in GF31_23_metadat.csv.GF31_random_reaches_1583.csv - This file describes the 1583 randomly selected permafrost-dominant sites for machine learning analysis.era5_GF31_monthly_vars_random_reaches_1583.csv - This file contains the monthly ERA5 land data for the 1583 randomly selected permafrost-dominant sites.observed.zip: USGS and Hydat station data for the 74 gages analyzed in this study. Monthly, seasonal, and annual streamflow observations for minimum streamflow, mean streamflow, and maximum streamflow. Units are m3/sec. 1975-2022.streamflow_daily_GF31_infilled_1979_2022.csv - infilled daily streamflow data (infilled using GloFAS v 3.1) for 55 gages. Units are m3/sec. 1979-2022.glofas_23.zip - Glofas v3.1 file for the 23 permafrost-dominant gages in the study. Monthly, seasonal, and annual streamflow observations for minimum streamflow, mean streamflow, and maximum streamflow. Units are m3/sec. 1979-2021.glofas_1583.zip - Glofas v3.1 file for the 1583 randomly selected permafrost-dominant gages in the study. Monthly, seasonal, and annual streamflow observations for minimum streamflow, mean streamflow, and maximum streamflow. Units are m3/sec. 1979-2021.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of the Williams-type model for barley yields in North Dakota and Minnesota

The Williams-type yield model is based on multiple regression analysis of historial time series data at CRD level pooled to regional level (groups of similar CRDs). Basic variables considered in the analysis include USDA yield, monthly mean temperature, monthly precipitation, soil texture and topographic information, and variables derived from these. Technologic trend is represented by piecewise linear and/or quadratic functions of year. Indicators of yield reliability obtained from a ten-year bootstrap test (1970-1979) demonstrate that biases are small and performance based on root mean square appears to be acceptable for the intended AgRISTARS large area applications. The model is objective, adequate, timely, simple, and not costly. It consideres scientific knowledge on a broad scale but not in detail, and does not provide a good current measure of modeled yield reliability.

Barnett, T. L.↗

Development of an On-board Failure Diagnostics and Prognostics System for Solid Rocket Booster

We develop a case breach model for the on-board fault diagnostics and prognostics system for subscale solid-rocket boosters (SRBs). The model development was motivated by recent ground firing tests, in which a deviation of measured time-traces from the predicted time-series was observed. A modified model takes into account the nozzle ablation, including the effect of roughness of the nozzle surface, the geometry of the fault, and erosion and burning of the walls of the hole in the metal case. The derived low-dimensional performance model (LDPM) of the fault can reproduce the observed time-series data very well. To verify the performance of the LDPM we build a FLUENT model of the case breach fault and demonstrate a good agreement between theoretical predictions based on the analytical solution of the model equations and the results of the FLUENT simulations. We then incorporate the derived LDPM into an inferential Bayesian framework and verify performance of the Bayesian algorithm for the diagnostics and prognostics of the case breach fault. It is shown that the obtained LDPM allows one to track parameters of the SRB during the flight in real time, to diagnose case breach fault, and to predict its values in the future. The application of the method to fault diagnostics and prognostics (FD&P) of other SRB faults modes is discussed.

Smelyanskiy, Vadim N.↗

Evaluating Image Classification Deep Convolutional Neural Network Architectures for Remaining Useful Life Estimation of Turbofan Engines

Accurate estimation of the remaining useful life (RUL) is a key component of condition-based maintenance (CBM) and prognosis and health management (PHM). Data-based models for the estimation of RUL are of particular interest because expert knowledge of systems is not always available, and physical modeling is often not feasible. Additionally, using data-based models, which make decisions based on raw sensor data, allow features to be learned instead of manually determined. In this work, deep convolutional neural network (CNN) architectures are investigated for their ability to estimate the RUL of turbofan engines. To improve the accuracy of the models, CNN architectures, which have proven successful in image classification, are implemented and tested. Specifically, the blocks used in the Visual Geometry Group (VGG) architecture, inception modules used in the GoogLeNet architecture, and residual blocks used in the ResNet architecture are incorporated. To account for varying flight lengths, the input to the models is a window of time series data collected from the engine under test. Window locations at the climb, cruise, and descent stages are considered. To further improve the RUL estimations, multiple overlapping windows at each location are used. This increases the amount of training data available and is found to increase the accuracy of the resulting RUL estimations by averaging the estimates from all overlapping segments. The model is trained and tested using the new Commercial Modular Aero-Propulsion System Simulation (N-CMAPSS) data set, and high prognosis accuracy was achieved. Furthermore, this work expands on the model developed and used in the 2021 PHM Society Data Challenge, which received second place.

convolutional neural networks↗

Satellite-Derived Dynamics of Southern Ocean Sea Ice

Antarctic ERS-2, RADARSAT Synthetic Aperture Radar and ERS-1/2 Scatterometer images were analyzed with SMMI radiometer image time-series data to investigate seasonal variability in satellite-tracked sea-ice dynamics in the Southern Ocean during 1992. Supporting field data were acquired during 'in-situ' experiments including the winter 1992 Ice Station Weddell and Winter Weddell Gyre studies. A variety of surface measurements were made during these experiments including Argos-buoy deployment and GPS drift measurements. These are used in conjunction with International Program for Antarctic Buoys drift trajectories for ice-motion tracking validation. Comparisons between gridded Special Sensor Microwave Imager (SSMI) ice-motion vectors and European Center for Medium Range Weather Forecasts/National Centers for Environmental Prediction (ECMWF/NCEP) analyses indicate that large-scale drift is forced predominantly by the long-term mean, large-scale synoptic pressure field. Only sub-daily SAR sea-ice tracking can capture high-frequency fluctuations, driven by polar lows or tidal forcing. In these cases, sea-ice drift can respond rapidly to changes in forcing on semi-diurnal time scales depending on the location with respect to the coastline. Seasonality of ice drift, particularly in the Weddell and Ross Seas, is linked to ice extent and compactness, and internal ice stresses transmitted through the pack ice from the coast. Three-monthly seasonal climatologies are presented of austral winter of ice drift in the Southern Ocean. The large Weddell and Ross Sea gyres are clearly resolved along with key seasonal and spatial attributes of their cyclonic circulation. Regional time series of ice dynamics parameters are used to illustrate correlations with meteorological forcing. Persistent divergence such as that occurring in the Ronne-Filchner polynya system results in large fractions of new ice. Similarly, convergence zones produce large fractions of deformed ice and characterize the dynamics of regions where perennial ice is observed. High shear strains also help delineate the axis of the Antarctic divergence in many places in the ice cover. In these regions, the separation between the coastal 'east wind drift'and ACC-dominated drift regimes is characterized by zonally extended regions of intense shear.

Drinkwater, Mark R.↗

Quantitative guidance for efficient vertical flow measurements at the sediment–water interface using temperature–depth profiles

Upward discharge to surface water bodies can be quantified using analytical models based on temperature–depth (T-z) profiles. The use of sediment T-z profiles is attractive as discharge estimates can be obtained using point-in-time data that are collected inexpensively and rapidly. Previous studies have identified that T-z methods can only be applied at times of the year when there is significant difference between the streambed–water interface and deeper sediment temperatures (e.g., winter and summer). However, surface water temperatures also vary diurnally, and the influence of these variations on discharge estimates from T-z methods is poorly understood. For this study, synthetic T-z profiles were generated numerically using measured streambed interface temperature data to assess the influence of diurnal temperature variations on discharge estimation and provide insight into the suitable application of T-z methods. Results show that the time of day of data collection can have a substantial influence on vertical flux estimates using T-z methods. For low groundwater discharge fluxes (e.g., 0.1 m d -1 ), daily transience in streambed temperatures led to relatively large errors in estimated flow magnitude and direction. For higher discharge fluxes (1.5 m d -1 ), the influence of transient streambed temperatures on discharge estimates was strongly reduced. Discharge estimates from point-in-time T-z profiles were most accurate when the uppermost point in the T-z profile was near the bed interface daily mean (two time periods daily). Where temperature time series data are available, daily averaged T-z profiles can produce accurate discharge estimates across a wide range of discharge rates. Seasonality in shallow groundwater temperature generally had a negligible influence on vertical flow estimates. Finally, these findings can be used to plan field campaigns and provide guidance on the optimal application of T-z methods to quantify vertical groundwater discharge to surface water bodies.

54 ENVIRONMENTAL SCIENCES↗

Non-parametric projections of national income distribution consistent with the Shared Socioeconomic Pathways

Understanding and projecting income distributions within countries and regions is important to understanding consumption trends and the distributional consequences of climate impacts and responses. Several global, country-level projections of income distribution are available but most project only the Gini coefficient (a summary statistic of the distribution) or utilize the Gini along with the assumption of a lognormal distribution. We test the lognormal assumption and find that it typically underestimates income in the highest deciles and over-estimates it in others. We find that a new model based on two principal components of national time series data for income distribution provides a better fit to the data for all deciles, especially for the highest and lowest. We also construct a projection model in which the first principal component is driven by the Gini coefficient and the second captures deviations from this relationship. We use the model to project income distribution by decile for all countries for the five shared socioeconomic pathways. We find that inequality is consistently higher than projections based on the Gini and the lognormal functional form, with some countries reaching ratios of the highest to lowest income deciles that are almost three times their value using the lognormal assumption.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Tracing and Forecasting Metabolic Indices of Cancer Patients Using Patient-Specific Deep Learning Models

We develop a patient-specific dynamical system model from the time series data of the cancer patient’s metabolic panel taken during the period of cancer treatment and recovery. The model consists of a pair of stacked long short-term memory (LSTM) recurrent neural networks and a fully connected neural network in each unit. It is intended to be used by physicians to trace back and look forward at the patient’s metabolic indices, to identify potential adverse events, and to make short-term predictions. When the model is used in making short-term predictions, the relative error in every index is less than 10% in the L ∞ norm and less than 6.3% in the L 1 norm in the validation process. Once a master model is built, the patient-specific model can be calibrated through transfer learning. As an example, we obtain patient-specific models for four more cancer patients through transfer learning, which all exhibit reduced training time and a comparable level of accuracy. This study demonstrates that this modeling approach is reliable and can deliver clinically acceptable physiological models for tracking and forecasting patients’ metabolic indices.

60 APPLIED LIFE SCIENCES↗

Data-driven Resilience Characterization of Control Dynamical Systems

In this paper, we define and quantify resiliency of a power network and propose data-driven algorithms for computing the same for the power grid. To do this, we use the Koopman operator framework to lift the controlled dynamical system to an abstract (possibly higher) dimensional space, where the evolution is linear. The linear system representation allows us to relate small time local controllability and observability of a general nonlinear control system to the controllability and observability of the lifted linear system. Finally, we define the resiliency of the underlying power grid in terms of the controllability and observability gramians of the lifted linear system. We illustrate the proposed approach to compute the resiliency metrics on time-series data obtained from a microgrid.

koopman operator, resilience, control↗

Hardware-Based Emulator with Deep Learning Model for Building Energy Control and Prediction Based on Occupancy Sensors’ Data

Heating, ventilation, and air conditioning (HVAC) is the largest source of residential energy consumption. Occupancy sensors’ data can be used for HVAC control since it indicates the number of people in the building. HVAC and sensors form a typical cyber-physical system (CPS). In this paper, we aim to build a hardware-based emulation platform to study the occupancy data’s features, which can be further extracted by using machine learning models. In particular, we propose two hardware-based emulators to investigate the use of wired/wireless communication interfaces for occupancy sensor-based building CPS control, and the use of deep learning to predict the building energy consumption with the sensor data. We hypothesize is that the building energy consumption may be predicted by using the occupancy data collected by the sensors, and question what type of prediction model should be used to accurately predict the energy load. Another hypothesis is that an in-lab hardware/software platform could be built to emulate the occupancy sensing process. The machine learning algorithms can then be used to analyze the energy load based on the sensing data. To test the emulator, the occupancy data from the sensors is used to predict energy consumption. The synchronization scheme between sensors and the HVAC server will be discussed. We have built two hardware/software emulation platforms to investigate the sensor/HVAC integration strategies, and used an enhanced deep learning model—which has sequence-to-sequence long short-term memory (Seq2Seq LSTM)—with an attention model to predict the building energy consumption with the preservation of the intrinsic patterns. Because the long-range temporal dependencies are captured, the Seq2Seq models may provide a higher accuracy by using LSTM architectures with encoder and decoder. Meanwhile, LSTMs can capture the temporal and spatial patterns of time series data. The attention model can highlight the most relevant input information in the energy prediction by allocating the attention weights. The communication overhead between the sensors and the HVAC control server can also be alleviated via the attention mechanism, which can automatically ignore the irrelevant information and amplify the relevant information during CNN training. Our experiments and performance analysis show that, compared with the traditional LSTM neural network, the performance of the proposed method has a 30% higher prediction accuracy.

Ye, Zhijing↗

Comparison of CEAS and Williams-type models for spring wheat yields in North Dakota and Minnesota

The CEAS and Williams-type yield models are both based on multiple regression analysis of historical time series data at CRD level. The CEAS model develops a separate relation for each CRD; the Williams-type model pools CRD data to regional level (groups of similar CRDs). Basic variables considered in the analyses are USDA yield, monthly mean temperature, monthly precipitation, and variables derived from these. The Williams-type model also used soil texture and topographic information. Technological trend is represented in both by piecewise linear functions of year. Indicators of yield reliability obtained from a ten-year bootstrap test of each model (1970-1979) demonstrate that the models are very similar in performance in all respects. Both models are about equally objective, adequate, timely, simple, and inexpensive. Both consider scientific knowledge on a broad scale but not in detail. Neither provides a good current measure of modeled yield reliability. The CEAS model is considered very slightly preferable for AgRISTARS applications.

Barnett, T. L.↗

Data-Driven Operator Theoretic Methods for Phase Space Learning and Analysis

This paper uses data-driven operator theoretic approaches to explore the global phase space of a dynamical system. In this work, we defined conditions for discovering new invariant subspaces in the state space of a dynamical system starting from an invariant subspace based on the spectral properties of the Koopman operator. When the system evolution is known locally in several invariant subspaces in the state space of a dynamical system, a phase space stitching result is derived that yields the global Koopman operator. Additionally, in the case of equivariant systems, a phase space stitching result is developed to identify the global Koopman operator using the symmetry properties between the invariant subspaces of the dynamical system and time-series data from any one of the invariant subspaces. Finally, these results are extended to topologically conjugate dynamical systems; in particular, the relation between the Koopman tuple of topologically conjugate systems is established. The proposed results are demonstrated on several second-order nonlinear dynamical systems including a bistable toggle switch. Our method elucidates a strategy for designing discovery experiments: experiment execution can be done in many steps, and models from different invariant subspaces can be combined to approximate the global Koopman operator.

42 ENGINEERING↗

AI-Based Analytics and Energy Modeling Framework for Characterizing Urban Energy Systems

Developing location-specific district energy models is essential for understanding energy patterns and supporting efficient management and planning decisions. However, accurately characterizing these models remains challenging due to gaps in building characteristics and labor-intensive traditional modeling workflows. To address these challenges, we develop an AI-based framework that integrates top-down and bottom-up building energy data to automate urban energy model characterization. The framework trains multimodal deep learning models using heterogeneous ResStockTM datasets to infer missing building characteristics from varying levels of known information and generate simulation-ready inputs for district-scale energy modeling. It also employs a conditioning-based injection approach to generate ”what-if” scenarios, enabling users to explore retrofit, efficiency, and technology-upgrade pathways. Integrated within URBANoptTM, a bottom-up district energy modeling platform for simulating co-located buildings, the framework infers detailed building-level inputs required for bottom-up simulations. Both localized and generalized AI models are developed to learn relationships across categorical, numerical, and time-series data, enabling reconstruction of missing attributes and generation of targeted upgrade scenarios. We demonstrate this methodology on a residential neighborhood in Baltimore, MD, assessing internal consistency against ResStock reference data and URBANopt simulation, and comparing selected attributes against real-world building characteristics. Results show strong overall predictive accuracy in data completion and scenario generation, with localized and generalized models offering complementary trade-offs between precision and scalability. Overall, our automated framework streamlines energy modeling and provides a reliable framework for urban building energy characterization.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗