SEARCH · Engineering Papers

Results for “Time Series Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

All sources NASA NTRS DOE OSTI

DOE OSTI2019

A Flexible Framework for Building Occupancy Detection Using Spatiotemporal Pattern Networks

This paper presents a reliable, scalable, and transferable framework to predict occupancy in a building utilizing diverse, multi-modal information. We propose a new methodology for learning-driven occupancy detection built on the concepts of probabilistic graphical modeling and observable Markov chain modeling. To capture the relationship between multi-sensor data and occupancy, we propose this Occ-STPN framework that is flexible to support both multivariate and univariate formulations. While the multivariate Occ-STPN performs feature-level fusion of multiple predictors and occupancy time-series data, the univariate Occ-STPN involves decision fusion of occupancy predictions using individual predictors based on a mutual information weighted fusion scheme. We also propose a new metric to evaluate the performance of occupancy prediction algorithms. Two popular datasets are used to validate our approach and demonstrate that our framework is scalable in terms of the number of information sources (e.g., sensors) as well as it is possible to transfer trained models from one building to another without significant reduction in performance. Reliability of the algorithm is also tested by injecting noise into the datasets.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2021

Superconducting Radio-frequency Cavity Fault Classification Using Machine Learning at Jefferson Laboratory

We report on the development of machine learning models for classifying C100 superconducting radiofrequency (SRF) cavity faults in the Continuous Electron Beam Accelerator Facility (CEBAF) at Jefferson Lab. Of the 418 SRF cavities in CEBAF, 96 are designed with a digital low-level RF system configured such that a cavity fault triggers recordings of RF signals for each of eight cavities in the cryomodule. Subject matter experts analyze the collected time-series data and identify which of the eight cavities faulted first and classify the type of fault. This information is used to find trends and strategically deploy mitigations to problematic cryomodules. However, manually labeling the data is laborious and time-consuming. By leveraging machine learning, near real-time - rather than postmortem - identification of the offending cavity and classification of the fault type has been implemented. We discuss the performance of the machine learning models during a recent physics run. We also discuss efforts for further insights into fault types through unsupervised learning techniques and present preliminary work on cavity and fault prediction using data collected prior to a failure event.

Tennant, C. D.↗

NASA NTRS2013

Alanna Conners and the Origins of Principled Data Analysis

Alanna was one of the most important pioneers in the development of not just sophisticated algorithms for analyzing astronomical data but more importantly an overall viewpoint emphasizing the use of statistically sound principles in place of blind application of cook-book recipes, or black boxes. I will outline some of the threads of this viewpoint, emphasizing time series data, with a focus on the importance of these developments for the Age of Digital Astronomy that we are entering.

age of digital astronomy↗

DOE OSTI2024

System and method for wave prediction

A method and system for prediction of wave properties include collecting time series data streams from one or more wave measurement devices and processing the data using a wave-prediction algorithm to identify the frequency components of the data and compute wave parameters. The wave-field is propagated in space and time to predict wave height, speed, and velocity at a target location. A sliding window approach is used to continuously update the prediction in real-time.

Previsic, Mirko↗

NASA NTRS2023

Spatiotemporal Characterization of Droughts and Vegetation Response in Northwest Africa From 1981 to 2020

Drought has become one of the most devastating natural risks of agricultural production and the environment in almost all climate regions. Thus, understanding the spatiotemporal characteristics of drought and its associated impacts is crucial in drought early warning management and adaptation efforts. In this study, we used the 3-month Standardized Precipitation Index (SPI-3) obtained from Climate Hazards Group InfraRed Precipitation with Station data (CHIRPS) to investigate the space–time characteristics of drought conditions. Also, this study examined the impact of the SPI-based drought on vegetation health conditions using the Advanced Very High Resolution Radiometer (AVHRR) Normalized Difference Vegetation Index (NDVI) time-series data from 1981 to 2020. The results revealed that the region experiences drought primarily between July and September, with the most prolonged drought events lasting up to five months. Morocco suffered from more frequent droughts than other countries in the region. The Mann-Kendall test showed that the trend of drought became drier over the last decade, whereas the period from 1981 to 2010 witnessed either wetting or no trends. This study also found that the response of crops and grasslands showed higher correlation with the SPI-3 and that the response of vegetation to droughts was higher during the dry season. The findings of this study provide useful information to support local and regional drought planning and adaptation programs and enhance the understanding of drought development in the region.

Nguyen Quang Thi↗

DOE OSTI2022

Development of a Annual Air Handling Unit Fault Dataset for FDD Tools: Lessons Learned and Considerations for FDD Developers

As energy management and information systems (e.g., automated fault detection and diagnostics [AFDD] tools) become more prevalent in the commercial building stock, it is important to determine the effectiveness of these technologies by benchmarking their performance. The authors have been working to develop the largest publicly available dataset of HVAC fault data for performance benchmarking applications, covering the most common HVAC systems and designs including chiller plants, rooftop packaged units, dual duct air handling units and single duct air handling units. This study covers the development, modeling, and validation of a synthetic fault dataset for a single duct air handling unit (AHU), one of the most common HVAC configurations found in the commercial building stock. Despite this being a common system, real-world time series data are scarce and usually do not span a wide range of weather conditions. Due to this limitation, a detailed AHU model was employed to carry out annual simulations of numerous common sensor and mechanical faults, which were then validated by comparing their effects on system performance to expected symptoms. We summarize the nature of each fault and their impacts under different weather and operation conditions. Finally, we highlight considerations for FDD developers that may want to use this dataset to assess their algorithms’ performance and their improvement over time.

Casillas, Armando↗

NASA NTRS1972

Atmospheric pressure, density, temperature and wind variations between 50 and 200 km

Data on atmospheric pressure, density, temperature and winds between 50 and 200 km were collected from sources including Meteorological Rocket Network data, ROBIN falling sphere data, grenade release and pitot tube data, meteor winds, chemical release winds, satellite data, and others. These data were analyzed by a daily difference method and results on the distribution statistics, magnitude, and spatial structure of the irregular atmospheric variations are presented. Time structures of the irregular variations were determined by the analysis of residuals from harmonic analysis of time series data. The observed height variations of irregular winds and densities are found to be in accord with a theoretical relation between these two quantities. The latitude variations (at 50 - 60 km height) show an increasing trend with latitude. A possible explanation of the unusually large irregular wind magnitudes of the White Sands MRN data is given in terms of mountain wave generation by the Sierra Nevada range about 1000 km west of White Sands. An analytical method is developed which, based on an analogy of the irregular motion field with axisymmetric turbulence, allows measured or model correlation or structure functions to be used to evaluate the effective frequency spectra of scalar and vector quantities of a spacecraft moving at any speed and at any trajectory elevation angle.

Justus, C. G.↗

NASA NTRSDate not supplied

High Performance Access to Archival Data Stored in HDF4 and HDF5 on Cloud Object Stores Without Reformatting the Files

Cloud computing offers numerous advantages for users of extensive Earth science data collections. These benefits encompass direct online access to data files and granules from any location, scalable access supporting parallel computing workflows, and flexible computing tools enabling innovative experimentation with processing techniques. However, older archival file formats designed for distinct computing systems hinder efficient access to decade-long time-series data when compared to data stored in modern cloud-optimized formats like Web Object Stores (WOS), exemplified by Amazon Web Services’ Simple Storage Service (S3). We describe DMR++ (Dataset Metadata Response plus plus), a technology facilitating efficient access to HDF5 (Hierarchical Data Format, version 5) and HDF4 files stored on WOS systems without requiring data reformatting. DMR++ achieves performance comparable to technologies like Zarr while preserving the original file structure, a substantial benefit considering the vast quantity of archival files held by organizations such as NASA. Moreover, DMR++ typically outperforms cloud-optimized versions of HDF5. Essentially an XML (Extensible Markup Language) document usually stored alongside the described data, DMR++ can also be generated on-the-fly but is generally created during data staging to the WOS. Archival files that use HDF4/5 often store large arrays of numerical data. The data in these files is often compressed, typically reducing their size by a factor of four or more. To achieve efficient access to portions of those arrays, they are 'chunked' into smaller sub-arrays, each individually compressed. The chunk size is a compromise, where spinning disks can efficiently access data in smaller chunks while S3 favors larger chunks. A simple optimization of aggregating smaller chunks that are stored adjacently, transferring them in a single access and then individually decompressing them will improve performance. NASA data pose an additional challenge: special Application Programmer Interface (API) libraries are often needed to compute some variables. These libraries are incompatible with WOS environments. Our solution involves storing computed values in the DMR++ document or a companion file, making them accessible like other variables and eliminating the need for specialized APIs. We outline specific optimizations for both satellite grid and swath data stored in HDF4-EOS2 (Earth Observing System).

James Gallagher↗

DOE OSTI2022

FAIRification, Quality Assessment, and Missingness Pattern Discovery for Spatiotemporal Photovoltaic Data

The growth of the photovoltaic market has pushed the demand for power forecasting and performance evaluation for a huge population of PV power plants. Many of these power plants have spatiotemporal coherence that can be utilized for improving model accuracy. We have demonstrated in this paper the FAIRification of spatiotemporal PV time series data. Through the creation of a solar power plant ontology, we propose standards for the naming and structure of metadata used to describe the data from these power plants. Using the structure from this ontology, we have developed both R and Python packages for the automation of the FAIRification process. Going further, we have also developed an R package that automates the analysis of the quality of a data set through the designation of letter grades. To solve the issue of data missingness, we propose the use of St-GNN autoencoders to detect and impute missing values from a data set by utilizing data from power plants nearby.

14 SOLAR ENERGY↗

DOE OSTI2024

A Data-driven approach to Determining the Fidelity in the Hardware-in-the-loop Systems using Subspace Identification Method

One of the major questions in any Hardware-in-the-loop (HiL) simulation is to understand the fidelity of the HiL simulation itself which is most often indicated qualitatively as either high or low instead of quantifying it. Being cognizant of the level of fidelity forms the crux to assess the validity and credibility of the HiL simulation. In this work, we address this issue by developing a systematic, data-driven approach to assess the fidelity of any HiL simulation, and more specifically, the fidelity of the interface between the simulator and hardware in an HiL simulation. Applying a subspace identification method, a linear system representing the interface is obtained from the time-series data captured between the hardware and simulator in the HiL simulation. Finally, the fidelity is defined based on this linear system properties. The proposed data-driven fidelity quantification framework is illustrated on the IEEE 123 node feeder system running on HYPERSIM and interacting with virtual protection relays.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS2011

Full-Scale Turbofan-Engine Turbine-Transfer Function Determination Using Three Internal Sensors

Existing NASA/Honeywell EVNERT full-scale static engine test data is analyzed by using source-separation techniques in order to determine the turbine transfer of the currently sub-dominant combustor noise. The results are used to assess the combustor-noise prediction capability of the Aircraft Noise Prediction Program (ANOPP). Time-series data from three sensors internal to the Honeywell TECH977 research engine is used in the analysis. The true combustor-noise turbine-transfer function is educed by utilizing a new three-signal approach. The resulting narrowband gain factors are compared with the corresponding constant values obtained from two empirical acoustic-turbine-loss formulas. It is found that a simplified Pratt & Whitney formula agrees better with the experimental results for frequencies of practical importance. The 130 deg downstream-direction far-field 1/3-octave sound-pressure levels (SPL) results of Hultgren & Miles are reexamined using a post-correction of their ANOPP predictions for both the total noise signature and the combustion-noise component. It is found that replacing the standard ANOPP turbine-attenuation function for combustion noise with the simplified Pratt & Whitney formula clearly improves the predictions. It is recommended that the GECOR combustion-noise module in ANOPP be updated to allow for a user-selectable switch between the current transmission-loss model and the simplified Pratt & Whitney formula. The NASA Fundamental Aeronautics Program has the principal objective of overcoming today's national challenges in air transportation. The Subsonic Fixed Wing Project's Reduce-Perceived-Noise Technical Challenge aims to develop concepts and technologies to dramatically reduce the perceived aircraft noise outside of airport boundaries. The reduction of aircraft noise is critical to enabling the anticipated large increase in future air traffic.

Hultgren, Lennart S.↗

NASA NTRS2006

Generating Control Commands From Gestures Sensed by EMG

An effort is under way to develop noninvasive neuro-electric interfaces through which human operators could control systems as diverse as simple mechanical devices, computers, aircraft, and even spacecraft. The basic idea is to use electrodes on the surface of the skin to acquire electromyographic (EMG) signals associated with gestures, digitize and process the EMG signals to recognize the gestures, and generate digital commands to perform the actions signified by the gestures. In an experimental prototype of such an interface, the EMG signals associated with hand gestures are acquired by use of several pairs of electrodes mounted in sleeves on a subject s forearm (see figure). The EMG signals are sampled and digitized. The resulting time-series data are fed as input to pattern-recognition software that has been trained to distinguish gestures from a given gesture set. The software implements, among other things, hidden Markov models, which are used to recognize the gestures as they are being performed in real time. Thus far, two experiments have been performed on the prototype interface to demonstrate feasibility: an experiment in synthesizing the output of a joystick and an experiment in synthesizing the output of a computer or typewriter keyboard. In the joystick experiment, the EMG signals were processed into joystick commands for a realistic flight simulator for an airplane. The acting pilot reached out into the air, grabbed an imaginary joystick, and pretended to manipulate the joystick to achieve left and right banks and up and down pitches of the simulated airplane. In the keyboard experiment, the subject pretended to type on a numerical keypad, and the EMG signals were processed into keystrokes. The results of the experiments demonstrate the basic feasibility of this method while indicating the need for further research to reduce the incidence of errors (including confusion among gestures). Topics that must be addressed include the numbers and arrangements of electrodes needed to acquire sufficient data; refinements in the acquisition, filtering, and digitization of EMG signals; and methods of training the pattern- recognition software. The joystick and keyboard simulations were chosen for the initial experiments because they are familiar to many computer users. It is anticipated that, ultimately, interfaces would utilize EMG signals associated with movements more nearly natural than those associated with joysticks or keyboards. Future versions of the pattern-recognition software are planned to be capable of adapting to the preferences and day-today variations in EMG outputs of individual users; this capability for adaptation would also make it possible to select gestures that, to a given user, feel the most nearly natural for generating control signals for a given task (provided that there are enough properly positioned electrodes to acquire the EMG signals from the muscles involved in the gestures).

Wheeler, Kevin R.↗

DOE OSTI2025

Data-Driven State of Health Estimation for Second-Life Batteries Using Interpolated Synthetic Data and Feature Selection

Accurate estimation of the State of Health (SOH) for second-life batteries (SLBs) is crucial given their increasing use in energy storage applications. Precise SOH prediction is essential for safe operation and robust battery management systems. A major challenge is the limited availability of datasets for building reliable degradation models. To address this, synthetic data generation through linear interpolation is performed to extend the available data, making it more representative of real-world battery operating conditions. By analyzing feature correlation with SOH, the most relevant features are selected for the model. The proposed approach employs a convolutional neural network (CNN) model trained on this interpolated, feature-selected dataset, using time series data of voltage, temperature, and current over a cycle. By focusing on highly correlated features, the model achieves over 95% accuracy, with mean absolute error and root mean squared error up to 2.27% and 2.64%, respectively, in SOH estimation for two battery datasets tested. These results highlight the potential of combining synthetic data generation and feature selection to enhance SOH predictions, showcasing the superior performance of the proposed CNN model for both new batteries and SLBs.

feature selection↗

NASA NTRS1973

Short and long periodic atmospheric variations between 25 and 200 km

Previously collected data on atmospheric pressure, density, temperature and winds between 25 and 200 km from sources including Meteorological Rocket Network data, ROBIN falling sphere data, grenade release and pitot tube data, meteor winds, chemical release winds, satellite data, and others were analyzed by a daily difference method and results on the distribution statistics, magnitude, and spatial structure of gravity wave and planetary wave atmospheric variations are presented. Time structure of the gravity wave variations were determined by the analysis of residuals from harmonic analysis of time series data. Planetary wave contributions in the 25-85 km range were discovered and found to have significant height and latitudinal variation. Long period planetary waves, and seasonal variations were also computed by harmonic analysis. Revised height variations of the gravity wave contributions in the 25 to 85 km height range were computed. An engineering method and design values for gravity wave magnitudes and wave lengths are given to be used for such tasks as evaluating the effects on the dynamical heating, stability and control of spacecraft such as the space shuttle vehicle in launch or reentry trajectories.

Justus, C. G.↗

DOE OSTI2020

First Results on Dark Matter Substructure from Astrometric Weak Lensing

Low-mass structures of dark matter (DM) are expected to be entirely devoid of light-emitting regions and baryons. Precisely because of this lack of baryonic feedback, small-scale substructures of the Milky Way are a relatively pristine testing ground for discovering aspects of DM microphysics and primordial fluctuations on subgalactic scales. In this work, we report results from the first search for Galactic DM subhalos with time-domain astrometric weak gravitational lensing. The analysis is based on a matched-filter template of local lensing corrections to the proper motion of stars in the Magellanic Clouds. We describe a data analysis pipeline detailing sample selection, background subtraction, and handling outliers and other systematics. For tentative candidate lenses, we identify a signature based on an anomalous parallax template that can unequivocally confirm the presence of a DM lens, opening up prospects for robust discovery potential with full time-series data. We present our constraints on substructure fraction f l ≲5 at 90% CL (and f l ≲2 at 50% CL) for compact lenses with radii r l <1pc, with best sensitivity reached for lens masses M l around 10 7 -10 8 M ⊙ . Parametric improvements are expected with future astrometric data sets; by end of mission, Gaia could reach f l ≲10 -3 for these massive point-like objects, and be sensitive to lighter and/or more extended subhalos for O(1) substructure fractions.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2023

A Reproducible Validation of Algorithms for Estimating Array Tilt and Azimuth from Photovoltaic Power Time Series

In this research, we assess the viability of four different, publicly available algorithms for estimating the azimuth and tilt parameters of solar photovoltaic systems using only the associated AC power time series data and site latitude-longitude coordinates. In this work, we curated a benchmarking data set of 44 fixed-tilt systems, comprising 275 measured AC power inverter data streams, with known azimuth and tilt parameters. Additionally, we isolated test cases in the data set with real- world issues, including shading and clipping, to determine how algorithm performance varies based on the presence of these phenomena. Using this data set for benchmarking, we evaluated the estimated vs. actual system characteristics for each algorithm, as well as the associated algorithm execution time using a standardized benchmarking process. The two highest performing algorithms were the Solar Data Tools and the PVWatts 5- based methods, which both achieved a median absolute error of approximately 5 and 1 degrees for azimuth and tilt, respectively. During run time analysis, the SDT method was approximately 5 times faster than the PVWatts 5-based method, with the median execution time for a stream varying between 6 and 8 seconds vs. a median run time of 31 seconds for the PVWatts 5-based method.

azimuth↗

DOE OSTI2021

Data trustworthiness signatures for nuclear reactor dynamics simulation

With the increased reliance on digitization in industrial control systems, the need for effective monitoring techniques has risen dramatically. Specifically, there is now a growing concern about the so-called false data injection (FDI) attacks. These attacks aim to alter the raw sensors’ data to cause malicious outcomes. Any serious FDI algorithm is based on an intimate knowledge of the system and its associated physics models, which renders conventional outlier/anomaly detection techniques almost obsolete in the face of such attacks. Thus, a critical need has emerged to develop a new class of defense methods that are capable of detecting FDI attacks under the assumption that the attacker has a strong familiarity with the system and its physics modeling. This class of defense methods are denoted by model-based defenses which are premised on the assumption that the attacker, while having a good understanding of the system, does not have full privileged access to all proprietary data and historical records of operation. However, (s)he is assumed to be capable of learning system behavior using self-learning techniques during an initial lie-in-wait period. To defend against this scenario, we propose a new model-based randomized window algorithm that searches time-series data for signatures that can serve as classifiers between normal and FDI scenarios. The classifiers are based on the correlations between the dominant degrees of freedom (DOFs) and the less-dominant DOFs (expected to be very sensitive to the system details that are unknown to the attacker). For demonstration, RELAP5 models are employed to calculate representative nuclear reactor behavior during a number of transient scenarios. Finally, falsified data are injected into the RELAP5-simulated behavior, and the proposed signature-identification algorithm is employed to detect the injected data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2020

The use of seismic spatial gradients in a single layer neural network for seismic source discrimination: proof of concept

This report describes a proof-of-concept method of seismic source discrimination using seismic gradiometry and a common machine learning technique. The tests described here are purely numerical, using synthetic seismic data and well understood mathematical techniques. The primary innovation described here is the application of a richer seismic data set derived from seismic gradiometry. Seismic gradiometry is a method to estimate the time variable spatial gradient of the wavefield to compute various wavefield attributes such as slowness, dynamic strain, and rotational motions. With the addition of these wavefield attributes, we are afforded up to twenty "compo- nents" of time series data measured at a single point on, or in, the Earth. This is in direct contrast to conventional three-component seismic data collected at several locations using a seismic network. Using the gradiometrically-derived wavefield components directly in a single-layer neural network, I show that it is possible to discriminate between three common seismic source types (earthquakes, explosions, and opening fractures) for various noise conditions and gradiometry configurations.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗