Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “time series prediction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
NASA NTRS1999

Phase Time and Envelope Time in Time-Distance Analysis and Acoustic Imaging

Time-distance analysis and acoustic imaging are two related techniques to probe the local properties of solar interior. In this study, we discuss the relation of phase time and envelope time between the two techniques. The location of the envelope peak of the cross correlation function in time-distance analysis is identified as the travel time of the wave packet formed by modes with the same w/l. The phase time of the cross correlation function provides information of the phase change accumulated along the wave path, including the phase change at the boundaries of the mode cavity. The acoustic signals constructed with the technique of acoustic imaging contain both phase and intensity information. The phase of constructed signals can be studied by computing the cross correlation function between time series constructed with ingoing and outgoing waves. In this study, we use the data taken with the Taiwan Oscillation Network (TON) instrument and the Michelson Doppler Imager (MDI) instrument. The analysis is carried out for the quiet Sun. We use the relation of envelope time versus distance measured in time-distance analyses to construct the acoustic signals in acoustic imaging analyses. The phase time of the cross correlation function of constructed ingoing and outgoing time series is twice the difference between the phase time and envelope time in time-distance analyses as predicted. The envelope peak of the cross correlation function between constructed ingoing and outgoing time series is located at zero time as predicted for results of one-bounce at 3 mHz for all four data sets and two-bounce at 3 mHz for two TON data sets. But it is different from zero for other cases. The cause of the deviation of the envelope peak from zero is not known.

Chou, Dean-Yi↗
DOE OSTI2020

Delegated Regressor, A Robust Approach for Automated Anomaly Detection in the Soil Radon Time Series Data

We propose a new method based on the idea of delegating regressors for predicting the soil radon gas concentration (SRGC) and anomalies in radon or any other time series data. The proposed method is compared to different traditional boosting e.g., Extreme Gradient Boosting (EGB) and simple regression methods e.g., support vector regressors with linear kernel and radial kernel in terms of accurate predictions. R language has been used for the statistical analysis of radon time series (RTS) data. The results obtained show that the proposed methodology predicts SRGC more accurately when compared to different traditional boosting and regression methods. The best correlation is found between the actual and predicted radon concentration for window size of 2 i.e., two days before and after the start of seismic activities. RTS data was collected from 05 February 2017 to 16 February 2018, including 7 seismic events recorded during the study period. Findings of study show that the proposed methodology predicts the SRGC with more precision, for all the window sizes, by overlapping predicted with the actual radon time series concentrations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Prediction of chronic kidney disease progression using recurrent neural network and electronic health records

Chronic kidney disease (CKD) is a progressive loss in kidney function. Early detection of patients who will progress to late-stage CKD is of paramount importance for patient care. To address this, we develop a pipeline to process longitudinal electronic heath records (EHRs) and construct recurrent neural network (RNN) models to predict CKD progression from stages II/III to stages IV/V. The RNN model generates predictions based on time-series records of patients, including repeated lab tests and other clinical variables. Our investigation reveals that using a single variable, the recorded estimated glomerular filtration rate (eGFR) over time, the RNN model achieves an average area under the receiver operating characteristic curve (AUROC) of 0.957 for predicting future CKD progression. When additional clinical variables, such as demographics, vital information, lab test results, and health behaviors, are incorporated, the average AUROC increases to 0.967. In both scenarios, the standard deviation of the AUROC across cross-validation trials is less than 0.01, indicating a stable and high prediction accuracy. Our analysis results demonstrate the proposed RNN model outperforms existing standard approaches, including static and dynamic Cox proportional hazards models, random forest, and LightGBM. The utilization of the RNN model and the time-series data of previous eGFR measurements underscores its potential as a straightforward and effective tool for assessing the clinical risk of CKD patients concerning their disease progression.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Structure-Informed Graph Learning of Networked Dependencies for Online Prediction of Power System Transient Dynamics

Online transient analysis plays an increasingly important role in dynamic power grids as the renewable generation continues growing. Traditional numerical methods for transient analysis not only are computationally intensive but also require precise contingency information as input, and therefore, are not suitable for online applications. Existing online transient assessment studies focus on the determination of post-contingency system stability or stability margin. Here, this paper develops a novel graph-learning framework, Deep-learning Neural Representation or DNR, for online prediction, of the time-series trajectories of the system states using initial system responses that can be measured by phasor measurement units (PMUs). The proposed DNR framework consists of two sequential modules: a Network Constructor that captures network dependencies among generators, and a Dynamics Predictor that predicts the system trajectories. The key to improved prediction performance is the introduction of the spatio-temporal message-passing operations into graph neural networks with structural knowledge. Its effectiveness and scalability are validated through comparative studies, demonstrating the prediction performance under different contingency scenarios for systems of different sizes. This framework provides a solution to online predicting post-fault system dynamics based on real-time PMU measurements. Additionally, it can also be applied to facilitate the offline transient simulation without simulating the entire trajectories.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Symbolic pregression: Discovering physical laws from distorted video

In this work, we present a method for unsupervised learning of equations of motion for objects in raw and optionally distorted unlabeled synthetic video (or, more generally, for discovering and modeling predictable features in time-series data). We first train an autoencoder that maps each video frame into a low-dimensional latent space where the laws of motion are as simple as possible, by minimizing a combination of nonlinearity, acceleration, and prediction error. Differential equations describing the motion are then discovered using Pareto-optimal symbolic regression. We find that our pre-regression (“pregression”) step is able to rediscover Cartesian coordinates of unlabeled moving objects even when the video is distorted by a generalized lens. Using intuition from multidimensional knot theory, we find that the pregression step is facilitated by first adding extra latent space dimensions to avoid topological problems during training and then removing these extra dimensions via principal component analysis. An inertial frame is autodiscovered by minimizing the combined equation complexity for multiple experiments.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

MAD: Self-Supervised Masked Anomaly Detection Task for Multivariate Time Series

In this paper, we introduce Masked Anomaly Detection (MAD), a general self-supervised learning task for multivariate time series anomaly detection. With the increasing availability of sensor data from industrial systems, being able to detecting anomalies from streams of multivariate time series data is of significant importance. Given the scarcity of anomalies in real-world applications, the majority of literature has been focusing on modeling normality. The learned normal representations can empower anomaly detection as the model has learned to capture certain key underlying data regularities. A typical formulation is to learn a predictive model, i.e., use a window of time series data to predict future data values. In this paper, we propose an alternative self-supervised learning task. By randomly masking a portion of the inputs and training a model to estimate them using the remaining ones, MAD is an improvement over the traditional left-to-right next step prediction (NSP) task. Our experimental results demonstrate that MAD can achieve better anomaly detection rates over traditional NSP approaches when using exactly the same neural network (NN) base models, and can be modified to run as fast as NSP models during test time on the same hardware, thus making it an ideal upgrade for many existing NSP-based NN anomaly detection models.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Artificial intelligence time series forecasting for feed-forward laser stabilization

Laser plasma accelerators, typically operating at 1–10 Hz repetition rates, have the ability to produce high-quality electron beams in compact, all-optical-driven configurations, with the electron beams uniquely suited for a wide variety of accelerator-based applications. However, fluctuations and drifts in the laser delivery to the meter-scaled and below plasma target (the electron beam source) will translate into electron beam source variations that can limit their utility for demanding applications like light sources or linear colliders. Commercially available active feedback laser stabilization systems are intrinsically bandwidth limited due to their integration with multi-inch corrective mirror mounts which minimizes their effectiveness. In this manuscript, we present a Neural Network time series forecaster that can predict laser position fluctuations of the laser delivery to the final target well ahead of a future laser shot. The Root-Mean-Square-Error (RMSE) of the prediction accuracy was < 2 μ m for a 1 / e 2 beam radius of 34 μ m . Our feed-forward approach serves as a first-step in circumventing the bandwidth limitations imposed by the currently available stabilization systems since it allows for mirrors to be moved into position ahead of time to offset the predicted future position drift. This will help advance laser plasma accelerator research by providing greater robustness and stability needed for its applications.

Berger, Curtis↗
DOE OSTI2022

An LSTM Deep Learning Network for ¿Background Radiation Prediction

Determination of appropriate background radiation is important in any measurement application. Environmental radiation monitors and monitors used to assess dose to individuals outside of controlled areas are particularly susceptible to changes in readings due to fluctuations in the environmental conditions. These fluctuations (e.g. radon progeny concentrations) lead to changes in the detector response in the actual radiation environment, and they need to be taken into account when extracting the net operational doses. Work has been ongoing to apply advances in Deep Learning and Artificial Intelligence to account for changes in detector responses based on environmental parameters; in particular, a Long-Short Term Memory (LSTM) Deep Learning architecture has been utilized to incorporate time-series data into a prediction model. In this work, we present the current status of the project to predict radiation measurements based on meteorological conditions and air packet trajectories extracted using the National Oceanic and Atmospheric Administration's (NOAA) Hybrid Single-Particle Lagrangian Integrated Trajectory (HYSPLIT4) model.

Degtiarenko, Pavel↗
NASA NTRS2011

Full-Scale Turbofan-Engine Turbine-Transfer Function Determination Using Three Internal Sensors

Existing NASA/Honeywell EVNERT full-scale static engine test data is analyzed by using source-separation techniques in order to determine the turbine transfer of the currently sub-dominant combustor noise. The results are used to assess the combustor-noise prediction capability of the Aircraft Noise Prediction Program (ANOPP). Time-series data from three sensors internal to the Honeywell TECH977 research engine is used in the analysis. The true combustor-noise turbine-transfer function is educed by utilizing a new three-signal approach. The resulting narrowband gain factors are compared with the corresponding constant values obtained from two empirical acoustic-turbine-loss formulas. It is found that a simplified Pratt & Whitney formula agrees better with the experimental results for frequencies of practical importance. The 130 deg downstream-direction far-field 1/3-octave sound-pressure levels (SPL) results of Hultgren & Miles are reexamined using a post-correction of their ANOPP predictions for both the total noise signature and the combustion-noise component. It is found that replacing the standard ANOPP turbine-attenuation function for combustion noise with the simplified Pratt & Whitney formula clearly improves the predictions. It is recommended that the GECOR combustion-noise module in ANOPP be updated to allow for a user-selectable switch between the current transmission-loss model and the simplified Pratt & Whitney formula. The NASA Fundamental Aeronautics Program has the principal objective of overcoming today's national challenges in air transportation. The Subsonic Fixed Wing Project's Reduce-Perceived-Noise Technical Challenge aims to develop concepts and technologies to dramatically reduce the perceived aircraft noise outside of airport boundaries. The reduction of aircraft noise is critical to enabling the anticipated large increase in future air traffic.

Hultgren, Lennart S.↗
DOE OSTI2023

Early Alarm: Robust Event Analysis for Power Systems using 1-D Fully Convolutional Network

This work presents a novel deep learning model for early, accurate, and robust detection, recognition, and temporal localization of multi-type events in large-scale power systems. The proposed method develops a unified 1-D fully convolutional network (FCN) model that takes time series of raw frequency signals measured from a power system as input, extracts distinguishing features, and predicts at every temporal point in the time series if an event is happening and what the type of the event is. Compared to existing methods, the proposed model eliminates the necessity for hand-crafted feature extraction or complicated data pre-processing, can flexibly handle input signals of arbitrary length, and precisely infer the event occurrence time. Most importantly, the model is intentionally trained with incomplete patterns, such that it is more robust to partial features of an event which is common in real-world online recognition, resulting in early alarm for power system failures. Extensive experimental results demonstrate that the proposed method achieves superior performance to the state-of-the-art, and also shows strong robustness to noise and system oscillations.

Li, Chengcheng↗
DOE OSTI2020

Transient Weighted Moving-Average Model of Photovoltaic Module Back-Surface Temperature

Accurate modeling of photovoltaic (PV) performance requires the precise calculation of module temperature. Currently, most temperature models rely on steady-state assumptions that do not account for the transient climatic conditions and thermal mass of the module. On the other hand, complex physics-based transient models are computationally expensive and difficult to parameterize. In order to address this, a new approach to transient thermal modeling was developed, in which the steady-state predictions from previous timesteps are weighted and averaged to accurately predict the module temperature at finer time scales. This model is informed by 3-D finite-element analyses, which are used to calculate the effect of wind speed and module unit mass on module temperature. The model, in application, serves as an added filter over existing steady-state models that smooths out erroneous values that are a result of intermittency in solar resource. Validation of this moving-average model has shown that it can improve the overall PV energy performance model accuracy by as much as 0.58% over steady-state models based on mean absolute error improvements and can significantly reduce the variability between the model predictions and measured temperature times series data.

14 SOLAR ENERGY↗
DOE OSTI2024

System and method for wave prediction

A method and system for prediction of wave properties include collecting time series data streams from one or more wave measurement devices and processing the data using a wave-prediction algorithm to identify the frequency components of the data and compute wave parameters. The wave-field is propagated in space and time to predict wave height, speed, and velocity at a target location. A sliding window approach is used to continuously update the prediction in real-time.

Previsic, Mirko↗
DOE OSTI2024

System and method for wave prediction

A method and system for prediction of wave properties include collecting time-series data streams from one or more wave measurement devices and processing the data to identify data parameters to establish boundary conditions of a numerical model. The numerical model may be used to compute a predicted wave field of time-series data for a variety of wave properties at a target location.

Previsic, Mirko↗
DOE OSTI2022

Long-term missing value imputation for time series data using deep neural networks

We present an approach that uses a deep learning model, in particular, a MultiLayer Perceptron, for estimating the missing values of a variable in multivariate time series data. We focus on filling a long continuous gap (e.g., multiple months of missing daily observations) rather than on individual randomly missing observations. Our proposed gap filling algorithm uses an automated method for determining the optimal MLP model architecture, thus allowing for optimal prediction performance for the given time series. We tested our approach by filling gaps of various lengths (three months to three years) in three environmental datasets with different time series characteristics, namely daily groundwater levels, daily soil moisture, and hourly Net Ecosystem Exchange. We compared the accuracy of the gap-filled values obtained with our approach to the widely used R-based time series gap filling methods ImputeTS and mtsdi. The results indicate that using an MLP for filling a large gap leads to better results, especially when the data behave nonlinearly. Thus, our approach enables the use of datasets that have a large gap in one variable, which is common in many long-term environmental monitoring observations.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2011

Weekly Solutions of Time-Variable Gravity from 1993 to 2010

The GRACE mission has been highly successful in determining the time-variable gravity field of the Earth, producing monthly or even more frequent solutions (cf. 10-day) solutions using both spherical harmonics and mascons. However the GRACE time series only commences in 2002 - 2003 and a gap of several years may occur in the series before a GRACE follow-on satellite is launched. Satellites tracked by SLR and DORIS have also been used to study time variations in the Earth's gravitational field. These include (most recently) the solutions of Cox and Chao (2002), Cheng et al. (2004, 2007) and Lemoine et al. (2007). In this paper we discuss the development of a new time series of low degree spherical harmonic fields based on the available SLR, DORIS and GPS data. We develop simultaneous solutions for both the geocenter and the low degree harmonics up to 5x5. The solutions integrate data from SLR geodetic satellites (e.g., Lageos1, Lageos2, Starlette, Stella, Ajisai, Larets, Westpac), altimetry satellites (TOPEX/Poseidon, Envisat, Jason-1, Jason-2), and satellites tracked solely by DORIS (e.g. SPOT2-5). We discuss some pertinent aspects of the satellite-specific modeling. We include altimeter crossovers in the weekly solutions where feasible and time permits. The resulting geocenter time series is compared with geophysical model predictions and other independently-derived solutions. Over the GRACE time period the fidelity and consistency with the GRACE solutions are presented.

Lemoine, F.↗
NASA NTRS1994

The short-term prediction of universal time and length of day using atmospheric angular momentum

The ability to predict short-term variations in the Earth's rotation has gained importance in recent years owing to more precise spacecraft tracking requirements. Universal time (UT1), that component of the Earth's orientation corresponding to the rotation angle, can be measured by number of high-precision space geodetic techniques. A Kalman filter developed at the Jet Propulsion Laboratory (JPL) optimally combines these different data sets and generates a smoothed times series and a set of predictions for UT1, as well as for additional Earth orientation components. These UT1 predictions utilize an empirically derived random walk stochastic model for the length of the day (LOD) and require frequent and up-to-date measurements of either UT1 or LOD to keep errors from quickly accumulating. Recent studies have shown that LOD variations are correlated with changes in the Earth's axial atmospheric angular momentum (AAM) over timescales of several years down to as little as 8 days. AAM estimates and forecasts out to 10 days are routinely available from meteorological analysis centers; these data can supplement geodetic measurements to improve the short-term prediction of LOD and have therefore been incorporated as independent data types in the JPL Kalman filter. We find that AAM and, to a lesser extent, AAM forecast data are extremely helpful in generating accurate near-real-time estimates of UT1 and LOD and in improving short-term predictions of these quantities out to about 10 days.

Freedman, A. P.↗
NASA NTRS1971

Crime prediction modeling

A study of techniques for the prediction of crime in the City of Los Angeles was conducted. Alternative approaches to crime prediction (causal, quasicausal, associative, extrapolative, and pattern-recognition models) are discussed, as is the environment within which predictions were desired for the immediate application. The decision was made to use time series (extrapolative) models to produce the desired predictions. The characteristics of the data and the procedure used to choose equations for the extrapolations are discussed. The usefulness of different functional forms (constant, quadratic, and exponential forms) and of different parameter estimation techniques (multiple regression and multiple exponential smoothing) are compared, and the quality of the resultant predictions is assessed.

Source record↗