Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “autoregressive models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Linear and nonlinear ARMA model parameter estimation using an artificial neural network

This paper addresses parametric system identification of linear and nonlinear dynamic systems by analysis of the input and output signals. Specifically, we investigate the relationship between estimation of the system using a feedforward neural network model and estimation of the system by use of linear and nonlinear autoregressive moving-average (ARMA) models. By utilizing a neural network model incorporating a polynomial activation function, we show the equivalence of the artificial neural network to the linear and nonlinear ARMA models. We compare the parameterization of the estimated system using the neural network and ARMA approaches by utilizing data generated by means of computer simulations. Specifically, we show that the parameters of a simulated ARMA system can be obtained from the neural network analysis of the simulated data or by conventional least squares ARMA analysis. The feasibility of applying neural networks with polynomial activation functions to the analysis of experimental data is explored by application to measurements of heart rate (HR) and instantaneous lung volume (ILV) fluctuations.

NASA Discipline Regulatory Physiology↗

ARMAX-Based Transfer Function Model Identification Using Wide-Area Measurement for Adaptive and Coordinated Damping Control

One of the main drawbacks of the existing oscillation damping controllers that are designed based on offline dynamic models is adaptivity to the power system operating condition. With the increasing availability of wide-area measurements and the rapid development of system identification techniques, it is possible to identify a measurement-based transfer function model online that can be used to tune the oscillation damping controller. Such a model could capture all dominant oscillation modes for adaptive and coordinated oscillation damping control. our paper describes a comprehensive approach to identify a low-order transfer function model of a power system using a multi-input multi-output (MIMO) autoregressive moving average exogenous (ARMAX) model. This methodology consists of five steps: 1) input selection; 2) output selection; 3) identification trigger; 4) model estimation; and 5) model validation. The proposed method is validated by using ambient data and ring-down data in the 16-machine 68-bus Northeast Power Coordinating Council system. Our results demonstrate that the measurement-based model using MIMO ARMAX can capture all the dominant oscillation modes. Compared with the MIMO subspace state space model, the MIMO ARMAX model has equivalent accuracy but lower order and improved computational efficiency. The proposed model can be applied for adaptive and coordinated oscillation damping control.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Multi-Scale Temporal Patterns in Stream Biogeochemistry Indicate Linked Permafrost and Ecological Dynamics of Boreal Catchments

Temporal patterns in stream chemistry provide integrated signals describing the hydrological and ecological state of whole catchments. However, stream chemistry integrates multi-scale signals of processes occurring in both the catchment and stream. Deconvoluting these signals could identify mechanisms of solute transport and transformation and provide a basis for monitoring ecosystem change. Here, we applied trend analysis, wavelet decomposition, multivariate autoregressive state-space modeling, and analysis of concentration-discharge relationships to assess temporal patterns in high-frequency (15 min) stream chemistry from permafrost-influenced boreal catchments in Interior Alaska at diel, storm, and seasonal time scales. We compared catchments that varied in spatial extent of permafrost to identify characteristic biogeochemical signals. Catchments with higher spatial extents of permafrost were characterized by increasing nitrate concentration through the thaw season, an abrupt increase in nitrate and fluorescent dissolved organic matter (fDOM) and declining conductivity in late summer, and flushing of nitrate and fDOM during summer rainstorms. In contrast, these patterns were absent, of lower magnitude, or reversed in catchments with lower permafrost extent. Solute dynamics revealed a positive influence of permafrost on fDOM export and the role of shallow, seasonally dynamic flowpaths in delivering solutes from high-permafrost catchments to streams. Lower spatial extent of permafrost resulted in static delivery of nitrate and limited transport of fDOM to streams. Shifts in concentration-discharge relationships and seasonal trends in stream chemistry toward less temporally dynamic patterns might therefore indicate reorganized catchment hydrology and biogeochemistry due to permafrost thaw.

54 ENVIRONMENTAL SCIENCES↗

Partner with a Third-Party Delivery Service or Not? A Prediction-and-Decision Tool for Restaurants Facing Takeout Demand Surges During a Pandemic

Amidst the COVID-19 pandemic, restaurants become more reliant on no-contact pick-up or delivery ways for serving customers. As a result, they need to make tactical planning decisions such as whether to partner with online platforms, to form their own delivery team, or both. In this paper, we develop an integrated prediction-decision model to analyze the profit of combining the two approaches and to decide the needed number of drivers under stochastic demand. We first use the susceptible-infected-recovered (SIR) model to forecast future infected cases in a given region and then construct an autoregressive-moving-average (ARMA) regression model to predict food-ordering demand. Using predicted demand samples, we formulate a stochastic integer program to optimize food delivery plans. We conduct numerical studies using COVID-19 data and food-ordering demand data collected from local restaurants in Nuevo Leon, Mexico, from April to October 2020, to show results for helping restaurants build contingency plans under rapid market changes. Our method can be used under unexpected demand surges, various infection/vaccination status, and demand patterns. Here, our results show that a restaurant can benefit from partnering with third-party delivery platforms when (i) the subscription fee is low, (ii) customers can flexibly decide whether to order from platforms or from restaurants directly, (iii) customers require more efficient delivery, (iv) average delivery distance is long, or (v) demand variance is high.

97 MATHEMATICS AND COMPUTING↗

Short-term apartment-level load forecasting using a modified neural network with selected auto-regressive features

Residential electricity load profiles and their diversity have become increasingly important to realize the benefits of Smart or Transactive Energy Networks (TENs). An important element of TENs will be practical, accurate, and implementable residential load forecasting techniques. While there have been many approaches to short-term load forecasting, few have included forecasting for individual households, partly because the high volatility and idiosyncrasies present in individual household load data can pose significant challenges. In this study, we develop a Convolutional Long Short-Term Memory-based neural network with Selected Autoregressive Features (termed a CLSAF model) to improve short-term household electricity load forecasting accuracy by employing three strategies: autoregressive features selection, exogenous features selection, and a “default” state to avoid overfitting at times of high load volatility. We include aggregations of apartments to floor and building level, because utilities may favor transactive approaches that rely on aggregator models, e.g., a cluster of consumers as opposed to an individual. We demonstrate that the CLSAF model, by virtue of its enhanced feature representation and modest computational resources, can accomplish load forecasting in a multi-family residential building across three spatial granularities (individual apartment/household, floor, and building levels), with an accuracy improvement of up to 25% compared to a persistence model. We propose a data screening technique to characterize time-series electricity-load data. This technique is suitable for integration into a TEN ecosystem and allows one to estimate confidence levels of the load forecasts to optimize computational resources and the risks associated with uncertain forecasts.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Machine Learned Empirical Numerical Integrator from Simulated Data

Recently, a number of state-of-the-art surrogate machine learning (ML) models have been designed for global weather and climate prediction, which have been trained using reanalysis data products. Reanalysis data products are constructed using numerical model simulations that combine numerical integration of partial differential equations and parameterization schemes. These products are typically only archived and made available using coarsened spatial and temporal resolutions. This study explores the impact of the numerical generation methods used to produce the training datasets and the temporal resolution of those datasets on machine learning surrogate models. Using the nonlinear vector autoregression (NVAR) machine as an explainable ML technique, simple dynamical systems are emulated with ML models trained on data produced by three classical numerical integration schemes. NVAR is validated as a skillful ML method, capable of producing accurate predictions and, more importantly, reconstructing both the underlying dynamics and the numerical integration scheme used to generate the training data. However, the machine fails to generalize predictions on unseen test data generated by different numerical integration schemes, despite the underlying dynamical system being the same. This result provides a word of caution for the growing field of machine learning emulation of weather and climate dynamics. Furthermore, we illustrate using NVAR that training on temporally coarsened data may increase the required complexity of ML models and potentially introduce new numerical challenges. Finally, we discover that empirical integration schemes with arbitrary time-stepping sizes can be constructed directly from the data, which implies a potential for the development of empirical numerical integration schemes.

54 ENVIRONMENTAL SCIENCES↗

Nonlinear time-series-based adaptive control applications

A control design methodology based on a nonlinear time-series reference model is presented. It is indicated by highly nonlinear simulations that such designs successfully stabilize troublesome aircraft maneuvers undergoing large changes in angle of attack as well as large electric power transients due to line faults. In both applications, the nonlinear controller was significantly better than the corresponding linear adaptive controller. For the electric power network, a flexible AC transmission system with series capacitor power feedback control is studied. A bilinear autoregressive moving average reference model is identified from system data, and the feedback control is manipulated according to a desired reference state. The control is optimized according to a predictive one-step quadratic performance index. A similar algorithm is derived for control of rapid changes in aircraft angle of attack over a normally unstable flight regime. In the latter case, however, a generalization of a bilinear time-series model reference includes quadratic and cubic terms in angle of attack.

Mohler, R. R.↗

Data-Driven Linear Parameter-Varying Modeling and Control of Flexible Loads for Grid Services

Flexible loads have great potential to improve the electric grid's flexibility and stability. To effectively control large ensembles of heterogeneous loads, reliable models thereof are required. This paper presents a data-driven modeling and control approach to manage flexible loads for providing grid services. We leverage a linear parameter-varying autoregressive moving average (LPV-ARMA) model to describe the aggregate load response, where the parameters in the model are used to capture external environmental impacts (e.g., weather). A gain-scheduling feedback controller is then developed to adapt to environmental variations. This data-driven approach can be easily applied to different types of loads in various environmental conditions. In addition to the ensemble controller, distributed load controllers are designed to deliver grid services, while maintaining the quality of service of inherent load tasks. We demonstrate the work on the IEEE 37-node distribution system for real-time power regulation services through control of thermostatically controlled loads.

61 RADIATION PROTECTION AND DOSIMETRY↗

Exploring Spatiotemporal Relations Between Soil Moisture, Precipitation, and Streamflow for a Large Set of Watersheds Using Google Earth Engine

An understanding of streamflow variability and its response to changes in climate conditions is essential for water resource planning and management practices that will help to mitigate the impacts of extreme events such as floods and droughts on agriculture and other human activities. This study investigated the relationship between precipitation, soil moisture, and streamflow over a wide range of watersheds across the United States using Google Earth Engine (GEE). The correlation analyses disclosed a strong association between precipitation, soil moisture, and streamflow, however, soil moisture was found to have a higher correlation with the streamflow relative to precipitation. Results indicated different strength of the association depends on the watershed classes and lag times assessments. The perennial watersheds showed higher coherence compared to intermittent watersheds. Previous month precipitation and soil moisture have a stronger influence on the current month streamflow, particularly in the snow-dominated watersheds. Monthly streamflow forecasting models were developed using an autoregressive integrated moving average (ARIMA) and support vector machine (SVM). The results showed that the SVM model generally performed better than the ARIMA model. Overall streamflow forecasting model performance varied considerably among watershed classes, and perennial watersheds tend to exhibit better predictably compared to intermittent watersheds due to lower streamflow variability. The SVM models with precipitation and streamflow inputs performed better than those with streamflow input only. Results indicated that the inclusion of antecedent root-zone soil moisture improved the streamflow forecasting in most of the watersheds, and the largest improvements occurred in the intermittent watersheds. In conclusion, this work demonstrated that knowing the relationship between precipitation, soil moisture, and streamflow in different watershed classes will enhance the understanding of the hydrologic process and can be effectively utilized in improving streamflow forecasting for better satellite-based water resource management strategies.

Nazmus Sazib↗

Joint Seasonal ARMA Approach for Modeling of Load Forecast Errors in Planning Studies

To make informed and robust decisions in the probabilistic power system operation and planning process, it is critical to conduct multiple simulations of the generated combinations of wind and load parameters and their forecast errors to handle the variability and uncertainty of these time series. In order for the simulation results to be trustworthy, the simulated series must preserve the salient statistical characteristics of the real series. In this paper, we analyze day-ahead load forecast error data from multiple balancing authority locations and characterize statistical properties such as mean, standard deviation, autocorrelation, correlation between series, time-of-day bias, and time-of-day autocorrelation. We then construct and validate a seasonal autoregressive moving average (ARMA) model to model these characteristics, and use the model to jointly simulate day-ahead load forecast error series for all BAs.

Power system planning, Operations, Probabilistic m↗

Multilevel Analysis, Design, and Modeling of Coupling Advanced Nuclear Reactors and Thermal Energy Storage in an Integrated Energy System

This report discusses the different options for coupling thermal energy storage (TES) systems to advanced nuclear power plants (A-NPPs) in order to enable flexible and hybrid plant operation. An advanced light-water reactor (A LWR), a high-temperature gas-cooled reactor (HTGR) and a liquid-metal fast reactor (LMFR) were selected as the initial use cases for demonstrating a thermally balanced energy storage coupling design for thermal power extraction. The models presented herein showcase several design considerations, focusing on optimal deployment methodologies for achieving steady-state and transient-state operation with minimum disruption to the nuclear power cycle. This first part of the study presents steady-state models developed using Aspen HYSYS®, with the thermal energy bypass for NPP-TES coupling being varied at up to 50%. The various components were sized using the Aspen Process Economic Analyzer (APEA) and Aspen Exchanger Design and Rating (EDR), when applicable. Cost functions from these models were developed using the latest publicly available data obtained from APEA V11. The TES-coupled A-NPP steady-state models and cost functions then provided a baseline for dynamic operation and process optimization by using Idaho National Laboratory (INL)’s Framework for Optimization of Resources and Economics (FORCE) tools. A stochastic optimization of the various energy storage systems coupled to the A-NPPs was then performed using the Risk Analysis Virtual Environment (RAVEN) and its dispatch optimization plugin, the Holistic Energy Resource Optimization Network (HERON). The signal processing and synthetic history capabilities of RAVEN were used to account for the unpredictable behavior of electricity markets. An autoregressive moving average (ARMA) model was used to analyze price signals from the Pennsylvania-New Jersey-Maryland (PJM) market and were applied to the HERON analysis in order to optimize a system with the best economics. Transient modeling evaluation was then performed using Modelica models within the HYBRID repository, which was developed at INL for the Department of Energy Integrated Energy Systems program for the characterization of dynamic integrated system behavior and feedback. This includes evaluation of the TES-coupled A-LWR systems’ impact on physical and thermal system response during imposed system demands. Additional TES-coupled reactor types, coupling approaches, markets, and TES technologies will be evaluated in future work.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Do Machine Learning Approaches Offer Skill Improvement for Short-Term Forecasting of Wind Gust Occurrence and Magnitude?

Abstract Wind gusts, and in particular intense gusts, are societally relevant but extremely challenging to forecast. This study systematically assesses the skill enhancement that can be achieved using artificial neural networks (ANNs) for forecasting of wind gust occurrence and magnitude. Geophysical predictors from the ERA5 reanalysis are used in conjunction with an autoregressive term in regression and ANN models with different predictors, and varying model complexity. Models are derived and assessed for the warm (April–September) and cold (October–March) seasons for three high passenger volume airports in the United States. Model uncertainty is assessed by deriving models for 1000 different randomly selected training (70%) and testing (30%) subsets. Gust prediction fidelity in independent test samples is critically dependent on inclusion of an autoregressive term. Gust occurrence probabilities derived using five-layer ANNs exhibit consistently higher fidelity than those from regression models and shallower ANNs. Inclusion of the autoregressive term and increasing the number of hidden layers in ANNs from 1 to 5 also improve the model performance for gust magnitudes (lower RMSE, increased correlation, and model standard deviations that more closely approximate observed values). Deeper ANNs (e.g., 20 hidden layers) exhibit higher skill in forecasting strong (17–25.7 m s −1 ) and damaging (≥25.7 m s −1 ) wind gusts. However, such deep networks exhibit evidence of overfitting and still substantially underestimate (by 50%) the frequency of strong and damaging wind gusts at the three airports considered herein. Significance Statement Improved short-term forecasting of wind gusts will enhance aviation safety and logistics and may offer other societal benefits. Here we present a rigorous investigation of the relative skill of models of wind gust occurrence and magnitude that employ different statistical methods. It is shown that artificial neural networks (ANNs) offer considerable skill enhancement over regression methods, particularly for strong and damaging wind gusts. For wind gust magnitudes in particular, application of deeper learning networks (e.g., five or more hidden layers) offers tangible improvements in forecast accuracy. However, deeper networks are vulnerable to overfitting and exhibit substantial variability with the specific training and testing data subset used. Also, even deep ANNs reproduce only half of strong and damaging wind gusts. These results indicate the need for future work to elucidate the dynamical mechanisms of intense wind gusts and advance solutions to their prediction.

54 ENVIRONMENTAL SCIENCES↗

An efficient approach to ARMA modeling of biological systems with multiple inputs and delays

This paper presents a new approach to AutoRegressive Moving Average (ARMA or ARX) modeling which automatically seeks the best model order to represent investigated linear, time invariant systems using their input/output data. The algorithm seeks the ARMA parameterization which accounts for variability in the output of the system due to input activity and contains the fewest number of parameters required to do so. The unique characteristics of the proposed system identification algorithm are its simplicity and efficiency in handling systems with delays and multiple inputs. We present results of applying the algorithm to simulated data and experimental biological data In addition, a technique for assessing the error associated with the impulse responses calculated from estimated ARMA parameterizations is presented. The mapping from ARMA coefficients to impulse response estimates is nonlinear, which complicates any effort to construct confidence bounds for the obtained impulse responses. Here a method for obtaining a linearization of this mapping is derived, which leads to a simple procedure to approximate the confidence bounds.

Non-NASA Center↗

Sensitivity of the U.S. economy to oil prices controlling for domestic production and imports

This paper investigates the sensitivity of U.S. economic performance to oil price changes, accounting for changes in the domestic petroleum supply-demand balance over the last decade. Herein, a non-linear (asymmetric) autoregressive distributed lag (NARDL) model is used to estimate the U.S. GDP elasticity with respect to the oil price, controlling for oil production, consumption and imports, and macroeconomic variables. The positive and negative components of the oil price both have statistically significant long-run impacts on the real U.S. GDP. The parameter estimates imply that a 1% positive and permanent oil price shock, all else the same, would have a long-run impact of –0.045% on the U.S. economy (an elasticity of –0.045), but short-run parameters on the positive oil price terms are not significant at the 10% level. The long-run parameter on the negative oil price component term implies an elasticity of –0.034. Thus, controlling for domestic U.S. oil production and oil trade, the long-run oil price elasticity of the U.S. GDP remains within the range of estimates from previous studies. The results also show that domestic oil production and consumption have short-run impacts on the U.S. GDP. The potential extent of interactions among these variables, and implications for the net economic impacts, under an oil price shock are subjects of future research.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

SECULAR STELLAR DYNAMICS NEAR A MASSIVE BLACK HOLE

The angular momentum evolution of stars close to massive black holes (MBHs) is driven by secular torques. In contrast to two-body relaxation, where interactions between stars are incoherent, the resulting resonant relaxation (RR) process is characterized by coherence times of hundreds of orbital periods. In this paper, we show that all the statistical properties of RR can be reproduced in an autoregressive moving average (ARMA) model. We use the ARMA model, calibrated with extensive N-body simulations, to analyze the long-term evolution of stellar systems around MBHs with Monte Carlo simulations. We show that for a single-mass system in steady state, a depression is carved out near an MBH as a result of tidal disruptions. Using Galactic center parameters, the extent of the depression is about 0.1 pc, of similar order to but less than the size of the observed 'hole' in the distribution of bright late-type stars. We also find that the velocity vectors of stars around an MBH are locally not isotropic. In a second application, we evolve the highly eccentric orbits that result from the tidal disruption of binary stars, which are considered to be plausible precursors of the 'S-stars' in the Galactic center. We find that RR predicts more highly eccentric (e > 0.9) S-star orbits than have been observed to date.

79 ASTRONOMY AND ASTROPHYSICS↗

Flexible and scalable methods for quantifying stochastic variability in the era of massive time-domain astronomical data sets

We present the use of continuous-time autoregressive moving average (CARMA) models as a method for estimating the variability features of a light curve, and in particular its power spectral density (PSD). CARMA models fully account for irregular sampling and measurement errors, making them valuable for quantifying variability, forecasting and interpolating light curves, and variability-based classification. We show that the PSD of a CARMA model can be expressed as a sum of Lorentzian functions, which makes them extremely flexible and able to model a broad range of PSDs. We present the likelihood function for light curves sampled from CARMA processes, placing them on a statistically rigorous foundation, and we present a Bayesian method to infer the probability distribution of the PSD given the measured light curve. Because calculation of the likelihood function scales linearly with the number of data points, CARMA modeling scales to current and future massive time-domain data sets. We conclude by applying our CARMA modeling approach to light curves for an X-ray binary, two active galactic nuclei, a long-period variable star, and an RR Lyrae star in order to illustrate their use, applicability, and interpretation.

79 ASTRONOMY AND ASTROPHYSICS↗

Investigation of a breathing surrogate prediction algorithm for prospective pulmonary gating

Purpose: A major challenge of four dimensional computed tomography (4DCT) in treatment planning and delivery has been the lack of respiration amplitude and phase reproducibility during image acquisition. The implementation of a prospective gating algorithm would ensure that images would be acquired only during user-specified breathing phases. This study describes the development and testing of an autoregressive moving average (ARMA) model for human respiratory phase prediction under quiet respiration conditions. Methods: A total of 47 4DCT patient datasets and synchronized respiration records was utilized in this study. Three datasets were used in model development and were removed from further evaluation of the ARMA model. The remaining 44 patient datasets were evaluated with the ARMA model for prediction time steps from 50 to 1000 ms in increments of 50 and 100 ms. Thirty-five of these datasets were further used to provide a comparison between the proposed ARMA model and a commercial algorithm with a prediction time step of 240 ms. Results: The optimal number of parameters for the ARMA model was based on three datasets reserved for model development. Prediction error was found to increase as the prediction time step increased. The minimum prediction time step required for prospective gating was selected to be half of the gantry rotation period. The maximum prediction time step with a conservative 95% confidence criterion was found to be 0.3 s. The ARMA model predicted peak inhalation and peak exhalation phases significantly better than the commercial algorithm. Furthermore, the commercial algorithm had numerous instances of missed breath cycles and falsely predicted breath cycles, while the proposed model did not have these errors. Conclusions: An ARMA model has been successfully applied to predict human respiratory phase occurrence. For a typical CT scanner gantry rotation period of 0.4 s (0.2 s prediction time step), the absolute error was relatively small, 0.06{+-}0.02 s at peak inhalation and 0.05{+-}0.04 s at peak exhalation. The application of the ARMA model for prospective pulmonary gating has been demonstrated.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

KARMA4

KARMA4 is a C++ library for autoregressive moving average (ARMA) modeling and forecasting of time-series data while incorporating both process and observation error. KARMA4 is designed for fitting and forecasting of time-series data for predictive purposes.

Khalil, Mohammad↗