Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “auto-regressive model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

34 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS1984

Identification of the dynamics of a two-dimensional grid structure using least square lattice filters

It is doubtful whether the dynamics of large space structures (LSS) can be predicted well enough for control system design applications. Hence, dynamic modeling from on-orbit measurements followed by a modification of the control system is of interest, taking into account the utilization of adaptive control concepts. The present paper is concerned with the model determination phase of the adaptive control problem. Using spectral decoupling to determine mode shapes, mode frequency and damping data can be obtained with the aid of an equation error parameter identification method. This method employs a second-order auto-regressive moving average (ARMA) model to represent the natural mode amplitudes. The discussed procedure involves an extension of the application of the least square lattice filter in system identification to a nonintegral, two-dimensional grid structure made of overlapping bars.

Montgomery, R. C.↗
DOE OSTI2023

Grid-Integrated Production of Fischer-Tropsch Synfuels from Nuclear Power

Idaho National Laboratory (INL) investigates the relative economic profitability of an integrated energy system (IES) coupling an NPP with a synfuel production process at selected case study locations across the United States. In the synfuel IES, a high-temperature steam electrolysis (HTSE) plant is thermally and electrically coupled with an NPP to produce zero-carbon hydrogen. The synthetic fuel is produced from this H 2 combined with a CO 2 supply using the reverse water gas shift process followed by the Fischer-Tropsch (FT) reaction. This analysis considers a system in which the CO 2 is sourced from regional CO 2 emitters via the construction and operation of pipeline-based CO 2 supply networks. Locating the FT plant at the same site as the NPP and HTSE plants enables the NPP to provide zero-carbon heat and power to the HTSE plant and zero-carbon power to the FT plant as well as avoid the requirement for long-distance H 2 product transport from the HTSE plant to the FT plant. Hydrogen storage is used to enable the NPP to dispatch power to the electrical grid (instead of the HTSE plant) when grid demand increases, thus enabling the FT plant to continue to operate in a steady-state production mode. The ability to cease hydrogen production for several hours within each day enables the NPP to provide power to the grid to balance the electricity market during peak periods and maximize revenues for the nuclear synfuel IES. The FT process design considered has a 99% carbon conversion efficiency. The use of nuclear energy and nuclear energy-derived hydrogen enables synfuel production to achieve this high level of carbon utilization. Additionally, the life-cycle carbon emissions of the nuclear-based synfuel production process are very low, with WTW emissions of approximately 25 gCO 2 e/MJ, including steam credits (generated from FT process excess heat), and approximately 7 gCO 2 e/MJ, if steam credits are excluded. This compares favorably with the WTW emissions of 90.5 gCO 2 e/MJ for a compression-ignition, direct injection (CIDI) vehicle with a fuel economy of 31.6 miles per gallon gasoline equivalent (MPGGE), using low-sulfur diesel produced using conventional petroleum production and refining processes. Several NPPs in various regions of the U.S. are considered as case study analyses. Supply locations and transportation via pipeline of the CO 2 feedstock to the NPP site are analyzed through the National Energy Technology Laboratory (NETL) CO 2 Transport Cost model. The team finds that the amount of CO 2 generated by different sectors is sufficient for the synfuel production process at all locations considered. The CO 2 transportation costs are functions of the distance of the source to the NPP location, the CO 2 capture cost at the source, and the quantity of CO 2 transported. Historical electricity prices for the NPP case study locations are collected and analyzed. Monthly average prices, price range, and duration of negative-price periods vary among these locations. For each location, an auto-regressive moving average (ARMA) model is trained on historical electricity price data. ARMA validation is done to ensure the synthetic price distributions represent one of historical prices with high fidelity. Synthetic time series from these ARMA models are used in a coupled dispatch and system optimization in the Holistic Energy Resource Optimization Network (HERON) to compute the differential net present value (NPV) of the IES. The team finds that this econometric is positive, ranging from $14M–1.3bn (2020) depending on the location. The optimal synfuel IES configuration to obtain this increase in NPV often maximizes the size of the synfuel production process with regards to the size of the NPP. However, the team shows that the NPP still plays a stabilizing role for the grid: In periods of high prices and high loads, more electricity from the NPP is sent to the grid. A high variability of electricity prices and extreme maximum prices tend to drive up electricity production. While it requires significant investment, the synfuel IES could increase the economic profitability for the existing fleet of LWRs across the country while still maintaining the grid stabilizer role of NPPs. During its lifetime, the main costs for the nuclear synfuel IES are the carbon feedstock transportation costs, followed by the capital expenses (CAPEX) and operation and maintenance (O&M) costs while the revenue comes first from the IRA H 2 production tax credit (PTC) and then from the sales of synfuel products. The profitability of the synfuel IES is most sensitive to the value of the hydrogen PTC and the synfuel products as well as the cost of the carbon feedstock, highlighting the importance of governmental incentives regarding hydrogen, carbon emissions, and synfuel in driving the deployment of future nuclear synfuel IESs.

08 HYDROGEN↗
DOE OSTI2020

A low-complexity non-intrusive approach to predict the energy demand of buildings over short-term horizons

Reliable, non-intrusive, short-term (of up to 12 hours ahead) prediction of a building's energy demand is a critical component of intelligent energy management applications. A number of such approaches have been proposed over time, utilizing various statistical and, more recently, machine learning techniques, such as decision trees, neural networks and support vector machines. Importantly, all of these works barely outperform simple seasonal auto-regressive integrated moving average models, while their complexity is significantly higher. Here, we propose a novel low-complexity non-intrusive approach that improves the predictive accuracy of the state-of-the-art by up to ~10%. The backbone of our approach is a K-nearest neighbours search method, that exploits the demand pattern of the most similar historical days, and incorporates appropriate time-series pre-processing and easing. In the context of this work, we evaluate our approach against state-of-the-art methods and provide insights on their performance.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS2004

GPC-Based Stable Reconfigurable Control

This paper presents development of multi-input multi-output (MIMO) Generalized Pre-dictive Control (GPC) law and its application to reconfigurable control design in the event of actuator saturation. A Controlled Auto-Regressive Integrating Moving Average (CARIMA) model is used to describe the plant dynamics. The control law is derived using input-output description of the system and is also related to the state-space form of the model. The stability of the GPC control law without reconfiguration is first established using Riccati-based approach and state-space formulation. A novel reconfiguration strategy is developed for the systems which have actuator redundancy and are faced with actuator saturation type failure. An elegant reconfigurable control design is presented with stability proof. Several numerical examples are presented to demonstrate the application of various results.

Soloway, Don↗
DOE OSTI2020

Detection of DoS Attacks Using ARFIMA Modeling of GOOSE Communication in IEC 61850 Substations

Integration of Information and Communication Technology (ICT) in modern smart grids (SGs) offers many advantages including the use of renewables and an effective way to protect, control and monitor the energy transmission and distribution. To reach an optimal operation of future energy systems, availability, integrity and confidentiality of data should be guaranteed. Research on the cyber-physical security of electrical substations based on IEC 61850 is still at an early stage. In the present work, we first model the network traffic data in electrical substations, then, we present a statistical Anomaly Detection (AD) method to detect Denial of Service (DoS) attacks against the Generic Object Oriented Substation Event (GOOSE) network communication. According to interpretations on the self-similarity and the Long-Range Dependency (LRD) of the data, an Auto-Regressive Fractionally Integrated Moving Average (ARFIMA) model was shown to describe well the GOOSE communication in the substation process network. Based on this ARFIMA-model and in view of cyber-physical security, an effective model-based AD method is developed and analyzed. Two variants of the statistical AD considering statistical hypothesis testing based on the Generalized Likelihood Ratio Test (GLRT) and the cumulative sum (CUSUM) are presented to detect flooding attacks that might affect the availability of the data. Our work presents a novel AD method, with two different variants, tailored to the specific features of the GOOSE traffic in IEC 61850 substations. The statistical AD is capable of detecting anomalies at unknown change times under the realistic assumption of unknown model parameters. The performance of both variants of the AD method is validated and assessed using data collected from a simulation case study. We perform several Monte-Carlo simulations under different noise variances. The detection delay is provided for each detector and it represents the number of discrete time samples after which an anomaly is detected. In fact, our statistical AD method with both variants (CUSUM and GLRT) has around half the false positive rate and a smaller detection delay when compared with two of the closest works found in the literature. Our AD approach based on the GLRT detector has the smallest false positive rate among all considered approaches. Whereas, our AD approach based on the CUSUM test has the lowest false negative rate thus the best detection rate. Depending on the requirements as well as the costs of false alarms or missed anomalies, both variants of our statistical detection method can be used and are further analyzed using composite detection metrics.

IEC 61850 electrical substations↗
DOE OSTI2025

Predicting Initial Trans-Membrane Pressure for Optimized Operations in UF Unit Using Random Forest

With the growing scarcity of freshwater, innovative process design mechanisms like Reverse Osmosis (RO) are increasingly gaining attention among water treatment utilities to address the rising demand. Ensuring reliable water production necessitates efficient resource utilization, minimizing downtime in (ultra-filtration) UF systems. Recent advancements in machine learning (ML) have enabled the development of accurate data-driven models for Model Predictive Control (MPC), often requiring minimal prior knowledge of underlying physical processes. In this study, we present predictive regression models based on Random Forest (RF) and Auto-Regressive (AR) approaches to forecast the initial Trans-Membrane Pressure (TMP) for each filtration cycle in data generated by Direct Potable Reuse (DPR) systems. The proposed RF-based model demonstrates superior performance compared to baseline methods, including historical mean, Last Observation Carried Forward (LOCF), and naïve AR models, across various forecasting horizons in terms of root mean square error (RMSE) metric. To evaluate how different classes of process variables contribute to TMP dynamics over time, we examine the feature importance of independent covariates across multiple forecast horizons. This analysis provides insight into the temporal relevance of operational and sensor-derived features, guiding control and monitoring strategies. Additionally, the impact of hyperparameter tuning on TMP prediction performance is studied for both direct and recursive RF modelling approaches across increasing forecast horizons. Accurate prediction of initial TMP is critical for optimizing RO operations, as it enables the development of robust modelling frameworks by accurately estimating membrane fouling trends, thereby enhancing process efficiency and long-term reliability. The demonstrated efficacy of the RF-based approach highlights its potential as a tool for real-time decision-making in water treatment systems, paving the way for advanced process optimization and sustainable water resource management.

Mukherjee, Subrata [ORNL] (ORCID:0000000309930338)↗
DOE OSTI2025

Predicting Initial Trans-Membrane Pressure for Optimized Operations in UF Unit Using Random Forest

With the growing scarcity of freshwater, innovative process design mechanisms like Ultra-filtration(UF) units are increasingly gaining attention among water treatment utilities to address the rising demand. Ensuring reliable water production necessitates efficient resource utilization, minimizing downtime in UF systems. Recent advancements in machine learning (ML) have enabled the development of accurate data-driven models for Model Predictive Control (MPC), often requiring minimal prior knowledge of underlying physical processes. In this study, we present predictive regression models based on Random Forest (RF) and Auto-Regressive (AR) approaches to forecast the initial Trans-Membrane Pressure (TMP) for each filtration cycle in data generated by Direct Potable Reuse (DPR) systems. The proposed RF-based model demonstrates superior performance compared to baseline methods, including historical mean, Last Observation Carried Forward (LOCF), and naïve AR models, across various forecasting horizons in terms of root mean square (RMSE) metric. Accurate prediction of initial TMP is critical for optimizing CCRO operations, as it enables the development of robust modelling frameworks that enhance process efficiency and reliability. The demonstrated efficacy of the RF-based approach highlights its potential as a tool for real-time decision-making in water treatment systems, paving the way for advanced process optimization and sustainable water resource management.

Mukherjee, Subrata [ORNL] (ORCID:0000000309930338)↗
NASA NTRS2012

Development, Verification and Use of Gust Modeling in the NASA Computational Fluid Dynamics Code FUN3D

This paper presents the implementation of gust modeling capability in the CFD code FUN3D. The gust capability is verified by computing the response of an airfoil to a sharp edged gust. This result is compared with the theoretical result. The present simulations will be compared with other CFD gust simulations. This paper also serves as a users manual for FUN3D gust analyses using a variety of gust profiles. Finally, the development of an Auto-Regressive Moving-Average (ARMA) reduced order gust model using a gust with a Gaussian profile in the FUN3D code is presented. ARMA simulated results of a sequence of one-minus-cosine gusts is shown to compare well with the same gust profile computed with FUN3D. Proper Orthogonal Decomposition (POD) is combined with the ARMA modeling technique to predict the time varying pressure coefficient increment distribution due to a novel gust profile. The aeroelastic response of a pitch/plunge airfoil to a gust environment is computed with a reduced order model, and compared with a direct simulation of the system in the FUN3D code. The two results are found to agree very well.

Bartels, Robert E.↗
DOE OSTI2025

Artificial neural networks estimate evapotranspiration for Miscanthus × giganteus as effectively as empirical model but with fewer inputs

Estimating actual evapotranspiration (ET) is particularly crucial for addressing how vegetation affects the water balance of ecosystems. ET estimation can be complex with empirical models due to their many parameters and reliance on aridity. In contrast, artificial neural networks (ANNs) could potentially estimate ET with fewer and more common meteorological parameters. In this study, we trained two ANNs, one using a feed-forward approach (FFN) and the other a nonlinear auto-regressive network (NARX), to predict ET and compared them to the commonly used empirical model Granger and Gray (GG). We trained our models on a nine-year eddy covariance (EC) dataset for Miscanthu s × giganteus ( M . × giganteus ) from Illinois (UIEF), then tested them using out-of-sample data from both UIEF and a different location in Iowa (SABR) to compare the accuracy of FFN, NARX, and GG models in estimating daily ET. A combination of air temperature (T a ) and solar radiation (R s ) was chosen as inputs due to the highest R 2 for FFN (R 2 = 0.79, 0.81, and 0.79 for training, testing, and validation, respectively) and only T a for NARX (R 2 = 0.70 for out-of-sample validation). The predictive power of the FFN model was superior to the NARX and GG models at the UIEF site (R 2 = 0.84, 0.70, and 0.83 for out-of-sample validation, respectively). Our analysis showed that ANN approaches are as accurate as empirical approaches for estimating ET but use fewer inputs.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Recalibration of missing low-frequency variability and trends in the North Atlantic Oscillation

Abstract Multi-decadal trends in the wintertime North Atlantic Oscillation (NAO) are under-represented by coupled general circulation models (CGCMs), consistent with a lack of autocorrelation in their NAO index series. This study proposes and tests two simple “reddening” approaches for correcting this problem in simulated indices based on simple one parameter short-term (AR; Auto-Regressive order 1) and long-term (FD; Fractional-Difference) time series filters. Using CGCMs from the Coupled Model Intercomparison Project Phase 6 (CMIP6), the FD filter successfully improves the autocorrelation structure of the NAO, and in turn the simulation of extreme trends, while the AR filter is less successful. The 1963–1993 NAO trend is the maximum 31-year trend in the historical period. Raw CGCMs underestimate the likelihood of this trend by a factor of ten but this discrepancy is corrected after reddening. CMIP6 future projections show that long-term (2024–2094) NAO ensemble mean trends systematically increase with the magnitude of radiative forcing: -2.4 to 3.5 hPa/century for low-to-high forcing after reddening (more than double the range using raw output). The related likelihood of future maximum 31year trends comparable to 1963–1993 ranges from 3 to 7% whereas none of these CMIP6 projections simulate this without reddening. Near-term projections of the next 31 years (2024–2054) are less sensitive than long term trends to the future scenario, showing weak-to-no forced trend. However, reddening increases the ensemble range by 74% (to +/-1 standard deviation/decade), which could increase/decrease regional climate change signals in the Northern Hemisphere by magnitudes that are underestimated when using raw CGCM output.

Meteorology & Atmospheric Sciences↗
DOE OSTI2025

A Machine Learning Approach for Hourly Traffic Prediction Used in EV-Charging Sites

Reliable forecasting of hourly traffic volumes on highways is critical for planning and operating electric-vehicle charging infrastructure without overloading the grid. In this work, we develop and evaluate a station-specific machine-learning approach based on NeuralProphet, enhanced with conditional seasonality to better distinguish weekday, weekend, and holiday patterns. For each station, the model automatically retrieves the same calendar day from the prior years as an AR-Net initialization, fits trend and Fourier-based seasonality components, and then applies short-term auto-regressive corrections. We train and test on 2021 and 2022 TMAS data, respectively, and validate performance over the whole year. We chose to demonstrate how the model performs on a typical weekday (3/15/2022), weekend (3/27/2022), and a special holiday (12/25/2022). Our results yield MAPE of 7.4%, 23.6%, and 32.0%, respectively. Over the entire year 2022, the overall MAPE was 17%. This demonstrates that station-specific models with conditional seasonality can achieve accurate, scalable hourly forecasts for EV-charging load planning.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2026

SPUS-Small-PDE-U-net-Solver

Small PDE U-Net Solver (SPUS) is a compact and efficient foundation model (FM) designed as a unified neural operator for solving a wide range of partial differentialequations (PDEs). SPUS leverages a lightweight residual U-Net-based architecture as a foundation model architecture. To enable effective learning in this minimalist framework, SPUS utilizes a simple yet powerful auto-regressive pretraining strategy which closely replicates the behavior of numerical solvers to learn the underlying physics. SPUS is designed to be pretrained on a diverse set of fluid dynamics PDEs from public benchmark datasets.

Siddik, Abu↗
DOE OSTI2025

Discrete generative diffusion models without stochastic differential equations: A tensor network approach

Diffusion models (DMs) are a class of generative machine learning methods that sample a target distribution by transforming samples of a trivial (often Gaussian) distribution using a learned stochastic differential equation. In standard DMs, this is done by learning a “score function” that reverses the effect of adding diffusive noise to the distribution of interest. Here we consider the generalisation of DMs to lattice systems with discrete degrees of freedom, and where noise is added via Markov chain jump dynamics. We show how to use tensor networks (TNs) to efficiently define and sample such “discrete diffusion models” (DDMs) without explicitly having to solve a stochastic differential equation. We show the following: (i) by parametrising the data and evolution operators as TNs, the denoising dynamics can be represented exactly; (ii) the auto-regressive nature of TNs allows to generate samples efficiently and without bias; (iii) for sampling Boltzmann-like distributions, TNs allow to construct an efficient learning scheme that integrates well with Monte Carlo. We illustrate this approach to study the equilibrium of two models with non-trivial thermodynamics, the d = 1 constrained Fredkin chain and the d = 2 Ising model. Published by the American Physical Society 2025

Causer, Luke (ORCID:0000000194243473)↗
NASA NTRS1996

A study of GPS measurement errors due to noise and multipath interference for CGADS

This report describes a study performed by the Colorado Center for Astrodynamics Research (CCAR) on GPS measurement errors in the Codeless GPS Attitude Determination System (CGADS) due to noise and multipath interference. Preliminary simulation models fo the CGADS receiver and orbital multipath are described. The standard FFT algorithms for processing the codeless data is described and two alternative algorithms - an auto-regressive/least squares (AR-LS) method, and a combined adaptive notch filter/least squares (ANF-ALS) method, are also presented. Effects of system noise, quantization, baseband frequency selection, and Doppler rates on the accuracy of phase estimates with each of the processing methods are shown. Typical electrical phase errors for the AR-LS method are 0.2 degrees, compared to 0.3 and 0.5 degrees for the FFT and ANF-ALS algorithms, respectively. Doppler rate was found to have the largest effect on the performance.

Axelrad, Penina↗
DOE OSTI2021

Short-term apartment-level load forecasting using a modified neural network with selected auto-regressive features

Residential electricity load profiles and their diversity have become increasingly important to realize the benefits of Smart or Transactive Energy Networks (TENs). An important element of TENs will be practical, accurate, and implementable residential load forecasting techniques. While there have been many approaches to short-term load forecasting, few have included forecasting for individual households, partly because the high volatility and idiosyncrasies present in individual household load data can pose significant challenges. In this study, we develop a Convolutional Long Short-Term Memory-based neural network with Selected Autoregressive Features (termed a CLSAF model) to improve short-term household electricity load forecasting accuracy by employing three strategies: autoregressive features selection, exogenous features selection, and a “default” state to avoid overfitting at times of high load volatility. We include aggregations of apartments to floor and building level, because utilities may favor transactive approaches that rely on aggregator models, e.g., a cluster of consumers as opposed to an individual. We demonstrate that the CLSAF model, by virtue of its enhanced feature representation and modest computational resources, can accomplish load forecasting in a multi-family residential building across three spatial granularities (individual apartment/household, floor, and building levels), with an accuracy improvement of up to 25% compared to a persistence model. We propose a data screening technique to characterize time-series electricity-load data. This technique is suitable for integration into a TEN ecosystem and allows one to estimate confidence levels of the load forecasts to optimize computational resources and the risks associated with uncertain forecasts.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Anomaly Detection for Online Monitoring of Thermocouple Sensors in the Advanced Test Reactor

This study explores data-driven anomaly detection methods to analyze sensor fail- ures in the Advanced Gas Reactor (AGR) nuclear fuel irradiation experiments. Specifically, we examine failures of thermocouples (TCs), which are critical for mon- itoring and controlling in-reactor temperatures during operation. Failures were pri- marily observed during abrupt power transitions and manifested as sensor drop-outs, drifts, or unexplained behavior. We applied three time-series analysis techniques— rolling mean smoothing, matrix profile, and vector auto-regression (VAR)—to de- tect anomalies in TC data prior to failure events. The rolling mean method effec- tively highlighted deviations aligned with reported failures, while the matrix profile provided partial early warning but sometimes flagged normal fluctuations during power-down periods. VAR shows potential in capturing multivariate dependencies but requires further calibration. A rare case of TC drift was also documented, which did not result in failure, underscoring the challenge of building predictive models with sparse positive examples. Our findings demonstrate that traditional statistical tools can aid anomaly detection but have limited predictive power without richer training data. We propose future directions including synthetic data generation, real- time surrogate modeling, and multi-modal feature integration. This work provides a foundation for applying robust anomaly detection frameworks to mission-critical sensor systems in experimental settings.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗