SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Hedrick, E., K. Reynolds, D. Bhattacharyya, S.E. Zitney, and B. Omell, "Development of Algorithms for Reinforcement Learning Augmented Model Predictive Control," AIChE 2021 Annual Meeting, Boston, MA, November 15-19 (2021).
Hedrick, E., K. Reynolds, D. Bhattacharyya, S.E. Zitney, and B. Omell, "Nonlinear Predictive Control of an Industrial Selective Catalytic Reduction Unit with Time-Varying Time Delay," AIChE 2021 Annual Meeting, Boston, MA, November 7-11 (2021).
Hedrick, E., K. Hedrick, D. Bhattacharyya, S.E. Zitney, and B.P. Omell, "Integrating Reinforcement Learning with Model Predictive Control for Adaptive Control of Energy Systems," Clearwater Clean Energy Conference, Clearwater, FL, August 1-4, 2022.
Despite three decades of extensive research and field testing that have consistently validated the benefits of Model Predictive Control (MPC) in building applications, the technology has seen limited market adoption. This paper evaluates the readiness of MPC for widespread deployment, showcases recent demonstrations and field tests across diverse building types, including residential, small commercial, large commercial, and campus settings. Our results demonstrate that MPC can optimize system operations to achieve load shifting, minimize curtailment of on-site generation, and reduce energy costs by up to 80 %, while maintaining or improving occupant comfort. We also show that MPC can effectively control large assets, such as MW-sized thermal storage systems, and respond to dynamic pricing signals. However, achieving scale remains difficult due to labor-intensive workflows, reliance on a “PhD-in-the-loop” for MPC design and maintenance, susceptibility to fragile data infrastructure, and persistent workforce education and acceptance barriers. To bridge this gap, we outline a transition from bespoke, labor intensive prototypes toward streamlined, segment-targeted deployment strategies that leverage model templates, semantic tools, and generative AI. By automating control configuration and reducing engineering effort, these recommendations provide a pathway for transforming successful research demonstrations into scalable, market ready solutions for MPC-based controls.
Using gasoline or other low reactivity fuels with a pilot injection or port fuel injection in a compression ignition engine has shown great potential in reducing NOx emissions while keeping high thermal efficiency compared to diesel. However, excessive combustion noise is caused by a high maximum pressure rise rate in the cylinder due to the higher fractions of premixed charge of the low-reactivity fuel. This noise can result in structural damage to engine components and as such, combustion noise limits the range of the operating parameters and makes the control of such engines challenging. In this study, a simulation environment was built up in MATLAB/Simulink leveraging a physics-based zero-dimension combustion model to capture the in-cylinder pressure time traces as well as metrics relevant to thermal efficiency and combustion noise. Here, in order to also facilitate the control of emissions, machine learning models were investigated to capture NOx emissions. A kernel-based extreme learning machine (K-ELM) performed best and had a coefficient of correlation (R-squared) of 0.998. The combustion and NOx emission models are valid for not only conventional gasoline fuel but also oxygenated alternative fuel blends at three different pilot injection strategies. In order to track key combustion metrics while keeping noise and emissions within constraints, a model predictive control (MPC) was applied for a compression ignition engine operating with a range of potential fuels and fuel injection strategies. The MPC is validated under different scenarios, including a load step change, fuel type change, and injection strategy change, with proportional–integral (PI) control as the baseline. The simulation results show that MPC reduces about 26% of ringing intensity in the transient process and 17% at the steady state for E30. Generally, MPC can optimize the overall performance through modifying the main injection timing, pilot fuel mass, and exhaust gas recirculation (EGR) fraction.
Integrating renewable energy and energy storage systems provides a way of operating the electrical grid system more energy efficiently and stably. Thermal storage and batteries are the most common devices for integration. However, it is not clear which integrated storage system performs better in terms of overall economics. Ice storage has low initial and maintenance costs, but there is an efficiency penalty for charging of storage and it can only shift electrical loads associated with building cooling requirements. A battery's round-trip efficiency, on the contrary, is quite consistent and batteries can be used to shift both HVAC and non-HVAC loads. However, batteries have greater initial costs and a shorter life. Finally, this research presents a tool, using model predictive control and optimal sizing, and provides a case study for comparing life-cycle economics of battery and ice storage systems for commercial buildings that have chillers for cooling and an on-site photovoltaic system.
Buildings are one of the largest energy consumers worldwide, using large amounts of energy during their construction and for climate control during operation. Active insulation systems (AIS) have been shown to reduce the energy needed for climate control in buildings by dynamically regulating the heat transferred between a building’s interior and exterior. Infrastructure-scale additive manufacturing (AM) has the potential to reduce the resources needed for building construction. Combining these two technologies into a single building envelope would create a path towards more sustainable buildings. A test was conducted for the Federal Energy Management Program (FEMP) Energy Exchange training and trade show, in August 2021, to investigate a new building envelope design, termed the Empower Wall, that utilized an AIS and was constructed using AM. Model predictive control was implemented to manage operation of the Empower Wall in concert with the existing HVAC system. Finally, the prototype system demonstrated that the Empower Wall lowered total energy consumption and reduced the cost of energy used.
Due to the occurrence of over-fitting at the learning phase, the modeling of chemical processes via artificial neural networks (ANN) by using corrupted data (i.e., noisy data) is an ongoing challenge. Therefore, this work investigates the effect of both Gaussian and non-Gaussian noise on the performance of process-structure based recurrent neural networks (RNN) models, which take the form of partially-connected RNN models in this work, that are used to approximate a class of multi-input-multi-outputs nonlinear systems. Furthermore, two different techniques, specifically Monte Carlo dropout and co-teaching, are utilized in the development of partially-connected RNN models. Here, these two techniques are employed to reduce the over-fitting in ANNs when noisy data is used in the training process and, hence, to improve the open-loop accuracy as well as the closed-loop performance under a Lyapunov-based model predictive controller (MPC). Aspen Plus Dynamics, a well-known high-fidelity process simulator, is used to simulate a large-scale chemical process application in order to demonstrate the anticipated improvements in both open-loop approximation and closed-loop controller performance in the presence of Gaussian and non-Gaussian noise in the data set using physics-informed RNNs.
This is a presentation of the paper "Multi-Model Predictive Control for Enhanced Load Following of a sCO2 Recompression Brayton Cycle" submitted to the International sCO2 Power Cycles Symposium.
The primary source of sulfur dioxide (SO 2 ) emissions is flue gas from fossil fuels-based power plants. SO 2 emissions are known to not only cause health issues, but also have an adverse effect on the environment in various ways. Several Flue Gas Desulfurization (FGD) technologies have been incorporated in power plants. The most popular technology is Wet FGD, where a limestone slurry is used to absorb SO 2 from the flue gas. A detailed droplet scale model describing the instantaneous and finite rate chemistry is developed. The ill-posed Differential-Algebraic Equation (DAE) droplet model is reformulated to a well-posed index-1 DAE through index reduction. The droplet model is integrated with the bulk phase by incorporating gas-liquid mass transfer, and an oxidation reactor model to simulate the dynamic operation of the counter-current spray scrubber. As a result, the model has a well-conditioned Jacobian and overcomes the modeling challenges of previous works and enables numerical solution without requiring carefully selected initialization or specialized solution procedures. The model is successfully validated using power plant measurements, and nonlinear model predictive control (NMPC) studies are demonstrated to optimize recycle stream flowrates to minimize pumping costs.
Explore the source record for details and available documents.
Hedrick, E., K. Hedrick, D. Bhattacharyya, S.E. Zitney, and B.P. Omell, "Model Predictive Control as a Reinforcement Learning Policy: Faster Learning Via Policy Rollouts," AIChE 2022 Annual Meeting, Phoenix, AZ, November 13-18 (2022).
Here we present a novel application of reinforcement learning (RL) for online dynamic tuning of model predictive controllers (MPC). Applying a state-action-reward-state-action (SARSA) algorithm for temporal difference learning with a control-specific reward function improves the error tracking performance of a standard MPC formulation. The proposed RL approach is also readily adaptable to other MPCs, or entirely different control approaches. Practical details for the implementation of the RL-MPC algorithm are also presented. The proposed algorithm is applied to a case study of controlling nitrogen oxide (NO x ) emissions in an industrial selective catalytic reduction (SCR) unit, a control problem characterized by significant nonlinearity and time delay. Along with an RL-MPC formulation for NOx control, another MPC is proposed to mitigate ammonia slip and decrease ammonia consumption in the SCR. Results showing the efficacy of the RL-MPC for NO x control through learning and implementation on the nonlinear SCR dynamic model are presented.
Paper targets SPEEDAM 2024 (https://www.speedam.org). The paper provides details of a model predictive control designed to operate a four-zone medium-voltage AC/DC electric ship.
Due to the fast advancement of communication and information technology, intelligent buildings have garnered great interest. These buildings can forecast weather, ambient temperature, and sun irradiation and can modify heating, ventilation, and air conditioning (HVAC) operations appropriately, based on current and previous data. This change is intended to reduce HVAC system energy usage while maintaining an appropriate degree of thermal comfort and indoor air quality. Since its inception, model predictive control (MPC) has been one of the prospective solutions for HVAC management systems to reduce both costs and energy usage. Additionally, MPC is becoming increasingly practical as the processing capacity of building automation systems increases and a large quantity of monitored building data becomes available. MPC also provides the potential to improve the energy efficiency of HVAC systems via its capacity to consider limitations, to predict disruptions, and to factor in multiple competing goals such as interior thermal comfort and building energy consumption. Although substantial research has been conducted on MPC in building HVAC systems, there is a shortage of critical reviews and a lack of a comprehensive framework that formulates and defines the applications. Here, this article provides a comprehensive state-of-the-art overview of MPC in HVAC systems. Detailed discussions of modeling approaches and optimization algorithms are included. Numerous design aspects such as prediction horizon, occupancy behavior, building type, and cost function, that impact MPC performance are discussed in detail. The technical characteristics, advantages, and disadvantages of various types of modeling software are discussed. The primary objective of this work is to highlight critical design characteristics for the MPC control scheme and to give improved suggestions for future research. Moreover, numerous prospective scenarios have been suggested that might provide future research direction.
We develop an online data-enabled predictive (ODeePC) control method for trajectory tracking of unknown systems, building upon the recently proposed DeePC. Our proposed ODeePC method leverages a primal-dual algorithm with real-time measurement feedback to iteratively compute the corresponding real-time optimal control policy as system conditions change. Specifically, our developed ODeePC: a) records data from the unknown system and updates the underlying primal-dual algorithm dynamically, b) can track changes in the system's operating point and adjust the control inputs, and c) is computationally efficient as it deploys a Fast Fourier Transform-based algorithm enabling the fast computation of the product of a non-square Hankel matrix with a vector. We provide theoretical guarantees regarding the asymptotic behavior of ODeePC and demonstrate its performance through a power system application.
Dabadghao, V., D.A. Allan, M. Li, J.C. Eslick, J. Ma, S.E. Zitney, D. Bhattacharyya, and L.T. Biegler, “Nonlinear Model Predictive Control for Solid-Oxide Electrolysis Cell Systems,” AIChE 2022 Annual Meeting, Phoenix, AZ, November 13-18 (2022).
Abstract Solid oxide cells (SOCs) are a promising dual‐mode technology for the production of hydrogen through high‐temperature water electrolysis, and the generation of power through a fuel cell reaction that consumes hydrogen. Switching between these two modes as the price of electricity fluctuates requires reversible SOC operation and accurate tracking of hydrogen and power production set points. Moreover, a well‐functioning control system is important to avoid cell degradation during mode‐switching operation. In this article, we apply nonlinear model predictive control (NMPC) to an SOC module and supporting equipment and compare NMPC performance to classical proportional‐integral (PI) control strategies, while switching between the modes of hydrogen and power production. While both control methods provide similar performance across various metrics during mode switching, NMPC demonstrates a significant advantage in reducing cell thermal gradients and curvatures (mixed spatial‐temporal partial derivatives), thereby helping to mitigate long‐term degradation.