Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model Predictive Control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Time-Varying Output Delay Compensation-A Model-Free Approach and its Application on Cooperative On-Ramp Merging

This paper presents a model-free approach to compensate for time-varying output delay in networked control systems. The proposed architecture combines a model-free observer and the Smith predictor. The model-free observer estimates the current state while handling modeling errors and uncertainties of the system. The Smith predictor moves the effect of time delay outside the control closed-loop using the estimated delayed output and the actual output of the plant. The proposed method is applied to a cooperative on-ramp merging problem. First, an ultra-local model predictive control is implemented to provide a computationally efficient online speed planner agnostic to the vehicle dynamics. After that, a model-free observer is designed to estimate the current state. Finally, the proposed architecture is tested against a time-varying output delay with an upper bound of 200 milliseconds. The results demonstrate the effectiveness of the proposed method with improved tracking of intervehicle distance.

Waleed khan, Muhammad [The University of Texas at ↗
DOE OSTI2023

Adaptive Deep Reinforcement Learning Algorithm for Distribution System Cyber Attack Defense With High Penetration of DERs

With grid modernization, smart inverters are increasingly used to execute advanced controls for distribution network reliability. However, this also increases the cyber-attack space. Here this paper focuses on the defense approaches to restore the system to normal operation circumstances in the presence of cyber-attacks. A unique deep reinforcement learning (DRL) method is developed to minimize voltage violations and reduce power losses for impacted feeders. The defense problem is reformulated as a Markov decision-making process to dynamically control DERs while minimizing load shedding. This is achieved via an improved soft actor-critic (SAC)-based DRL algorithm, which can govern DER set points and load-shedding scenarios in discrete and continuous modes via the auto-tune entropy and Gaussian policy features. Numerical comparison results on the modified IEEE 123-node system with other control approaches, such as Volt-VAR (VV), Volt-Watt (VW), and model predictive control (MPC) show that the proposed method can eliminate voltage violations and provide feasible control actions that perform complete mitigation of cyber-threats.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Optimizing Control for Efficient Load Shifting with Thermal Energy Storage in Existing HVAC Systems

This project developed the integration of a direct-contact heat exchanger (DCHX) based thermal energy storage (TES) system with a chiller–air handling unit (AHU) plant to evaluate its potential for reducing building energy costs. Detailed physical models of the TES unit, building envelope, and HVAC components were developed alongside simplified control-oriented models to support both high-fidelity simulation and real-time optimization. Two control strategies were implemented and compared: a rule-based control (RBC) aligned with utility time-of-use (ToU) rates, and a model predictive control (MPC) framework leveraging forecasts of building load, weather, and internal gains.Simulation results show that the RBC strategy reduced daily electricity costs by around 30% by shifting cooling production from on-peak to off-peak hours. In contrast, the MPC strategy achieved significantly greater performance, reducing daily operating costs by up to 44% and peak-hour costs by more than 60%. Both strategies maintained indoor thermal comfort within acceptable limits, with MPC further improving load distribution and reducing equipment cycling.The outcomes confirm that TES integration, particularly when coordinated with advanced predictive control, can provide substantial cost savings and on-peak demand reduction. . These findings directly support the U.S. Department of Energy’s goals for grid-interactive efficient buildings and demonstrate the potential of TES-enabled HVAC systems for scalable deployment across the commercial building.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2025

Optimizing Control for Efficient Load Shifting with Thermal Energy Storage in Existing HVAC Systems

This project developed the integration of a direct-contact heat exchanger (DCHX) based thermal energy storage (TES) system with a chiller–air handling unit (AHU) plant to evaluate its potential for reducing building energy costs. Detailed physical models of the TES unit, building envelope, and HVAC components were developed alongside simplified control-oriented models to support both high-fidelity simulation and real-time optimization. Two control strategies were implemented and compared: a rule-based control (RBC) aligned with utility time-of-use (ToU) rates, and a model predictive control (MPC) framework leveraging forecasts of building load, weather, and internal gains. Simulation results show that the RBC strategy reduced daily electricity costs by around 30% by shifting cooling production from on-peak to off-peak hours. In contrast, the MPC strategy achieved significantly greater performance, reducing daily operating costs by up to 44% and peak-hour costs by more than 60%. Both strategies maintained indoor thermal comfort within acceptable limits, with MPC further improving load distribution and reducing equipment cycling. The outcomes confirm that TES integration, particularly when coordinated with advanced predictive control, can provide substantial cost savings and on-peak demand reduction. . These findings directly support the U.S. Department of Energy’s goals for grid-interactive efficient buildings and demonstrate the potential of TES-enabled HVAC systems for scalable deployment across the commercial building.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Online data-enabled predictive control

We develop an online data-enabled predictive (ODeePC) control method for optimal control of unknown systems, building on the recently proposed DeePC (Coulson et al., 2019). Our proposed ODeePC method leverages a primal-dual algorithm with real-time measurement feedback to iteratively compute the corresponding real-time optimal control policy as system conditions change. The proposed ODeePC conceptual-wise resembles standard adaptive system identification and model predictive control (MPC), but it provides a new alternative for the standard methods. ODeePC is enabled by computationally efficient methods that exploit the special structure of the Hankel matrices in the context of DeePC with Fast Fourier Transform (FFT) and primal-dual algorithm We provide theoretical guarantees regarding the asymptotic behavior of ODeePC, and we demonstrate its performance through numerical examples.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Learning Constrained Parametric Differentiable Predictive Control Policies With Guarantees

We present differentiable predictive control (DPC), a method for offline learning of constrained neural control policies for nonlinear dynamical systems with performance guarantees. We show that the sensitivities of the parametric optimal control problem can be used to obtain direct policy gradients. Specifically, we employ automatic differentiation (AD) to efficiently compute the sensitivities of the model predictive control (MPC) objective function and constraints penalties. To guarantee safety upon deployment, we derive probabilistic guarantees on closed-loop stability and constraint satisfaction based on indicator functions and Hoeffding’s inequality. We empirically demonstrate that the proposed method can learn neural control policies for various parametric optimal control tasks. In particular, we show that the proposed DPC method can stabilize systems with unstable dynamics, track time-varying references, and satisfy nonlinear state and input constraints. Our DPC method has practical time savings compared to alternative approaches for fast and memory-efficient controller design. Specifically, DPC does not depend on a supervisory controller as opposed to approximate MPC based on imitation learning. We demonstrate that, without losing performance, DPC is scalable with greatly reduced demands on memory and computation compared to implicit and explicit MPC while being more sample efficient than model-free reinforcement learning (RL) algorithms.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

NMPC for Mode-Switching Operation of Reversible Solid Oxide Cell Systems

Solid oxide cells (SOCs) are a promising dual-mode technology that generates hydrogen through high-temperature water electrolysis and generates power through a fuel cell reaction that consumes hydrogen. Reversible operation of SOCs requires a transition between these two modes for hydrogen production setpoints as the demand and price of electricity fluctuate. Moreover, a well-functioning control system is important to avoid cell degradation during mode-switching operation. In this work, we apply nonlinear model predictive control (NMPC) to an SOC module and supporting equipment and compare NMPC performance to classical proportional integral (PI) control strategies, while ramping between the modes of hydrogen and power production. While both control methods provide similar performance in many metrics, NMPC significantly reduces cell thermal gradients and curvatures (mixed spatial-temporal partial derivatives) during mode switching. A dynamic process flowsheet of the reversible SOC system was developed in the open-source, equation-based IDAES modeling framework. Our IDAES dynamic simulation results show that NMPC can ramp the SOC system between hydrogen and power production targets within short mode-switching times. Moreover, NMPC can comply with operating limits in the SOC system more effectively than PI, and only NMPC can directly enforce user-specified limits for mixed spatial-temporal partial derivatives of temperature. This allows for management of the trade-off be-tween operating efficiency and cell degradation, which is dependent on these temperature curvatures.

Li, Mingrui↗
DOE OSTI2022

DC-Link Current Minimization Control for Current Source Converter-Based Solid-State Transformer

This article proposes a fast predictive control method and a small DC-link inductor to minimize the DC-link current in current-source converter (CSC)-based solid-state transformer. The DC-link current minimization can significantly reduce power loss and improve efficiency. The challenge of this problem is on improving both steady-state and dynamic performance. PI control methods and large DC-link inductors are conventionally used in the CSC but have limited dynamic performance. A model predictive control (MPC) method is proposed to achieve switching-cycle-level settling time, and the DC-link inductor is sized for 40% ripple to enable fast current change. Importantly, this article also proposes to minimize the DC-link current by varying the current even within a line cycle under single-phase load to improve the steady-state performance, in contrast with the reduction to a constant value in the literature. The proposed MPC features a constant switching frequency without weighting factors. The MPC does not have a high computational burden and is implemented in a regular digital controller for a prototype of soft-switching solid-state transformer (S4T) with reduced conduction loss. The effectiveness of the proposed method has been experimentally verified on the SiC S4T prototype during steady-state and dynamics under different multiport power flow conditions up to 2 kV peak. Here, the DC-link current in the experiments is close to the minimum current with a short zero-vector duration, which further verifies the performance of the proposed method.

14 SOLAR ENERGY↗
DOE OSTI2024

Traffic Signal Control for Large-Scale Urban Traffic Networks: Real-World Experiments using Vision-Based Sensors

Effective control of traffic signals plays a critical role in ensuring smooth vehicle flow in urban areas. Expertly engineered traffic signal controllers can considerably minimize travel delays and enhance sustainability. In this paper, the team proposes the Model Predictive Control (MPC) traffic signal control strategy using real-time traffic flow data from a vision-based camera as feedback information. Also, a realistic signal timing plan that considers National Electrical Manufacturers Association (NEMA) constraints has been developed to be applied to real-world scenarios. The primary aim is to reduce the number of vehicles across all links in the controlled area, thereby optimizing traffic flow and reducing energy consumption. To validate the proposed method, several real-life experiments were conducted at 24 intersections in Chattanooga, Tennessee, by collaborating with traffic field engineers. These experiments demonstrated significant performance improvements in comparison to the existing method.

data processing↗
DOE OSTI2025

Predicting Initial Trans-Membrane Pressure for Optimized Operations in UF Unit Using Random Forest

With the growing scarcity of freshwater, innovative process design mechanisms like Ultra-filtration(UF) units are increasingly gaining attention among water treatment utilities to address the rising demand. Ensuring reliable water production necessitates efficient resource utilization, minimizing downtime in UF systems. Recent advancements in machine learning (ML) have enabled the development of accurate data-driven models for Model Predictive Control (MPC), often requiring minimal prior knowledge of underlying physical processes. In this study, we present predictive regression models based on Random Forest (RF) and Auto-Regressive (AR) approaches to forecast the initial Trans-Membrane Pressure (TMP) for each filtration cycle in data generated by Direct Potable Reuse (DPR) systems. The proposed RF-based model demonstrates superior performance compared to baseline methods, including historical mean, Last Observation Carried Forward (LOCF), and naïve AR models, across various forecasting horizons in terms of root mean square (RMSE) metric. Accurate prediction of initial TMP is critical for optimizing CCRO operations, as it enables the development of robust modelling frameworks that enhance process efficiency and reliability. The demonstrated efficacy of the RF-based approach highlights its potential as a tool for real-time decision-making in water treatment systems, paving the way for advanced process optimization and sustainable water resource management.

Mukherjee, Subrata [ORNL] (ORCID:0000000309930338)↗
DOE OSTI2021

Grid-Interactive Multi-Zone Building Control Using Reinforcement Learning with Global-Local Policy Search

In this paper, we develop a grid-interactive multi-zone building controller based on a deep reinforcement learning (RL) approach. The controller is designed to facilitate building operation during normal conditions and demand response events, while ensuring occupants comfort and energy efficiency. We leverage a continuous action space RL formulation, and devise a two-stage global-local RL training framework. In the first stage, a global fast policy search is performed using a gradient-free RL algorithm. In the second stage, a local fine-tuning is conducted using a policy gradient method. In contrast to the state-of-the-art model predictive control (MPC) approach, the proposed RL controller does not require complex computation during real-time operation and can adapt to nonlinear building models. We illustrate the controller performance numerically using a five-zone commercial building.

30 DIRECT ENERGY CONVERSION↗
DOE OSTI2023

NMPC for Setpoint Tracking Operation of a Solid Oxide Electrolysis Cell System

Solid oxide electrolysis cells (SOECs) are a promising technology to generate hydrogen through water electrolysis. However, intermittent renewable energy requires SOECs to transition between hydrogen production setpoints as the price of electricity fluctuates. A well-functioning control system is important to avoid cell degradation during setpoint tracking operation. In this work, we apply nonlinear model predictive control (NMPC) to an SOEC module and supporting equipment and compare NMPC performance to classical PI control while ramping between hydrogen production setpoints. We find that these control methods provide similar performance in many metrics, but NMPC significantly reduces cell thermal gradients during the setpoint transition.

Allan, Douglas↗
DOE OSTI2026

Machine learning-enhanced hybrid modeling approach for better identification of a building thermal network model and improved prediction

The gray-box modeling approach, which uses a semi-physical thermal network model, has been widely used in building prediction applications, such as model predictive control (MPC). However, unmeasured disturbances, such as occupants, lighting, and in/exfiltration loads, make it challenging to apply this approach to practical buildings. In this word, we propose a hybrid modeling approach that integrates the gray-box model with a model for unmeasured disturbance. After reviewing several system identification approaches, we systematically designed the unmeasured disturbance model with a model selection process based on statistical tests to make it robust. We generated data based on the building model calibrated by real operational data and then trained the hybrid model for two different weather conditions. The hybrid model approach demonstrates an RMSE reduction of approximately 0.2–0.9 °C and 0.3–2 °C on 1-day ahead temperature prediction compared to the Conventional approach for mild (Berkeley, CA) and cold (Chicago, IL) climates, respectively. In addition, this approach was applied to experimental data obtained from the laboratory building to be used for the MPC application, showing superior prediction performances.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Grid-Interactive Multi-Zone Building Control Using Reinforcement Learning with Global-Local Policy Search: Preprint

In this paper, we develop a grid-interactive multi-zone building controller based on a deep reinforcement learning (RL) approach. The controller is designed to facilitate building operation during normal conditions and demand response events, while ensuring occupants comfort and energy efficiency. We leverage a continuous action space RL formulation, and devise a two-stage global-local RL training framework. In the first stage, a global fast policy search is performed using a gradient-free RL algorithm. In the second stage, a local fine-tuning is conducted using a policy gradient method. In contrast to the state-of-the-art model predictive control (MPC) approach, the proposed RL controller does not require complex computation during real-time operation and can adapt to non-linear building models. We illustrate the controller performance numerically using a five-zone commercial building.

30 DIRECT ENERGY CONVERSION↗
DOE OSTI2022

A Method of Optimal Control for Class 8 Vehicle Platoons Over Hilly Terrain

This work develops and implements an NMPC control system to facilitate fuel-optimal platooning of Class 8 vehicles over challenging terrain. Prior research has shown that Cooperative Adaptive Cruise Control (CACC), which allows multiple Class 8 vehicles to follow in close succession, can save between 3 and 8% in overall fuel consumption on flat terrain. However, on more challenging terrain, e.g. rolling hills, platooning vehicles can experience diminished fuel savings, and, in some cases, an increase in fuel consumption relative to individual vehicle operation. This research explores the use of Nonlinear Model Predictive Control (NMPC) with predefined route grade profiles to allow platooning vehicles to generate an optimal velocity trajectory with respect to fuel consumption. In order to successfully implement the NMPC system, a model relating vehicle velocity to fuel consumption was generated and validated using experimental data. Additionally, the predefined route grade profiles were created by using the vehicle's GPS velocity over the desired terrain. The real-time NMPC system was then implemented on a two-truck platoon operating over challenging terrain, with a reference vehicle running individually. The results from NMPC platooning are compared against fuel results from a classical proportional-integral-derivative (PID) headway control method. Furthermore, this comparison yields the comparative fuel savings and energy efficiency benefit of NMPC system. In the final analysis, significant fuel savings of greater than 14 and 20% were seen for the lead and following vehicles relative to their respective traditional cruise control and platooning architectures.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2022

SolarPlus-Optimizer v0.1

With the falling costs of solar arrays and battery storage and reduced reliability of the grid due to natural disasters, small-scale local generation and storage resources are beginning to proliferate. However, very few software options exist for integrated control of building loads, batteries and other distributed energy resources. The available software solutions on the market can force customers to adopt one particular ecosystem of products, thus limiting consumer choice, and are often incapable of operating independently of the grid during blackouts. In this software package, we present the "Solar+ Optimizer" (SPO), a control platform that provides demand flexibility, resiliency and reduced utility bills, built using open-source software. SPO employs Model Predictive Control (MPC) to produce real time optimal control strategies for the building loads and the distributed energy resources on site. SPO is designed to be vendor-agnostic, protocol-independent and resilient to loss of wide-area network connectivity. The software was evaluated in a real convenience store in northern California with on-site solar generation, battery storage and control of HVAC and commercial refrigeration loads. Preliminary tests showed price responsiveness of the building and cost savings of more than 10% in energy costs alone.

Prakash, AnandKrishnan↗
DOE OSTI2025

TEAMER Technical Support for Optimal Control of an Oscillating Surge Wave Energy Converter (CRADA Final Report)

This project will focus on running experiments that evaluate the benefits of using model predictive control (MPC) to optimize power absorbed by a laboratory-scale oscillating surge wave energy converter (OSWEC). MPC is a promising technique to optimize wave energy converter (WEC) behavior while applying system constraints that can help promote structural integrity and device survivability, but there are few studies that experimentally test this control scheme on WECs. Therefore, the Participant is proposing a series of tests that will assess the benefits of MPC experimentally in response to a variety of sea states. For these tests, the Participant will provide the OSWEC device and Data Acquisition (DAQ) system, and request support from the Contractor to use and operate the wave tank for experiments.

16 TIDAL AND WAVE POWER↗
DOE OSTI2023

Enhancing SRF cavity stability and minimizing detuning with data-driven resonance control based on dynamic mode decomposition

Effective resonance control of superconducting radio frequency (SRF) cavities is critical for large machines like LCLS-II, as failure to achieve proper control can result in increased RF power consumption, higher cryogenic heat loads, and increased costs. To address this challenge, we have developed a machine learning (ML) model based on the dynamic mode decomposition method to represent the forced cavity dynamics. Using this model, we designed a model predictive controller (MPC) and demonstrated through simulation that the MPC can effectively stabilize the amplitude and phase of SRF cavities using only a frequency actuator, even in the presence of multiple mechanical modes. The lightweight and explicit ML model makes the controller suitable for direct implementation on field-programmable gate arrays, unlocking the full potential of SRF linacs like LCLS-II, enabling higher beam power and energy, and also serving as an advanced motion controller for various applications, such as photon beamlines and storage rings.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗