Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model predictive control (MPC)”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Optimizing Control for Efficient Load Shifting with Thermal Energy Storage in Existing HVAC Systems

This project developed the integration of a direct-contact heat exchanger (DCHX) based thermal energy storage (TES) system with a chiller–air handling unit (AHU) plant to evaluate its potential for reducing building energy costs. Detailed physical models of the TES unit, building envelope, and HVAC components were developed alongside simplified control-oriented models to support both high-fidelity simulation and real-time optimization. Two control strategies were implemented and compared: a rule-based control (RBC) aligned with utility time-of-use (ToU) rates, and a model predictive control (MPC) framework leveraging forecasts of building load, weather, and internal gains. Simulation results show that the RBC strategy reduced daily electricity costs by around 30% by shifting cooling production from on-peak to off-peak hours. In contrast, the MPC strategy achieved significantly greater performance, reducing daily operating costs by up to 44% and peak-hour costs by more than 60%. Both strategies maintained indoor thermal comfort within acceptable limits, with MPC further improving load distribution and reducing equipment cycling. The outcomes confirm that TES integration, particularly when coordinated with advanced predictive control, can provide substantial cost savings and on-peak demand reduction. . These findings directly support the U.S. Department of Energy’s goals for grid-interactive efficient buildings and demonstrate the potential of TES-enabled HVAC systems for scalable deployment across the commercial building.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Community Resilience Through Rapid Restoration Leveraging Distributed Energy Resources (DERs) and Low-Cost Sensors

Equitable and automated bottoms-up power restoration following an extreme event will be demonstrated at a site in Puerto Rico. To do so, the team will develop enhanced grid situational awareness techniques integrating behind-the-meter (BTM) distributed energy resources (DER) discovery, impedance sweeping based outage boundary detection, and feasible restoration path identification algorithms. Resilience metric will be developed and incorporated along with situational awareness information in a distributed Model Predictive Control (MPC)-based restoration optimization algorithm to control and mobilize grid assets. These algorithms will be validated through power hardware-in-the-loop experiments and ultimately, a site demonstration to show that outage recovery time and total recovered load could be improved by >20% over the baseline.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Real-Time On-Ramp Merging Control of Connected and Automated Vehicles using Pseudospectral Convex Optimization

Highway on-ramp merging can be a challenging task for human drivers due to the complex vehicle negotiations and interactions in limited time and space. Connected and automated vehicles (CAVs) have great potential to address the problem and offer many benefits in terms of safety, traffic efficiency, and fuel economy. However, real-time optimal control of CAVs still faces many challenges, including nonlinear dynamics, complex inter-vehicle interactions, and a highly dynamic and uncertain traffic environment. To address these challenges, we develop a novel control approach that balances the solution optimality and computational efficiency to determine optimal merging speed profiles in real time. Specifically, by employing a pseudospectral method and a sequential convex programming approach, two algorithms are proposed and implemented within the model predictive control (MPC) framework to enable real-time generation of optimal solutions for potential on-vehicle applications. The convergence and optimality of the proposed algorithms are validated by comparing with a general-purpose solver under different traffic scenarios.

Shi, Yang↗

Deep Reinforcement Learning for Autonomous Water Heater Control

Electric water heaters represent 14% of the electricity consumption in residential buildings. An average household in the United States (U.S.) spends about USD 400–600 (0.45 ¢/L–0.68 ¢/L) on water heating every year. In this context, water heaters are often considered as a valuable asset for Demand Response (DR) and building energy management system (BEMS) applications. To this end, this study proposes a model-free deep reinforcement learning (RL) approach that aims to minimize the electricity cost of a water heater under a time-of-use (TOU) electricity pricing policy by only using standard DR commands. In this approach, a set of RL agents, with different look ahead periods, were trained using the deep Q-networks (DQN) algorithm and their performance was tested on an unseen pair of price and hot water usage profiles. The testing results showed that the RL agents can help save electricity cost in the range of 19% to 35% compared to the baseline operation without causing any discomfort to end users. Additionally, the RL agents outperformed rule-based and model predictive control (MPC)-based controllers and achieved comparable performance to optimization-based control.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Fifth-Generation District Heating and Cooling Substations: Demand Response with Artificial Neural Network-Based Model Predictive Control

District heating and cooling (DHC) is considered one of the most sustainable technologies to meet the heating and cooling demands of buildings in urban areas. The fifth-generation district heating and cooling (5GDHC) concept, often referred to as ambient loops, is a novel solution emerging in Europe and has become a widely discussed topic in current energy system research. 5GDHC systems operate at a temperature close to the ground and include electrically driven heat pumps and associated thermal energy storage in a building-sited energy transfer station (ETS) to satisfy user comfort. This work presents new strategies for improving the operation of these energy transfer stations by means of a model predictive control (MPC) method based on recurrent artificial neural networks. The results show that, under simple time-of-use utility rates, the advanced controller outperforms a rule-based controller for smart charging of the domestic hot water (DHW) thermal energy storage under specific boundary conditions. By exploiting the available thermal energy storage capacity, the MPC controller is capable of shifting up to 14% of the electricity consumption of the ETS from on-peak to off-peak hours. Therefore, the advanced control implemented in 5GDHC networks promotes coupling between the thermal and the electric sector, producing flexibility on the electric grid.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Intelligent Engine Systems: Adaptive Control

We have studied the application of the baseline Model Predictive Control (MPC) algorithm to the control of main fuel flow rate (WF36), variable bleed valve (AE24) and variable stator vane (STP25) control of a simulated high-bypass turbofan engine. Using reference trajectories for thrust and turbine inlet temperature (T41) generated by a simulated new engine, we have examined MPC for tracking these two reference outputs while controlling a deteriorated engine. We have examined the results of MPC control for six different transients: two idle-to-takeoff transients at sea level static (SLS) conditions, one takeoff-to-idle transient at SLS, a Bode power command and reverse Bode power command at 20,000 ft/Mach 0.5, and a reverse Bode transient at 35,000 ft/Mach 0.84. For all cases, our primary focus was on the computational effort required by MPC for varying MPC update rates, control horizons, and prediction horizons. We have also considered the effects of these MPC parameters on the performance of the control, with special emphasis on the thrust tracking error, the peak T41, and the sizes of violations of the constraints on the problem, primarily the booster stall margin limit, which for most cases is the lone constraint that is violated with any frequency.

Gibson, Nathan↗

A Robustly Stabilizing Model Predictive Control Algorithm

A model predictive control (MPC) algorithm that differs from prior MPC algorithms has been developed for controlling an uncertain nonlinear system. This algorithm guarantees the resolvability of an associated finite-horizon optimal-control problem in a receding-horizon implementation.

Ackmece, A. Behcet↗

Safe Maritime Autonomous Path Planning in a High Sea State

This paper presents a path planning method for sea surface vehicles that prevents capsizing and bow-diving in a high sea-state. A key idea is to use response amplitude operators (RAOs) or, in control terminology, the transfer functions from a sea state to a vessel's motion, in order to find a set of speeds and headings that results in excessive pitch and roll oscillations. This information is translated to arithmetic constraints on the ship's velocity, which are passed to a model predictive control (MPC)-based path planner to find a safe and optimal path that achieves specified goals. An obstacle avoidance capability is also added to the path planner. The proposed method is demonstrated by simulations.

Ono, Masahiro↗

Model Predictive Control Study for an Electrified Turbofan Engine

A control sensitivity study is conducted for electrified aircraft propulsion concepts using a publicly available turbofan engine simulation. A Proportional-Integral (PI) controller serves as a baseline for comparison against an advanced Model Predictive Control (MPC) approach. MPC is used in the control scheme to allow for subsystem coordination of engine and electric power loads. The electrified turbofan engine includes electric machines to augment the amount of torque being applied to the spools of the engine during transient phases of operation. Power augmentation allows for energy to be stored or exhausted in a manner that increases the fuel efficiency of the engine, reducing aircraft emissions and noise. The study compares the fan speed, high pressure compressor stall margin, and low pressure compressor stall margin against the baseline PI control system, an MPC system without electric machines, and an MPC system with electric machines. The MPC system with electric machines is optimized using the sample time, control horizon and prediction horizon. The MPC design provided a stable damped response as desired and allowed operability margins to be maintained

Electrified Aircraft Propulsion↗

Adaptive Optimization for System Performance and Combined Bernstein Polynomial, Optimal Reciprocal Collision Avoidance, Differential Dynamic Programming for Trajectory Replanning and Collision Avoidance for UAM Vehicles

The emerging urban air mobility (UAM) sector in aerospace is driving development of unconventional multi-modal vehicle configurations and autonomous flight. The combination of multi-modal vehicle dynamics, complex environment, requirements to deal with flight contingencies in an efficient and safe manner, as well as necessity for precise trajectory following and performance, are the driving influence behind adaptive optimization for system performance. We are interested in trajectory optimization algorithm that would system parameter estimation and identifying the optimal switching time between modes of hybrid dynamical systems. This presentation discusses a parameterized optimal control trajectory optimization algorithm that is an extended and generalized version of Differential Dynamic Programming (DDP), titled Parameterized Differential Dynamic Programming (PDDP). DDP is an efficient trajectory optimization algorithm relying on second order approximations of a system’s dynamics and cost function and has recently been applied to optimize systems with time invariant parameters. Experiments are presented applying PDDP to solve model predictive control (MPC) and moving horizon estimation (MHE) tasks simultaneously. In particular, PDDP is used to determine the optimal transition point between flight regimes of a complex urban air mobility (UAM) class vehicle exhibiting multiple phases of flight and to identify and compensate for actuation faults.

optimization↗

Restoring Distribution System Under Renewable Uncertainty Using Reinforcement Learning: Preprint

Distributed energy resources (DER) in distribution systems, including renewable generation, micro-turbine, and energy storage, can be used to restore critical loads following extreme events to increase grid resiliency. However, properly coordinating multiple DERs in the system for multi-step restoration process under renewable uncertainty and fuel availability is a complicated sequential optimal control problem. Due to its capability to handle system non-linearity and uncertainty, reinforcement learning (RL) stands out as a potentially powerful candidate in solving complex sequential control problems. Moreover, the offline training of RL provides excellent action readiness during online operation, making it suitable to problems such as load restoration, where in-time, correct and coordinated actions are needed. In this study, a distribution system prioritized load restoration based on a simplified single-bus system is studied: with imperfect renewable generation forecast, the performance of an RL controller is compared with that of a deterministic model predictive control (MPC). Our experiment results show that the RL controller is able to learn from experience, adapt to the imperfect forecast information and provide a more reliable restoration process when compared with the baseline MPC controller.

61 RADIATION PROTECTION AND DOSIMETRY↗

Restoring Distribution System Under Renewable Uncertainty Using Reinforcement Learning

Distributed energy resources (DER) in distribution systems, including renewable generation, micro-turbine, and energy storage, can be used to restore critical loads following extreme events to increase grid resiliency. However, properly coordinating multiple DERs in the system for multi-step restoration process under renewable uncertainty and fuel availability is a complicated sequential optimal control problem. Due to its capability to handle system non-linearity and uncertainty, reinforcement learning (RL) stands out as a potentially powerful candidate in solving complex sequential control problems. Moreover, the offline training of RL provides excellent action readiness during online operation, making it suitable to problems such as load restoration, where in-time, correct and coordinated actions are needed. In this study, a distribution system prioritized load restoration based on a simplified single-bus system is studied: with imperfect renewable generation forecast, the performance of an RL controller is compared with that of a deterministic model predictive control (MPC). Our experiment results show that the RL controller is able to learn from experience, adapt to the imperfect forecast information and provide a more reliable restoration process when compared with the baseline MPC controller.

61 RADIATION PROTECTION AND DOSIMETRY↗

Model predictive control for matrix converter operating in current control mode with load current estimation

A matrix converter system operating in current control mode is provided. The matrix converter includes a switching matrix coupled between a low voltage side and a high voltage side, wherein the matrix converter is coupled at its low voltage side to a generator for receiving an input power including an input current and transforming the input power into an output power at its high voltage side, wherein a load is coupled to the high voltage side. The control system includes a load observer and a model predictive controller (MPC). The load observer is configured to estimate a load current that flows to the load from the high voltage side of the matrix converter as a function of a switching state of the switching matrix, an output voltage output at the high voltage side of the matrix converter, and the input current. The MPC is configured to select the switching state of the switching matrix to meet one or more control objectives defined by minimization of a multi-objective function that tracks the output voltage and the input current using the estimated load current.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Comparison of Optimal Energy Management Strategies Using Dynamic Programming, Model Predictive Control, and Constant Velocity Prediction

Due to the recent advancements in autonomous vehicle technology, future vehicle velocity predictions are becoming more robust which allows fuel economy (FE) improvements in hybrid electric vehicles through optimal energy management strategies (EMS). A real- world highway drive cycle (DC) and a controls-oriented 2017 Toyota Prius Prime model are used to study potential FE improvements. We proposed three important metrics for comparison: (1) perfect full drive cycle prediction using dynamic programming, (2) 10-second prediction horizon model predictive control (MPC), and (3) 10-second constant velocity prediction. These different velocity predictions are put into an optimal EMS derivation algorithm to derive optimal engine torque and engine speed. The results show that the constant velocity prediction algorithm outperformed the baseline control strategy but underperformed the MPC strategy with an average 1.58% and 2.45% of FE improvement with highway and city-highway DC. Also, using a 10-second prediction window MPC strategy provided FE improvement results close to the full drive cycle prediction case. MPC has the potential to achieve 60%-65% and 70% - 80% of global FE improvement over highway and city-highway DC respectively.

Patel, Amol Arvind↗

Comparison of Optimal Energy Management Strategies Using Dynamic Programming, Model Predictive Control, and Constant Velocity Prediction

Due to the recent advancements in autonomous vehicle technology, future vehicle velocity predictions are becoming more robust which allows fuel economy (FE) improvements in hybrid electric vehicles through optimal energy management strategies (EMS). A realworld highway drive cycle (DC) and a controls-oriented 2017 Toyota Prius Prime model are used to study potential FE improvements. We proposed three important metrics for comparison: (1) perfect full drive cycle prediction using dynamic programming, (2) 10-second prediction horizon model predictive control (MPC), and (3) 10-second constant velocity prediction. These different velocity predictions are put into an optimal EMS derivation algorithm to derive optimal engine torque and engine speed. The results show that the constant velocity prediction algorithm outperformed the baseline control strategy but underperformed the MPC strategy with an average 1.58% and 2.45% of FE improvement with highway and city-highway DC. Also, using a 10-second prediction window MPC strategy provided FE improvement results close to the full drive cycle prediction case. MPC has the potential to achieve 60%-65% and 70% - 80% of global FE improvement over highway and city-highway DC respectively.

Patel, Amol Arvind↗

Global-Local Policy Search and its Application in Grid-Interactive Building Control

As the buildings sector represents over 70% of the total U.S. electricity consumption, it offers a great amount of untapped demand-side resources to tackle many critical grid-side problems and improve the overall energy system's efficiency. To help make buildings grid-interactive, this paper proposes a global-local policy search method to train a reinforcement learning (RL) based controller which optimizes building operation during both normal hours and demand response (DR) events. Experiments on a simulated five-zone commercial building demonstrate that by adding a local fine-tuning stage to the evolution strategy policy training process, the control costs can be further reduced by 7.55% in unseen testing scenarios. Baseline comparison also indicates that the learned RL controller outperforms a pragmatic linear model predictive controller (MPC), while not requiring intensive online computation.

demand response↗

Multi-range vehicle speed prediction using vehicle connectivity for enhanced energy efficiency of vehicles

An integrated speed prediction framework based on historical traffic data mining and real-time V2I communications for CAVs. The present framework provides multi-horizon speed predictions with different fidelity over short and long horizons. The present multi-horizon speed prediction is integrated with an economic model predictive control (MPC) strategy for the battery thermal management (BTM) of connected and automated electric vehicles (EVs) as a case study. The simulation results over real-world urban driving cycles confirm the enhanced prediction performance of the present data mining strategy over long prediction horizons. Despite the uncertainty in long-range CAV speed predictions, the vehicle level simulation results show that 14% and 19% energy savings can be accumulated sequentially through eco-driving and BTM optimization (eco-cooling), respectively, when compared with normal-driving and conventional BTM strategy.

Amini, Mohammad Reza↗

Virtual storage capability of residential buildings for sustainable smart city via model-based predictive control

This paper evaluates the virtual storage capability of a residential air-conditioning (AC) system by utilizing the building mass as a thermal storage to enable sustainable cities through model-based predictive control (MPC). The control-oriented building model was developed with a grey-box model structure based on the experimental data to predict the indoor air temperature. Based on the model, the operation cost-saving potential of the MPC was investigated in a single house with different comfort levels, electricity prices, and prediction horizons. The cost-saving of the MPC was approximately 10.6 % compared to the conventional control. The MPC was expanded to a residential building cluster considering the peak demand charge. In an hourly shedding and load-up scenario, the performances of the MPC and the heuristic prior-based control (PBC) are promising. When shedding was enforced all day, the peak demand saving of the MPC was 36~38 %, whereas that of the PBC was 25.7 % compared to the baseline. In addition, the monthly electricity bill, including the operation and peak demand cost, was investigated with different demand charge rates and weather conditions. The total saving decreased with a low demand charge rate and hot conditions, and the operation cost saving was compromised with more aggressive demand shedding.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗