Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model Predictive Control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

How good are learning-based control v.s. model-based control for load shifting? Investigations on a single zone building energy system

Both model predictive control (MPC) and deep reinforcement learning control (DRL) have been presented as a way to approximate the true optimality of a dynamic programming problem, and these two have shown significant operational cost saving potentials for building energy systems. Furthermore, there is still a lack of in-depth quantitative studies on their approximation levels to the true optimality, especially in the building energy domain. To fill in the gap, this paper provides a numerical framework that enables the evaluation of the optimality levels of different controllers for building energy systems. This framework is then used to comprehensively compare the optimal control performance of both MPC and DRL controllers with given computation budgets for a single zone fan coil unit system. Note the optimality is estimated based on a user-specific selection of trade-off weights among energy costs, thermal comfort and control slew rates. Compared with the best optimality we can find through expensive optimization simulations, the best DRL agent can maximally approximate the optimality by 96.54%, which outperforms the best MPC whose optimality level is 90.11%. However, due to the stochasticity, the DRL agent is only expected to approximate the optimality by 90.42%, which is almost equivalent to the best MPC. Except for Proximal Policy Optimization (PPO), all DRL agents can have a better approximation to the optimality than the best MPC, and are expected to have better approximation than the MPC with a prediction horizon of 32 steps (15 min per step). In terms of reducing energy cost and thermal discomfort, MPC can outperform the rule-based control (RBC) by 18.47%–25.44%. DRL can be expected to outperform RBC by 18.95%–25.65% ,and the best DRL control policy can outperform RBC by 20.29%–29.72%. Although the comparison of the optimality level is performed in a perfect setting, e.g., MPC assumes perfect models, and DRL assumes a perfect offline training process and online deployment process, this can shed insight on their capabilities of approximating to the original dynamic programming problem.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Proof-of-Concept for Sensor Modeling in MOOSE for the Design of Autonomous Nuclear Reactor Control

Autonomous operation is essential for the deployment of microreactors and fission batteries, both in terrestrial and space applications. For this reason, recent studies have investigated autonomous control by using adaptive model predictive control and multi-objective optimization for heat pipe–cooled microreactors under normal and heat pipe failure conditions. However, prototypes of microreactors and fission batteries do not exist yet, and even the design space has not been narrowed down conclusively, making the instrumentation and control system design difficult. For this reason, there is a need for flexible computational capabilities to create a numerical stand-in of potential microreactor and fission battery designs. The latter can be used to design and test control strategies to support autonomous operations. In this poster, we describe the initial implementation of a pluggable sensor system for the easy implementation of realistic sensor models in the multiphysics object-oriented simulation environment (MOOSE) framework. This new capability will enable MOOSE users to create a numerical stand-in of microreactors and fission batteries, ultimately allowing them to easily test new control algorithms, and instrumentation strategies for advanced systems in the design phase.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS2020

A Modeling Approach for Handling Qualities and Controls Safety Analysis of Electric Air Taxi Vehicles

The combination of modern advances in electric propulsion, fly-by-wire controls, autonomy, and increasing demand for short range air taxi operations, is currently producing an outburst of vehicle designs more diverse than ever before. Advanced software tools are needed to support the rapid and safe introduction of any design into the airspace, including the safety of the deployed flight control system and vehicle handling qualities. This paper presents a methodology for building air taxi vehicle models with distributed electric propulsion for use in analyzing flight control system safety at the conceptual design level.The approach builds on existing software tools capable of outputting aeromechanics-based linear perturbation models for Vertical Take-off and Landing vehicles with multiple rotors. Rotor torque inputs are then converted into equivalent voltage control inputs, and the linear state and input dynamics matrices are modified to include electric motor dynamics with common parameters for direct-current electric motors. The linear perturbation dynamics are then stitched across multiple operating points into a quasi-Linear Parameter Varying model that covers the full flight envelope. A Model Predictive Controller is developed for use with the full envelope model, and a tradeoff analysis between handling quality and motor requirements is demonstrated using a six passenger NASA air taxi reference design.

Urban Air Mobility↗
DOE OSTI2022

Dynamic machine learning-based optimization algorithm to improve boiler efficiency

With decreasing computational costs, improvement in algorithms, and the aggregation of large industrial and commercial datasets, machine learning is becoming a ubiquitous tool for process and business innovations. Machine learning is still lacking applications in the field of dynamic optimization for real-time control. This work presents a novel framework for performing constrained dynamic optimization using a recurrent neural network model combined with a metaheuristic optimizer. The framework is designed to augment an existing control system and is purely data-driven, like most industrial Model Predictive Control applications. Several recurrent neural network models are compared as well as several metaheuristic optimizers. Hyperparameters and optimizer parameters are tuned with parameter sweeps, and the resulting values are reported. Further, the best parameters for each optimizer and model combination are demonstrated in closed-loop control of a dynamic simulation, and several recommendations are made for generalizing this framework to other systems. Up to 0.953% improvement is realized over the non-optimized case for a simulated coal-fired boiler. While this is not a large improvement in percentage, the total economic impact is $991,000 per year, and this study builds a foundation for future machine learning with dynamic optimization.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

The first field application of a low-cost MPC for grid-interactive K-12 schools: Lessons-learned and savings assessment

K-12 schools are the largest energy consumers in the public sector, with their HVAC energy consumption representing the largest portion of their total energy use. While transitioning these schools to grid-interactive HVAC system operation through advanced controls offers significant financial and environmental benefits, and model predictive control (MPC) has been identified as a promising solution to achieve that, very few MPCs are affordable and have been deployed in K-12 schools. This situation raises concerns about the unclear real-world benefits of MPC technology among facility managers and industries. To address this gap, this paper presents a low-cost MPC solution that requires minimal control infrastructure costs and a unique field demonstration at a K-12 school, conducted for both cooling and heating seasons. This work adopted a previously developed MPC and extended it for use in the school application. The MPC aims to coordinate multiple packaged units to eliminate unnecessary peaks and shift cooling or heating loads in response to grid signals based on load conditions, while maintaining thermostat temperatures within school-defined bounds. Throughout the field tests, the MPC achieved a 24% reduction in peak demand during the cooling season and shifted cooling or heating loads by up to 16% in response to the school's utility tariff, considering load conditions, while also allowing end-users to override thermostat setpoints. Further, the paper also discusses the limitations of this study and future research directions for better performance of the MPC at K-12 schools.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

C3PU:Real-Time Predictive Charge Control Software for Battery Management Systems (Code for Charge Control and Predictive Unit) [SWR-21-48]

C3PU sets up a model predictive control formulation for the optimal charging control of battery packs and can be deployed for real-time operation on an embedded microprocessor. C3PU uses electrochemical and thermal models of battery packs to predict the charging trajectories of the battery pack over a time horizon under different operating conditions. It then selects the optimal charging trajectory such that a pre-defined objective is minimized, which in the present state of the code is to minimize the charging duration of the battery pack. The optimal charging trajectory is obtained by solving an underlying mathematical problem. However, C3PU is flexible to incorporate other charging objectives. The underlying battery models can be swapped as well, as long as they follow certain mathematical properties. Mathematically, optimal control problems (in this case, optimally controlling the charging current of the battery pack) are computationally expensive. C3PU implements advanced numerical techniques, namely pseudo-spectral optimization, to reduce the computational burden of the underlying problem to solve. This allows for the problem to be solved in real-time in an embedded system. Once the optimal charging trajectory is computed over a time horizon, C3PU can package such data and send it out via appropriate communication protocols.

Mishra, Partha↗
DOE OSTI2026

Machine learning-enhanced MPC for demand flexibility in small commercial buildings: An experimental study

Small- and medium-sized commercial buildings (SMCBs) represent the majority of U.S. commercial building stock and a significant share of peak electricity demand, yet they often lack centralized building automation systems, representing a significant untapped resource for urban energy management. This infrastructure gap makes advanced control implementation challenging, limiting the potential for widespread demand flexibility. Model Predictive Control (MPC) has shown strong potential for load shifting, peak demand reduction, and cost savings, but its effectiveness is hindered by unmeasured disturbances such as internal heat gains. This paper presents a Hybrid MPC framework that integrates a physics-based gray-box building thermal model, identified using a lumped disturbance (LD) approach, with a machine learning (ML) model for forecasting unmeasured disturbances. The hybrid approach is designed for buildings with multiple individually controlled heat pump and thermostat pairs, common in SMCBs, and aims to optimize coordinated scheduling of multiple heat pumps under dynamic electricity pricing while respecting comfort constraints. The methodology is validated through both simulations of case study buildings and experimental studies at a highly-instrumented test facility. Simulation results show that the Hybrid MPC achieves substantial load shifting and peak demand reduction, approaching the performance of an ideal MPC with perfect disturbance knowledge, and outperforming a conventional MPC without disturbance forecasting. In experiments, the Hybrid MPC reduced daily HVAC energy costs by 8.7%, peak-price time load (load shifting) by 41.7%, and peak demand by 29.2% compared to baseline control, demonstrating comparable benefits to the 11.6% cost savings, 42.9% load shifting, and 23.2% peak reduction of the ideal MPC. These results demonstrate that the proposed hybrid modeling approach can significantly improve MPC performance in real-world SMCB applications without requiring additional disturbance measurements.

Demand Flexibility↗
DOE OSTI2022

SolarPlus Optimizer: Integrated Control of Solar, Batteries, and Flexible Loads for Small Commercial Buildings

Building-level microgrids may be a key strategy to unlock the combined potential of flexible loads, renewable generation, and energy storage. However, few software options exist for integrated control of building loads and other distributed energy resources at this scale. The commercial software solutions on the market can force customers to adopt one particular ecosystem of products, thus limiting consumer choice. The SolarPlus Optimizer (SPO) is an open-source building-level microgrid control platform that uses Model Predictive Control to optimize both building loads and behind-the-meter energy storage to reduce energy bills and increase demand flexibility. This paper evaluates the capabilities of SPO in a small commercial building in Northern California under multiple electricity tariffs and demand response scenarios. Comparing SPO operation with an emulated battery and baseline operation employing a commercial optimization service, SPO reduced electricity bills by an estimated 7.3% in summer, 3.2% in spring, and 3.7% in winter. In a “load shape” scenario meant to counter the “duck curve”, SPO achieved 71% fewer violations from the load signal than the baseline control method. During a three hour long load shed event, SPO reduced cooling and refrigeration load by 38%. This research shows significant potential to provide load flexibility for building-level microgrids for this type of control systems. Finally, the paper discusses the future direction of research on open-source control systems.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Advanced Monitoring and Control in the ANL METL Facility Using an Engineering Digital Twin

The potential benefits of using an engineering digital twin to achieve greater autonomy for monitoring and control functions in advanced reactors was investigated for the Mechanisms Engineering Test Loop (METL) liquid sodium facility at Argonne National Laboratory. The METL sodium purification system served as a representative system as it requires significant human in-the-loop interaction to accomplish its design function. The objective was to demonstrate how real-time operation could be automated while preserving oversight of the operator for ensuring that the system design functions are met. A digital twin model of the purification system was developed for both the cold trap purification loop and plugging meter diagnostic loop using information from the METL piping and instrumentation diagram (P&ID). Automated monitoring and diagnosis of component degradation in the METL facility was demonstrated in tests using the PRO-AID health monitoring software with the digital twin model incorporated in the library of components. Component failures were introduced and were successfully diagnosed in real time. These tests serve to demonstrate an advanced monitoring capability able to differentiate sensor degradation from component degradation, to generate a rank ordering of probabilities of different failure mechanisms that serves to circumvent the false alarm problem with current anomaly detection methods, and how facility monitoring can be transformed from anomaly detection to identification of a specific fault. Automated control of the purification system was demonstrated through simulations that exercised a model predictive controller designed using the digital twin model. Results of these simulations compared favorably with experimental data showing very good reference tracking response with negligible overshoot. In conclusion, these pilot tests and simulations successfully demonstrated the use of a digital twin for improved automation of monitoring and control. It was shown how the digital twin enables switching between control modes from cold trap operation where impurities are removed to plugging meter operation where impurity concentrations are measured.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

A Hybrid Reinforcement Learning-MPC Approach for Distribution System Critical Load Restoration

This paper proposes a hybrid control approach for distribution system critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while MPC models grid operations incorporating RL policy actions (i.e., reserve requirements), renewable (wind and solar) power predictions, and load demand forecasts. We formulate the reserve requirement determination problem as a sequential decision-making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC simulation. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The RL algorithm is trained offline using a historical forecast of renewable generation and load demand. The method is tested using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine, and battery. Case studies demonstrated that the proposed method outperforms other policies with static operating reserves.

distribution system↗
DOE OSTI2022

A Hybrid Reinforcement Learning-MPC Approach for Distribution System Critical Load Restoration: Preprint

This paper proposes a hybrid control approach for distribution system critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while MPC models grid operations incorporating RL policy actions, i.e., the reserve requirement, renewable (wind and solar) power predictions, and load demand forecasts. We formulate the reserve requirement determination problem as a sequential decision making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The RL algorithm is trained off-line using historical forecast of renewable generation and load demand. The method is tested using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine and battery. Case studies demonstrated that the proposed method outperforms other operating reserve determination methods.

distribution system↗
DOE OSTI2022

Learning-based Anticipatory Control of Microreactors

Learning-based anticipatory control advances the level of autonomy of microreactor control systems, a key consideration for the unattended operation of fission batteries. In this work, an anticipatory control system is shown to provide accurate load-following for a microreactor by utilizing a model predictive control framework.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS2022

Adaptive Force Control for Small Celestial Body Sampling

An adaptive force control algorithm for small celestial body sampling for a variety of surface properties is developed. The control algorithm consists of an adaptive controller combined with feedback linearization. When a spacecraft makes contact with the surface, it must maintain a desired contact force in order to capture a sample. The properties of the surface are unknown or uncertain before contact with the surface is made. The adaptive controller performs system identification online to create an input-output model of the feedback linearized system. From the input-output model a block observable canonical form is realized and the control input is determined by model predictive control (MPC) to maintain a desired contact force in spite of the unknown surface properties. The approach is applied to a variety of surface properties with linear and nonlinear contact models.

Quadrelli, Marco M↗
DOE OSTI2020

Current Observer Based Predictive Decoupled Power Control Grid-Interactive Inverter

This paper presents a sensor-less current model predictive control (MPC) scheme via a full state observer based current estimator. The grid interactive inverters’ control schemes require current and voltage sensors. Elimination of current sensor enhances the inverter reliability. This paper leverages the inherent characteristics of MPC towards robust current sensor-less grid interactive inverter with LC filter. The observer for inductor current is developed based on the existing capacitor voltage measurement. The estimator dynamic state-space matrices are then obtained through reconstruction of the inverter model with the capacitor voltage and inductor current being the state variables. The controller objectives are to regulate active and reactive power in a decoupled manner. The theoretical expectation, controller performance, and accuracy of the current estimation are verified by conducting a real-time simulation via Typhoon HIL.

Zhang, Zhen↗