Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “predictive control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Machine learning-enhanced MPC for demand flexibility in small commercial buildings: An experimental study

Small- and medium-sized commercial buildings (SMCBs) represent the majority of U.S. commercial building stock and a significant share of peak electricity demand, yet they often lack centralized building automation systems, representing a significant untapped resource for urban energy management. This infrastructure gap makes advanced control implementation challenging, limiting the potential for widespread demand flexibility. Model Predictive Control (MPC) has shown strong potential for load shifting, peak demand reduction, and cost savings, but its effectiveness is hindered by unmeasured disturbances such as internal heat gains. This paper presents a Hybrid MPC framework that integrates a physics-based gray-box building thermal model, identified using a lumped disturbance (LD) approach, with a machine learning (ML) model for forecasting unmeasured disturbances. The hybrid approach is designed for buildings with multiple individually controlled heat pump and thermostat pairs, common in SMCBs, and aims to optimize coordinated scheduling of multiple heat pumps under dynamic electricity pricing while respecting comfort constraints. The methodology is validated through both simulations of case study buildings and experimental studies at a highly-instrumented test facility. Simulation results show that the Hybrid MPC achieves substantial load shifting and peak demand reduction, approaching the performance of an ideal MPC with perfect disturbance knowledge, and outperforming a conventional MPC without disturbance forecasting. In experiments, the Hybrid MPC reduced daily HVAC energy costs by 8.7%, peak-price time load (load shifting) by 41.7%, and peak demand by 29.2% compared to baseline control, demonstrating comparable benefits to the 11.6% cost savings, 42.9% load shifting, and 23.2% peak reduction of the ideal MPC. These results demonstrate that the proposed hybrid modeling approach can significantly improve MPC performance in real-world SMCB applications without requiring additional disturbance measurements.

Demand Flexibility↗
DOE OSTI2023

Pseudospectral convex optimization for on-ramp merging control of connected vehicles

It can be a daunting task for human drivers to merge into highways because of the intricate vehicle negotiations and potential risk within limited time and space. Connected vehicle (CV) technologies could be a solution to this problem and offer many benefits to the road safety, traffic mobility, and energy efficiency. However, real-time optimal control of CVs is still an open challenge, due to the nonlinear vehicle dynamics, non-convex fuel consumption model, and highly dynamic uncertain inter-vehicle interactions. To tackle these issues, a novel real-time optimal control approach that balances the computational efficiency and solution optimality is proposed for the purpose of onboard application. To this end, the pseudospectral collocation method is integrated with a sequential convex programming approach to develop two new optimization algorithms, which are implemented within a model predictive control (MPC) framework to allow for real-time generation of optimal merging speed profiles. One algorithm leverages the line search technique to improve convergence, and the other benefits from the trust region method for better computational efficiency. The optimality and convergence process of both proposed algorithms are investigated by comparing their solutions with a popular non-linear solver. Furthermore, simulation results show that the proposed methods outperform the benchmark in terms of computational cost, fuel consumption, and traffic efficiency. In particular, the proposed fuel-economy merging rule can save 57.1% fuel consumption on average on four different traffic volumes. Meanwhile, the proposed optimal control algorithms can reduce 2.2% travel time on average comparing to the “first-in-first-out” merging rule.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2020

Wave Prediction using X-Band Radar (Final Summary Report)

Model Predictive Control (MPC) is the best controls framework available to wave energy today. It allows for the maximization of energy yield from a WEC system while respecting various constraints and losses in the system. This type of constrained optimization is a critical capability for the techno-economic optimization of WEC devices and is difficult to do effectively with causal controls frameworks. MPC requires a future prediction of wave excitation forces, requiring wave prediction on a future time horizon of up to 30 seconds. The future horizon required is highly dependent on the WEC and PTO type available. To our knowledge no-one has been able to implement MPC on a WEC device at sea, due to the fact that phase-resolved wave-prediction is not a capability that has been sufficiently developed to date. The key objectives of this project are focused on developing “industry-ready” wave prediction technology building blocks that can be applied to a wide range of different wave energy conversion topologies. Our collaborative work with device developers has demonstrated that the level of improvement attainable for any particular device is heavily dependent on the device and PTO topology chosen. The range of annual average power capture improvements is on the order of 10% to over 100%. However, the important aspect is that we can get within about 10% of theoretical upper limits even when considering errors in the wave prediction and more importantly, we can optimize performance while respecting various constraints such as motion amplitude or peak structural loads. The combination of improved performance while limiting structural loads has a net effect of reducing the levelized cost of energy from these emerging technologies and allows us to design control laws that meet an economic optimum. Efforts under a previous project on controls has focused on developing a set of wave-prediction algorithms that work by leveraging a network of wave sensing measurement buoys that are equipped with real-time telemetry. The present work is focusing primarily on using X-band radar to measure the wave-field around the WEC to predict the future excitation forces on the structure and combining the measurements of these different sources to create improvements in the wave-prediction accuracy.

16 TIDAL AND WAVE POWER↗
DOE OSTI2022

Learning-based Anticipatory Control of Microreactors

Learning-based anticipatory control advances the level of autonomy of microreactor control systems, a key consideration for the unattended operation of fission batteries. In this work, an anticipatory control system is shown to provide accurate load-following for a microreactor by utilizing a model predictive control framework.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Insensitivity to propagation timing in a preview-enabled wind turbine control experiment

Lidar scanners are capable of taking measurements of a wind field upstream of a wind turbine. The wind turbine controller can use these measurements as a “preview” of future disturbances impacting the turbine. Such preview-enabled (or feedforward) controllers show superior performance to standard wind turbine control configurations based purely on a feedback architecture. To capitalize on the performance improvements that preview wind measurements can provide, feedforward control actions should be timed to coincide with the arrival of the wind field at the wind turbine location. However, the time of propagation of the wind field between the lidar measurement location and the wind turbine is not perfectly known. Moreover, the best time to take feedforward control action may not perfectly coincide with the true arrival time of the wind disturbance. This contribution presents results from an experiment where preview-enabled model predictive control was deployed on a fully-actuated, scaled model wind turbine operating in a wind tunnel testbed. In the study, we investigate the sensitivity of the controller performance to the assumed propagation delay using a range of wind input sequences. We find that the preview-enabled controller outperforms the feedback only case across a wide range of assumed propagation delays, demonstrating a level of robustness to the time alignment of the incoming disturbances.

17 WIND ENERGY↗
DOE OSTI2022

A Method of Optimal Control for Class 8 Vehicle Platoons Over Hilly Terrain

This work develops and implements an NMPC control system to facilitate fuel-optimal platooning of Class 8 vehicles over challenging terrain. Prior research has shown that Cooperative Adaptive Cruise Control (CACC), which allows multiple Class 8 vehicles to follow in close succession, can save between 3 and 8% in overall fuel consumption on flat terrain. However, on more challenging terrain, e.g. rolling hills, platooning vehicles can experience diminished fuel savings, and, in some cases, an increase in fuel consumption relative to individual vehicle operation. This research explores the use of Nonlinear Model Predictive Control (NMPC) with predefined route grade profiles to allow platooning vehicles to generate an optimal velocity trajectory with respect to fuel consumption. In order to successfully implement the NMPC system, a model relating vehicle velocity to fuel consumption was generated and validated using experimental data. Additionally, the predefined route grade profiles were created by using the vehicle's GPS velocity over the desired terrain. The real-time NMPC system was then implemented on a two-truck platoon operating over challenging terrain, with a reference vehicle running individually. The results from NMPC platooning are compared against fuel results from a classical proportional-integral-derivative (PID) headway control method. Furthermore, this comparison yields the comparative fuel savings and energy efficiency benefit of NMPC system. In the final analysis, significant fuel savings of greater than 14 and 20% were seen for the lead and following vehicles relative to their respective traditional cruise control and platooning architectures.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2022

SolarPlus Optimizer: Integrated Control of Solar, Batteries, and Flexible Loads for Small Commercial Buildings

Building-level microgrids may be a key strategy to unlock the combined potential of flexible loads, renewable generation, and energy storage. However, few software options exist for integrated control of building loads and other distributed energy resources at this scale. The commercial software solutions on the market can force customers to adopt one particular ecosystem of products, thus limiting consumer choice. The SolarPlus Optimizer (SPO) is an open-source building-level microgrid control platform that uses Model Predictive Control to optimize both building loads and behind-the-meter energy storage to reduce energy bills and increase demand flexibility. This paper evaluates the capabilities of SPO in a small commercial building in Northern California under multiple electricity tariffs and demand response scenarios. Comparing SPO operation with an emulated battery and baseline operation employing a commercial optimization service, SPO reduced electricity bills by an estimated 7.3% in summer, 3.2% in spring, and 3.7% in winter. In a “load shape” scenario meant to counter the “duck curve”, SPO achieved 71% fewer violations from the load signal than the baseline control method. During a three hour long load shed event, SPO reduced cooling and refrigeration load by 38%. This research shows significant potential to provide load flexibility for building-level microgrids for this type of control systems. Finally, the paper discusses the future direction of research on open-source control systems.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Proof-of-Concept for Sensor Modeling in MOOSE for the Design of Autonomous Nuclear Reactor Control

Autonomous operation is essential for the deployment of microreactors and fission batteries, both in terrestrial and space applications. For this reason, recent studies have investigated autonomous control by using adaptive model predictive control and multi-objective optimization for heat pipe–cooled microreactors under normal and heat pipe failure conditions. However, prototypes of microreactors and fission batteries do not exist yet, and even the design space has not been narrowed down conclusively, making the instrumentation and control system design difficult. For this reason, there is a need for flexible computational capabilities to create a numerical stand-in of potential microreactor and fission battery designs. The latter can be used to design and test control strategies to support autonomous operations. In this poster, we describe the initial implementation of a pluggable sensor system for the easy implementation of realistic sensor models in the multiphysics object-oriented simulation environment (MOOSE) framework. This new capability will enable MOOSE users to create a numerical stand-in of microreactors and fission batteries, ultimately allowing them to easily test new control algorithms, and instrumentation strategies for advanced systems in the design phase.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Fault isolation and fault-tolerant control for nonlinear stochastic distribution control systems with multiplicative faults

Here, in this paper, a fault isolation, diagnosis and fault tolerant control algorithm is proposed for nonlinear multiple multiplicative faults stochastic distribution control systems employing Takagi–Sugeno fuzzy system. To obtain the detailed fault information, a fault detection algorithm is introduced to discover the fault occurrence time. Then a fault isolation observer is built to produce the residual, and the error system is separated to subsystems affected only by disturbance and multiplicative faults. Moreover, a fault estimation scheme is presented to obtain the fault magnitude information. When faults occur, the system output probability density function will deviate from the desired distribution. So the model predictive control fault tolerant control scheme is needed to minimize the impact of faults as much as possible to make sure that the post fault output probability density function track the desired probability density function. The validity of the designed algorithm is demonstrated through a simulation example, where the fault tolerant control algorithm ensures that the system output probability density function still track the given output probability density function despite the complex case of multiple multiplicative faults occurring simultaneously.

42 ENGINEERING↗
DOE OSTI2022

Site demonstration and performance evaluation of MPC for a large chiller plant with TES for renewable energy integration and grid decarbonization

Thermal energy storage (TES) for a cooling plant is a crucial resource for load flexibility. Traditionally, simple, heuristic control approaches, such as the storage priority control which charges TES during the nighttime and discharges during the daytime, have been widely used in practice, and shown reasonable performance in the past benefiting both the grid and the end-users such as buildings and district energy systems. However, the increasing penetration of renewables changes the situation, exposing the grid to a growing duck curve, which encourages the consumption of more energy in the daytime, and volatile renewable generation which requires dynamic planning. The growing pressure of diminishing greenhouse gas emissions also increases the complexity of cooling TES plant operations as different control strategies may apply to optimize operations for energy cost or carbon emissions. This paper presents a model predictive control (MPC), site demonstration and evaluation results of optimal operation of a chiller plant, TES and behind-meter photovoltaics for a campus-level district cooling system. The MPC was formulated as a mixed-integer linear program for better numerical and control properties. Compared with baseline rule-based controls, the MPC results show reductions of the excess PV power by around 25%, of the greenhouse gas emission by 10%, and of peak electricity demand by 10%.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

A Hybrid Reinforcement Learning-MPC Approach for Distribution System Critical Load Restoration

This paper proposes a hybrid control approach for distribution system critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while MPC models grid operations incorporating RL policy actions (i.e., reserve requirements), renewable (wind and solar) power predictions, and load demand forecasts. We formulate the reserve requirement determination problem as a sequential decision-making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC simulation. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The RL algorithm is trained offline using a historical forecast of renewable generation and load demand. The method is tested using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine, and battery. Case studies demonstrated that the proposed method outperforms other policies with static operating reserves.

distribution system↗
DOE OSTI2022

A Hybrid Reinforcement Learning-MPC Approach for Distribution System Critical Load Restoration: Preprint

This paper proposes a hybrid control approach for distribution system critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while MPC models grid operations incorporating RL policy actions, i.e., the reserve requirement, renewable (wind and solar) power predictions, and load demand forecasts. We formulate the reserve requirement determination problem as a sequential decision making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The RL algorithm is trained off-line using historical forecast of renewable generation and load demand. The method is tested using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine and battery. Case studies demonstrated that the proposed method outperforms other operating reserve determination methods.

distribution system↗
DOE OSTI2021

Occupant Preference-Aware Load Scheduling for Resilient Communities

The load scheduling of resilient communities in the islanded mode is subject to many uncertainties such as weather forecast errors and occupant behavior stochasticity. To date, it remains unclear how occupant preferences affect the effectiveness of the load scheduling of resilient communities. This paper proposes an occupant thermal preference-aware load scheduler for resilient communities operating in the islanded mode. First, key resilience indicators are selected to quantify its impacts on the load scheduling of a resilient community. A deterministic model predictive control-based load scheduling framework is adopted as the baseline. Then, a chance-constrained controller is proposed to address the occupant-induced uncertainty in room temperature setpoints. Finally, the chance-constrained controller is compared with the deterministic controller on a virtual community testbed based on a real-world net-zero energy community in Florida, U.S. Results have shown that the proposed chance-constrained controller performs better in terms of serving occupants’ thermal preference and the required battery sizes compared to the deterministic controller with the presence of the assumed stochastic occupant behavior. This work indicates that it is necessary to consider the stochasticity of the occupant behavior when designing optimal load schedulers for resilient communities.

Wang, Jing↗
DOE OSTI2020

Current Observer Based Predictive Decoupled Power Control Grid-Interactive Inverter

This paper presents a sensor-less current model predictive control (MPC) scheme via a full state observer based current estimator. The grid interactive inverters’ control schemes require current and voltage sensors. Elimination of current sensor enhances the inverter reliability. This paper leverages the inherent characteristics of MPC towards robust current sensor-less grid interactive inverter with LC filter. The observer for inductor current is developed based on the existing capacitor voltage measurement. The estimator dynamic state-space matrices are then obtained through reconstruction of the inverter model with the capacitor voltage and inductor current being the state variables. The controller objectives are to regulate active and reactive power in a decoupled manner. The theoretical expectation, controller performance, and accuracy of the current estimation are verified by conducting a real-time simulation via Typhoon HIL.

Zhang, Zhen↗
DOE OSTI2020

Leveraging Fine-Grained Occupancy Estimation Patterns for Effective HVAC Control

As occupancy sensing technologies become mature, various occupancy sensors are increasingly deployed in commercial buildings for pervasive occupancy monitoring. These sensors provide occupant-count data, which contains rich spatiotemporal information about occupancy patterns. With long-term occupant-count data collected from a commercial building, we design three different predictive models that capture the occupancy dynamics and examine how a model predictive control of the HVAC system benefits from actual occupancy count prediction. Our analysis reveals that mispredictions of occupancy states, especially false positives and false negatives, may introduce inefficient control that leads to energy waste or user discomfort. To address this issue, we take a step further to design an adaptive model predictive controller that minimizes inefficient control actions according to misprediction types and distributions. A comprehensive evaluation is performed in OpenBuild and EnergyPlus simulators to study the effectiveness of the proposed end-to-end control strategy. The evaluation shows that the proposed solution reduces energy consumption by 29.5% while improving the average weighted occupants comfort by 86.7% in Predicted Mean Vote (PMV) over the fixed schedule strategy.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

How good are learning-based control v.s. model-based control for load shifting? Investigations on a single zone building energy system

Both model predictive control (MPC) and deep reinforcement learning control (DRL) have been presented as a way to approximate the true optimality of a dynamic programming problem, and these two have shown significant operational cost saving potentials for building energy systems. Furthermore, there is still a lack of in-depth quantitative studies on their approximation levels to the true optimality, especially in the building energy domain. To fill in the gap, this paper provides a numerical framework that enables the evaluation of the optimality levels of different controllers for building energy systems. This framework is then used to comprehensively compare the optimal control performance of both MPC and DRL controllers with given computation budgets for a single zone fan coil unit system. Note the optimality is estimated based on a user-specific selection of trade-off weights among energy costs, thermal comfort and control slew rates. Compared with the best optimality we can find through expensive optimization simulations, the best DRL agent can maximally approximate the optimality by 96.54%, which outperforms the best MPC whose optimality level is 90.11%. However, due to the stochasticity, the DRL agent is only expected to approximate the optimality by 90.42%, which is almost equivalent to the best MPC. Except for Proximal Policy Optimization (PPO), all DRL agents can have a better approximation to the optimality than the best MPC, and are expected to have better approximation than the MPC with a prediction horizon of 32 steps (15 min per step). In terms of reducing energy cost and thermal discomfort, MPC can outperform the rule-based control (RBC) by 18.47%–25.44%. DRL can be expected to outperform RBC by 18.95%–25.65% ,and the best DRL control policy can outperform RBC by 20.29%–29.72%. Although the comparison of the optimality level is performed in a perfect setting, e.g., MPC assumes perfect models, and DRL assumes a perfect offline training process and online deployment process, this can shed insight on their capabilities of approximating to the original dynamic programming problem.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Distributed Maneuver Planning With Connected and Automated Vehicles for Boosting Traffic Efficiency

Connected and automated vehicles (CAVs) have the potential to improve traffic throughput and achieve a more efficient utilization of the available roadway infrastructure. They also have the potential to reduce energy consumption through traffic motion harmonization, even when operating in mixed traffic with other human-driven vehicles. The key to realizing these potentials are coordinated control schemes that can be implemented in a distributed manner with the CAVs. In this paper, we propose a distributed predictive control framework that features a two-dimensional maneuver planner incorporating explicit coordination constraints between connected vehicles operating in mixed traffic at various penetration levels. Here, the framework includes a distributed implementation of a reference speed assigner that estimates local traffic speed from on-board measurements and communicated information. We present an extensive evaluation of the proposed framework in traffic micro-simulations at various CAV penetrations from traffic flow, energy use, and lane utilization points of view. Results are compared to a baseline scenario with no CAVs, as well as, a benchmark one-dimensional planner.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2020

Application of Koopman operator for model-based control of fracture propagation and proppant transport in hydraulic fracturing operation

This work explores the application of the recently developed Koopman operator approach for model identification and feedback control of a hydraulic fracturing process. Controlling fracture propagation and proppant transport with precision is a challenge due in large part to the difficulty of constructing approximate models that accurately capture the characteristic moving boundary and highly-coupled dynamics exhibited by the process. Koopman operator theory is particularly attractive here as it offers a way to explicitly construct linear representations for even highly nonlinear dynamics. The method is data-driven and relies on lifting the states to an infinite-dimensional space of functions called observables where the dynamics are governed by a linear Koopman operator. Here this work considers two problems: (a) fracture geometry control, and (b) proppant concentration control. In both cases, an approximate linear model of the corresponding dynamics is constructed and used to design a model predictive controller (MPC). The manuscript shows that in the case of highly nonlinear dynamics, as observed in the proppant concentration, use of canonical functions in the observable basis fails. In such cases, a priori system knowledge can be leveraged to choose the required basis. The numerical experiments demonstrate that the Koopman linear model shows excellent agreement with the real system and successfully achieves the desired target values maximizing the oil and gas productivity. Additionally, due to its linear structure, the Koopman models allow convex MPC formulations that avoid any issues associated with nonlinear optimization.

42 ENGINEERING↗