Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “predictive control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Learning Stochastic Parametric Differentiable Predictive Control Policies

We present a scalable unsupervised learning-based method for obtaining explicit control policies for model predictive control problems for stochastic linear systems with additive uncertainties subject to nonlinear chance constraints. We call the proposed method stochastic parametric differentiable predictive control (SP-DPC), which extends the recently proposed deterministic DPC policy optimization algorithm. We formulate the SP-DPC as a deterministic approximation to the stochastic parametric constrained optimal control problem via independent sampling of the problem's parameters and uncertainties. This formulation allows us to directly compute the policy gradients via automatic differentiation of the problem's value function, evaluated over sampled parameters and uncertainties. In particular, the computed expectation of the problem's value function is backpropagated through the finite-time closed-loop system rollouts parametrized by a known nominal system dynamics model and neural control policy. We also provide theoretical probabilistic guarantees on closed-loop stability and chance constraints satisfaction for systems controlled by learned neural policies. We demonstrate the computational efficiency and scalability of the proposed policy optimization algorithm in three numerical examples, including systems with a large number of states or subject to nonlinear constraints.

Drgona, Jan↗

Ontologies at Work: Analyzing Information Requirements for Model Predictive Control in Buildings

Model Predictive Control (MPC) has shown significant potential for improving energy efficiency, indoor air quality and occupant comfort of buildings. MPC-based control algorithms have also shown the ability to shift loads and optimize for multiple objectives, including but not limited to reducing the green-house gas emissions, energy costs and peak demand. However, one of the main implementation challenges of these control algorithms is the integration and configuration effort needed to deploy a supervisory MPC controller in a building. By assigning standardized references to information sources and control points in buildings, existing studies have shown that semantic ontologies and corresponding queries have the potential to ease the deployment of such controllers. Yet, the use of semantic information to ease the deployment processes of MPC controllers is still limited. In this paper, we review three MPC experiments and synthesize the information requirements of these optimization problems. We then turn to existing and upcoming semantic ontologies such as Brick, SAREF and ASHRAE Standard 223 to represent these requirements, evaluating their potential to support the implementation of an MPC controller. This investigation concludes with a discussion of existing opportunities and open questions that the community should explore to support more streamlined MPC implementations.

Prakash, Anand Krishnan↗

A Robustly Stabilizing Model Predictive Control Algorithm

A model predictive control (MPC) algorithm that differs from prior MPC algorithms has been developed for controlling an uncertain nonlinear system. This algorithm guarantees the resolvability of an associated finite-horizon optimal-control problem in a receding-horizon implementation.

Ackmece, A. Behcet↗

Pilots Rate Augmented Generalized Predictive Control for Reconfiguration

The objective of this paper is to report the results from the research being conducted in reconfigurable fight controls at NASA Ames. A study was conducted with three NASA Dryden test pilots to evaluate two approaches of reconfiguring an aircraft's control system when failures occur in the control surfaces and engine. NASA Ames is investigating both a Neural Generalized Predictive Control scheme and a Neural Network based Dynamic Inverse controller. This paper highlights the Predictive Control scheme where a simple augmentation to reduce zero steady-state error led to the neural network predictor model becoming redundant for the task. Instead of using a neural network predictor model, a nominal single point linear model was used and then augmented with an error corrector. This paper shows that the Generalized Predictive Controller and the Dynamic Inverse Neural Network controller perform equally well at reconfiguration, but with less rate requirements from the actuators. Also presented are the pilot ratings for each controller for various failure scenarios and two samples of the required control actuation during reconfiguration. Finally, the paper concludes by stepping through the Generalized Predictive Control's reconfiguration process for an elevator failure.

Soloway, Don↗

Predictive controller and estimator for NASA Deep Space Network antennas

A new design procedure is presented for a predictive controller that significantly improves antenna tracking performance. The predictive controller uses future values of the stored output command to generate the control signal. For antennas tracking stars or spacecraft, these values are known in advance, hence the predictive control scheme is easily implemented in this case. The predictive controller is designed for tracking control of the the NASA/JPL 70-m antenna. On-axis tracking is considered, where the output is taken on the encoder, or tachometer. Simulation results show a significant improvement in performance over the LQ controller.

Gawronski, W.↗

Tracking and Rejection of Biased Sinusoidal Signals Using Generalized Predictive Controller

Some novel applications require the tracking/rejection of biased sinusoidal reference/distur-bances. According to the internal model principle (IMP), a controller must embed the model of a biased sinusoidal signal to track references and also reject perturbations modeled through the aforementioned signal. However, the design of that kind of controller is not straightforward, especially when they are implemented in digital processors. This paper presents a controller, based on generalized predictive control (GPC), designed for tracking/rejection of biased sinusoidal signals. In general, GPC is based on the prediction of the plant responses through an augmented prediction model. The proposed approach develops an augmented model that predicts the future errors. The prediction model and the control law used in the proposed approach embed the discrete-time model of a biased sinusoidal signal. Thus, the proposed controller can track/reject biased sinusoidal references/disturbances. The predicted errors and the future inputs of the proposed augmented model are used to define the cost function that measures the control performance. An optimization technique was applied to obtain the solution of the cost function, which is the optimal sequence of future model inputs that allows defining the control law. Experimental tests prove that the proposed controller can asymptotically track and reject biased sinusoidal signals.

42 ENGINEERING↗

An application of generalized predictive control to rotorcraft terrain-following flight

Generalized predictive control (GPC) describes an algorithm for the control of dynamic systems in which a control input is generated which minimizes a quadratic cost function consisting of a weighted sum of errors between desired and predicted future system output and future predicted control increments. The output predictions are obtained from an internal model of the plant dynamics. The GPC algorithm is first applied to a simplified rotorcraft terrain-following problem, and GPC performance is compared to that of a conventional compensatory automatic system in terms of flight-path following, control activity, and control law implementation. Next, more realistic vehicle dynamics are utilized, and the GPC algorithm is applied to simultaneous terrain following and velocity control in the presence of atmospheric disturbances and errors in the internal model of the vehicle. The online computational and sensing requirements for implementing the GPC algorithm are minimal. Its use for manual control models appears promising.

Hess, Ronald A.↗

Learning Constrained Parametric Differentiable Predictive Control Policies With Guarantees

We present differentiable predictive control (DPC), a method for offline learning of constrained neural control policies for nonlinear dynamical systems with performance guarantees. We show that the sensitivities of the parametric optimal control problem can be used to obtain direct policy gradients. Specifically, we employ automatic differentiation (AD) to efficiently compute the sensitivities of the model predictive control (MPC) objective function and constraints penalties. To guarantee safety upon deployment, we derive probabilistic guarantees on closed-loop stability and constraint satisfaction based on indicator functions and Hoeffding’s inequality. We empirically demonstrate that the proposed method can learn neural control policies for various parametric optimal control tasks. In particular, we show that the proposed DPC method can stabilize systems with unstable dynamics, track time-varying references, and satisfy nonlinear state and input constraints. Our DPC method has practical time savings compared to alternative approaches for fast and memory-efficient controller design. Specifically, DPC does not depend on a supervisory controller as opposed to approximate MPC based on imitation learning. We demonstrate that, without losing performance, DPC is scalable with greatly reduced demands on memory and computation compared to implicit and explicit MPC while being more sample efficient than model-free reinforcement learning (RL) algorithms.

97 MATHEMATICS AND COMPUTING↗

Deadbeat Predictive Controllers

Several new computational algorithms are presented to compute the deadbeat predictive control law. The first algorithm makes use of a multi-step-ahead output prediction to compute the control law without explicitly calculating the controllability matrix. The system identification must be performed first and then the predictive control law is designed. The second algorithm uses the input and output data directly to compute the feedback law. It combines the system identification and the predictive control law into one formulation. The third algorithm uses an observable-canonical form realization to design the predictive controller. The relationship between all three algorithms is established through the use of the state-space representation. All algorithms are applicable to multi-input, multi-output systems with disturbance inputs. In addition to the feedback terms, feed forward terms may also be added for disturbance inputs if they are measurable. Although the feedforward terms do not influence the stability of the closed-loop feedback law, they enhance the performance of the controlled system.

Juang, Jer-Nan↗

Autonomous control for Heat-Pipe microreactor using Data-Driven model predictive control

To enable a self-regulating capability for heat pipe (HP) microreactors, an anticipatory control strategy achieved via model predictive control (MPC) could proactively respond to potential disturbances and deviations in operating setpoints. This paper demonstrates data-driven methods for predicting the distribution and transient of temperatures and heat fluxes at selected components and regions in a 37-HP system, based on which the optimal control actions in response to changes in user-defined setpoints can be found. We present the development and validation of linear state-space model, feedfoward, and recurrent neural networks. Here, we compare the performance of MPCs with different modeling approaches in terms of following setpoints for temperatures and averaged output heat fluxes. The accuracies of the three data-driven models are similar, but the control actions initiated by neural-network-based MPC can better adapt to drastic changes in setpoints yet generate the smallest errors.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Analysis of predicted mean vote-based model predictive control for residential HVAC systems

Model Predictive Control (MPC) is an advanced process control method that has attracted much attention in building heating, ventilation, and air conditioning (HVAC) systems. Here, this paper analyzes the optimal precooling performance in residential buildings using MPC with two different comfort indices, namely, temperature and predicted mean vote (PMV). It first formulates, for each comfort index, an optimization problem that accounts for different factors, such as weather, home thermal condition, prediction horizon, time-of use (TOU) utility rate, and rated cooling capacity. The problem is then solved, resulting in an MPC strategy that determines the HVAC on/off control signal and minimizes energy cost over a receding time horizon while maintaining thermal comfort. The energy performance difference between temperature-based and PMV-based MPC strategies is subsequently investigated, especially in light of the interior wall surface temperature and under different combinations of the factors. Extensive simulation results demonstrated that the proposed MPC strategies are adaptive and their performances depend primarily on weather, home thermal condition, and prediction horizon, while the impact of TOU utility rate and rated cooling capacity is relatively small. Because the PMV-based MPC strategy can take advantage of the lower interior wall surface temperature due to precooling, it resulted in 8–45% cost savings for the scenarios investigated and an average increase of 0.042–0.113 in the absolute value of the PMV index compared to the temperature-based MPC strategy.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Data-Driven Model Predictive Control for Temperature Management of Heat Pipe Microreactor

To enable the self-regulating capability of heat pipe (HP) microreactors, an anticipatory control strategy through model predictive control (MPC) could proactively respond to potential disturbances and deviations in operating setpoints. However, a key factor prohibiting the widespread adoption of MPCs in nuclear applications is the effort and computational costs associated with learning and calibrating first-principles-based process models when the target system is complex and when there are gaps between modeled and target reactor systems. In this paper, we demonstrate data-driven MPC using three approaches for modeling the system dynamics, including a linear state-space model, feedforward neural network, and recurrent neural networks long short-term memory. We present the development and validation process of each model and compare the performance of data-driven MPCs in controlling the temperatures of selected HPs at the evaporator and condenser regions in a 37-HP-monolith system. Our results show that, qualitatively, all data-driven MPCs are producing similar control actions, while quantitatively, with artificial neural nets (especially feedforward neural nets), MPC can better follow drastic changes in setpoints with smallest errors.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Rate-Based Model Predictive Control of Turbofan Engine Clearance

An innovative model predictive control strategy is developed for control of nonlinear aircraft propulsion systems and sub-systems. At the heart of the controller is a rate-based linear parameter-varying model that propagates the state derivatives across the prediction horizon, extending prediction fidelity to transient regimes where conventional models begin to lose validity. The new control law is applied to a demanding active clearance control application, where the objectives are to tightly regulate blade tip clearances and also anticipate and avoid detrimental blade-shroud rub occurrences by optimally maintaining a predefined minimum clearance. Simulation results verify that the rate-based controller is capable of satisfying the objectives during realistic flight scenarios where both a conventional Jacobian-based model predictive control law and an unconstrained linear-quadratic optimal controller are incapable of doing so. The controller is evaluated using a variety of different actuators, illustrating the efficacy and versatility of the control approach. It is concluded that the new strategy has promise for this and other nonlinear aerospace applications that place high importance on the attainment of control objectives during transient regimes.

DeCastro, Jonathan A.↗

Field demonstration and implementation analysis of model predictive control in an office HVAC system

Model Predictive Control (MPC) is a promising technique to address growing needs for heating, ventilation, and air-conditioning (HVAC) systems to operate more efficiently and with greater flexibility. However, due to a number of factors, including the required implementation expertise, lack of high quality data, and a risk-adverse industry, MPC has yet to gain widespread adoption. While many previous studies have shown the advantages of MPC, few analyzed the implementation effort and associated practical challenges. In addition, previous work has developed an open-source, Modelica-based tool-chain that automatically generates optimal control, parameter estimation, and state estimation problems aimed at facilitating MPC implementation. Therefore, this study demonstrates usage of this tool-chain to implement MPC in a real office building, discusses practical challenges of implementing MPC, and estimates the implementation effort associated with various tasks in order to inform the development of future workflows and serve as an initial benchmark for their impact on reducing implementation effort. This study finds that the implemented MPC saves approximately 40% of HVAC energy over the existing control during a two-month trial period and that tasks related to data collection and controller deployment activities can each require as much effort as model generation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Neural Generalized Predictive Control: A Newton-Raphson Implementation

An efficient implementation of Generalized Predictive Control using a multi-layer feedforward neural network as the plant's nonlinear model is presented. In using Newton-Raphson as the optimization algorithm, the number of iterations needed for convergence is significantly reduced from other techniques. The main cost of the Newton-Raphson algorithm is in the calculation of the Hessian, but even with this overhead the low iteration numbers make Newton-Raphson faster than other techniques and a viable algorithm for real-time control. This paper presents a detailed derivation of the Neural Generalized Predictive Control algorithm with Newton-Raphson as the minimization algorithm. Simulation results show convergence to a good solution within two iterations and timing data show that real-time control is possible. Comments about the algorithm's implementation are also included.

Soloway, Donald↗

Model predictive control for robust quantum state preparation

A critical engineering challenge in quantum technology is the accurate control of quantum dynamics. Model-based methods for optimal control have been shown to be highly effective when theory and experiment closely match. Consequently, realizing high-fidelity quantum processes with model-based control requires careful device characterization. In quantum processors based on cold atoms, the Hamiltonian can be well-characterized. For superconducting qubits operating at milli-Kelvin temperatures, the Hamiltonian is not as well-characterized. Unaccounted for physics (i.e., mode discrepancy), coherent disturbances, and increased noise compromise traditional model-based control. This work introduces model predictive control (MPC) for quantum control applications. MPC is a closed-loop optimization framework that (i) inherits a natural degree of disturbance rejection by incorporating measurement feedback, (ii) utilizes finite-horizon model-based optimizations to control complex multi-input, multi-output dynamical systems under state and input constraints, and (iii) is flexible enough to develop synergistically alongside other modern control strategies. We show how MPC can be used to generate practical optimized control sequences in representative examples of quantum state preparation. Specifically, we demonstrate for a qubit, a weakly-anharmonic qubit, and a system undergoing crosstalk, that MPC can realize successful model-based control even when the model is inadequate. These examples showcase why MPC is an important addition to the quantum engineering control suite.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Exploratory Studies in Generalized Predictive Control for Active Aeroelastic Control of Tiltrotor Aircraft

The Aeroelasticity Branch at NASA Langley Research Center has a long and substantive history of tiltrotor aeroelastic research. That research has included a broad range of experimental investigations in the Langley Transonic Dynamics Tunnel (TDT) using a variety of scale models and the development of essential analyses. Since 1994, the tiltrotor research program has been using a 1/5-scale, semispan aeroelastic model of the V-22 designed and built by Bell Helicopter Textron Inc. (BHTI) in 1981. That model has been refurbished to form a tiltrotor research testbed called the Wing and Rotor Aeroelastic Test System (WRATS) for use in the TDT. In collaboration with BHTI, studies under the current tiltrotor research program are focused on aeroelastic technology areas having the potential for enhancing the commercial and military viability of tiltrotor aircraft. Among the areas being addressed, considerable emphasis is being directed to the evaluation of modern adaptive multi-input multi- output (MIMO) control techniques for active stability augmentation and vibration control of tiltrotor aircraft. As part of this investigation, a predictive control technique known as Generalized Predictive Control (GPC) is being studied to assess its potential for actively controlling the swashplate of tiltrotor aircraft to enhance aeroelastic stability in both helicopter and airplane modes of flight. This paper summarizes the exploratory numerical and experimental studies that were conducted as part of that investigation.

Kvaternik, Raymond G.↗

Simulation Evaluation of a Large-Scale Implementation of Virtual-Phase Link-Based Model Predictive Control

Traffic congestion is a serious problem in the US, and traffic signal control is one of the effective solutions to congestion. Previous research on model predictive control (MPC)-based traffic signal control showed substantial benefits over conventional methods. This study focused on implementing MPC over a large-scale network with complex intersections and the impact of cycle length, network size, and imperfect state estimation on performances. This study implemented a virtual phase link (VPL)-based model predictive control method which used the number of vehicles in each VPL as input state variables and was suitable for National Electrical Manufacturing Association (NEMA) ring-barrier control. To test the impact of network size, the performance of distributed MPC (36 intersections in the network are divided into five subnetworks) was compared with that of MPC over the full network for a set of cycle lengths. To test the impact of imperfect state estimation, we synthetically infused estimation error and developed two scenarios, MPC-error and MPC-error narrow, which had higher and lower estimation errors, respectively. The performance of these MPC methods was compared with that of the existing time-of-day (TOD) method and an offline method that used Webster's method for split and MULTIBAND for cycle length and offset optimization. Trajectory and linkwise signal performance measures were collected from the simulation to evaluate performance. The distributed MPC method with perfect state estimation had the lowest delay and highest energy efficiency of all the methods. The performance of MPC decreased as the prediction inaccuracy increased. MPC-error had 7% and 11% more delay than MPC-error narrow in the morning and evening peaks, respectively. Overall, simulation results suggest that even with imperfect state estimation, MPC methods will outperform offline methods significantly.

large-scale simulation↗