Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “optimal control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

A Privacy Preserving Model-Free Optimization and Control Framework for Demand Response from Residential Thermal Loads

We consider the problem of optimizing the cost of procuring electricity for a large collection of homes managed by a load serving entity, by pre-cooling or pre-heating the thermal inertial loads in the homes to avoid procuring power during periods of peak electricity pricing. We would like to accomplish this objective in a completely privacy-preserving and model-free manner, that is, without direct access to the state variables (temperatures or power consumption) or the dynamical models (thermal characteristics) of individual homes, while guaranteeing personal comfort constraints of the consumers. We propose a two-stage optimization and control framework to address this problem. In the first stage, we use a long short-term memory (LSTM) network to predict hourly electricity prices, based on historical pricing data and weather forecasts. Given the hourly price forecast and thermal models of the homes, the problem of designing an optimal power consumption trajectory that minimizes the total electricity procurement cost for the collection of thermal loads can be formulated as a large-scale integer program (with millions of variables) due to the on-off cyclical dynamics of such loads. We provide a simple heuristic relaxation to make this large-scale optimization problem model-free and computationally tractable. In the second stage, we translate the results of this optimization problem into distributed open-loop control laws that can be implemented at individual homes without measuring or estimating their state variables, while simultaneously ensuring consumer comfort constraints. We demonstrate the performance of this approach on a large-scale test case comprising of 500 homes in the Houston area and benchmark its performance against a direct model-based optimization and control solution.

Sivaranjani, S.↗

Closing the loop: model-predictive control for a closed-circuit reverse osmosis system

This article presents a model-predictive controller (MPC) for the maximization of the energy efficiency of a closed-circuit desalination reverse osmosis (CCRO) system. CCRO is a process for producing drinking water that is based on a cyclic operation with the following two phases: (a) filtration and (b) drain. In this article, we test model predictive control for optimal control of this process. The most important features of our approach are as follows: (a) the selection of a model structure that enables reliable forecasts of the filtration phase (up to 3 h), (b) an on-line model calibration strategy that ensures model forecast reliability, and (c) the satisfaction of equipment safety and operational constraints on the selected setpoints. We challenge this through deliberate introduction of changes in the unmeasured feed concentration and the applied constraints. Our results indicate that frequent model parameter updates are critical to maintain model reliability for MPC purposes. In addition, we illustrate that parameter identifiability is not guaranteed and that deliberate variation in flow rates is necessary even though the process never operates in steady state. Finally, MPC can compute flow rate setpoints that maximize the energy efficiency of the CCRO process while satisfying the applicable equipment and safety constraints.

closed-circuit reverse osmosis↗

Multibody for Everybody (M4E): A Symbolic Dynamics Modeling Tool with Applications in Simulation, Control, and Optimization

Developing the analytical model of a multibody system is often the initial step in control and optimization. The analytical model (equations of motion) describes a system’s time evolution under specified forcing conditions. Although developing these equations is easy for simple systems, this process becomes more complex for systems composed of multiple bodies. Deriving equations of motion for complex multibody systems requires specialized expertise in multibody dynamics, is time-consuming, and is susceptible to error. To address this issue, this paper presents an open-source, easy-to-use, systematic framework to derive symbolic equations of motion in both Python and MATLAB using the joint coordinate formulation. This formulation results in a set of ordinary differential equations that use the minimum set of coordinates needed to model a system. The symbolic representation provides better insight into the influence of design parameters on system performance, facilitates sensitivity analysis and parameter studies, and supports direct implementation of control and optimization routines. The tool enables numerical simulation for specified parameter sets, is modular for straightforward integration with other tools and libraries, and allows incorporation of hydrodynamics, mooring, and other external forces. The result is a reproducible, extensible pipeline for modeling, simulation, and design of complex multibody systems. The proposed tool is versatile and can be applied to domains such as robotics, control, and design. In addition, we integrated external libraries that provide capabilities for modeling offshore systems such as underwater robots and marine energy converters.

16 TIDAL AND WAVE POWER↗

An Efficient Numerical Algorithm for Solving Data Driven Feedback Control Problems

The goal of this paper is to solve a class of stochastic optimal control problems numerically, in which the state process is governed by an Itô type stochastic differential equation with control process entering both in the drift and the diffusion, and is observed partially. The optimal control of feedback form is determined based on the available observational data. In this work, we call this type of control problems the data driven feedback control. The computational framework that we introduce to solve such type of problems aims to find the best estimate for the optimal control as a conditional expectation given the observational information. To make our method feasible in providing timely feedback to the controlled system from data, we develop an efficient stochastic optimization algorithm to implement our computational framework.

97 MATHEMATICS AND COMPUTING↗

Real Time Predictive and Adaptive Hybrid Powertrain Control Development via Neuroevolution

The real-time application of powertrain-based predictive energy management (PrEM) brings the prospect of additional energy savings for hybrid powertrains. Torque split optimal control methodologies have been a focus in the automotive industry and academia for many years. Their real-time application in modern vehicles is, however, still lagging behind. While conventional exact and non-exact optimal control techniques such as Dynamic Programming and Model Predictive Control have been demonstrated, they suffer from the curse of dimensionality and quickly display limitations with high system complexity and highly stochastic environment operation. This paper demonstrates that Neuroevolution associated drive cycle classification algorithms can infer optimal control strategies for any system complexity and environment, hence streamlining and speeding up the control development process. Neuroevolution also circumvents the integration of low fidelity online plant models, further avoiding prohibitive embedded computing requirements and fidelity loss. This brings the prospect of optimal control to complex multi-physics system applications. The methodology presented here covers the development of the drive cycles used to train and validate the neurocontrollers and classifiers, as well as the application of the Neuroevolution process.

33 ADVANCED PROPULSION SYSTEMS↗

Voltage Restoration in Microgrids using Temporal Logic Specifications

This paper proposes an energy storage controller synthesis method for voltage restoration in microgrids with respect to temporal logic specifications (TLSs). TLSs is introduced in this paper as a formalism to control the voltage variation of a critical bus against an operational bounds over time. The power system with synchronous generator (SG) connected to a critical load bus is modeled as a set of differential-algebraic equations and a simplified analytical model is derived to describe the voltage variation of this critical bus. The control objective is to schedule an optimal control input signal from a supportive energy storage system (ESS) connected to the critical bus, such that the voltage variation of the latter satisfies the TLSs, such as a finite-time restoration. The proposed control is verified on a lumped distribution system model. With this control diagram, supportive controllers can be designed to make voltage behaviors comply with grid codes and avoid unnecessary relay actions.

Taousser, Fatima Zohra↗

Development of near-optimal advanced control sequences for chiller plants with water-side economizers in U.S. Climates (ASHRAE RP-1661)

Various advanced control sequences for chiller plants with water-side economizers (WSE) have been proposed in literature, but the evaluation and optimization of those controls is limited. It is possible to maximize energy savings by selecting different sequences and related parameters based on the plant configuration, load, and climate. This paper addresses this gap by developing near-optimal advanced control sequences for chiller plants with WSEs. First, advanced control sequences for chiller plants with WSEs are categorized into condenser water, chilled water, and hybrid controls and representative sequences from each category are identified. Next, 504 different scenarios are optimized. These scenarios represent all possible combinations of two plant configurations, a constant or variable load profile, three advanced control sequences, and seven optimization parameter combinations in six climate zones. The results show the recommended near-optimal sequences can reduce energy consumption by up to 15% relative to the baseline depending on the configuration, load profile, and climate. Specifically, the CW-CHW sequence is recommended for the majority of systems because it is often the most energy efficient and/or reduces the runtime of chillers. The methodology in this paper provides practical guidance for achieving energy savings through near-optimal control of chiller plants with WSEs.

42 ENGINEERING↗

Assimilating partial observation to enhance feedback control of stochastic dynamical systems

Here, in this paper, we present a novel methodology to tackle feedback optimal control problems in scenarios where the exact state of the controlled process is unknown. It integrates data assimilation techniques and optimal control solvers to manage partial observation of the state process, a common occurrence in practical scenarios. Traditional stochastic optimal control methods assume full state observation, which is often not feasible in real-world fluid dynamics control problems. Our approach underscores the significance of utilizing observational data to inform control policy design. Specifically, we introduce a kernel learning backward stochastic differential equation (SDE) filter to enhance data assimilation efficiency and propose a sample-wise stochastic optimization method within the stochastic maximum principle framework. We demonstrate the efficacy and accuracy of our method in the control of advection-diffusion-reaction flow problem and the Dubins airplane maneuvering problem with model uncertainty.

data driven↗

Optimization-based control using input convex neural networks

Input convex neural networks (ICNNs) are a family of deep learning models where the outputs are constructed to be convex functions of the inputs. By parameterizing system models using ICNNs, optimization-based control problems can be solved as convex optimization problems, leading to improved performance and robustness. This work proposes a novel framework where the control objective function and constraints are modelled using ICNNs. A case study of optimization-based control with output constraints is conducted on a process with input multiplicity and nonminimum phase behavior. The simulation results demonstrate improved economic yield compared with normal neural networks. Additionally, the input convexity formulation is compared with simple regularization techniques, and unique benefits such as improved data efficiency and robustness of the proposed formulation are shown. Finally, by explicitly incorporating prior knowledge about convexity, this framework provides a good balance between the universal approximation power of deep learning and computational feasibility required by control.

42 ENGINEERING↗

Data-driven modeling and control of dynamical systems using Koopman and Perron-Frobenius operators

This dissertation studies the data-driven modeling and control problem of nonlinear systems by exploiting the linear operator theoretic framework involving Koopman and Perro-Frobenius operator. A systematic linear-operator based controller design procedure has been established, which can be used to solve a variety of nonlinear control problems, including feedback stabilization using control Lyapunov functions, optimal quadratic regulation using Koopman eigenfunctions and convex optimization formulation of optimal control problem using P-F and Koopman operator approximation. As the core of data-driven modeling, we first propose a new algorithm for the finite-dimensional approximation of the linear transfer Koopman and Perron-Frobenius operator from time-series data. We argue that the existing approach for the finite-dimensional approximation of these transfer operators such as Dynamic Mode Decomposition (DMD) and Extended Dynamic Mode Decomposition (EDMD) do not capture two important properties of these operators, namely positivity and Markov property. The algorithm we propose preserves these two properties. We call the proposed algorithm as naturally structured DMD (NSDMD) since it retains the inherent properties of these operators. Naturally structured DMD algorithm leads to a better approximation of the steady-state dynamics of the system regarding computing Koopman and Perron- Frobenius operator eigenfunctions and eigenvalues. However, preserving positivity property is critical for capturing the real transient dynamics of the system. This positivity property of the transfer operators and it's finite-dimensional approximation play an important role for controller and estimator design of nonlinear systems. To solve the feedback stabilization problem for nonlinear control systems, we tried to take advantage of the Koopman operator framework. The Koopman operator approach provides a linear representation for a nonlinear dynamical system and a bilinear representation for a nonlinear control system. The problem of feedback stabilization of a nonlinear control system is then transformed to the stabilization of a bilinear control system. We propose a control Lyapunov function (CLF)-based approach for the design of stabilizing feedback controllers for the bilinear system. The search for finding a CLF for the bilinear control system is formulated as a convex optimization problem. This leads to a schematic procedure for designing CLF-based stabilizing feedback controllers for the bilinear system and hence the original nonlinear system. Another advantage of the proposed controller design approach outlined in this dissertation is that it does not require explicit knowledge of system dynamics. In particular, the bilinear representation of a nonlinear control system in the Koopman eigenfunction space can be obtained from time-series data. Next, we study the optimal quadratic regulation problem for nonlinear systems. The linear operator theoretic framework involving the Koopman operator is used to lift the dynamics of nonlinear control system to an infinite-dimensional bilinear system. The optimal quadratic regulation problem for nonlinear system is formulated in terms of the finite-dimensional approximation of the bilinear system. A convex optimization-based approach is proposed for solving the quadratic regulator problem for bilinear system. We applied a variety of examples and compared the simulation results between our framework and conventional LQR control using linearized model. For more general optimal control problems, we provide a density-function based convex formulation for the optimal control problem of the nonlinear system. The convex formulation relies on the duality result in the stability theory of a dynamical system involving density function and Perron-Frobenius operator. The optimal control problem is formulated as an infinite-dimensional convex optimization program. The finite-dimensional approximation of the optimization problem relies on the recent advances made in the data-driven computation of the Koopman operator, which is dual to the Perron-Frobenius operator. Simulation results are presented to demonstrate the application of the developed framework.

Huang, Bowen↗

Advanced Reactor Control and Operations (ARCO): A University Research Facility for Developing Optimized Digital Control Rooms

The Advanced Reactor Control and Operations (ARCO) facility was constructed in January 2018 to serve as a test bed for advanced reactor control rooms and operator support systems. Since then, it has supported human-machine interface user experience research, fault detection and mitigation technology development, control room concept of operations development, and remote operations research. ARCO serves as the control room for the Compact Integral Effects Test (CIET) facility, which replicates the primary-side flow paths and thermal-hydraulic behavior of a fluoride-salt-cooled high-temperature reactor (FHR) using simulant fluids and scaling principles. New reactor designs feature different operating conditions and scenarios than those in existing reactors. ARCO supports the research and development of digital tools for operator communications, intuitive real-time data analysis, online health monitoring and prognostics, and control room cybersecurity. By integrating these different technologies, ARCO acts as a prototypical control system to iteratively develop methods and tools of operation in advanced small modular nuclear reactors. This paper describes the features of and challenges to operating advanced small modular reactors underlying the design basis for ARCO and its operator support systems.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Modeling and Validation of a Residential Multi-Functional Variable Refrigerant Flow Heat Pump System with Heat Recovery

To bridge the existing gap in modeling the variable refrigerant flow heat pump systems with heat recovery (VRFHR), we developed a suite of dynamic VRFHR system models in Modelica. These models are specifically tailored for residential multi-functional VRFHR (MF-VRFHR) applications, including space conditioning and domestic hot water (DHW) heating, utilizing both the TIL library for HVAC equipment and the Buildings library for thermal load calculations. The development comprises essential component models, including the newly developed heat recovery unit (HRU), along with system models that integrate the heat pump system and building envelope. These system models accommodate various operational modes such as heating-only, cooling-only, and heating-recovery (including heating-dominant and cooling-dominant) modes. Furthermore, we propose an efficient optimization-based model calibration method that identifies critical model parameters while utilizing a small amount of data obtained from either real systems or manufacturer's specifications. We demonstrate the effectiveness of these models and the proposed calibration method for a MF-VRFHR system installed in Richland, WA. The developed models are calibrated and validated using data collected under different operational modes during both heating and cooling seasons. The results show that the models capture the system dynamics and achieve high accuracy, with the coefficient of the variation of the root-mean-square-error less than 15% for variables such as outdoor unit power consumption, compressor speed, space temperature and DHW temperature. The validated models serve as a reliable representation of the MF-VRFHR system, facilitating the development and validation of optimized controls needed to realize the full benefits of integrated heat pump systems. Future research will utilize these models to develop advanced controls and optimize system performance for improved energy efficiency and demand flexibility.

Modeling, Variable refrigerant flow (VRF) systems,↗

High-dimensional control co-design of a wave energy converter with a novel pitch resonator power takeoff system

Researchers are exploring adding wave energy converters to existing oceanographic buoys to provide a predictable source of renewable power. A ”pitch resonator” power take-off system has been developed that generates power using a geared flywheel system designed to match resonance with the pitching motion of the buoy. However, the novelty of the concept leaves researchers uncertain about various design aspects of the system. This work presents a novel design study of a pitch resonator to inform design decisions for an upcoming deployment of the system. The assessment uses control co-design via WecOptTool to optimize control trajectories for maximal electrical power production while varying five design parameters of the pitch resonator. Given the large search space of the problem, the control trajectories are optimized within a Monte Carlo analysis to identify optimal designs, followed by parameter sweeps around the optimum to identify trends between the design parameters. The gear ratio between the pitch resonator spring and flywheel are found to be the most sensitive design variables to power performance. Finally, the assessment also finds similar power generation for various sizes of resonator components, suggesting that correctly designing for optimal control trajectories at resonance is more critical to the design than component sizing.

16 TIDAL AND WAVE POWER↗

Consensus-Based Control and Optimization of Power System Inertia

The integration of distributed energy resources (DERs), such as solar, wind, and energy storage systems, into power grids through inverter-based resources reduces power system inertia, leading to faster frequency dynamics and potential grid instability. To address this challenge, this paper proposes a distributed, consensus-based approach for the real-time control and optimization of inertia sources (synchronous generators and/or DERs) during system disturbances, enhancing both system stability and economic performance. The distributed control and optimization approach assumes each inertia source exchanges information solely with its neighbor ones, making it easily scalable to large power grid networks. The impacts of the communication connectivity among the inertia sources as well as their generation capacity limits on the distributed approach are investigated. We also demonstrate the approach’s robustness in scenarios involving communication time delays and packet losses, validating its effectiveness through numerical simulations on a 4-bus test system and a two-area 8-bus test system.

Power system inertia↗

Learning Constrained Parametric Differentiable Predictive Control Policies With Guarantees

We present differentiable predictive control (DPC), a method for offline learning of constrained neural control policies for nonlinear dynamical systems with performance guarantees. We show that the sensitivities of the parametric optimal control problem can be used to obtain direct policy gradients. Specifically, we employ automatic differentiation (AD) to efficiently compute the sensitivities of the model predictive control (MPC) objective function and constraints penalties. To guarantee safety upon deployment, we derive probabilistic guarantees on closed-loop stability and constraint satisfaction based on indicator functions and Hoeffding’s inequality. We empirically demonstrate that the proposed method can learn neural control policies for various parametric optimal control tasks. In particular, we show that the proposed DPC method can stabilize systems with unstable dynamics, track time-varying references, and satisfy nonlinear state and input constraints. Our DPC method has practical time savings compared to alternative approaches for fast and memory-efficient controller design. Specifically, DPC does not depend on a supervisory controller as opposed to approximate MPC based on imitation learning. We demonstrate that, without losing performance, DPC is scalable with greatly reduced demands on memory and computation compared to implicit and explicit MPC while being more sample efficient than model-free reinforcement learning (RL) algorithms.

97 MATHEMATICS AND COMPUTING↗

High-Fidelity Software-Defined Quantum Logic on a Superconducting Qudit

We present an efficient approach to achieving arbitrary, high-fidelity control of a multilevel quantum system using optimal control techniques. As an demonstration, we implement a continuous, software-defined microwave pulse to realize a 0 ↔ 2 SWAP gate that achieves an average gate fidelity of 99.4%. We describe our procedure for extracting the system Hamiltonian, calibrating the quantum and classical hardware chain, and evaluating the gate fidelity. Our work represents an alternative, fully generalizable route towards achieving universal quantum control by leveraging optimal control techniques.

Superconducting qubits↗

Optimizing detachment control using the magnetic configuration of divertors

Abstract As tokamak research moves to reactor conditions, the control of a stable, optimally-detached divertor plasma has become increasingly relevant. Simple predictions of such detachment control have been performed previously using the detachment location sensitivity (DLS) model (Lipschultz et al 2016 Nucl. Fusion 56 056007). In this study the DLS model is extended and combined with SOLPS-ITER simulations of isolated divertor grids to study the effects of alternate divertor magnetic field properties on detachment control. The DLS model predicts that divertors can achieve easier access to detachment through a long connection length, a high total flux expansion, and a high average magnetic field in the divertor compared with that at the x -point. SOLPS-ITER simulations suggest an even stronger impact of total flux expansion and connection length on detachment access than the DLS model predicts. In terms of detachment evolution, both simulation and modelling show a high gradient in the total magnetic field and low B p o l B are able to more easily keep a detachment front at a desired poloidal location. Regions with no stable detachment front locations can arise for high magnetic field gradients directed towards the target. Significant differences have been found between impurity scan simulations and the DLS model. These differences may be attributed to sources and sinks of power and electron pressure, and should be explored further in future work.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗