Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Optimal Control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,783 records · Page 99

Coordination of Energy Storage and Distributed Generation for Voltage Control and Peak-valley Filling

The increasing penetration of distributed energy resources (DERs) in distribution network (DN) poses challenges on voltage control. In addition, the growing integration of DERs also reshapes the traditional load profile. To comprehensively address the voltage control and peak-valley filling in DN, this paper proposes a model predictive control (MPC) based optimization framework. The proposed method can achieve coordinated voltage control and peak-valley filling by adjusting the reactive power output from distributed generations (DGs) and the charging/discharging of energy storage systems (ESS). The performance of the proposed method is demonstrated by simulations on a modified IEEE-123 bus system.

Zhang, Zhengfa [University of Tennessee, Knoxville↗

An Introduction to the Federated Architecture for Secure and Transactive Distributed Energy Management Solutions (FAST-DERMS): Preprint

Deployment and capability of distributed energy resources (DER) in power systems is growing rapidly. These resources present an opportunity for low-cost provision of energy and grid services. The Federal Energy Regulatory Commission recently provided rulings to enable market participation of these distribution-connected resources, but the prevailing strategies for their management may not scale well to meet future needs. This paper introduces the Federated Architecture for Secure and Transactive Distributed Energy Management Solutions (FASTDERMS) which was designed to address this need. In it we describe the architectural features of the approach, and a reference controls implementation employing a hierarchical coordination that includes stochastic optimization, model predictive control, and a simple real-time management scheme. Sample results from simulation show firm transmission-level service provision measured at the distribution substation.

DERMS↗

Coherent control of plasma dynamics by feedback-optimized wavefront manipulation

Plasmas generated by an intense laser pulse can support coherent structures such as large amplitude wakefield that can affect the outcome of an experiment. We investigate the coherent control of plasma dynamics by feedback-optimized wavefront manipulation using a deformable mirror. The experimental outcome is directly used as feedback in an evolutionary algorithm for optimization of the phase front of the driving laser pulse. In this paper, we applied this method to two different experiments: (i) acceleration of electrons in laser driven plasma waves and (ii) self-compression of optical pulses induced by ionization nonlinearity. The manipulation of the laser wavefront leads to orders of magnitude improvement to electron beam properties such as the peak charge, beam divergence, and transverse emittance. The demonstration of coherent control for plasmas opens new possibilities for future laser-based accelerators and their applications.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Corrective Control to Handle Forecast Uncertainty: A Chance Constrained Optimal Power Flow

Higher shares of electricity generation from renewable energy sources and market liberalization is increasing uncertainty in power systems operation. At the same time, operation is becoming more flexible with improved control systems and new technology such as phase shifting transformers (PSTs) and high voltage direct current connections (HVDC). Previous studies have shown that the use of corrective control in response to outages contributes to a reduction in operating cost, while maintaining N-1 security. In this work, we propose a method to extend the use of corrective control of PSTs and HVDCs to react to uncertainty. We characterize the uncertainty as continuous random variables, and define the corrective control actions through affine control policies. This allows us to efficiently model control reactions to a large number of uncertainty sources. The control policies are then included in a chance constrained optimal power flow formulation, which guarantees that the system constraints are enforced with a desired probability. Lastly, by applying an analytical reformulation of the chance constraints, we obtain a second-order cone problem for which we develop an efficient solution algorithm. In a case study for the IEEE 118 bus system, we show that corrective control for uncertainty leads to a decrease in operational cost, while maintaining system security. Further, we demonstrate the scalability of the method by solving the problem for the IEEE 300 bus and the Polish system test cases.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Optimal Operation of a Hybrid Hydraulic Electric Architecture (HHEA) for Off-Road Vehicles Over Discrete Operating Decisions

Many off-highway machines including construction and agriculture equipment use hydraulics for power transmission and throttling as a means for control. Trends towards better efficiency and electrification have led to the creation of a novel Hybrid Hydraulic-Electric Architecture (HHEA) which could significantly reduce energy consumption and maintain control performance, even in machines that are too large to be directly electrified. This is achieved by using a set of common pressure rails to transmit the majority of power via power dense hydraulics and modulating the power with small electric motor-drives to achieve precise control. This paper proposes a computationally efficient method for computing the optimal sequence of pressure rail selections for the HHEA over finite drive cycles. This is useful for fairly comparing the novel architecture’s energy performance to existing architectures and for use in iterative optimal design of the architecture. The optimal control technique makes use of a static model of the architecture and losses. Constraints are enforced such that the drive cycle is repeatable. The constrained optimal operation is solved using a Lagrange multiplier technique that transforms the optimization into a small set of sub-problems by considering combinations of active constraints. Each of these sub-problems can be solved efficiently because loss calculations for all time steps can be computed in parallel. A case study of an off-road construction machine demon-strates that the HHEA reduces energy consumption by 2/3 compared to the baseline load sensing architecture.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Equilibrium Control Policies for Markov Chains

The average cost criterion has held great intuitive appeal and has attracted considerable attention. It is widely employed when controlling dynamic systems that evolve stochastically over time by means of formulating an optimization problem to achieve long-term goals efficiently. The average cost criterion is especially appealing when the decision-making process is long compared to other timescales involved, and there is no compelling motivation to select short-term optimization. This paper addresses the problem of controlling a Markov chain so as to minimize the average cost per unit time. Our approach treats the problem as a dual constrained optimization problem. We derive conditions guaranteeing that a saddle point exists for the new dual problem and we show that this saddle point is an equilibrium control policy for each state of the Markov chain. For practical situations with constraints consistent to those we study here, our results imply that recognition of such saddle points may be of value in deriving in real time an optimal control policy.

99 GENERAL AND MISCELLANEOUS↗

A persistent adjoint method with dynamic time-scaling and an application to mass action kinetics

In this article, we consider an optimization problem where the objective function is evaluated at the fixed-point of a contraction mapping parameterized by a control variable, and optimization takes place over this control variable. Since the derivative of the fixed-point with respect to the parameter can usually not be evaluated exactly, an adjoint dynamical system can be used to estimate gradients. Using this estimation procedure, the optimization algorithm alternates between derivative estimation and an approximate gradient descent step. We analyze a variant of this approach involving dynamic time-scaling, where after each parameter update the adjoint system is iterated until a convergence threshold is passed. Here, we prove that, under certain conditions, the algorithm can find approximate stationary points of the objective function. We demonstrate the approach in the settings of an inverse problem in chemical kinetics, and learning in attractor networks.

97 MATHEMATICS AND COMPUTING↗

A Cooperative Control Algorithm for Camera Based Observational Systems

Over the last several years, there has been considerable growth in camera based observation systems for a variety of safety, scientific, and recreational applications. In order to improve the effectiveness of these systems, we frequently desire the ability to increase the number of observed objects, but solving this problem is not as simple as adding more cameras. Quite often, there are economic or physical restrictions that prevent us from adding additional cameras to the system. As a result, we require methods that coordinate the tracking of objects between multiple cameras in an optimal way. In order to accomplish this goal, we present a new cooperative control algorithm for a camera based observational system. Specifically, we present a receding horizon control where we model the underlying optimal control problem as a mixed integer linear program. The benefit of this design is that we can coordinate the actions between each camera while simultaneously respecting its kinematics. In addition, we further improve the quality of our solution by coupling our algorithm with a Kalman filter. Through this integration, we not only add a predictive component to our control, but we use the uncertainty estimates provided by the filter to encourage the system to periodically observe any outliers in the observed area. This combined approach allows us to intelligently observe the entire region of interest in an effective and thorough manner.

99 GENERAL AND MISCELLANEOUS↗

Introduction to ALERT: A User-Interface Tool for Resilient Optimization

As the cyber-physical systems grow in complexity, there is a need for proactive resilience strategies that involve online, adaptive control actions to best prepare for any impending adversarial events. In this technical effort, supported by RD2C LDRD initiative, the project team designed and demonstrated online strategies – referred to as ALERT controls – for proactive and adaptive tuning of existing optimal controls in a microgrid, with quantifiably assured margins of resilience to various cyber-physical adversarial events. This ALERT functionality is made available to the end-users, e.g., the system operators, via an interactive user-interface. The end-users will not only be able to use the interface to visualize the system’s operation under various cyber-physical adversarial scenarios, but also evaluate the amount of tolerance the system has against selected adversarial perturbations of interest (e.g., malfunctioning sensors, suspected attacked measurements) via the adversarial plots. In this technical report, we briefly outline the algorithmic modules of the developed ALERT control technology, and introduce the user-interface tool that allows end-users (e.g., microgrid operators) to enter their system description, specify various operational and resilience requirements, and evaluate the impact of the control decisions via illustrative plots.

97 MATHEMATICS AND COMPUTING↗

Selective and Scalable Control of Spin Quantum Memories in a Photonic Circuit

A central goal in many quantum information processing applications is a network of quantum memories that can be entangled with each other while being individually controlled and measured with high fidelity. This goal has motivated the development of programmable photonic integrated circuits (PICs) with integrated spin quantum memories using diamond color center spin-photon interfaces. However, this approach introduces a challenge into the microwave control of individual spins within closely packed registers. Here, we present a quantum memory-integrated photonics platform capable of (i) the integration of multiple diamond color center spins into a cryogenically compatible, high-speed programmable PIC platform, (ii) selective manipulation of individual spin qubits addressed via tunable magnetic field gradients, and (iii) simultaneous control of qubits using numerically optimized microwave pulse shaping. The combination of localized optical control, enabled by the PIC platform, together with selective spin manipulation opens the path to scalable quantum networks on intrachip and interchip platforms.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Deep reinforcement learning based optimization for a tightly coupled nuclear renewable integrated energy system

New ways to integrate energy systems to maximize efficiency are being sought to meet carbon emissions goals. Nuclear-renewable integrated energy system (NR-IES) concepts are a leading solution that couples a nuclear power plant with renewable energy, hydrogen generation plants, and energy storage systems, such that thermal and electrical power are dispatchable to fulfill grid-flexibility requirements while also producing hydrogen and maximizing revenue. Here, this paper introduces a deep reinforcement learning (DRL)-based framework to address the complex decision-making tasks for NR-IES. The objective is to maximize revenue by generating and selling hydrogen and electricity simultaneously according to their time-varying prices while keeping the energy flow in the subsystems in balance. A Python-based simulator for a NR-IES concept has been developed to integrate with OpenAI Gym and Ray/RLlib to enable an efficient and flexible computational framework for DRL research and development. Three state-of-the-art DRL algorithms have been investigated, including two-delayed deep deterministic policy gradient (TD3), soft-actor critic (SAC), proximal policy optimization (PPO), to illustrate DRL’s superiority for controlling NR-IES by comparing it with a conventional control approach, particle swarm optimization (PSO). In this effort, PPO has shown more-stable performance and also better generalization capability than SAC and TD3. Comparisons with PSO have demonstrated that, on average, PPO can achieve 13.9% more mean episode returns from the training process and 29.4% more mean episode returns from the testing process when different hydrogen-production targets are applied.

08 HYDROGEN↗

Statistical Multiobjective Optimization of Thiospinel CoNi 2 S 4 Nanocrystal Synthesis via Design of Experiments

Thiospinels, such as CoNi 2 S 4 , are showing promise for numerous applications, including as catalysts for the hydrogen evolution reaction, hydrodesulfurization, and oxygen evolution and reduction reactions; however, CoNi 2 S 4 has not been synthesized as small, colloidal nanocrystals with high surface-area-to-volume ratios. Traditional optimization methods to control nanocrystal attributes such as size typically rely upon one variable at a time (OVAT) methods that are not only time and labor intensive but also lack the ability to identify higher-order interactions between experimental variables that affect target outcomes. Herein, we demonstrate that a statistical design of experiments (DoE) approach can optimize the synthesis of CoNi 2 S 4 nanocrystals, allowing for control over the responses of nanocrystal size, size distribution, and isolated yield. After implementing a 2 5–2 fractional factorial design, the statistical screening of five different experimental variables identified temperature, Co:Ni precursor ratio, Co:thiol ratio, and their higher-order interactions as the most critical factors in influencing the aforementioned responses. Second-order design with a Doehlert matrix yielded polynomial functions used to predict the reaction parameters needed to individually optimize all three responses. A multiobjective optimization, allowing for the simultaneous optimization of size, size distribution, and isolated yield, predicted the synthetic conditions needed to achieve a minimum nanocrystal size of 6.1 nm, a minimum polydispersity (σ/$\bar{d}$) of 10%, and a maximum isolated yield of 99%, with a desirability of 96%. The resulting model was experimentally verified by performing reactions under the specified conditions. Furthermore, our work illustrates the advantage of multivariate experimental design as a powerful tool for accelerating control and optimization in nanocrystal syntheses.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A safe reinforcement learning algorithm for supervisory control of power plants

Traditional control theory-based methods require tailored engineering for each system and constant fine-tuning. In power plant control, one often needs to obtain a precise representation of the system dynamics and carefully design the control scheme accordingly. Model-free Reinforcement learning (RL) has emerged as a promising solution for control tasks due to its ability to learn from trial-and-error interactions with the environment. It eliminates the need for explicitly modeling the environment’s dynamics, which is potentially inaccurate. However, the direct imposition of state constraints in power plant control raises challenges for standard RL methods. To address this, we propose a chance-constrained RL algorithm based on Proximal Policy Optimization for supervisory control. Our method employs Lagrangian relaxation to convert the constrained optimization problem into an unconstrained objective, where trainable Lagrange multipliers enforce the state constraints. In conclusion, our approach achieves the smallest distance of violation and violation rate in a load-follow maneuver for an advanced Nuclear Power Plant design.

constrained optimization↗

Advanced, Integrated Control for Building Operations to Achieve 40% Energy Saving

We developed and demonstrated a software based integrated advanced building control platform called Smart Energy Box (SEB), which can coordinate building subsystem controls, integrate variety of energy optimization algorithms and provide proactive and collaborative energy management and control for building operations using weather and occupancy information. The integrated control system is a low cost solution and also features: Scalable component based architecture allows to build a solution for different building control system configurations with needed components; Open Architecture with a central data repository for data exchange among runtime components; Extendible to accommodate variety of communication protocols. Optimal building control for central loads, distributed loads and onsite energy resource; uses web server as a loosely coupled way to engage both building operators and building occupants in collaboration for energy conservation. Based on the open platform of SEB, we have investigated and evaluated a variety of operation and energy saving control strategies on Carnegie Mellon University Intelligent Work place which is equipped with alternative cooling/heating/ventilation/lighting methods, including radiant mullions, radiant cooling/heating ceiling panels, cool waves, dedicated ventilation unit, motorized window and blinds, and external louvers. Based on the validation results of these control strategies, they were integrated in SEB in a collaborative and dynamic way. This advanced control system was programmed and computer tested with a model of the Intelligent Workplace's northern section (IW n ). The advanced control program was then installed in the IW n control system; the performance was measured and compared with that of the state of the art control system to verify the overall energy savings great than 40%. In addition advanced human machine interfaces (HMI's) were developed to communicate both with building occupants and the building operator. Lifecycle cost analyses of the advanced building control were performed, and a Building Control System Guide was prepared and published to inform owners, architects, and engineers dealing with new construction or renovation of buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Nuclear Hybrid Energy Systems: Imperatives, Prospects, and Challenges

As global population reaches an expected 8 billion people by 2030, primary energy consumption is expected to increase by almost 40% from approximately 520 exajoules consumed today to almost 740 exajoules. Much of this increase is expected to come from non-Organization for Economic Cooperation and Development (OECD) nations, and Asia specifically. In these economies, energy used for transportation is expected to grow substantially, as is industrial, commercial and to a lesser degree residential energy use, creating considerable pressure on global and local energy markets. The magnitude and timing of growth in energy consumption likely will create a global imperative to deploy energy production technologies that balance the three pillars of energy security: • economic stability – related to the affordability of energy products, stability and predictability in their price, and the efficient and effective deployment of global capital resources in their development; • environmental sustainability – related to minimizing the negative impacts of energy production to air, land, and water systems and advancing the long-term viability of using a particular resource in a way that does not limit future generations ability to prosper; • resource security – related to the ability to access energy resources and products where and when necessary, in an affordable and predictable manner. One approach to meeting these objectives is hybrid energy systems (HES). Broadly described, HES are energy product production plants that take two or more energy resource inputs (typically includes both carbon and non-carbon based sources) and produce two or more energy products (e.g. electricity, liquid transportation fuels, industrial chemicals) in an integrated plant. Nuclear energy integration into HES offers intriguing potential, particularly if smaller (<300 MWe) reactors are available. Although the concept of using nuclear energy in a variety of non-electrical process applications is certainly not new, renewed interest in more tightly coupled energy product plants (such as HES) that meet the objectives outline above have gained additional interest recently, an interest likely sparked by sharpening energy security concerns. Studies have shown that non-nuclear integrated (hybrid) energy systems can have appealing attributes in terms of overall process efficiency, enhanced electric grid stability, renewable energy integration, and economic performance, and lifecycle greenhouse gas emissions. These attributes seem to be sufficiently compelling that several significant commercial investments in fossil-renewable HES are being made in the United States while the U.S. Defense Advanced Research Projects Agency (DARPA) has openly solicited information regarding nuclear energy integration schemes. The challenges of nuclear energy integration include myriad issues associated with the following RD&D areas, or “platforms”: • feedstock processing (e.g. bio-feedstock integration with coal, carbon feedstock extraction using nuclear energy); • heat / energy management (e.g. advanced heat exchangers, process design); • energy storage (e.g. H2 production, liquid fuels synthesis); • byproduct management (e.g. CO2 recycle approaches); • systems dynamics, integration and control (e.g. process dynamics analyses and optimization, advanced prognostics, diagnostics, variable time scale control and flow sheet optimization).

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Mercury Specie and Multi-Pollutant Control

This project was awarded to demonstrate the ability to affect and optimize mercury speciation and multi-pollutant control using non-intrusive advanced sensor and optimization technologies. The intent was to demonstrate plant-wide optimization systems on a large coal fired steam electric power plant in order to minimize emissions, including mercury (Hg), while maximizing efficiency and maintaining saleable byproducts. Advanced solutions utilizing state-of-the-art sensors and neural network-based optimization and control technologies were proposed to maximize the removal of mercury vapor from the boiler flue gas thereby resulting in lower uncontrolled releases of mercury into the atmosphere. Budget Period 1 (Phase I) - Included the installation of sensors, software system design and establishment of the as-found baseline operating metrics for pre-project and post-project data comparison. Budget Period 2 (Phase II) - Software was installed, data communications links from the sensors were verified, and modifications required to integrate the software system to the DCS were performed. Budget Period 3 (Phase III) - Included the validation and demonstration of all control systems and software, and the comparison of the optimized test results with the targets established for the project site. This report represents the final technical report for the project, covering the entire award period and representing the final results compared to project goals. NeuCo shouldered 61% of the total project cost; while DOE shouldered the remaining 39%. The DOE requires repayment of its investment. This repayment will result from commercial sales of the products developed under the project. NRG's Limestone power plant (formerly owned by Texas Genco) contributed the host site, human resources, and engineering support to ensure the project's success.

01 COAL, LIGNITE, AND PEAT↗

Nonlinear control of the minimum safety factor in tokamaks by optimal allocation of spatially moving electron cyclotron current drive

The minimum value of the safety factor profile is related to the magnetohydrodynamic (MHD) stability of the plasma confined in a tokamak. Therefore, active control of the minimum safety factor may mitigate MHD instabilities that can degrade or even terminate plasma confinement. Typically, in most tokamak scenarios, the minimum safety factor evolves spatially with time, i.e., the location at which the safety factor achieves the minimum value changes with time. In addition to the inherent nonlinearities in the minimum safety factor evolution, its spatial variation makes the control design challenging. In particular, complexity in control design may arise from the need for time-dependent nonlinear models that account for spatial variation of the minimum safety factor. Furthermore, the minimum safety factor may drift to locations where the actuator authority is low. The problem of minimum safety factor control with target location tracking and moving electron cyclotron current drive (ECCD) is addressed in this work. A nonlinear time-dependent model that incorporates the spatial variation of the minimum safety factor is presented. A nonlinear controller based on optimal feedback linearization is developed to track a target minimum safety factor. The proposed controller treats the ECCD position as a controllable variable. In other words, the controller prescribes the ECCD position (in addition to the non-inductive powers) in real time based on an optimal criterion that is defined a priori. This work also presents the steps necessary to integrate the minimum safety factor controller with a total energy controller to achieve multiple control objectives simultaneously. In conclusion, the proposed integrated control algorithm is tested using nonlinear simulations in the Control Oriented Transport SIMulator (COTSIM) for a DIII-D tokamak scenario.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗