Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Optimal Control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,369 records · Page 76

Restoring Critical Loads In Resilient Distribution Systems using A Curriculum Learned Controller

In this paper, we propose a curriculum learned reinforcement learning (RL) controller to facilitate distribution system critical load restoration (CLR), leveraging RL's fast online response and its outstanding optimal sequential control capability. Like many grid control problems, CLR is complicated due to the large control action space and renewable uncertainty in a heavily constrained non-linear environment with strong intertemporal dependency. The nature of the problem oftentimes causes the RL policy to converge to a poor-performing local optimum if learned directly. To overcome this, we design a two-stage curriculum in which the RL agent will learn generation control and load restoration decision under different scenarios progressively. Via curriculum learning, the trained RL controller is expected to achieve a better control performance, with critical loads restored as rapidly and reliably as possible. Using the IEEE 13-bus test system, we illustrate the performance of the RL controller trained by the proposed curriculum-based method.

curriculum learning↗

EVSE DERMS Controls [SWR-26-010]

An MQTT (Message Queuing Telemetry Transport) and OCPP (Open Charge Point Protocol) based remote smart charging controller framework for AC Electric Vehicle Supply Equipments (EVSEs). The code in this repo allows for the National Laboratory of the Rockies (NLR) controls to interface with the real Distributed Energy Resource Management System (DERMS) and EVSEs in NLR's ESIF Optimization and Control Laboratory (OCL). Different charge management algorithms can be tested to determine which power allocation method is most effective with the overall goal of demonstrating clear and well documented test results as well as providing functional control algorithms which could be utilized to provide effective smart charge management (SCM) at EV charging stations. Different power allocation methods are programmed in lab_demo_controller.py and include allocation based on first come first served, equal sharing, state of charge (SOC), priority factors, and behind the meter control methods.

Panossian, Nadia [National Laboratory of the Rocki↗

Optimized allocation method of the VSC-MTDC system for frequency regulation reserves considering the cost

In recent years, the interconnection of asynchronous power grids through the VSC-MTDC system has been proposed and extensively studied in light of the potential benefits of economical bulk power exchanges and frequency regulation reserves sharing. This paper proposed an optimized allocation method for sharing frequency regulation reserves among the interconnected power systems and the corresponding frequency regulation control of the VSC-MTDC system under emergency frequency deviation events. Firstly, the frequency regulation reserve classification is proposed. In the classification, the available frequency response capacity reserves of each interconnection are divided into commercial reserves and regular reserves. While the commercial reserves are procured through long-term contracts, the regular reserves are purchased based on market prices of frequency regulation services. Secondly, based on the proposed frequency regulation reserve classification, a novel frequency regulation control is then introduced for the VSC-MTDC system. This control method could minimize the costs of the disturbed power grid for the needed frequency response supports from the other power grids. Simulation verifications are performed on a modified IEEE 39 bus system and a highly reduced power system model representing the North American grids. The simulation verification indicates that the developed frequency regulation control significantly reduced ancillary service costs of the disturbed power grid.

24 POWER TRANSMISSION AND DISTRIBUTION↗

PV output smoothing using a battery and natural gas engine-generator.

In some situations involving weak grids or high penetration scenarios, the variability of photovoltaic systems can affect the local electrical grid. In order to mitigate destabilizing effects of power fluctuations, an energy storage device or other controllable generation or load can be used. This paper describes the development of a controller for coordinated operation of a small gas engine-generator set (genset) and a battery for smoothing PV plant output. There are a number of benefits derived from using a traditional generation resource in combination with the battery; the variability of the photovoltaic system can be reduced to a specific level with a smaller battery and Power Conditioning System (PCS) and the lifetime of the battery can be extended. The controller was designed specifically for a PV/energy storage project (Prosperity) and a gas engine-generator (Mesa Del Sol) currently operating on the same feeder in Albuquerque, New Mexico. A number of smoothing simulations of the Prosperity PV were conducted using power data collected from the site. By adjusting the control parameters, tradeoffs between battery use and ramp rates could be tuned. A cost function was created to optimize the control in order to balance, in this example, the need to have low ramp rates with reducing battery size and operation. Simulations were performed for cases with only a genset or battery, and with and without coordinated control between the genset and battery, e.g., without the communication link between sites or during a communication failure. The degree of smoothing without coordinated control did not change significantly because the battery dominated the smoothing response. It is anticipated that this work will be followed by a field demonstration in the near future.

Johnson, Jay Dean↗

Restoring Critical Loads in Resilient Distribution Systems Using a Curriculum Learned Controller: Preprint

In this paper, we propose a curriculum learned reinforcement learning (RL) controller to facilitate distribution system critical load restoration (CLR), leveraging RL's fast online response and its outstanding optimal sequential control capability. Like many grid control problems, CLR is complicated due to the large control action space and renewable uncertainty in a heavily constrained non-linear environment with strong intertemporal dependency. The nature of the problem oftentimes causes the RL policy to converge to a poor-performing local optimum if learned directly. To overcome this, we design a two-stage curriculum in which the RL agent will learn generation control and load restoration decision under different scenarios progressively. Via curriculum learning, the trained RL controller is expected to achieve a better control performance, with critical loads restored as rapidly and reliably as possible. Using the IEEE 13-bus test system, we illustrate the performance of the RL controller trained by the proposed curriculum-based method.

61 RADIATION PROTECTION AND DOSIMETRY↗

Controlling mercury emissions from coal-fired power plants

Increasingly stringent US federal and state limits on mercury emissions form coal-fired power plants demand optimal mercury control technologies. This article summarises the successful removal of mercury emissions achieved with activated carbon injection and boiler bromide addition, technologies nearing commercial readiness, as well as several novel control concepts currently under development. It also discusses some of the issues standing in the way of confident performance and cost predictions. In testing conducted on western coal-fired units with fabric filters or TOXECON to date, ACI has generally achieved mercury removal rates > 90%. At units with ESPs, similar performance requires brominated ACI. Alternatively, units firing western coals can use boiler bromide addition to increase flue gas mercury oxidation and downstream capture in a wet scrubber, or to enhance mercury removal by ACI. At eastern bituminous fired units with ESPs, ACI is not as effective, largely due to SO{sub 3} resulting from the high sulfur content of the coal or the use of SO{sub 3} flue gas conditioning to improve ESP performance. 7 refs., 3 figs.

01 COAL, LIGNITE, AND PEAT↗

Optimized Gen-II FeCrAl cladding production in large quantity for campaign testing

There are two major objectives in this report; (1) to optimize microstructure control of ATF FeCrAl alloys during tube drawing processes, and (2) to provide an update on the progress of ATF FeCrAl tube production via commercial manufacturers. Experimental efforts have been made to optimize the process parameters balancing the tube fabricability, especially for tube drawing processes, and microstructure control of the final tube products. Lab-scale sheet materials of Gen II FeCrAl alloys (Mo-containing and Nb-containing FeCrAl alloys) were used in the study, combined with a stepwise warm-rolling process and intermediate annealing, aiming to simulate the tube drawing process in a commercial tube manufacturer. The intermediate annealing at 650ºC for 1h was suggested for the tube-drawing process of Mo-containing FeCrAl alloys because it successfully softened the material by recovering the work hardening introduced through the rolling step, without inducing grain coarsening due to recrystallization. The final tube product is expected to have stabilized deformed microstructure providing the improved tensile properties with sufficient ductility. Optimization efforts on Nb-containing FeCrAl alloys focused on the effect of alloying additions and annealing conditions on the stability of deformed microstructure. Relationships between the second-phase precipitates (Fe 2 Nb-Laves phase) and microstructure stability are discussed. FeCrAl tube production through commercial tube manufacturers is currently in progress. Three different manufacturers, Century Tubes, Inc. (CTI), Rhenium Alloys, Inc. (RAI), and Superior Tube Company, Inc. (STC), are providing capabilities for cold-drawing, warm-drawing, and HPTR cold-pilgering, respectively. The first two companies are currently working on large quantity tube production (expected 250 ft length) of Gen I model FeCrAl alloy (B136Y3, at CTI) and Gen II (C35M4, at RAI), with the process parameters obtained from the experimental efforts. The expected delivery dates are at the end of July, 2016, and the middle of June, 2016, respectively. Tube production at STC would be the first attempt to apply cold-pilgering to the FeCrAl alloys. Communication has been initiated, and the materials have been machined for the cold-pilgering process.

36 MATERIALS SCIENCE↗

Real-Time Sea State Estimation for Wave Energy Converter Control via Machine Learning

Wave energy converters (WECs) harness the untapped power of ocean waves to generate renewable energy, offering a promising solution to sustainable energy. An optimal WEC control strategy is essential to maximize power capture that dynamically adjusts system parameters in response to rapidly changing sea states. This study presents a novel control approach that leverages neural networks to estimate sea states from onboard WEC measurements such as position, velocity, and force. Using a point absorber WEC device as a test platform, our proposed approach estimates sea states in real-time and subsequently adjusts PID controller gains to maximize energy extraction. Simulation results across diverse sea conditions demonstrate that our strategy eliminates the need for external wave monitoring equipment while maintaining power capture efficiency. The results show that our neural network-based control technique can improve power capture by 25.6% while significantly reducing system complexity. This approach offers a practical alternative for WEC deployments where direct wave measurements are either infeasible or cost prohibitive.

PIDcontrol↗

Controlling distributed energy resources via deep reinforcement learning for load flexibility and energy efficiency

Behind-the-meter distributed energy resources (DERs), including building solar photovoltaic (PV) technology and electric battery storage, are increasingly being considered as solutions to support carbon reduction goals and increase grid reliability and resiliency. However, dynamic control of these resources in concert with traditional building loads, to effect efficiency and demand flexibility, is not yet commonplace in commercial control products. Traditional rule-based control algorithms do not offer integrated closed-loop control to optimize across systems, and most often, PV and battery systems are operated for energy arbitrage and demand charge management, and not for the provision of grid services. More advanced control approaches, such as MPC control have not been widely adopted in industry because they require significant expertise to develop and deploy. Recent advances in deep reinforcement learning (DRL) offer a promising option to optimize the operation of DER systems and building loads with reduced setup effort. However, there are limited studies that evaluate the efficacy of these methods to control multiple building subsystems simultaneously. Additionally, most of the research has been conducted in simulated environments as opposed to real buildings. This paper proposes a DRL approach that uses a deep deterministic policy gradient algorithm for integrated control of HVAC and electric battery storage systems in the presence of on-site PV generation. The DRL algorithm, trained on synthetic data, was deployed in a physical test building and evaluated against a baseline that uses the current best-in-class rule-based control strategies. Performance in delivering energy efficiency, load shift, and load shed was tested using price-based signals. The results showed that the DRL-based controller can produce cost savings of up to 39.6% as compared to the baseline controller, while maintaining similar thermal comfort in the building. The project team has also integrated the simulation components developed during this work as an OpenAIGym environment and made it publicly available so that prospective DRL researchers can leverage this environment to evaluate alternate DRL algorithms.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Modeling and Optimization of Trip Level Energy Consumption and Charging Management for Connected Automated Electric Vehicles

This will be a presentation for a tutorial session in 2019 ITEC based on reviewing the publicly existing work in the literature. Trip aware energy consumption and charging management for electric vehicles is a key component to ensure sustainability of electrified transportation. The upcoming vehicle communication and autonomous driving technologies will provide opportunities to achieve more intelligent management strategies. This tutorial will introduce the state-to-art technologies that are being designed for optimizing the trip level energy cost and recharging operations of connected automated electric vehicles (CAEVs). The information needs, modeling, control and optimization techniques for optimal trip level energy management will be introduced. Opportunities and benefits from vehicle communication and automation will be discussed. In general, three main sub-topics will be presented in detail: first, advanced EV energy consumption modeling and prediction technologies; second, energy efficient driving technologies, e.g. eco-driving and eco-routing, etc.; third, optimally automatic charging decision making for CAEVs. Following these details, the research challenges, opportunities for co-optimization between the energy consumption and energy recharging of CAEVs will be illustrated in this tutorial.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Accelerated CO2 Storage Optimization Using Multi-Resolution Fourier Neural Operator at the Illinois Basin Decatur Project (IBDP)

This paper presents a deep learning-based approach for optimizing CO2 injection in carbon capture and storage (CCS) operations. We developed a multi-resolution machine learning model to significantly reduce data generation costs. Utilizing this proxy model, we implemented a multi-objective genetic algorithm to optimize well control during the CO2 injection process. The proposed approach was applied to the Illinois Basin Decatur Project (IBDP), successfully optimizing the CO2 injection schedule based on three key objectives: maximizing the amount of CO2 stored, maximizing sweep efficiency, and minimizing pressure increase. The use of the proxy model accelerated the optimization workflow by two orders of magnitude, while the cost of data generation for the proxy model was reduced by 90% by utilizing a coarse-scale model.

accelerated CO2 storage optimization↗

Optimization of synthesis protocols to control the nanostructure and the morphology of metal oxide thin films for memristive applications

We propose a multi-technique approach based on in-vacuum synthesis of metal oxides to optimize the memristive properties of devices that use a metal oxide thin film as insulating layer. Pulsed Microplasma Cluster Source (PMCS) is based on supersonic beams seeded by clusters of the metal oxide. Nanocrystalline TiO{sub 2} thin films can be grown at room temperature, controlling the oxide stoichiometry from titanium metal up to a significant oxygen excess. Pulsed Electron beam Deposition (PED) is suitable to grow crystalline thin films on large areas, a step towards producing device arrays with controlled morphology and stoichiometry. Atomic Layer Deposition (ALD) is a powerful technique to grow materials layer-by-layer, finely controlling the chemical and structural properties of the film up to thickness of 50-80 nm. We will present a few examples of metal-insulator-metal structures showing a pinched hysteresis loop in their current-voltage characteristic. The structure, stoichiometry and morphology of the metal oxide layer, either aluminum oxide or titanium dioxide, is investigated by means of scanning electron microscopy (SEM) and by Raman scattering.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

A superstructure-based optimal synthesis of PSA cycles for post-combustion CO2 capture

Recent developments have shown pressure/vacuum swing adsorption (PSA/VSA) to be a promising option to effectively capture CO2 from flue gas streams. In most commercial PSA cycles, the weakly adsorbed component in the mixture is the desired product, and enriching the strongly adsorbed CO2 is not a concern. On the other hand, it is necessary to concentrate CO2 to high purity to reduce CO2 sequestration costs and minimize safety and environmental risks. Thus, it is necessary to develop PSA processes specifically targeted to obtain pure strongly adsorbed component. A multitude of PSA/VSA cycles have been developed in the literature for CO2 capture from feedstocks low in CO2 concentration. However, no systematic methodology has been suggested to develop, evaluate, and optimize PSA cycles for high purity CO2 capture. This study presents a systematic optimization-based formulation to synthesize novel PSA cycles for a given application. In particular, a novel PSA superstructure is presented to design optimal PSA cycle configurations and evaluate CO2 capture strategies. The superstructure is rich enough to predict a number of different PSA operating steps. The bed connections in the superstructure are governed by time-dependent control variables, which can be varied to realize most PSA operating steps. An optimal sequence of operating steps is achieved through the formulation of an optimal control problem with the partial differential and algebraic equations of the PSA system and the cyclic steady state condition. Large-scale optimization capabilities have enabled us to adopt a complete discretization methodology to solve the optimal control problem as a largescale nonlinear program, using the nonlinear optimization solver IPOPT. The superstructure approach is demonstrated for case studies related to post-combustion CO2 capture. In particular, optimal PSA cycles were synthesized, which maximize CO2 recovery for a given purity, and minimize overall power consumption. The results show the potential of the superstructure to predict PSA cycles with up to 98% purity and recovery of CO2. Moreover, for recovery of around 85% and purity of over 90%, these cycles can recover CO2 from atmospheric flue gas with a low power consumption of 465 kWh tonne 1 CO2. The approach presented is, therefore, very promising and quite useful for evaluating the suitability of different adsorbents, feedstocks, and operating strategies for PSA, and assessing its usefulness for CO2 capture.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Performance Evaluation of Distributed Energy Resource Management Algorithm in Large Distribution Networks

This paper presents performance evaluation of hierarchical optimization and control for distributed energy resource management system (DERMS) in large distribution networks via an advanced hardware-in-the-loop (HIL) platform. The HIL platform provides realistic testing in a laboratory environment, including the accurate modeling of a full-scale distribution system of 11,000 nodes, the DERMS software controller, and 90 power hardware photovoltaics (PVs) and battery inverters. The applied DERMS algorithm is designed based on a realtime optimal power flow algorithm and implemented with acceleration design that performs fast dispatch of simulated PVs and real physical hardware DER devices every 4 seconds.

DERMS↗

Hardware-in-the-Loop Evaluation for Potential High Limit Estimation-Based PV Plant Active Control

This paper validates the efficacy of an artificial intelligence (AI)-based photovoltaic (PV) plant control and optimization approach in enabling PV plants as accountable grid reliability service providers. The validation is performed in a realistic laboratory controller-hardware-in-the-loop environment, leveraging accurate PV plant modeling and standard industrial communication protocols. Through simulations that account for diverse weather conditions and active control scenarios, the results highlight the superior performance of the AI-based solution in comparison to a state-of-the-art reference-control grouping-based approach. Such a finding contributes to mitigating the risk of overcurtailment and uninstructed deviations of active PV plant controls, and offers practical guidance for its field deployment. Furthermore, it establishes a standardized testing framework for comparing various PV active control strategies.

hardware-in-the-loop↗

Control co-design under uncertainty for offshore wind farms: Optimizing grid integration, energy storage, and market participation

Offshore wind farms (OWFs) are set to significantly contribute to global decarbonization efforts. Developers often use a sequential approach to optimize design variables and market participation for grid-integrated offshore wind farms. However, this method can lead to sub-optimal system performance, and uncertainties associated with renewable resources are often overlooked in decision-making. Here, this paper proposes a control co-design approach, optimizing design and control decisions for integrating OWFs into the power grid while considering energy market and primary frequency market participation. Additionally, we introduce optimal sizing solutions for energy storage systems deployed onshore to enhance revenue for OWF developers over time. This framework addresses uncertainties related to wind resources and energy prices. We analyze five U.S. west-coast offshore wind farm locations and potential interconnection points, as identified by the Bureau of Ocean Energy Management (BOEM). Results show that optimized control co-design solutions can increase market revenue by 3.2% and provide flexibility in managing wind resource uncertainties.

Control Co-design↗

Literature Survey on Operational Voltage Control and Reactive Power Management on Transmission and Sub-Transmission Networks

Voltage and reactive power system control is generally performed following usual patterns of loads, based on off-line studies for daily and seasonal operations. This practice is currently challenged by the inclusion of distributed renewable generation, such as solar. There has been focus on resolving this problem at the distribution level; however, the transmission and sub-transmission levels have received less attention. This paper provides a literature review of proposed methods and solution approaches to coordinate and optimize voltage control and reactive power management, with an emphasis on applications at transmission and sub-transmission level. The conclusion drawn from the survey is that additional research is needed in the areas of optimizing switch shunt actions and coordinating all available resources to deal with uncertain patterns from increasing distributed renewable generation in the operational time frame. These topics are not deeply explored in the literature.

capacitors↗