Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Leader-Follower”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Towards Resilient Design of Leader-following Consensus with Attack Identification and Privacy Preservation Capabilities

This paper considers a leader-following consensus in the presence of unknown but bounded cyber-attacks. Specifically, we consider the following cyber-attack scenarios: (i) an attacker aims to destabilize the consensus dynamics by injecting exogenous signals to both the actuators of the followers and/or the communication network, (ii) an eavesdropper adversary aims to obtain information on the physical state of the agents. To this end, a novel resilient leader-following consensus algorithm based on a competitive interaction method is proposed. In addition, it is demonstrated that by appropriately choosing the information exchanged between the agents, the proposed control framework also enables the cooperative system to either distributively identify the compromised communication links in real-time or to protect the privacy of the physical state of the agents from the eavesdropper. Here, a numerical example is provided to illustrate the proposed resilient control algorithms.

Gusrialdi, Azwirman↗

Peer-to-peer Communication Control Architecture for Engaging Ubiquitous DERs to Support Distribution System Resiliency

In this project, we developed a leader-follower consensus (LFC) control architecture to coordinate between GFM and GFL inverters with the former being leaders and the latter being followers. The objective is to simultaneously achieve a fast frequency and voltage regulation along with accurate real power and var sharing among all inverters under various disturbances. The distinction of our work is that we consider both GFM and GFL inveters for frequency and voltage regulations. In addition, rather than a standard consensus algorithm, our work utilized a leader-follower consensus algorithm which exploits the physical characteristics of GFM-GFL inverters: (i) the GFM inverters directly control frequency and voltage, and hence, serve as leaders, (ii) the GFL inverters measure frequency/voltage to modulate their outputs, and hence, they should serve as followers. The effectiveness of the proposed LFC coordination was tested on a networked microgrid test system under different disturbances and communication degradation events. We demonstrated that the proposed fully coordinated control is robust to disturbances, while outperforming uncoordinated and GFM-only coordinated approaches. Overall, this work emphasized the necessity and benefits of the GFMGFL coordination in the secondary control of microgrids.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A Regularized Variance-Reduced Modified Extragradient Method for Stochastic Hierarchical Games

We consider an N -player hierarchical game in which the i th player’s objective comprises of an expectation-valued term, parametrized by rival decisions, and a hierarchical term. Such a framework allows for capturing a broad range of stochastic hierarchical optimization problems, Stackelberg equilibrium problems, and leader-follower games. We develop an iteratively regularized and smoothed variance-reduced modified extragradient framework for iteratively approaching hierarchical equilibria in a stochastic setting. We equip our analysis with rate statements, complexity guarantees, and almost-sure convergence results. We then extend these statements to settings where the lower-level problem is solved inexactly and provide the corresponding rate and complexity statements. Our model framework encompasses many game theoretic equilibrium problems studied in the context of power markets. We present a realistic application to the study of virtual power plants, emphasizing the role of hierarchical decision making and regularization. Preliminary numerics suggest that empirical behavior compares well with theoretical guarantees.

Tikhonov regularization↗

Biomimetic model-based advanced control strategy integrated with multi-agent optimization for nonlinear chemical processes

Here, a novel framework is proposed for integrating biomimetic-based advanced control and multi-agent optimization approaches for nonlinear chemical process applications. In particular, a Biologically-Inspired Optimal Control Strategy, denoted as BIO-CS, is combined with multi-agent optimization (MAO) techniques to provide optimal solutions for dynamic systems. In this combined framework, the BIO-CS algorithm employs gradient-based optimal control solvers for the intermediate problems associated with the leader-follower agents’ local interactions. Also, the MAO uses the capabilities of heuristic-based optimization techniques by sharing process information to obtain optimal operating setpoints for the controller considering an overall process objective. The applicability of the proposed method is demonstrated using a nonlinear, multivariable, process model of a fermentation system. Specifically, the optimal operating points are computed by the MAO implementation for setpoint tracking, trajectory tracking and plant-model mismatch scenarios for BIO-CS application. Results of the developed framework are compared to a gradient-based Sequential Quadratic Programming (SQP) technique and a classical proportional-integral (PI) controller in terms of optimization and control studies, respectively. As an additional contribution, BIO-CS is also cast as a model predictive controller (MPC) for the first time and compared to the agent-based BIO-CS approach in terms of computational time and tracking error. Closed-loop control results show up to 46% improvement in tracking performance during transient for the multi-agent BIO-CS when compared to BIO-CS as MPC for additional computational expense. The obtained results illustrate the capabilities of this novel integrated framework including BIO-CS as MPC to achieve desired nonlinear system performance for various scenarios.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Development of an integrated model for energy systems planning and carbon dioxide mitigation under uncertainty – Tradeoffs between two-level decision makers

Highlights: • A bi-level model is developed for energy systems planning and carbon dioxide mitigation. • Tradeoffs between two-level decision-makers’ demands are quantified under uncertainty. • The energy and environmental impact of CO{sub 2} mitigation policy is analyzed for Beijing. • Results provide a range of decision alternatives between system optimality and reliability. A bi-level fuzzy programming (BFLP) method was developed for energy systems planning (ESP) and carbon dioxide (CO{sub 2}) mitigation under uncertainty. BFLP could handle fuzzy information and leader-follower problem in decision-making processes. It could also address the tradeoffs among different decision makers in two decision-making levels through prioritizing the most important goal. Then, a BFLP-ESP model was formulated for planning energy system of Beijing, in which the upper-level objective is to minimize CO{sub 2} emission and the lower-level objective is to minimize the system cost. Results provided a range of decision alternatives that corresponded to a tradeoff between system optimality and reliability under uncertainty. Compared to the single-level model with a target to minimize system cost, the amounts of pollutant/CO{sub 2} emissions from BFLP-ESP were reduced since the study system would prefer more clean energies (i.e. natural gas, LPG and electricity) to replace coal fuel. Decision alternatives from BFLP were more beneficial for supporting Beijing to adjust its energy mix and enact its emission-abatement policy. Results also revealed that the low-carbon policy for power plants (e.g., shutting down all coal-fired power plants) could lead to a potentially increment of imported energy for Beijing, which would increase the risk of energy shortage. The findings could help decision makers analyze the interactions between different stakeholders in ESP and provide useful information for policy design under uncertainty.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Investigating the future supply distribution of industrial grade wood pellets in the global bioenergy market

This study analyzes the potential resource distribution in global competitive feedstock markets for industrial grade wood pellets. Based on historic trade patterns and expected future production and demand structures, a set of potential buyers and sellers of industrial grade wood pellets are simulated for 2022, 2030, and 2040. In contrast to previous trade modeling efforts, this study assumes a fully competitive market, i.e., excluding long-term contract arrangements, to show resource distributions under a potential future commodity market. This is done via a non-cooperative bi-level Stackelberg leader-follower game model. Of particular interest is the potential impact of international feedstock competition on the availability of US feedstock resources. The model results show that the main destinations for US wood pellet exports typically pay 10-20% more per tonne than the domestic market. The results show that domestic wood pellets are available to US industry at prices higher than the expected $88 per tonne delivered.

09 BIOMASS FUELS↗

Deep reinforcement learning of cell movement in the early stage of C.elegans embryogenesis

Motivation: Cell movement in the early phase of Caenorhabditis elegans development is regulated by a highly complex process in which a set of rules and connections are formulated at distinct scales. Previous efforts have demonstrated that agent-based, multi-scale modeling systems can integrate physical and biological rules and provide new avenues to study developmental systems. However, the application of these systems to model cell movement is still challenging and requires a comprehensive understanding of regulatory networks at the right scales. Recent developments in deep learning and reinforcement learning provide an unprecedented opportunity to explore cell movement using 3D time-lapse microscopy images. Results: We present a deep reinforcement learning approach within an agent-based modeling system to characterize cell movement in the embryonic development of C.elegans. Our modeling system captures the complexity of cell movement patterns in the embryo and overcomes the local optimization problem encountered by traditional rule-based, agent-based modeling that uses greedy algorithms. Here, we tested our model with two real developmental processes: the anterior movement of the Cpaaa cell via intercalation and the rearrangement of the superficial left-right asymmetry. In the first case, the model results suggested that Cpaaa’s intercalation is an active directional cell movement caused by the continuous effects from a longer distance (farther than the length of two adjacent cells), as opposed to a passive movement caused by neighbor cell movements. In the second case, a leader-follower mechanism well explained the collective cell movement pattern in the asymmetry rearrangement. These results showed that our approach to introduce deep reinforcement learning into agent-based modeling can test regulatory mechanisms by exploring cell migration paths in a reverse engineering perspective. Lastly, this model opens new doors to explore the large datasets generated by live imaging. Availability and implementation: Source code is available at https://github.com/zwang84/drl4cellmovement.

59 BASIC BIOLOGICAL SCIENCES↗

Resilient Inverter-Driven Black Start with Collective Parallel Grid-Forming Operation

As modern power systems are experiencing exceptional changes with increasing penetrations of inverter-based resources (IBRs), system restoration using IBRs has received attention. Using local grid-forming (GFM) assets near consumers, engineered to establish grid voltages in the absence of a stiff grid, i.e., bottom-up restoration, a distribution system could obtain high system resilience by not relying on the bulk power system restoration, which requires significant human intervention and procedure. This paper studies the technical feasibility of the novel approach with detailed electromagnetic transient (EMT) simulations. To thoroughly evaluate the potential of GFM inverters and the technical challenges in IBR-driven black start, a detailed three-phase inverter model is developed, including negative-sequence control for voltage balance and a phase-by- phase current limiter to sustain momentary overloading during the black start. To examine dynamic aspects of the black-start process, the EMT simulation also models transformer and motor dynamics to emulate their inrush and startup behaviors as well as network dynamics. In addition, active involvement of grid- following distributed energy resources is also studied to facilitate the black-start process. By allowing multiple GFM inverters to collectively black start without leader-follower coordination, we demonstrate that a system can achieve high resilience even with a fraction of assets lost. Two test cases of inverter-driven black start, using two and one GFM inverters, respectively, for a heavily unbalanced 2-MVA distribution feeder are demonstrated. Takeaways for further study and field deployment are provided.

grid-forming inverter↗

Black Start of Unbalanced Microgrids Harmonizing Single- and Three-Phase Grid-Forming Inverters

As power systems are transforming with increasing penetrations of inverter-based resources (IBRs), system restoration using IBRs has drawn attention. Using distributed grid-forming (GFM) assets located near critical loads, either three-phase or single-phase, to establish microgrid voltages in the absence of a bulk grid, a distribution system could obtain high system survivability. For swift and secure recovery of a critical load in a single-phase lateral, local single-phase GFM inverters can form a microgrid, and then it can be combined with a neighbouring grid with the inverters remaining in GFM mode for voltage and frequency regulation until the bulk grid comes online. It leads to dynamic interoperation of single-phase GFM inverters with three-phase ones in the black start process. This paper studies the novel approach with electromagnetic transient (EMT) simulations. To evaluate the potential and the technical challenges of the heterogeneous IBR-driven black start, three-phase and single-phase GFM inverter models are developed, including negative-sequence control for voltage balance and a phase-by-phase current limiter (three-phase) and current magnitude limiter (single-phase). To examine dynamic aspects of the black-start process, the EMT simulation also models transformer and motor dynamics emulating their inrush and startup behavior as well as network dynamics. Involvement of grid-following assets to facilitate the black-start process is also modeled. By allowing multiple GFM inverters to collectively black start without leader-follower coordination, regardless of phases, a system can achieve extreme resilience. An inverter-driven black start of a heavily unbalanced 2-MVA distribution feeder using 1 three-phase and 3 single-phase GFM inverters is demonstrated. The simulation shows the heterogeneous system can maintain stability with the single-phase GFM dynamics coupled with the three-phase one.

grid-forming inverter↗

Resource Adequacy in Electricity Markets With Renewable Energy

This paper presents a market-based resource adequacy assessment framework to analyze the system generation portfolio that results in a competitive market environment. In particular, we apply the modeling framework to investigate the impact of high penetration levels of variable renewable energy resources and different market designs on achieving resource adequacy. The model captures the strategic capacity investment and retirement decision-making of profit-maximizing generation companies. In contrast to many previous studies, this paper considers markets for capacity, energy, and reserve products in detail; thus, the modeling framework allows improved analysis of generation expansion and revenue sufficiency in a competitive market environment. The modeling framework is based on Stackelberg leader-follower games and is formulated as a bi-level optimization problem, which is then transformed into a mathematical program with equilibrium constraints. Furthermore, we employ a Lagrangian decomposition algorithm to enhance computational performance. In a case study of the electric reliability council of texas (ERCOT) system, we compare the results from the proposed model with those obtained from a traditional centralized least-cost planning model. Finally, the results demonstrate the effectiveness of the proposed modeling framework and highlight the importance of considering strategic behavior in a competitive market framework when assessing resource adequacy.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Improved Particle Swarm Algorithm Using Rubik’s Cube Topology for Bilevel Building Energy Transaction

Following the rapid growth of distributed energy resources (e.g., renewables, battery), localized peer-to-peer energy transactions are receiving more attention for multiple benefits, such as reducing power loss and stabilizing the main power grid. To promote distributed renewables locally, the local trading price is usually set to be within the external energy purchasing and selling price range. Consequently, building prosumers are motivated to trade energy through a local transaction center. This local energy transaction is modeled in bilevel optimization game. A selfish upper level agent is assumed with the privilege to set the internal energy transaction price with an objective of maximizing its arbitrage profit. Meanwhile, the building prosumers at the lower level will response to this transaction price and make decisions on electricity transaction amount. Therefore, this non-cooperative leader-follower trading game is seeking for equilibrium solutions on the energy transaction amount and prices. Additionally, a uniform local transaction price structure (purchase price equals selling price) is considered here. Aiming at reducing the computational burden from classical Karush–Kuhn–Tucker (KKT) transformation and protecting the private information of each stakeholder (e.g., building), swarm intelligence-based solution approach is employed for upper level agent to generate trading price and coordinate the transactive operations. On one hand, to decrease the chance of premature convergence in global-best topology, Rubik’s Cube topology is proposed in this study based on further improvement of a two-dimensional square lattice model (i.e., one local-best topology-Von Neumann topology). Rotating operation of the cube is introduced to dynamically changing the neighborhood and enhancing information flow at the later searching state. Several groups of experiments are designed to evaluate the performance of proposed Rubik’s Cube topology-based particle swarm algorithm. The results have validated the effectiveness of proposed topology and operators comparing with global-best version PSO and Von Neumann topology-based PSO and its scalability on larger scale applications.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

BI-LEVEL OPTIMIZATION FOR ELECTRICITY TRANSACTION IN SMART COMMUNITY WITH MODULAR PUMP HYDRO STORAGE

Grid integration of the increasing distributed energy resources could be challenging in terms of new infrastructure investment, power grid stability, etc. To resolve more renewables locally and reduce the need for extensive electricity transmission, a community energy transaction market is assumed with market operator as the leader whose responsibility is to generate local energy prices and clear the energy transaction payment among the prosumers (followers). The leader and multi-followers have competitive objectives of revenue maximization and operational cost minimization. This non-cooperative leader-follower (Stackelberg) game is formulated using a bi-level optimization framework, where a novel modular pump hydro storage technology (GLIDES system) is set as an upper level market operator, and the lower level prosumers are nearby commercial buildings. The best responses of the lower level model could be derived by necessary optimality conditions, and thus the bi-level model could be transformed into single level optimization model via replacing the lower level model by its Karush-Kuhn-Tucker (KKT) necessary conditions. Several experiments have been designed to compare the local energy transaction behavior and profit distribution with the different demand response levels and different local price structures. The experimental results indicate that the lower level prosumers could benefit the most when local buying and selling prices are equal, while maximum revenue potential for the upper level agent could be reached with non-equal trading prices.

Chen, Yang↗

Dedicated short range communications used as fail-safe in autonomous navigation

Here in this paper, we have analyzed scenarios for leader-follower vehicle convoys that have the potential to be unsafe, hazardous, or even fatal in order to provide insight on dangerous driving conditions for autonomous vehicle platoons. These scenarios were created in a simulation software called Prescan, and are made to reflect the behavior of the vehicle dynamics and sensor characteristics of a real-world vehicle convoy that is currently being tested at the American Center for Mobility (ACM) and sponsored by the Department of Energy (DOE), National Renewable Energy Laboratory (NREL), the U.S. Army Combat Capabilities Development Command - Ground Vehicle Systems Center (U.S. Army CC-DEVCOM) and the Michigan Department of Transportation (MDOT). The follower vehicle in this study is tested under multiple scenarios, equipped with a Dedicated Short Range vehicle-to-vehicle communication system (DSRC), a radar-based adaptive cruise control system (ACC) and a precision global positioning system (GPS).

42 ENGINEERING↗

Approaches for Synthesis and Deployment of Controller Models on Automated Vehicles for Car-following in Mixed Autonomy

This paper describes the software design patterns and vehicle interfaces that were employed to transition vehicle controllers from simulation environments to open-road field experiments. The approach relies on a life cycle that utilizes model-based design and code generation, along with agile software development, and both software and hardware-in-the-loop testing, with additional safety margins. Autonomous designs should consider the dynamics of mixed autonomy in traffic to safely operate among humans. The software that provides a vehicle’s behavior intelligence is often developed through simulation, which may have a mismatch between dynamics, or as a result of a reinforcement learning workflow, which may be a black box with challenges to analyze. In each of these cases, it is important to have research interfaces that provide strongly typed data streams accessible to researchers who are not software experts while continuing to satisfy safety and liveness constraints. This paper describes how we design the hardware platform interfaces and software design process for a mixed autonomy traffic experiment with a leader-follower scenario. Controller synthesis for these vehicles requires clearly articulated vehicle interfaces and software design patterns for successful onboard deployment. Testing strategies for such controllers are also described before algorithms are transitioned to full-scale field experiments with safety operators for the vehicles. Testing strategies include software-in-the-loop simulation testing, hardware-in-the-loop simulation, ghost-car testing, and read-only testing in live traffic. With our approach, we were not only able to validate our controller synthesized in scripts and simulation, but also able to scale deployment to multiple vehicles.

Bhadani, Rahul↗

Software Control Program For Transportable Microgrid State-of-charge Balancing And Frequency Stability Controls

A deterministic state-of-charge (SOC) balancing approach software control code is introduced as an integral secondary management to primary control layer of an islanded small microgrid or nanogrid system made up of multiple grid-forming inverter/battery/solar combination systems, where each set of batteries with each inverter are on independent DC buses (i.e. non-paralleled on the DC sides). A DERMS-level control approach, algorithm and automation controller program was developed to improve coordination and enable microgrid asset compliance and SOC balancing, enabling provision of a system-level power stability support architecture, load support, and asset scalability. The architecture is configured to treat each unit or micro/nano-grid as a node in a microgrid network, allowing for autonomous DERMS control regarding load and SOC balancing and power stability. As the network grows with the addition of units, greater coordination efforts may be required. The ideal small network microgrid ranges from 2-10 inverter/battery units before additional control parameters must be considered in the existing architecture. The control approach focuses on a deterministic state-of-charge analysis as the primary level control process followed by a secondary control loop using a forced frequency-watt droop strategy to conform off-the-shelf components into behaving under a leader-follower configuration. Adopting this control scheme has been shown to allow for a balanced, unit-coordinated microgrid network, enabling stable power flow. The deterministic state-of-charge approach is introduced as an integral primary control layer of an islanded small network microgrid. A standard strategy for SOC balancing is implementing a battery management system (BMS) to control SOC on the DC side. An alternative approach is to determine how to coordinate sending and receiving power on the AC side with multiple units. The latter approach assesses all the integrated units in the microgrid network. Once the individual units are identified, further system data is required to calculate each unit's total kWh, provided information about its capability to supply or consume kWh and availability. The secondary control layer in the multi-layered small network microgrid methodology uses the primary layer’s decision to initiate frequency setpoint changes, initializing the SOC balancing. The secondary control layer considers numerous system-dependent variables to enable a charging and discharging profile based on adjustable frequency setpoints. The combined architecture will result in stable, coordinated power flow enhancing an AC microgrid's functionalities.

Myers, KurtS [Idaho National Laboratory (INL), Ida↗

Rubik’s Cube Topology Based Particle Swarm Algorithm for Bilevel Building Energy Transaction

Following the rapid growth of distributed energy resources (e.g. renewables, battery), localized peer-to-peer energy transactions are receiving more attention for multiple benefits, such as, reducing power loss, stabilizing the main power grid, etc. To promote distributed renewables locally, the local trading price is usually set to be within the external energy purchasing and selling price range. Consequently, building prosumers are motivated to trade energy through a local transaction center. This local energy transaction is modeled in bilevel optimization game. A selfish upper level agent is assumed with the privilege to set the internal energy transaction price with an objective of maximizing its arbitrage profit. Meanwhile, the building prosumers at the lower level will response to this transaction price and make decisions on electricity transaction amount. Therefore, this non-cooperative leader-follower trading game is seeking for equilibrium solutions on the energy transaction amount and prices. In addition, a uniform local transaction price structure (purchase price equals selling price) is considered here. Aiming at reducing the computational burden from classical Karush-Kuhn-Tucker (KKT) transformation and protecting the private information of each stakeholder (e.g., building), swarm intelligence based solution approach is employed for upper level agent to generate trading price and coordinate the transactive operations. On one hand, to decrease the chance of premature convergence in global-best topology, Rubiks Cube topology is proposed in this study based on further improvement of a two-dimensional square lattice model (i.e., one local-best topology-Von Neumann topology). Rotating operation of the cube is introduced to dynamically changing the neighborhood and enhancing information flow at the later searching state. Several groups of experiments are designed to evaluate the performance of proposed Rubiks Cube topology based particle swarm algorithm. The results have validated the effectiveness of proposed topology and operators comparing with global-best version PSO and Von Neumann topology based PSO and its scalability on larger scale applications.

Feng, Xiaochun↗