Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Hierarchical control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Multi-Agent Control Planes for Quantum Networks: A Scalable Architecture for Autonomous Quantum Internet Management

Quantum networks are expected to enable distributed quantum computing, secure communication, and global entanglement distribution. However, operating such networks presents significant challenges, including stochastic quantum processes, fragile entanglement resources, dynamic topology, and cross-layer control requirements. Current quantum network control architectures largely rely on centralized or hierarchical controllers inspired by classical software-defined networking (SDN). While effective for small testbeds, these approaches face scalability, latency, and reliability limitations as quantum networks grow. This paper proposes a multi-agent control plane architecture for quantum networks. In this design, intelligent software agents operate at quantum nodes, repeaters, and orchestration layers, collectively managing entanglement generation, routing, purification, and scheduling. The distributed intelligence of the agent system allows the network to adapt dynamically to quantum hardware variability and environmental noise. We argue that multi-agent systems provide significant advantages over centralized control approaches, including scalability, resilience, local autonomy, and real-time adaptation. The paper discusses architectural design principles, agent coordination mechanisms, and research challenges in deploying multi-agent control planes for the emerging quantum Internet.

Alnajjar, Anees [ORNL] (ORCID:0000000237101601)↗

Quantum microgrid state estimation

This paper investigates the feasibility and efficiency of quantum-circuit-based algorithms for microgrid state estimation. Here, our new contributions include: (1) a general quantum state estimation (GQSE) formulation is devised for swing-bus-contained microgrids through the quantized Gaussian–Newton iteration, (2) a preconditioned quantum linear solver (PQLS) is developed for tackling the ill-conditioned GQSE with limited quantum resources, and (3) an enhanced quantum state estimation (EQSE) algorithm is further established for hierarchical-control-based microgrids with exogenous disturbances. Extensive case studies demonstrate the correctness of GQSE, PQLS and EQSE in two typical microgrids. The robustness and convergence performance of EQSE are also verified.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Circulating Current Reduction of Back-to-Back MMC with Advanced Grid-Support Functionalities for Medium-Voltage Applications

A Lyapunov energy function based circulating current reduction scheme for a back to back modular multilevel converter based system for a microgrid application has been proposed in this digest. In order to ensure no circulating or zero sequence currents within the modules, the dynamics from one leg of the converter to the other are evaluated. A Lyapunov energy function is then developed and utilizing the circulating current dynamics of the converter the overall control law is implemented. In this digest a decentralized hierarchical control architecture has been implemented for the main current control; where the outer loop or the central controller implements the higher level grid interconnection functions as per IEEE 1547-2018 standards and the inner loop based on synchronous reference frame implements the current control architecture. The inner loops' outputs are the commanded converter voltages either on either side which are augmented by the Lyapunov energy function based circulating current suppression architecture. To evaluate the efficacy of the overall system, the overall system is modeled around a 300kVA back to back SiC multilevel modular converter used as a direct-connected medium voltage (MV) grid intertie based on MATLAB/Simulink domain. Several important case studies are presented in this paper to prove the effectiveness of the proposed architecture. case study results are presented.

circulating current↗

Fault-Tolerant Decentralized Control for Large-Scale Inverter-Based Resources for Active Power Tracking

Integration of inverter-based resources (IBRs) which lack the intrinsic characteristics such as the inertial response of the traditional synchronous-generator (SG)-based sources presents a new challenge in the form of analyzing the grid stability under their presence. While the dynamic composition of IBRs differs from that of the SGs, the control objective remains similar in terms of tracking the desired active power. This letter presents a decentralized primal-dual-based fault-tolerant control framework for the power allocation in IBRs. Overall, a hierarchical control algorithm is developed with a lower level addressing the current control and the parameter estimation for the IBRs and the higher level acting as the reference power generator to the low level based on the desired active power profile. The decentralized network-based algorithm adaptively splits the desired power between the IBRs taking into consideration the health of the IBRs transmission lines. The proposed framework is tested through a simulation on the network of IBRs and the high-level controller performance is compared against the existing framework in the literature. The proposed algorithm shows significant performance improvement in the magnitude of power deviation and settling time to the nominal value under faulty conditions as compared to the algorithm in the literature.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Traffic Control via Connected and Automated Vehicles (CAVs): An Open-Road Field Experiment with 100 CAVs

The CIRCLES project aims to reduce instabilities in traffic flow, which are naturally occurring phenomena due to human driving behavior. Also called “phantom jams” or “stop-and-go waves,” these instabilities are a significant source of wasted energy. Toward this goal, the CIRCLES project designed a control system, referred to as the MegaController by the CIRCLES team, that could be deployed in real traffic. Our field experiment, the MegaVanderTest (MVT), leveraged a heterogeneous fleet of 100 longitudinally controlled vehicles as Lagrangian traffic actuators, each of which ran a controller with the architecture described in this article. The MegaController is a hierarchical control architecture that consists of two main layers. The upper layer is called the Speed Planner and is a centralized optimal control algorithm. It assigns speed targets to the vehicles, conveyed through the LTE cellular network. The lower layer is a control layer, running on each vehicle. It performs local actuation by overriding the stock adaptive cruise controller, using the stock onboard sensors. The Speed Planner ingests live data feeds provided by third parties as well as data from our own control vehicles and uses both to perform the speed assignment. The architecture of the Speed Planner allows for the modular use of standard control techniques, such as optimal control, model predictive control (MPC), kernel methods, and others. The architecture of the local controller allows for the flexible implementation of local controllers. Corresponding techniques include deep reinforcement learning (RL), MPC, and explicit controllers. Depending on the vehicle architecture, all onboard sensing data can be accessed by the local controllers or only some. Likewise, control inputs vary across different automakers, with inputs ranging from torque or acceleration requests for some cars to electronic selection of adaptive cruise control (ACC) setpoints in others. The proposed architecture technically allows for the combination of all possible settings proposed previously, that is {Speed Planner algorithms} × {local Vehicle Controller algorithms} × {full or partial sensing} × {torque or speed control}. As a result, most configurations were tested throughout the ramp up to the MegaVandertest (MVT).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

"Traffic Control via Connected and Automated Vehicles: An Open-Road Field Experiment with 100 CAVs"

The CIRCLES project aims to reduce instabilities in traffic flow, which are naturally occurring phenomena due to human driving behavior. These "phantom jams" or "stop-and-go waves,"are a significant source of wasted energy. Toward this goal, the CIRCLES project designed a control system referred to as the MegaController by the CIRCLES team, that could be deployed in real traffic. Our field experiment leveraged a heterogeneous fleet of 100 longitudinally-controlled vehicles as Lagrangian traffic actuators, each of which ran a controller with the architecture described in this paper. The MegaController is a hierarchical control architecture, which consists of two main layers. The upper layer is called Speed Planner, and is a centralized optimal control algorithm. It assigns speed targets to the vehicles, conveyed through the LTE cellular network. The lower layer is a control layer, running on each vehicle. It performs local actuation by overriding the stock adaptive cruise controller, using the stock on-board sensors. The Speed Planner ingests live data feeds provided by third parties, as well as data from our own control vehicles, and uses both to perform the speed assignment. The architecture of the speed planner allows for modular use of standard control techniques, such as optimal control, model predictive control, kernel methods and others, including Deep RL, model predictive control and explicit controllers. Depending on the vehicle architecture, all onboard sensing data can be accessed by the local controllers, or only some. Control inputs vary across different automakers, with inputs ranging from torque or acceleration requests for some cars, and electronic selection of ACC set points in others. The proposed architecture allows for the combination of all possible settings proposed above. Most configurations were tested throughout the ramp up to the MegaVandertest.

Lee, Jonathan↗

Co-simulation Framework for Community-scale Building-grid Integration [SWR-21-75]

Distributed energy resources (DERs), including rooftop solar, energy storage, and flexible loads, are gaining popularity as costs decline and as building owners and utilities realize their benefits. DERs can improve distribution system efficiency, help prevent the need for expensive grid upgrades, and increase the resilience of local communities. However, they can also cause difficulties in grid operations and can require controls to achieve their benefits. To address this challenge, NREL researchers have developed a community-scale solution that assesses the impacts of DERs and their control strategies on a distribution system. The framework has been shown to reduce solar photovoltaic (PV) curtailment to 0%, mitigate the adverse impact of solar variability on the distribution voltage, and provide up to 5-day critical load support during emergency events. Utilizing 5 different modules representing the feeder, buildings, home energy management systems, an aggregator, and a utility controller, NREL expects this simulation technology to play a critical role in the continued integration of DERs. According to the Energy Information Administration (EIA), solar curtailments accounted for 94% of the total energy curtailed in the California Independent System Operator (CAISO) in 2020. By enabling Independent System Operators (ISOs) and utility operators to bring solar curtailments to 0%, the electrical grid can become less dependent on fossil-fueled power generation sources. NREL's co-simulation framework contains five major components: Distribution Feeder Model: describes the distribution feeder topology using OpenDSS, including the locations of all DERs. Residential Building Model: simulates a large number of buildings at a high resolution using OCHRETM. The model is equipped to control equipment based on signals from an external module. The model includes major household appliances such as HVAC and a water heater, non-dispatchable load models, a distributed PV system, and a home battery system. Home Energy Management System: optimizes the controls for the devices in a home using foreseeTM. The control can adjust based on the user preferences including cost, comfort, and convenience. In hierarchical control scenarios, where the houses follow signals from an aggregator, the home energy management system provides a flexibility band with a range of power and follows the dispatch signals received from aggregator. Community-Level Aggregator: solves for optimal energy dispatch based on the flexibility bands received from each home and the grid service signal received from the utility controller. Utility-Level Controller: provides grid signals for voltage control using Distributed Energy Resources (DERs), such as solar systems, in the community.

Balamurugan, Sivasathya Pradha↗

Harnessing Virtual Power Plants Reliably: Enabling tools for increased observability, controllability, operation, and aggregation of distributed energy resources

Harnessing virtual power plants enhances the integration of distributed energy resources into utility grids for a sustainable energy future. Virtual power plants (VPPs) aggregate DERs to enhance resource adequacy and reduce emissions. U.S. utilities are exploring various technologies to manage DERs effectively. FERC Order 2222 allows DERs to participate in both wholesale and retail markets. Enhancing observability and controllability of behind-the-meter (BTM) DERs is essential for reliable grid operations. A hierarchical control architecture can improve coordination among residential energy resources. Field tests showed nearly 20% energy savings and 30% peak power reduction during grid events. Effective management of DERs requires enhanced situational awareness to prevent grid congestion. Integrating DER management systems (DERMS) with existing planning tools can improve operational security. Near-real-time grid models can validate optimal resource set points against resource uncertainty. Traditional uninterruptible power supplies (UPS) can be upgraded to support grid services and become part of VPPs. Upgrading UPS systems can reduce costs by 75% and unlock significant battery capacity. New battery management systems and grid-aware controllers are essential for optimizing UPS performance. Continued research and development are necessary to address challenges in integrating DERs into utility grids. Encouraging customer participation in pilot programs is vital for the evolution of VPPs. Here, the shift towards price-responsive DERs and VPPs is expected to enhance energy distribution efficiency.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Evaluation of Distributed Power Apportioning with Net Load Management Engine in Microgrids Using Power Hardware-in-the-Loop Simulation

This article presents the performance evaluation of ratio consensus-based distributed power apportioning engine along with centralized net load management (NLM) engine that ensures viable and stable operation of an islanded microgrid. Managing net load variability in a microgrid with high penetrations of uncertain renewable generation and ever-changing load demands is a crucial need in order to ensure viable and stable operation of the microgrid. Centralized “dispatch-rule”-based and/or multi-agent-based distributed control of distributed energy resources (DERs) in microgrid are well accepted for microgrid by adapting ANSI/ISA-95-based hierarchical control architecture. In the application where microgrid network has large geographical span with multiple DERs dispersed in the network, high penetration of uncertain renewable energy resources, and ever-changing load demands, a judicious selection of techniques/solutions for managing net-load resources for maintaining viability and stability is required. With this motivation, this article proposes a novel solution to mitigate the challenges by incorporating a mixed centralized NLM engine and distributed power apportioning control of DERs and loads. A power-hardware-in-the-loop (PHIL) -based experiment is conducted with the centralized NLM engine and the distributed power apportioning engine along with two commercial inverters. The experimental results validates the efficacy of the proposed method in ensuring viability and stability of a microgrid.

hardware-in-the-loop simulation↗

Controlled In Situ Foaming for Mechanical Responsiveness of Architected Foams

Addition of chemical blowing agents to polysiloxane resins produces foams with closed–cell morphology. Combining this chemistry with the 3D–printing technique direct ink writing (DIW) permits the creation of architected foams with controllable, hierarchical tiers of porosity. Here, using a two–component foaming ink, the extent of foaming can be controlled by incorporating an active mixing printhead as part of the fabrication process. Changes in the mixing speed allows for in situ control of the foaming reaction where the mixing speed is directly correlated with the resulting foaming that occurs upon extrusion. These architected foams display tunable mechanical responses, porosities, and open–to–closed cell ratios. While chemically blown polysiloxane foam is a well–established material, utilizing DIW as fabrication technique presents a novel approach for creating tailored, architected foams that require minimal post–processing.

36 MATERIALS SCIENCE↗

Performance Evaluation of Next-Generation Grid Automation and Controls with High PV Penetration

This paper presents a hardware-in-the-loop (BIL) simulation to evaluate the performance of an advanced grid automation architecture, referred to as data-enhanced hierarchical control (DEHC), in achieving voltage regulation and conservation voltage reduction (CVR) in distribution networks with very high photovoltaic (PV) generation. This architecture comprises an advanced distribution management system (ADMS), a distributed energy resource management system (DERMS), and grid-edge devices working synergistically to provide the grid benefits. The HIL setup used for the evaluation includes ADMS, DERMS, and grid-edge devices. The DEHC performance is evaluated in two representative scenarios considering loose and tight constraints of the power factor at the substation. The results show that the DEHC architecture is effective in achieving voltage regulation and CVR and thus enables the grid integration of high levels of PV generation.

ADMS↗

Real-time Simulation Framework for Hardware-in-the-Loop Testing of Multi-port Autonomous Reconfigurable Solar Power Plant (MARS)

Multiport autonomous reconfigurable solar power plant (MARS) has been proposed for integrated development of photovoltaic (PV) and energy storage system (ESS) that can connect to high-voltage direct current (HVdc) and alternating current (ac) transmission grid. To de-risk the development of this complex integrated system that consists of hundreds to thousands of power electronics modules, a controller hardware-in-the-loop (cHIL) test setup will be extremely beneficial. The cHIL testing can be used for evaluation of modules as well as the hierarchical control system in MARS. With the unique configuration of power electronics modules in MARS, it becomes necessary to develop custom-designed real-time simulation models in the cHIL setup in absence of off-the-shelf models. In this paper, high-fidelity dynamic model of MARS, control algorithms at the lower level, and required communication algorithms are developed and optimized for real-time performance in the cHIL setup. Real-time experimental results from the cHIL are provided.

Dong, Zerui↗

High-Performance Transmission and Distribution Co-simulation with 10,000+ Inverter-Based Resources

The inverter-based resource (IBR) has become avery important component in the distribution system. The impacts on system transient stability introduced by high IBR penetration are not fully addressed because of the lack of high-fidelity models. The aggregate IBR model at the transmission level cannot precisely reproduce the dynamics of distributed IBR at the distribution system because of the oversimplification. In this paper, we will develop a high-penetration fully-connected transmission and distribution (T&D) co-simulation platform that supports the simulation of 10,000+ dispersed IBR models. The interfacing and iterative initialization techniques for the co-simulation have been implemented to maintain stable operation and simulation of large-multitude of IBR models. The phasor-domain IBR models with grid-forming (GFM) and grid-following (GFL) control are implemented in the distribution systems simulators. The developed platform is tested on high-performance computing (HPC) resources and can be utilized to explore the hierarchical control strategies of IBRs for the large-scale T&D hybrid system.

Liu, Yuan↗

Control and Grid Support Function Evaluation for a Three-Phase Back-to-Back Modular Multilevel Converter System

This paper focuses on the evaluation of advanced inverter controls for a 500kW back-to-back (B2B), silicon carbide, multilevel modular converter (MMC) used as a direct-connected medium-voltage grid intertie. A decentralized hierarchical controller architecture for the MMC system is presented, which uses the main controller to implement higher level grid interconnection functions per the IEEE 1547–2018 standards and the local controllers to execute lower level closed-loop functionality of the MMC stages. This paper presents and elaborates on the grid functionalities are elaborated and presented. The back-to-back converter system is equipped with local controllers and their corresponding functionalities are presented. Case study results for the corresponding functionalities presented show the effectiveness of the proposed architecture. To enhance the operation capabilities of the system, a parameter update scheme has been implemented and utilized in unison with the controller.

decentralized control↗

Operation and Control of a Back to Back Modular Multilevel Converter System for Grid Forming Application with Advanced Grid Support Functionalities

The main focus of this paper is to investigate the possibility of using modular multilevel converter based back-to-back system for grid forming applications. A decentralized hierarchical control architecture with a modified local controller based on nonlinear techniques for grid forming application have been investigated. Grid functionalities based on IEEE 1547-2018 for grid forming converters have been utilized. The local controllers ensure distortion free balanced sinusoidal output voltage on the grid forming side with unbalanced or nonlinear loading condition. The grid following side ensures unity power factor currents under unbalanced grid voltage condition. The dc bus voltage control ensures oscillation free voltage under balanced conditions and control of the average voltage under unbalanced condition. Efficacy of the overall system is verified by modeling the system in MATLAB/Simulink and PLECS domain and the most important case studies are presented.

advanced grid support functionalities↗

Resilient Control of Networked Microgrids Using Vertical Federated Reinforcement Learning: Designs and Real-Time Test-Bed Validations

Improving system-level resiliency of networked microgrids against adversarial cyber-attacks is an important aspect in the current regime of increased inverter-based resources (IBRs). To achieve that, this paper contributes in designing a hierarchical control layer, in conjunction with the existing control layers, resilient to adversarial attack signals. Considering model complexities, unknown dynamical behaviors of IBRs, and privacy issues regarding data sharing in multi-party-owned microgrids, designing such a control layer is non-trivial. Here, to tackle these issues, a novel federated reinforcement learning (Fed-RL) method is proposed. To grasp the interconnected dynamics of networked microgrids, the paper develops Federated Soft Actor-Critic (FedSAC) algorithm following the vertical structure of implementing Fed-RL. Next, utilizing the OpenAI Gym interface, we built a custom set-up in GridLAB-D/HELICS co-simulation platform, named Resilient RL Co-simulation (ResRLCoSIM), to train the RL agents with IEEE 123-bus benchmark comprising 3 interconnected microgrids. Finally, the learned policies in the simulation are transferred to the real-time hardware-in-the-loop (HIL) test-bed developed using the high-fidelity Hypersim platform. Finally, experiments show that the simulator-trained RL controllers achieve desirable performance with the test-bed platform, validating the minimization of the sim-to-real gap.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Solid State Power Substation DC Node Optimization and Controller Hardware-In-The-Loop Demonstration

A solid state power substation (SSPS) node is a microgrid that integrates distributed energy resources and loads and injects/absorbs power to/from the SSPS distribution network. It is an essential building block of a futuristic distribution grid network. This paper presents the development and demonstration of optimization use cases of a SSPS DC node. By adopting multi-layer hierarchical control architecture and developing automatic device identification and dynamic optimization formulation algorithms, the SSPS DC node can perform plug-and-play resource integration and seamless transition of the optimized node operation under on and off grid condition without sophisticated algorithms, control mode changes, and user interactions. Four optimization use cases including economic dispatches with price signal changes, a sudden PV power drop, and a single directional meter and its associated costs with sending power back to the grid, and resiliency under a grid inverter trip condition were demonstrated through the real-time controller hardware-in-the-loop simulation.

Kim, Namwon↗