Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Hierarchical control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Multi-scale, Multi-disciplinary, and Multi-agent Explainable AI with Koopman-Undergirded Learning, Prediction, and Analysis (M3EA KULPA) (Project Closeout Report)

The goal of this project was to develop and use domain-aware machine learning formulations, based on the Koopman Operator (KO), for modelling multi-scale, multi-disciplinary (e.g., multi-physics), and/or multi-agent systems. The project developed these formulations for the following cases: • Systems with dynamics at two separate time scales, • Systems with a bi-level hierarchical control structure, • Systems with bi-level hierarchical control and dynamics at two separate time scales (the lower level controls operating at the faster time scale), and • Systems with n separate but interacting agents/disciplines (with/without control, respectively); the controls for each agent could include bi-level hierarchical control and dynamics at two separate time scales as described above. The project then defined a set of dynamical systems consisting of different nonlinear oscillators that could be used to test these different formulations and then subsequently learned the KO models for those systems. With the KO models, we were able to do the following: • Quantify system stability, including both long-term and transient behavior, • Quantify the effects of feedbacks between the different time scales and agents/disciplines in terms of those feedbacks’ effects on system stability, • Replace a standard Proportional-Integral (PI) control in the hierarchical control structure with a KO-based Linear-Quadratic Regular (LQR), a form of optimal control, • Calculate optimal supervisory control policies a) with and without time scale separated dynamics at the lower level control levels and b) with both PI and KO-based LQR lower level control policies, and • Calculate dynamic Nash equilibria for multi-agent systems where each agent makes its own control decisions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Design of a supervisory control system for autonomous operation of advanced reactors

Advanced reactors to be deployed in the coming decades will face deregulated energy markets, and may adopt flexible operation to boost profitability. To aid in the transition from baseload to flexible operation paradigm, autonomous operation is sought. This work focuses on the control aspect of autonomous operation. Specifically, a hierarchical control system is designed to support constraint enforcement during routine operational transients. Within the system, data-driven modeling, physics-based state observation, and classical control algorithms are integrated to provide an adaptable and robust solution. A 320 MW Fluoride-cooled High-temperature Pebble-bed Reactor is the design basis for demonstrating the proposed control system. The hierarchical control system consists of a supervisory layer and low-level layer. The supervisory layer receives requests to change the system's operating conditions (e.g., the current reactor power to meet a load -follow), and accepts or rejects them based on constraints that have been assigned. Constraints are issued to keep the plant within an optimal operating region. The low-level layer interfaces with the actuators of the system to fulfill requested changes, while maintaining tracking and regulation duties. Further, to accept requests at the supervisory layer, the Reference Governor algorithm was adopted. To model the dynamics of the reactor, a system identification algorithm, Dynamic Mode Decomposition, was utilized. To estimate the evolution of process variables that cannot be directly measured (e.g., the propagation of delayed neutron precursors), the Unscented Kalman Filter, incorporating a nonlinear model of nuclear dynamics, was adopted. The composition of these algorithms led to a numerical demonstration of constraint enforcement during a 40% power drop transient (at a rate of 5 %/min). Uncontrolled secondary-side temperatures were successfully constrained. Adaptability of the proposed system was demonstrated by modifying the constraint values, and enforcing them during the transient. Robustness was also demonstrated by enforcing constraints under noisy environments.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2021

A Network-Aware Distributed Energy Resource Aggregation Framework for Flexible, Cost-Optimal, and Resilient Operation

To efficiently use the ubiquitous behind-the-meter distributed energy resources (DERs) in distribution systems for providing grid services, this paper presents a hierarchical control framework for DER optimal aggregation and control. We first develop a convex optimization model to evaluate the DER flexibility, and then use a convex model-predictive-control based approach to dispatch those DERs. The hierarchical control framework consists of a utility controller, community aggregators and multiple home energy management systems. The flexibility of the DERs is evaluated by each controller in the hierarchy such that the resultant flexibility is feasible given its operational domain. Based on the determined flexibility, the hierarchical controllers then compute optimal setpoints for the DERs to help the distribution system regulate node voltages and provide other distribution grid services. Numerical simulations performed on a model of a real distribution feeder in Colorado, using actual DER data in a residential community demonstrate that the proposed approach can effectively alleviate voltage issues and support resilient operation.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Control System of Multi-Port Autonomous Reconfigurable Solar Power Plant (MARS) & HIL Platforms for Design

Multi-port autonomous reconfigurable solar power plant (MARS) provides an attractive alternative to connect photovoltaic (PV) and energy storage systems (ESSs) to high-voltage direct current (HVdc) links and high-voltage alternating current (ac) grids. In this paper, a unique hierarchical control system of MARS is proposed and evaluated. To evaluate the control system and associated algorithms in early-stage research of complex architectures like MARS, it is important to develop unique suitable hardware-in-the-loop (HIL) platforms. In this paper, the HIL platforms for MARS to evaluate the performance of the hierarchical control system and the control algorithms implemented are presented. Further, they help with the design process of control systems. The real-time simulation models and algorithms that are utilized for MARS in the HIL platforms are also discussed in the paper. The HIL experiments of the control system of MARS showcase the capability to provide continuity of operation under faults and frequency support to the power grid during loss of generation. They also showcase the stability of the proposed hierarchical control system of MARS.

14 SOLAR ENERGY↗
DOE OSTI2022

Hierarchical Transactive Control of Flexible Building Loads Under Distribution LMP

With grid modernization efforts, future distribution networks, which consist of various distributed generators and flexible loads, will be more flexible and active. All new network components of distributed energy resources (DERs) drive and enable the transition towards a market-based distribution net-work that seeks the optimal allocation of all DERs. To address challenges associated with DERs, one promising solution is to utilize demand-side flexibility of building loads facilitated by demand response (DR) programs and provide ancillary grid services through distribution-level markets. Under this new paradigm, this paper proposes an efficient DR management strategy incorporating emerging price signals of distribution markets, i.e., distribution locational marginal price (DLMP), based on a hierarchical transactive control approach. The proposed approach establishes a two-layer decision-making framework; the upper layer formulates a bilevel model to obtain an optimal demand response (ODR) under DLMP, and the lower layer employs model-free control to dispatch the (aggregated) ODR to individual end users. Numerical case studies using a modified IEEE 33 test network are performed to verify the effectiveness of the proposed approach; load shifting and peak shaving for the distribution system operator and payments’ reduction for end users while maintaining their comfort.

Park, Byungkwon↗
DOE OSTI2023

Redox-enabled electronic interrogation and feedback control of hierarchical and networked biological systems

Abstract Microelectronic devices can directly communicate with biology, as electronic information can be transmitted via redox reactions within biological systems. By engineering biology’s native redox networks, we enable electronic interrogation and control of biological systems at several hierarchical levels: proteins, cells, and cell consortia. First, electro-biofabrication facilitates on-device biological component assembly. Then, electrode-actuated redox data transmission and redox-linked synthetic biology allows programming of enzyme activity and closed-loop electrogenetic control of cellular function. Specifically, horseradish peroxidase is assembled onto interdigitated electrodes where electrode-generated hydrogen peroxide controls its activity. E. coli ’s stress response regulon, oxyRS , is rewired to enable algorithm-based feedback control of gene expression, including an eCRISPR module that switches cell-cell quorum sensing communication from one autoinducer to another—creating an electronically controlled ‘bilingual’ cell. Then, these disparate redox-guided devices are wirelessly connected, enabling real-time communication and user-based control. We suggest these methodologies will help us to better understand and develop sophisticated control for biology.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Enhanced Control, Optimization, and Integration of Distributed Energy Applications (ECO-IDEA)

With support from the U.S. Department of Energy Solar Energy Technologies Office, the National Renewable Energy Laboratory (NREL) partnered with Xcel Energy, Schneider Electric, Varentec, and Electric Power Research Institute (EPRI) to meet the goals of the Enabling Extreme Real-Time Grid Integration of Solar Energy (ENERGISE) program. This project developed and validated an innovative data-enhanced hierarchical control architecture that enables the efficient, reliable, resilient, and secure operation of future distribution systems with a high penetration of distributed energy resources like solar energy. The architecture enables a hybrid control approach where a centralized control layer is complemented by distributed control algorithms for solar inverters and autonomous control of grid edge devices. It is fully interoperable and includes all the cybersecurity aspects necessary for reliable and secure system operation. The hybrid approach can seamlessly integrate multiple voltage-regulation technologies, both at central and grid-edge levels, which enables reliable and efficient system operation in the face of unpredictable conditions. The overarching goal of the Eco-Idea project is to develop, validate, and deploy a unique and innovative Data-Enhanced Hierarchical Control (DEHC) architecture that comprehensively addresses the formidable challenges associated with proliferation of high penetration of distributed PV such as reverse power flows, transients from variability of PV systems, feeder load balancing, and voltage stability. These issues are exposing the weaknesses of existing grid operations and controls - including, but not limited to, lack of grid situational awareness, heuristic and slow-acting control actions, latency of control for emergency situations, and points of failure in communications. The proposed architecture will comprehensively resolve the deficiencies of current operational settings - where monitoring and control solutions proposed across industry and academia may not be interoperable and may not coexist in the same system - and will enable an efficient, reliable, resilient, and secure operation of future distribution systems with penetration of solar energy well beyond current limits. The DEHC architecture was developed and validated rigorously through hardware-in-loop simulations in the laboratory environment and deployed on the field.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Automation for Grid Interconnected Laboratory Emulation

As computational capabilities improve, digital twins are becoming vital for evaluating equipment realistically in laboratories. This paper outlines a digital twin architecture for the power grid, employing electromagnetic transient (EMT) simulation alongside real-time simulation of power hardware and hierarchical control systems. EMT simulation occurs on a high-performance computing server for scalability. Additionally, the paper describes a workflow and real-time data streaming software facilitating connectivity among EMT simulation, hierarchical control systems, and power hardware. This software enables automated equipment connectivity in the laboratory for realistic evaluations, aiding in identifying necessary upgrades for both equipment control systems and the power grid.

Marthi, Phani Ratna Vanamali [ORNL] (ORCID:0000000↗
DOE OSTI2022

Power Electronic Hardware-in-the-Loop (PE-HIL): Testing Individual Controllers in Large-Scale Power Electronics Systems

Large power electronics systems like multi-port autonomous reconfigurable solar power plant (MARS) are increasingly being researched upon to integrate emerging energy sources. MARS connects photovoltaic (PV) systems and energy storage systems (ESSs) to high-voltage direct current (HVdc) links/grids and high-voltage alternating current (ac) transmission grids. As these large power electronics systems incorporate complex hierarchical control systems that are close-by and communicate fast, the control systems require an unique power electronic hardware-in-the-loop (PE-HIL) real-time architecture to evaluate individual controllers. In this paper, a PE-HIL real-time architecture is proposed to evaluate one of the hundreds to thousands of digital signal processors (DSPs) that are a part of the complex hierarchical control system. The DSP connects to a central processing unit (CPU) and a field programmable gate array (FPGA) that form a part of the upper levels of the control system. The DSP is part of the lower level of the control system. The proposed PE-HIL architecture is tested and evaluated. Preliminary test results are presented to showcase the concept.

Debnath, Suman↗
DOE OSTI2026

A Scalable, Distribution Network-Aware, Customer Privacy-Preserving Framework for Operation of Virtual Power Plants

This poster presents a hierarchical control framework for a virtual power plant that leverages behind-the-meter resources for grid services while maintaining customer privacy during setpoint disaggregation. Unlike many existing approaches, the virtual power plant model uses a hierarchical control strategy and an iterative approach to determine the optimal set point dis-aggregation without direct load control while maintaining system-level power flow and voltage constraints. The proposed approach is numerically validated on a synthetic distribution feeder in San Francisco, demonstrating the ability of the framework to provide privacy-preserving virtual power plant services.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

AI-Driven Smart Community Control for Accelerating PV Adoption and Enhancing Grid Resilience

The U.S. Department of Energy (DOE) has launched a Connected Communities program that supports projects that expand DOE's network of grid-interactive, efficient building communities nationwide. As an early pilot of Connected Communities, the National Renewable Energy Laboratory (NREL) and its partners have developed and demonstrated a community-scale, hierarchical control solution to address the potential grid issues arising from high penetration of solar photovoltaics (PV) as well as to improve grid reliability and resilience in this residential community. A field pilot study has been performed at an affordable housing development called the Basalt Vista Community, which was built for school teachers and other professionals in the local workforce and represents an autonomous energy grid with all-electric, energy-efficient homes. With no natural gas line in the community, this is the first all-electric net-zero community in rural Colorado. In the field pilot study, NREL has validated the performance of the hierarchical control solution, which consists of NREL's foresee home energy management systems (HEMS) and community aggregators, in increasing demand flexibility and self-consuming PV, reducing potential over-voltages, and supporting critical loads during emergency events. In this presentation, we will present the methodology, simulation and field pilot results, and lessons learned from the project.

all-electric community↗
DOE OSTI2024

Inverter Intensive Hybrid Power Plant Modeling with Small-Signal Stability Augmentation through Flexible Operation Mode Transition

Hybrid power plants (HPPs) prompt the penetration of inverter-based renewable energy sources (RES) in transmission systems; however, given their low-inertia nature, HPPs are dominated by power electronic inverters, so there are inevitable challenges in system stability when increasing numbers of HPPs are integrated into the modern power grids. To boost the penetration level of HPPs without jeopardizing system stability, it is desirable to equip them with operational characteristics (i.e., grid-forming capabilities) that are comparable to those of conventional power plants dominated by synchronous generators (SGs). In this paper, a holistic model of inverter intensive HPP is derived and a bi-level hierarchical control is developed to allow HPPs to flexibly switch among the designed operation modes (i.e., P-Q, P-V, and isochronous modes). Compared to SGs, which have limited controllability, the operation mode of each HPP could vary as requested. Such flexible mode transitions could be integrated into the secondary plant-level control and be leveraged as an additional control degree to further augment system stability. Further, the system small-signal stability margin is quantified with varying HPP operation modes. More importantly, modal analysis is thereby conducted to quantify the impacts of mode transition on the system oscillatory modes. The effectiveness of the proposed HPP bi-level hierarchical control is verified using extensive case studies based on the simplified real-world island power grid, and the results validate that the system small-signal stability margin can be enhanced with the additional degree of control flexibility enabled by HPP operation mode transition. The real-time hardware-in-the-loop (HIL) results are also provided to verify the proposed method.

grid-forming control↗
DOE OSTI2022

Resilient Hierarchical Networked Control Systems: Secure Controls for Critical Locations and at Edge

Integration of information and communication technology (ICT) offers new opportunities in improving the management and operation of critical infrastructures such as power systems as it allows connection of different sensors and control components via a communication network, leading to the so-called networked control systems (NCS). However, the use of open and pervasive ICT such as the Internet or wireless communication technologies comes at a price of making NCS vulnerable to cyber intrusions/attacks which may cause physical damage. Here, this chapter presents control algorithms to ensure resilient and safe operation of NCS under unknown cyberattacks. Specifically, a variant of dynamic watermarking strategies is presented by embedding encoding/decoding components of chaotic signals into the NCS for secure control for critical locations where the measurement/control signals are transmitted to/from the control center via a communication network. In addition, resilient cooperative control algorithms are discussed to ensure safe operation at edge of the NCS which consists of a large number of distributed controllable devices. Several numerical examples are provided to illustrate the proposed control strategies.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2023

Beneficial Integration of Energy Storage and Load Management with Photovoltaic (PV)

In recent years, a number of industry activities have aimed at addressing the integration challenges posed by the variability and uncertainty of higher penetration of renewable generation sources, like solar photovoltaic (PV) – one of the key objectives of the Sustainable and Holistic Integration of Energy Storage and Solar PV (SHINES) program launched by the U.S. Department of Energy's Office of Energy Efficiency and Renewable Energy (EERE). This EPRI led Beneficial Integration of Energy Storge, and Load Management with PV project aimed to design, develop, and demonstrate end-to-end distributed energy resource (DER) integration solution to build on these activities. EPRI led project team designed and implemented a local controller that uses model predictive control (MPC) algorithm to optimally manage DERs on site by planning for a receding horizon while executing the control settings for the first step of its plan. The team has also developed a system controller to interface with the local controller to demonstrate the hierarchical control and how it can leverage DER capabilities to address challenges like over voltage and thermal limit violations which typically limits the DER hosting capacity of distribution feeders. Team has demonstrated how the local controller with optimization algorithm can effectively manage controllable loads like HVAC, water heater, and pool pumps to allow for greater integration of PV with relatively smaller energy storage system requirements. Optimal utilization of the load control can also reduce the depth of discharge of batteries to meet grid export/import limit from behind-the-meter (BTM) DERs. Proper utilization of DER capabilities via local control intelligence, like the one developed and demonstrated in this project can help the industry to address integration challenges of higher penetration of solar PV in economically efficient manner. This can help to accelerate deployment of clean renewable energy systems at lower societal cost.

14 SOLAR ENERGY↗
DOE OSTI2023

A Review of Distributed Secondary Control Architectures in Islanded-Inverter-Based Microgrids

The increasing energy demand, the shortage of energy resources, and the environmental challenges faced by conventional power-generation systems are some of the ongoing challenges faced by modern power systems. Therefore, many efforts have been made by the scientific community to develop comprehensive solutions to overcome these issues. For instance, current technological advances have allowed the integration of distributed generators into the power systems, promoting the use of microgrids to overcome these issues. However, the use of renewable distributed generators have introduced new challenges to the traditional control system schemes. To overcome these challenges, a hierarchical control approach has been proposed for distributed renewable sources. In other words, the control scheme have been divided into three hierarchical levels, primary, secondary, and tertiary, to overcome the new challenges present in modern power systems. Due to extensiveness of this topic, this overview is focused on secondary control systems, mainly for AC isolated microgrids. To improve the power quality of modern systems, several secondary control schemes have been proposed to overcome the well-known problem of frequency and voltage deviation. Some of these schemes have also introduced adequate active/reactive power sharing techniques to optimize the utilization of resources. Additionally, other secondary control schemes have also focused on reducing the communication load, to lower the network cost and adding robustness against communication problems. This article presents an insight of the different control techniques used to overcome power quality and communication problems. A comprehensive overview of distributed secondary control techniques for islanded microgrids is presented. In addition, the implementation of these techniques is explained in an orderly and sequential manner.

14 SOLAR ENERGY↗
DOE OSTI2026

Multi-Agent Control Planes for Quantum Networks: A Scalable Architecture for Autonomous Quantum Internet Management

Quantum networks are expected to enable distributed quantum computing, secure communication, and global entanglement distribution. However, operating such networks presents significant challenges, including stochastic quantum processes, fragile entanglement resources, dynamic topology, and cross-layer control requirements. Current quantum network control architectures largely rely on centralized or hierarchical controllers inspired by classical software-defined networking (SDN). While effective for small testbeds, these approaches face scalability, latency, and reliability limitations as quantum networks grow. This paper proposes a multi-agent control plane architecture for quantum networks. In this design, intelligent software agents operate at quantum nodes, repeaters, and orchestration layers, collectively managing entanglement generation, routing, purification, and scheduling. The distributed intelligence of the agent system allows the network to adapt dynamically to quantum hardware variability and environmental noise. We argue that multi-agent systems provide significant advantages over centralized control approaches, including scalability, resilience, local autonomy, and real-time adaptation. The paper discusses architectural design principles, agent coordination mechanisms, and research challenges in deploying multi-agent control planes for the emerging quantum Internet.

Alnajjar, Anees [ORNL] (ORCID:0000000237101601)↗
DOE OSTI2022

Quantum microgrid state estimation

This paper investigates the feasibility and efficiency of quantum-circuit-based algorithms for microgrid state estimation. Here, our new contributions include: (1) a general quantum state estimation (GQSE) formulation is devised for swing-bus-contained microgrids through the quantized Gaussian–Newton iteration, (2) a preconditioned quantum linear solver (PQLS) is developed for tackling the ill-conditioned GQSE with limited quantum resources, and (3) an enhanced quantum state estimation (EQSE) algorithm is further established for hierarchical-control-based microgrids with exogenous disturbances. Extensive case studies demonstrate the correctness of GQSE, PQLS and EQSE in two typical microgrids. The robustness and convergence performance of EQSE are also verified.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

Circulating Current Reduction of Back-to-Back MMC with Advanced Grid-Support Functionalities for Medium-Voltage Applications

A Lyapunov energy function based circulating current reduction scheme for a back to back modular multilevel converter based system for a microgrid application has been proposed in this digest. In order to ensure no circulating or zero sequence currents within the modules, the dynamics from one leg of the converter to the other are evaluated. A Lyapunov energy function is then developed and utilizing the circulating current dynamics of the converter the overall control law is implemented. In this digest a decentralized hierarchical control architecture has been implemented for the main current control; where the outer loop or the central controller implements the higher level grid interconnection functions as per IEEE 1547-2018 standards and the inner loop based on synchronous reference frame implements the current control architecture. The inner loops' outputs are the commanded converter voltages either on either side which are augmented by the Lyapunov energy function based circulating current suppression architecture. To evaluate the efficacy of the overall system, the overall system is modeled around a 300kVA back to back SiC multilevel modular converter used as a direct-connected medium voltage (MV) grid intertie based on MATLAB/Simulink domain. Several important case studies are presented in this paper to prove the effectiveness of the proposed architecture. case study results are presented.

circulating current↗