Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Hierarchical control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Multi-Agent Control Planes for Quantum Networks: A Scalable Architecture for Autonomous Quantum Internet Management

Quantum networks are expected to enable distributed quantum computing, secure communication, and global entanglement distribution. However, operating such networks presents significant challenges, including stochastic quantum processes, fragile entanglement resources, dynamic topology, and cross-layer control requirements. Current quantum network control architectures largely rely on centralized or hierarchical controllers inspired by classical software-defined networking (SDN). While effective for small testbeds, these approaches face scalability, latency, and reliability limitations as quantum networks grow. This paper proposes a multi-agent control plane architecture for quantum networks. In this design, intelligent software agents operate at quantum nodes, repeaters, and orchestration layers, collectively managing entanglement generation, routing, purification, and scheduling. The distributed intelligence of the agent system allows the network to adapt dynamically to quantum hardware variability and environmental noise. We argue that multi-agent systems provide significant advantages over centralized control approaches, including scalability, resilience, local autonomy, and real-time adaptation. The paper discusses architectural design principles, agent coordination mechanisms, and research challenges in deploying multi-agent control planes for the emerging quantum Internet.

Alnajjar, Anees [ORNL] (ORCID:0000000237101601)↗
DOE OSTI2022

Quantum microgrid state estimation

This paper investigates the feasibility and efficiency of quantum-circuit-based algorithms for microgrid state estimation. Here, our new contributions include: (1) a general quantum state estimation (GQSE) formulation is devised for swing-bus-contained microgrids through the quantized Gaussian–Newton iteration, (2) a preconditioned quantum linear solver (PQLS) is developed for tackling the ill-conditioned GQSE with limited quantum resources, and (3) an enhanced quantum state estimation (EQSE) algorithm is further established for hierarchical-control-based microgrids with exogenous disturbances. Extensive case studies demonstrate the correctness of GQSE, PQLS and EQSE in two typical microgrids. The robustness and convergence performance of EQSE are also verified.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
NASA NTRS1991

Architectures for intelligent machines

The theory of intelligent machines has been recently reformulated to incorporate new architectures that are using neural and Petri nets. The analytic functions of an intelligent machine are implemented by intelligent controls, using entropy as a measure. The resulting hierarchical control structure is based on the principle of increasing precision with decreasing intelligence. Each of the three levels of the intelligent control is using different architectures, in order to satisfy the requirements of the principle: the organization level is moduled after a Boltzmann machine for abstract reasoning, task planning and decision making; the coordination level is composed of a number of Petri net transducers supervised, for command exchange, by a dispatcher, which also serves as an interface to the organization level; the execution level, include the sensory, planning for navigation and control hardware which interacts one-to-one with the appropriate coordinators, while a VME bus provides a channel for database exchange among the several devices. This system is currently implemented on a robotic transporter, designed for space construction at the CIRSSE laboratories at the Rensselaer Polytechnic Institute. The progress of its development is reported.

Saridis, George N.↗
DOE OSTI2023

Circulating Current Reduction of Back-to-Back MMC with Advanced Grid-Support Functionalities for Medium-Voltage Applications

A Lyapunov energy function based circulating current reduction scheme for a back to back modular multilevel converter based system for a microgrid application has been proposed in this digest. In order to ensure no circulating or zero sequence currents within the modules, the dynamics from one leg of the converter to the other are evaluated. A Lyapunov energy function is then developed and utilizing the circulating current dynamics of the converter the overall control law is implemented. In this digest a decentralized hierarchical control architecture has been implemented for the main current control; where the outer loop or the central controller implements the higher level grid interconnection functions as per IEEE 1547-2018 standards and the inner loop based on synchronous reference frame implements the current control architecture. The inner loops' outputs are the commanded converter voltages either on either side which are augmented by the Lyapunov energy function based circulating current suppression architecture. To evaluate the efficacy of the overall system, the overall system is modeled around a 300kVA back to back SiC multilevel modular converter used as a direct-connected medium voltage (MV) grid intertie based on MATLAB/Simulink domain. Several important case studies are presented in this paper to prove the effectiveness of the proposed architecture. case study results are presented.

circulating current↗
NASA NTRS1995

Locomotion training of legged robots using hybrid machine learning techniques

In this study artificial neural networks and fuzzy logic are used to control the jumping behavior of a three-link uniped robot. The biped locomotion control problem is an increment of the uniped locomotion control. Study of legged locomotion dynamics indicates that a hierarchical controller is required to control the behavior of a legged robot. A structured control strategy is suggested which includes navigator, motion planner, biped coordinator and uniped controllers. A three-link uniped robot simulation is developed to be used as the plant. Neurocontrollers were trained both online and offline. In the case of on-line training, a reinforcement learning technique was used to train the neurocontroller to make the robot jump to a specified height. After several hundred iterations of training, the plant output achieved an accuracy of 7.4%. However, when jump distance and body angular momentum were also included in the control objectives, training time became impractically long. In the case of off-line training, a three-layered backpropagation (BP) network was first used with three inputs, three outputs and 15 to 40 hidden nodes. Pre-generated data were presented to the network with a learning rate as low as 0.003 in order to reach convergence. The low learning rate required for convergence resulted in a very slow training process which took weeks to learn 460 examples. After training, performance of the neurocontroller was rather poor. Consequently, the BP network was replaced by a Cerebeller Model Articulation Controller (CMAC) network. Subsequent experiments described in this document show that the CMAC network is more suitable to the solution of uniped locomotion control problems in terms of both learning efficiency and performance. A new approach is introduced in this report, viz., a self-organizing multiagent cerebeller model for fuzzy-neural control of uniped locomotion is suggested to improve training efficiency. This is currently being evaluated for a possible patent by NASA, Johnson Space Center. An alternative modular approach is also developed which uses separate controllers for each stage of the running stride. A self-organizing fuzzy-neural controller controls the height, distance and angular momentum of the stride. A CMAC-based controller controls the movement of the leg from the time the foot leaves the ground to the time of landing. Because the leg joints are controlled at each time step during flight, movement is smooth and obstacles can be avoided. Initial results indicate that this approach can yield fast, accurate results.

Simon, William E.↗
DOE OSTI2024

Fault-Tolerant Decentralized Control for Large-Scale Inverter-Based Resources for Active Power Tracking

Integration of inverter-based resources (IBRs) which lack the intrinsic characteristics such as the inertial response of the traditional synchronous-generator (SG)-based sources presents a new challenge in the form of analyzing the grid stability under their presence. While the dynamic composition of IBRs differs from that of the SGs, the control objective remains similar in terms of tracking the desired active power. This letter presents a decentralized primal-dual-based fault-tolerant control framework for the power allocation in IBRs. Overall, a hierarchical control algorithm is developed with a lower level addressing the current control and the parameter estimation for the IBRs and the higher level acting as the reference power generator to the low level based on the desired active power profile. The decentralized network-based algorithm adaptively splits the desired power between the IBRs taking into consideration the health of the IBRs transmission lines. The proposed framework is tested through a simulation on the network of IBRs and the high-level controller performance is compared against the existing framework in the literature. The proposed algorithm shows significant performance improvement in the magnitude of power deviation and settling time to the nominal value under faulty conditions as compared to the algorithm in the literature.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Traffic Control via Connected and Automated Vehicles (CAVs): An Open-Road Field Experiment with 100 CAVs

The CIRCLES project aims to reduce instabilities in traffic flow, which are naturally occurring phenomena due to human driving behavior. Also called “phantom jams” or “stop-and-go waves,” these instabilities are a significant source of wasted energy. Toward this goal, the CIRCLES project designed a control system, referred to as the MegaController by the CIRCLES team, that could be deployed in real traffic. Our field experiment, the MegaVanderTest (MVT), leveraged a heterogeneous fleet of 100 longitudinally controlled vehicles as Lagrangian traffic actuators, each of which ran a controller with the architecture described in this article. The MegaController is a hierarchical control architecture that consists of two main layers. The upper layer is called the Speed Planner and is a centralized optimal control algorithm. It assigns speed targets to the vehicles, conveyed through the LTE cellular network. The lower layer is a control layer, running on each vehicle. It performs local actuation by overriding the stock adaptive cruise controller, using the stock onboard sensors. The Speed Planner ingests live data feeds provided by third parties as well as data from our own control vehicles and uses both to perform the speed assignment. The architecture of the Speed Planner allows for the modular use of standard control techniques, such as optimal control, model predictive control (MPC), kernel methods, and others. The architecture of the local controller allows for the flexible implementation of local controllers. Corresponding techniques include deep reinforcement learning (RL), MPC, and explicit controllers. Depending on the vehicle architecture, all onboard sensing data can be accessed by the local controllers or only some. Likewise, control inputs vary across different automakers, with inputs ranging from torque or acceleration requests for some cars to electronic selection of adaptive cruise control (ACC) setpoints in others. The proposed architecture technically allows for the combination of all possible settings proposed previously, that is {Speed Planner algorithms} × {local Vehicle Controller algorithms} × {full or partial sensing} × {torque or speed control}. As a result, most configurations were tested throughout the ramp up to the MegaVandertest (MVT).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

"Traffic Control via Connected and Automated Vehicles: An Open-Road Field Experiment with 100 CAVs"

The CIRCLES project aims to reduce instabilities in traffic flow, which are naturally occurring phenomena due to human driving behavior. These "phantom jams" or "stop-and-go waves,"are a significant source of wasted energy. Toward this goal, the CIRCLES project designed a control system referred to as the MegaController by the CIRCLES team, that could be deployed in real traffic. Our field experiment leveraged a heterogeneous fleet of 100 longitudinally-controlled vehicles as Lagrangian traffic actuators, each of which ran a controller with the architecture described in this paper. The MegaController is a hierarchical control architecture, which consists of two main layers. The upper layer is called Speed Planner, and is a centralized optimal control algorithm. It assigns speed targets to the vehicles, conveyed through the LTE cellular network. The lower layer is a control layer, running on each vehicle. It performs local actuation by overriding the stock adaptive cruise controller, using the stock on-board sensors. The Speed Planner ingests live data feeds provided by third parties, as well as data from our own control vehicles, and uses both to perform the speed assignment. The architecture of the speed planner allows for modular use of standard control techniques, such as optimal control, model predictive control, kernel methods and others, including Deep RL, model predictive control and explicit controllers. Depending on the vehicle architecture, all onboard sensing data can be accessed by the local controllers, or only some. Control inputs vary across different automakers, with inputs ranging from torque or acceleration requests for some cars, and electronic selection of ACC set points in others. The proposed architecture allows for the combination of all possible settings proposed above. Most configurations were tested throughout the ramp up to the MegaVandertest.

Lee, Jonathan↗
NASA NTRS1989

Stabilizing hierarchical compensation for locally controlled large flexible structures

A two-level hierarchical control strategy is proposed for large flexible space structures. The lower level consists of a set of local controllers. The higher level is a stabilizing compensator to account for any instabilities caused by controller-structure interaction with unmodeled dynamics. The advantage of this hierarchical strategy is that the lower level can be designed to meet the performance requirements, and the higher level can be designed independently to produce overall stability.

Das, B.↗
DOE OSTI2022

Co-simulation Framework for Community-scale Building-grid Integration [SWR-21-75]

Distributed energy resources (DERs), including rooftop solar, energy storage, and flexible loads, are gaining popularity as costs decline and as building owners and utilities realize their benefits. DERs can improve distribution system efficiency, help prevent the need for expensive grid upgrades, and increase the resilience of local communities. However, they can also cause difficulties in grid operations and can require controls to achieve their benefits. To address this challenge, NREL researchers have developed a community-scale solution that assesses the impacts of DERs and their control strategies on a distribution system. The framework has been shown to reduce solar photovoltaic (PV) curtailment to 0%, mitigate the adverse impact of solar variability on the distribution voltage, and provide up to 5-day critical load support during emergency events. Utilizing 5 different modules representing the feeder, buildings, home energy management systems, an aggregator, and a utility controller, NREL expects this simulation technology to play a critical role in the continued integration of DERs. According to the Energy Information Administration (EIA), solar curtailments accounted for 94% of the total energy curtailed in the California Independent System Operator (CAISO) in 2020. By enabling Independent System Operators (ISOs) and utility operators to bring solar curtailments to 0%, the electrical grid can become less dependent on fossil-fueled power generation sources. NREL's co-simulation framework contains five major components: Distribution Feeder Model: describes the distribution feeder topology using OpenDSS, including the locations of all DERs. Residential Building Model: simulates a large number of buildings at a high resolution using OCHRETM. The model is equipped to control equipment based on signals from an external module. The model includes major household appliances such as HVAC and a water heater, non-dispatchable load models, a distributed PV system, and a home battery system. Home Energy Management System: optimizes the controls for the devices in a home using foreseeTM. The control can adjust based on the user preferences including cost, comfort, and convenience. In hierarchical control scenarios, where the houses follow signals from an aggregator, the home energy management system provides a flexibility band with a range of power and follows the dispatch signals received from aggregator. Community-Level Aggregator: solves for optimal energy dispatch based on the flexibility bands received from each home and the grid service signal received from the utility controller. Utility-Level Controller: provides grid signals for voltage control using Distributed Energy Resources (DERs), such as solar systems, in the community.

Balamurugan, Sivasathya Pradha↗
NASA NTRS1982

Attitude and vibration control of a large flexible space-based antenna

The problem of control systems synthesis is considered for controlling the rigid body attitude and elastic motion of a large deployable space based antenna. Two methods for control systems synthesis are considered. The first method utilizes the stability and robustness properties of the controller consisting of torque actuators and collocated attitude and rate sensors. The second method is based on the linear quadratic Gaussian (LQG) control theory. A combination of the two methods, which results in a two level hierarchical control system, is also briefly discussed. The performance of the controllers is analyzed by computing the variances of pointing errors, feed misalignment errors and surface contour errors in the presence of sensor and actuator noise.

Joshi, S. M.↗
NASA NTRS1982

Attitude and vibration control of a large flexible space-based antenna

Control systems synthesis is considered for controlling the rigid body attitude and elastic motion of a large deployable space-based antenna. Two methods for control systems synthesis are considered. The first method utilizes the stability and robustness properties of the controller consisting of torque actuators and collocated attitude and rate sensors. The second method is based on the linear-quadratic-Gaussian control theory. A combination of the two methods, which results in a two level hierarchical control system, is also briefly discussed. The performance of the controllers is analyzed by computing the variances of pointing errors, feed misalignment errors and surface contour errors in the presence of sensor and actuator noise.

Joshi, S. M.↗
DOE OSTI2025

Harnessing Virtual Power Plants Reliably: Enabling tools for increased observability, controllability, operation, and aggregation of distributed energy resources

Harnessing virtual power plants enhances the integration of distributed energy resources into utility grids for a sustainable energy future. Virtual power plants (VPPs) aggregate DERs to enhance resource adequacy and reduce emissions. U.S. utilities are exploring various technologies to manage DERs effectively. FERC Order 2222 allows DERs to participate in both wholesale and retail markets. Enhancing observability and controllability of behind-the-meter (BTM) DERs is essential for reliable grid operations. A hierarchical control architecture can improve coordination among residential energy resources. Field tests showed nearly 20% energy savings and 30% peak power reduction during grid events. Effective management of DERs requires enhanced situational awareness to prevent grid congestion. Integrating DER management systems (DERMS) with existing planning tools can improve operational security. Near-real-time grid models can validate optimal resource set points against resource uncertainty. Traditional uninterruptible power supplies (UPS) can be upgraded to support grid services and become part of VPPs. Upgrading UPS systems can reduce costs by 75% and unlock significant battery capacity. New battery management systems and grid-aware controllers are essential for optimizing UPS performance. Continued research and development are necessary to address challenges in integrating DERs into utility grids. Encouraging customer participation in pilot programs is vital for the evolution of VPPs. Here, the shift towards price-responsive DERs and VPPs is expected to enhance energy distribution efficiency.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS1982

Control systems synthesis for a large flexible space antenna

The problem of control systems synthesis is considered for controlling the rigid-body attitude and elastic motion of a large deployable space-based antenna. Two methods for control systems synthesis are considered. The first method utilizes the stability and robustness properties of the controller consisting of torque actuators and collocated attitude and rate sensors. The second method is based on the linear-quadratic-Gaussian (LQG) control theory. A combination of the two methods, which results in a two-level hierarchical control system, is also briefly discussed. The performance of the controllers is analyzed by computing the variances of pointing errors, feed misalignment errors and surface contour errors in the presence of sensor and actuator noise.

Joshi, S. M.↗
DOE OSTI2023

Evaluation of Distributed Power Apportioning with Net Load Management Engine in Microgrids Using Power Hardware-in-the-Loop Simulation

This article presents the performance evaluation of ratio consensus-based distributed power apportioning engine along with centralized net load management (NLM) engine that ensures viable and stable operation of an islanded microgrid. Managing net load variability in a microgrid with high penetrations of uncertain renewable generation and ever-changing load demands is a crucial need in order to ensure viable and stable operation of the microgrid. Centralized “dispatch-rule”-based and/or multi-agent-based distributed control of distributed energy resources (DERs) in microgrid are well accepted for microgrid by adapting ANSI/ISA-95-based hierarchical control architecture. In the application where microgrid network has large geographical span with multiple DERs dispersed in the network, high penetration of uncertain renewable energy resources, and ever-changing load demands, a judicious selection of techniques/solutions for managing net-load resources for maintaining viability and stability is required. With this motivation, this article proposes a novel solution to mitigate the challenges by incorporating a mixed centralized NLM engine and distributed power apportioning control of DERs and loads. A power-hardware-in-the-loop (PHIL) -based experiment is conducted with the centralized NLM engine and the distributed power apportioning engine along with two commercial inverters. The experimental results validates the efficacy of the proposed method in ensuring viability and stability of a microgrid.

hardware-in-the-loop simulation↗
NASA NTRS1986

Automation effects in a multiloop manual control system

An experimental and analytical study was undertaken to investigate human interaction with a simple multiloop manual control system in which the human's activity was systematically varied by changing the level of automation. The system simulated was the longitudinal dynamics of a hovering helicopter. The automation-systems-stabilized vehicle responses from attitude to velocity to position and also provided for display automation in the form of a flight director. The control-loop structure resulting from the task definition can be considered a simple stereotype of a hierarchical control system. The experimental study was complemented by an analytical modeling effort which utilized simple crossover models of the human operator. It was shown that such models can be extended to the description of multiloop tasks involving preview and precognitive human operator behavior. The existence of time optimal manual control behavior was established for these tasks and the role which internal models may play in establishing human-machine performance was discussed.

Hess, R. A.↗
DOE OSTI2023

Controlled In Situ Foaming for Mechanical Responsiveness of Architected Foams

Addition of chemical blowing agents to polysiloxane resins produces foams with closed–cell morphology. Combining this chemistry with the 3D–printing technique direct ink writing (DIW) permits the creation of architected foams with controllable, hierarchical tiers of porosity. Here, using a two–component foaming ink, the extent of foaming can be controlled by incorporating an active mixing printhead as part of the fabrication process. Changes in the mixing speed allows for in situ control of the foaming reaction where the mixing speed is directly correlated with the resulting foaming that occurs upon extrusion. These architected foams display tunable mechanical responses, porosities, and open–to–closed cell ratios. While chemically blown polysiloxane foam is a well–established material, utilizing DIW as fabrication technique presents a novel approach for creating tailored, architected foams that require minimal post–processing.

36 MATERIALS SCIENCE↗