Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “control framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Deep Reinforcement Learning Enabled Physical-Model-Free Two-Timescale Voltage Control Method for Active Distribution Systems

Active distribution networks are being challenged by frequent and rapid voltage violations due to renewable energy integration. Conventional model-based voltage control methods rely on accurate parameters of the distribution networks, which are difficult to achieve in practice. This paper proposes a novel physical-model-free two-timescale voltage control framework for active distribution systems. To achieve fast control of PV inverters, the whole network is first partitioned into several subnetworks using voltage-reactive power sensitivity. Then, the scheduling of PV inverters in the multiple sub-networks is formulated as Markov games and solved by a multi-agent soft actor-critic (MASAC) algorithm, where each subnetwork is modeled as an intelligent agent. All agents are trained in a centralized manner to learn a coordinated strategy while being executed based on only local information for fast response. For the slower time-scale control, OLTCs and switched capacitors are coordinated by a single agent-based SAC algorithm using the global information with considering control behaviors of the inverters. Particularly, the two-level agents are trained concurrently with information exchange according to the reward signal calculated from the data-driven surrogate model. Comparative tests with different benchmark methods on IEEE 33-and 123-bus systems and 342-node low voltage distribution system demonstrate that the proposed method can effectively mitigate the fast voltage violations and achieve systematical coordination of different voltage regulation assets without the knowledge of accurate system model.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Coordination of thermostatically controlled loads

Apparatus and methods for a market-based control framework to coordinate a group of autonomous thermostatically controlled loads (TCL) to achieve system-level objectives with pricing incentives is disclosed. In one example of the disclosed technology, a method of providing power to a load via a power grid by submitting bids to a coordinator includes determining an energy response relating price data for one or more energy prices to quantity data for power to be consumed by the load, sending a bid for power for a finite time period based on the energy response to the coordinator, and receiving a clearing price based on: the bid, on bids received from a plurality of additional loads, and a feeder power constraint. In some examples, the energy response is based at least in part on an equivalent thermal parameter model and a control policy indicating one or more power states for the load.

Lian, Jianming↗

"Hierarchical Speed Planner for Automated Vehicles: A Framework for Lagrangian Variable Speed Limit in Mixed Autonomy Traffic"

This paper introduces a novel control framework for Lagrangian variable speed limits in hybrid traffic flow environments utilizing automated vehicles (AVs). The framework was validated using a fleet of 100 connected automated vehicles as part of the largest coordinated open-road test designed to smooth traffic flow. The framework includes two main components: a high-level controller deployed on the server side, named Speed Planner, and low-level controllers called vehicle controllers deployed on the vehicle side. The Speed Planner designs and updates target speeds for the vehicle controllers based on real-time Traffic State Estimation (TSE) [1]. The Speed Planner comprises two modules: a TSE enhancement module and a target speed design module. The TSE enhancement module is designed to minimize the effects of inherent latency in the received traffic information and to improve the spatial and temporal resolution of the input traffic data. The target speed design module generates target speed profiles with the goal of improving traffic flow. The vehicle controllers are designed to track the target speed meanwhile responding to the surrounding situation. The numerical simulation indicates the performance of the proposed method: the bottleneck throughput has increased by 5.01%, and the speed standard deviation has been reduced by a significant 34.36%. We further showcase an operational study with a description of how the controller was implemented on a field-test with 100 AVs and its comprehensive effects on the traffic flow.

Wang, Han↗

HP-FLEX: Field demonstration of the semantics-driven configuration of a Model Predictive Control system to make heat pumps flexible

Model Predictive Control (MPC) has demonstrated significant potential for optimizing building operations and enabling demand flexibility. However, the widespread adoption of MPC is hindered by complex manual configuration and commissioning processes that must be conducted by control experts working alongside building operators. These challenges drive up costs and reduce scalability, particularly when technical human resources and building automation systems are limited, such as in small and medium commercial buildings (SMCBs). This paper demonstrates how semantic standards, specifically ASHRAE 223P, can accelerate the adoption of MPC applications for load flexibility in SMCBs. The authors present a replicable control framework, titled “HP-FLEX” that leverages a building’s semantic model to bootstrap the required data configuration for an MPC controller developed for optimizing heat pump systems as flexible grid resources. The semantic model helps streamline the deployment workflow, particularly for site setup, data/control commissioning, and model setup. This integration enhances portability, transferability, and scalability of the HP-FLEX MPC, which has been developed to support MPC-based supervisory HVAC controllers in SMCBs. Additionally, the paper details the required building and thermostat metadata information to enable the HP-FLEX MPC based on field demonstrations. The new workflow was tested in a small commercial building located in California, U.S., and demonstrated a load shifting performance of 9% based on a dynamic pricing signal that varies by the hour. This work provides a practical pathway for transitioning sophisticated building applications from custom to standardized semantic representations, supporting the broader adoption of advanced control strategies like MPC. The framework also establishes a foundation for evolving metadata requirements as applications mature while maintaining compatibility with industry standards.

Paul, Lazlo↗

HP-FLEX: Field Demonstration of the Semantics-Driven Configuration of a Model Predictive Control System to Make Heat Pumps Flexible

Model Predictive Control (MPC) has demonstrated significant potential for optimizing building operations and enabling demand flexibility. However, the widespread adoption of MPC is hindered by complex manual configuration and commissioning processes that must be conducted by control experts working alongside building operators. These challenges drive up costs and reduce scalability, particularly when technical human resources and building automation systems are limited, such as in small and medium commercial buildings (SMCBs). This paper demonstrates how semantic standards, specifically ASHRAE 223P, can accelerate the adoption of MPC applications for load flexibility in SMCBs. The authors present a replicable control framework, titled “HP-FLEX” that leverages a building’s semantic model to bootstrap the required data configuration for an MPC controller developed for optimizing heat pump systems as flexible grid resources. The semantic model helps streamline the deployment workflow, particularly for site setup, data/control commissioning, and model setup. This integration enhances portability, transferability, and scalability of the HP-FLEX MPC, which has been developed to support MPC-based supervisory HVAC controllers in SMCBs. Additionally, the paper details the required building and thermostat metadata information to enable the HP-FLEX MPC based on field demonstrations. The new workflow was tested in a small commercial building located in California, U.S., and demonstrated a load shifting performance of 9% based on a dynamic pricing signal that varies by the hour. This work provides a practical pathway for transitioning sophisticated building applications from custom to standardized semantic representations, supporting the broader adoption of advanced control strategies like MPC. The framework also establishes a foundation for evolving metadata requirements as applications mature while maintaining compatibility with industry standards.

Paul, Lazlo↗

Decentralized Voltage Control of Large-Scale Distribution System with PVs Based on MADRL

This paper proposes a model-free decentralized control framework for the voltage regulation of large-scale distribution systems through the coordinated control of PV inverters. This is achieved by developing a novel interaction mechanism between the surrogate model and the centralized training and decentralized execution multiagent deep reinforcement learning framework. Specifically, the sparse Gaussian processes regression method is first utilized to develop the surrogate model of the original distribution system for reward calculation during the training stage, where each agent represents a sub-region in the centralized fashion for coordination strategy learning. After that, the learned control rules are used to inform controllers within each sub-region for real-time decisions with only local measurements. Comparative tests among various methods on the EPRI Ckt5 test system demonstrate the effectiveness of the proposed method.

distribution system↗

Metal‐Organic Framework (MOF) Morphology Control by Design

Abstract Exerting morphological control over metal‐organic frameworks (MOFs) is critical for determining their catalytic performance and to optimize their packing behavior in areas from separations to fuel gas storage. A mechanism‐based approach to tailor the morphology of MOFs is introduced and experimentally demonstrated for five cubic Zn 4 O‐based MOFs. This methodology provides three key features: 1) computational screening for selection of appropriate additives to change crystal morphology based on knowledge of the crystal structure alone; 2) use of additive to metal cluster geometric relationships to achieve morphologies expressing desired crystallographic facets; 3) potential for suppression of interpenetration for certain phases.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Optimal Power Hardware-in-the-Loop Interfacing: Applying Modern Control For Design and Verification of High-Accuracy Interfaces

Here, we develop a novel approach to designing power hardware-in-the-loop (PHIL) simulation interfaces that maximizes simulation bandwidth and accuracy by leveraging a modern control framework that explicitly considers objectives on accuracy and can automatically synthesize an optimal controller that meets these objectives while stabilizing the closed-loop system. The method developed improves upon common approaches to PHIL interface design that typically involve multiple design steps for manual compensation and stabilization design that can result in interfaces that are stable but have suboptimal bandwidth and accuracy. The approach developed is general and can be applied to most PHIL system configurations. The modeling framework allows for the inclusion of scaling factors and hardware-under-test current injection models that are common to practical PHIL simulations and have significant impacts on stability. We also present practical methods and metrics for verifying the absolute accuracy of PHIL simulation results without relying on relative comparisons to potentially inaccurate models or previous simulation results. We demonstrate the accuracy evaluation method and show the improved performance achievable when using the optimal PHIL interface design approach in an experimental case study involving a 100-kVA battery inverter.

42 ENGINEERING↗

Framework for Supporting Adaptive Droop Based Power Electronic Systems

The electric grid is evolving into an electrical network composed of power electronic converters interconnected with renewable and energy storage technologies. This requires the adoption of more advanced control such as volt/var regulation, fast frequency control, and active power frequency response. This work presents a communication and control framework to support dynamically changing droop control segments that can be used for different optimization schemes. Results are presented to work in a controller hardware in the loop testbed.

Starke, Michael↗

Decentralized Filtering Adaptive Neural Network Control for Uncertain Switched Interconnected Nonlinear Systems

This article presents a novel decentralized filtering adaptive neural network control framework for uncertain switched interconnected nonlinear systems. Each subsystem has its own decentralized controller based on the established decentralized state predictor. For each subsystem, the nonlinear uncertainties are approximated by a Gaussian radial basis function (GRBF) neural network incorporated with a piecewise constant adaptive law, where the adaptive law will update adaptive parameters from the error dynamics between the host system and the decentralized state predictor by discarding the unknowns, whereas a decentralized filtering control law is derived to cancel both local and mismatched uncertainties from other subsystems, as well as achieve the local objective tracking of the host system. The achievement of global objective depends on the achievement of local objective for each subsystem. The matched uncertainties are canceled directly by adopting their opposite in the control signal, whereas a dynamic inversion of the system is required to eliminate the effect of the mismatched uncertainties on the output. By exploiting the average dwell time principle, the error bounds between the real system and the virtual reference system, which defines the best performance that can be achieved by the closed-loop system, are derived. A numerical example is given to illustrate the effectiveness of the decentralized filtering adaptive neural network control architecture by comparing against the model reference adaptive control (MRAC).

Average dwell time, decentralized, filtering adapt↗

Combining model-based and model-free methods for stochastic control of distributed energy resources

Modern distribution systems are experiencing a fast transformation with the growing penetration of distributed energy resources (DERs). Along with the economic and environmental benefits of DERs, challenges arise to address the uncertainties caused by their inherent volatility. If properly coordinated, however, DERs have the potential to provide the controllability that grid operators need. Here, we propose a hierarchical control framework that combines the model-based and model-free methods for stochastic DER control in distribution systems. The upper-level scheduler considers a chance-constrained optimal power flow problem (model-based) that schedules DER setpoints to minimize the operational cost and maintain the operating reserve. The lower-level distributed DER controllers absorb real-time disturbances and uncertainties using the extremum seeking control (model-free) to achieve grid objectives. The combination of model-based and model-free methods allows us to take the advantages of both methods to effectively manage the uncertainty in distribution systems. The proposed work is demonstrated on the IEEE 13-node feeder.

24 POWER TRANSMISSION AND DISTRIBUTION↗

An Investigation of Heuristic Control Strategies for Multi-Electrolyzer Wind-Hydrogen Systems Considering Degradation

With the growing demand for renewable-energy-powered hydrogen generation and the corresponding increase in plant capacity, individually controlling many electrolyzer stacks will be critical for increasing the plant's lifetime and efficiency. This paper introduces a rule-based controller framework targeting electrolyzer degradation to explore the opportunity space in multi-stack hydrogen plant control. A novel control-oriented degradation model is also presented in this work, which quantifies the impact of steady power input, fluctuating power input, and the number of startup/shutdown cycles on electrolyzer degradation. Using a wind power input signal, 13 controller configurations are tested on 5 MW hydrogen plants consisting of 2, 5, 10, and 25 stacks. These configurations are evaluated on their capability to mitigate electrolyzer degradation and efficiently produce hydrogen from the time-varying input power. The results show that multi-stack control for degradation can extend the plant's lifetime by more than a factor of 3 with minimal impact on instantaneous hydrogen production.

control↗

Distributed Online Voltage Control in Distribution Network: A Two-Stage Real-Time Implementation

The increasing integration of renewable-based distributed generation (DG) brings growing challenges to distribution network (DN) voltage control. To address this issue, a two-stage distributed online voltage control framework (TDO-VC) is proposed in this paper. In the proposed method, legacy voltage control devices are controlled in the upper stage on an hourly timescale, while DGs operate autonomously online in the lower stage to remove instantaneous voltage violations. The idea of receding horizon control is applied in the upper stage to comprehensively consider the current and future renewable generation, and the generalized fast dual ascent (Gf-DA) is employed in the lower stage to effectively manage DGs through near real-time optimization. The effectiveness of the proposed TDO-VC is demonstrated by rigorous theoretical analysis and case studies on IEEE-123 bus system.

Distributed generation↗

Adaptive Reinforcement Learning Control for Power Distribution in Multi-Output Resonant Converters

This paper presents an adaptive reinforcement learning (ARL)-based control framework for efficient power distribution in a multi-output resonant converter for UAV applications. The proposed system is based on a high-frequency isolated resonant architecture, where a single energy source supplies multiple propulsion loads through independently controlled output rectifiers, addressing the need for coordinated multi-motor power management. The ARL framework dynamically allocates output power by learning optimal phase-shift control actions under varying load demands and operating conditions. The agent autonomously determines control parameters that maximize conversion efficiency while ensuring accurate power sharing among multiple outputs. In addition, the proposed approach enables adaptive operation without requiring detailed system modeling or manual tuning. Experimental results demonstrate stable and efficient performance over a wide range of operating conditions, confirming the effectiveness and robustness of the learning-based control strategy for multi-output resonant converter system.

Asa, Erdem [ORNL] (ORCID:0000000190884812)↗

Improving EV Charging Resilience under a Device Fault Condition

This paper presents a multi-layer control framework that can improve resilience of an electric vehicle (EV) charging system when a device fault occurs in an EV charger power converter. The multi-layer framework built in a hierarchical structure allows fast protection and device fault ride through (DFRT), active status monitoring, and control optimization to improve the charging resilience. The feasibility and the effectiveness of the DFRT response and the control optimization are verified through controller hardware-in-the-loop demonstration.

Kim, Namwon↗

Dynamic Modeling, Trajectory Optimization, and Linear Control of Cable-Driven Parallel Robots for Automated Panelized Building Retrofits

The construction industry faces a growing need for automation to reduce costs, improve accuracy and productivity, and address labor shortages. One area that stands to benefit significantly from automation is panelized prefabricated building envelope retrofits, which can improve a building’s energy efficiency in heating and cooling interior spaces. In this paper, we propose using cable-driven parallel robots (CDPRs), which can effectively lift and handle large objects, to install these panels. However, implementing CDPRs presents significant challenges because of their nonlinear dynamics, complex trajectory planning, and precise control requirements. To tackle these challenges, this work focuses on a new application of established control and trajectory optimization theories in a CDPR simulation of a building envelope retrofit under real-world conditions. We first model the dynamics of CDPRs, highlighting the critical role of damping in system behavior. Building on this dynamic model, we formulate a trajectory optimization problem to generate feasible and efficient motion plans for the robot under operational and environmental constraints. Given the high precision required in the construction industry, accurately tracking the optimized trajectory is essential. However, challenges such as partial observability and external vibrations complicate this task. To address these issues, a Linear Quadratic Gaussian control framework is applied, enabling the robot to track the optimized trajectories with precision. Simulation results show that the proposed controller enables precise end effector positioning with errors under 4 mm, even in the presence of external wind disturbances. Through comprehensive simulations, our approach allows for an in-depth exploration of the system’s nonlinear dynamics, trajectory optimization, and control strategies under controlled yet highly realistic conditions. The results demonstrate the feasibility of CDPRs for automating panel installation and provide insights into their practical deployment.

CDPR↗

Laboratory Evaluation of Federated, Hierarchical Controls for Distribution Power System Management: Preprint

The connection of more loads and distributed energy resources (DERs) to the distribution power system brings both challenges and opportunities to system operators. There are opportunities to aggregate flexible loads and DERs to provide transmission grid services, but the coordinated actions of DERs being managed by independent, third-party DER aggregators to support transmission system operations can present challenges. We developed a federated DER management architecture and control framework that aims to manage heterogeneous DERs to deliver reliable transmission grid services while respecting distribution system constraints. The controls include stochastic day-ahead optimization, model predictive control, and a simple real-time management scheme. We present simulation results obtained from a realistic laboratory test bed of federated controls managing DERs within a substation service area to make the substation net power follow the optimal net power determined by the day-ahead optimization based on cost and limiting reverse power flow.

24 POWER TRANSMISSION AND DISTRIBUTION↗