Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed controls”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Safe Deep Reinforcement Learning for Active Distribution System Model Predictive Control with EVs and DERs

The temporal and spatial mismatch between PV generation and electric vehicle (EV) charging and discharging may cause voltage violations in active distribution networks. Despite the widespread use of deep reinforcement learning (DRL) in power system optimization and control, it lacks guarantees on constraint satisfaction during both training and deployment. This paper proposes a Lagrangian-based safe DRL approach for model predictive control (MPC) of active distribution systems with large-scale integration of PVs, EVs, and energy storage systems (ESSs). A Transformer-LSTM time-series model is proposed to forecast EV charging demand, which is then formulated as a constraint to ensure charging requirements are met. Using this prediction, a Lagrangian-based safe soft actor-critic (SAC) framework is developed for real-time control in a three-phase unbalanced distribution system, enforcing voltage safety constraints while optimizing the cumulative net reward. By integrating the forecasting model with multi-period constraints, the proposed framework jointly coordinates PV systems, EV charging and discharging, and ESS scheduling within the MPC horizon. Numerical experiments on a modified IEEE 123-bus system with real-world data show that, under a high PV penetration scenario, the proposed method increases the net reward by 30.74% and reduces average voltage violations from 0.0011 p.u. to 0.0002 p.u. compared with standard SAC. Compared with the optimal power flow (OPF) approach, it achieves similar voltage security while yielding lower line losses. It also maintains real-time control capability, reducing operation latency to 53.21 ms per 15-minute control interval. The proposed method remains effective under varying PV/EV penetrations and load conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Deep Reinforcement Learning Enabled Physical-Model-Free Two-Timescale Voltage Control Method for Active Distribution Systems

Active distribution networks are being challenged by frequent and rapid voltage violations due to renewable energy integration. Conventional model-based voltage control methods rely on accurate parameters of the distribution networks, which are difficult to achieve in practice. This paper proposes a novel physical-model-free two-timescale voltage control framework for active distribution systems. To achieve fast control of PV inverters, the whole network is first partitioned into several subnetworks using voltage-reactive power sensitivity. Then, the scheduling of PV inverters in the multiple sub-networks is formulated as Markov games and solved by a multi-agent soft actor-critic (MASAC) algorithm, where each subnetwork is modeled as an intelligent agent. All agents are trained in a centralized manner to learn a coordinated strategy while being executed based on only local information for fast response. For the slower time-scale control, OLTCs and switched capacitors are coordinated by a single agent-based SAC algorithm using the global information with considering control behaviors of the inverters. Particularly, the two-level agents are trained concurrently with information exchange according to the reward signal calculated from the data-driven surrogate model. Comparative tests with different benchmark methods on IEEE 33-and 123-bus systems and 342-node low voltage distribution system demonstrate that the proposed method can effectively mitigate the fast voltage violations and achieve systematical coordination of different voltage regulation assets without the knowledge of accurate system model.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Restoring Critical Loads In Resilient Distribution Systems using A Curriculum Learned Controller

In this paper, we propose a curriculum learned reinforcement learning (RL) controller to facilitate distribution system critical load restoration (CLR), leveraging RL's fast online response and its outstanding optimal sequential control capability. Like many grid control problems, CLR is complicated due to the large control action space and renewable uncertainty in a heavily constrained non-linear environment with strong intertemporal dependency. The nature of the problem oftentimes causes the RL policy to converge to a poor-performing local optimum if learned directly. To overcome this, we design a two-stage curriculum in which the RL agent will learn generation control and load restoration decision under different scenarios progressively. Via curriculum learning, the trained RL controller is expected to achieve a better control performance, with critical loads restored as rapidly and reliably as possible. Using the IEEE 13-bus test system, we illustrate the performance of the RL controller trained by the proposed curriculum-based method.

curriculum learning↗
DOE OSTI2022

Coordinated Steering Angle and Yaw Moment Distribution to Increase Vehicle Regenerative Energy in Autonomous Driving

This paper presents an algorithm that increases vehicle regenerative braking energy recovery in autonomous driving by leveraging connected and automated vehicle (CAV) technology. Autonomous vehicles may select different maneuvers to increase kinetic energy recovery during deceleration. In the proposed algorithm, the cornering resistance that influences regenerative energy and energy consumption is defined in terms of steering angle during regenerative braking. In particular, a model predictive controller that distributes control inputs of the vehicle is adopted to reduce the cornering resistance for increasing regenerative braking torque. Utilizing the information from CAV technology, this algorithm enables the vehicle to safely conduct braking while increasing its regenerative energy recovery. CarSim-Simulink joint simulations demonstrate the effectiveness of the proposed method.

Choi, Junghyun↗
DOE OSTI2021

Restoring Critical Loads in Resilient Distribution Systems Using a Curriculum Learned Controller: Preprint

In this paper, we propose a curriculum learned reinforcement learning (RL) controller to facilitate distribution system critical load restoration (CLR), leveraging RL's fast online response and its outstanding optimal sequential control capability. Like many grid control problems, CLR is complicated due to the large control action space and renewable uncertainty in a heavily constrained non-linear environment with strong intertemporal dependency. The nature of the problem oftentimes causes the RL policy to converge to a poor-performing local optimum if learned directly. To overcome this, we design a two-stage curriculum in which the RL agent will learn generation control and load restoration decision under different scenarios progressively. Via curriculum learning, the trained RL controller is expected to achieve a better control performance, with critical loads restored as rapidly and reliably as possible. Using the IEEE 13-bus test system, we illustrate the performance of the RL controller trained by the proposed curriculum-based method.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2025

A Data Science and Machine Learning Platform Supporting Large Particle Accelerator Control and Diagnostics Applications Final Report: SBIR Initial Phase II DE-SC0022583

The Machine Learning Data Platform (MLDP) is a product providing full-stack support for data science, Machine Learning, and Artificial Intelligence (ML/AI) applications at particle accelerator and large experimental physics facilities. It supports ML/AI applications from front-end, high-speed acquisition of heterogeneous, time-series data, through data archiving and management, to back-end analysis. The MLDP embodies a “data-science ready” platform for data analysis and ML/AI applications in diagnosis, modelling, control, and optimization of these facilities. It provides data scientists and applications a consistent, datacentric interface to archive data standardizing implementation and deployment of ML/AI algorithms to different operations configurations within the same facility, or between facilities. Being an open-source, public-domain project, the MLDP is intended for broadest possible impact by increasing accessibility and minimizing the required expertise for installation and operation. The MLDP can also be deployed at user facilities for experimental data collection, archiving, and analysis. It is capable of acquisition and archiving of heterogeneous data from experimental equipment (e.g., images, arrays, structures, etc.) along with system hardware configurations (e.g., scalars, tables), control system process variables, and any metadata required for provenance. Thus, the MLDP can manage experimental data through its entire lifecycle, from acquisition and archiving, through analysis and investigation, to release and final publication.

43 PARTICLE ACCELERATORS↗
DOE OSTI2021

Data-Driven Multi-agent Deep Reinforcement Learning for Distribution System Decentralized Voltage Control with High Penetration of PVs

This paper proposes a novel model-free/data-driven centralized training and decentralized execution multi-agent deep reinforcement learning (MADRL) framework for distribution system voltage control with high penetration of PVs. The proposed MADRL can coordinate both the real and reactive power control of PVs with existing static var compensators and battery storage systems. Unlike the existing DRL-based voltage control methods, our proposed method does not rely on a system model during both the training and execution stages. This is achieved by developing a new interaction scheme between the surrogate modeling of the original system and the multi-agent soft actor critic (MASAC) MADRL algorithm. In particular, the sparse pseudo-Gaussian process with a few-shots of measurements is utilized to construct the surrogate model of the original environment, i.e., power flow model. This is a data-driven process and no model parameters are needed. Furthermore, the MASAC enabled MADRL allows to achieve better scalability by dividing the original system into different voltage control regions with the aid of real and reactive power sensitivities to voltage, where each region is treated as an agent. This also serves as the foundation for the centralized training and decentralized execution, thus significantly reducing the communication requirements as only local measurements are required for control. Comparative results with other alternatives on the IEEE 123-nodes and 342-nodes systems demonstrate the superiority of the proposed method.

14 SOLAR ENERGY↗
DOE OSTI2023

Data Privacy for the Grid: Toward a Data Privacy Standard for Inverter-Based and Distributed Energy Resources

The traditional approach to planning the distribution grid has focused on reliability in the context of gradual and reasonably predictable load growth. Forecasts of load growth, combined with asset management practices, were used by system planners to identify upgrades to the system to maintain or improve reliability. The decisions, typically based within load flow analysis tools, included considerations about contingency scenarios and corporate forecasts (i.e., top-down predictions at a summary level of what would happen in a particular area that could impact load growth and behavior). As a result, today, this traditional approach no longer fits all purposes.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Local Power-Voltage Sensitivity and Thevenin Impedance Estimation from Phasor Measurements

This paper describes how to use voltage phasor measurements to produce a sensitivity matrix that describes how real and reactive power injections at a node on a distribution network affect the local voltage magnitude and angle. Rather than estimating the sensitivity directly, the voltage phasor measurements and power commands/measurements are used to estimate the unbalanced, three-phase Thevenin impedance. The Thevenin impedance estimation is conducted using recursive least squares on temporal difference measurements. The Thevenin impedance and voltage phasor measurement are then used to build the local power-voltage sensitivity matrix with the closed form expression for the Jacobian of the power flow manifold. Hardware-in-the-loop simulations with phasor measurement units providing real phasor measurements are used to evaluate the recursive temporal difference Thevenin impedance estimation and Thevenin-based power-voltage sensitivity methods.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Smart Meters Enabling Voltage Monitoring and Control Functionalities: The Last-Mile Voltage Stability Issue

It is a demanding yet challenging task to design the next generation of smart meters. This work investigates the new voltage monitoring and control function for the next-generation smart meters, and identifies its added values for power system voltage stability issues. In terms of voltage monitoring, the risk benefit analysis for adding voltage magnitudes to smart meter measurements is presented, and the risk mitigation strategies along with the co-simulation validation via GridLAB-D and NS-3 are proposed, all providing insight into the new function evaluation. In terms of voltage control, a new voltage stability control scheme is developed, which uses voltage measurements from smart meters and utilizes the observability and controllability of distributed energy resources and controllable loads. Different from traditional voltage control schemes focusing on voltage regulation and power quality monitoring from the utility perspective, the proposed control scheme can achieve the maximum real power transfer margin at the end user side, enabling the voltage stability issues being solved at the grid edge, i.e. the last-mile segment. It is the first work that considers voltage monitoring and control collectively for smart meter investment. It can help power engineering community supplement smart meter applications and shape the next-generation smart meters.

42 ENGINEERING↗
DOE OSTI2022

A Generic Primary-Control Model for Grid-Forming Inverters: Towards Interoperable Operation & Control

This paper outlines an architectural vision centered around the notion of interoperability to integrate grid-forming inverter-based resources in large-scale grids. With the underlying principle of interoperability guiding developments, we focus on modeling the characteristics of droop, virtual synchronous machine, and virtual oscillator controls. Emphasis is placed on these three controllers since they are leading grid-forming control candidates and are likely to be commonplace as primary-control schemes in future systems. We show that these controllers can each be considered as instantiations of a more generic model and that all these controllers exhibit similar droop-like relations between pertinent terminal variables in steady state. This commonality between controllers gives interoperability among them such that automatic synchronization, power sharing, and voltage regulation can be achieved. Simulation results validate the models and demonstrate how the steady-state droop characteristics of these control methods can be aligned with the aid of the developed modeling paradigm.

control↗
DOE OSTI2021

Evaluation of Centralized Model-Based FLISR in a Lab Setup: Preprint

Utilities are installing advanced distribution management systems (ADMS) around the globe to improve the sensing and control of distribution systems. ADMS is becoming a critical component to improve the resiliency and reliability of distribution systems. These management systems host a multitude of applications that can be used to sense, control, and operate distribution systems. Fault location, isolation, and service restoration (FLISR) is one of the ADMS applications that is critical to improving resilience during fault conditions. FLISR applications use smart, controllable devices that are installed in the distribution system for FLISR operation. These controllable devices include distributed energy resources (DER) and reclosers. Evaluating such ADMS applications before installation in the field can help de-risk the field implementation and avoid costly failures in the field. This paper presents a background on experimental setup that are typically used to evaluate ADMS applications. This is followed by briefly presenting the setup used to evaluate the FLISR application in an off-the-shelf ADMS tool. Finally, results from the evaluation experiments are presented.

94 GMLC - Grid Modernization Laboratory Consortium↗
DOE OSTI2021

Evaluation of Centralized Model Based FLISR in a Lab Setup

Utilities are installing advanced distribution management systems (ADMS) around the globe to improve the sensing and control of distribution systems. ADMS is becoming a critical component to improve the resiliency and reliability of distribution systems. These management systems host a multitude of applications that can be used to sense, control, and operate distribution systems. Fault location, isolation, and service restoration (FLISR) is one of the ADMS applications that is critical to improving resilience during fault conditions. FLISR applications use smart, controllable devices that are installed in the distribution system for FLISR operation. These controllable devices include distributed energy resources (DER) and reclosers. Evaluating such ADMS applications before installation in the field can help de-risk the field implementation and avoid costly failures in the field. This paper presents a background on experimental setup that are typically used to evaluate ADMS applications. This is followed by briefly presenting the setup used to evaluate the FLISR application in an off-the-shelf ADMS tool. Finally, results from the evaluation experiments are presented.

94 GMLC - Grid Modernization Laboratory Consortium↗
DOE OSTI2021

Architected mesoporous crystalline magnesium silicates with ordered pore structures

Novel approaches to harness earth abundant silicates as building blocks for carbon dioxide removal, capture, utilization, and storage are gaining increasing attention in the context of sustainable and low carbon energy and resource recovery. Advancing a calibrated understanding of these fluid-silicate interactions is essential for developing scalable processes. One of the challenges in developing predictive controls over these interactions is the compositional and morphological heterogeneity of naturally occurring, heterogeneous magnesium silicate minerals. To address this challenge, the synthesis of architected mesoporous crystalline magnesium silicate (Mg 2 SiO 4 ) is proposed. While synthesis routes for producing amorphous mesoporous magnesium silicates have been developed via sol-gel methods, approaches to synthesize crystalline magnesium silicates with well-controlled pore size distributions have not been explored. The conventional approaches of converting matter that is amorphous to crystalline states at elevated temperatures results in a heterogeneous pore size distribution. To develop controls on pore size distribution, amorphous mesoporous magnesium silicates are coated with carbon. This approach preserves the pore size distributions during the amorphous to crystalline transformations of Mg-silicates at elevated temperatures. The carbon coating is removed on heating. Magnesium silicate particles produced using this approach have highly ordered pores around 2.58 nm and a specific surface area of 124.25 m 2 /g. In this study, we report the chemical compositions, morphologies, phase transitions, and pore structures of the intermediate materials produced during the synthesis of crystalline mesoporous magnesium silicates. The transitions, and pore structures of the intermediate materials produced during the synthesis of crystalline mesoporous magnesium silicates. Furthermore, the synthesis routes discussed in this study can be applied translationally to produce metal silicates with ordered mesoporous structures.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Fault isolation and fault-tolerant control for Takagi-Sugeno fuzzy time-varying delay stochastic distribution systems

A fault isolation, estimation, and fault-tolerant control (FTC) scheme for nonlinear time-varying delay stochastic distribution control systems was presented in this paper. The Takagi-Sugeno fuzzy model was adopted to approach the nonlinear dynamics of time-varying delay systems. According to the output equivalence principle and Laplace transformation, an augmented state vector was given to solve the time-varying delay problem. When multiple actuator faults and interference occur simultaneously, fault detection, isolation and fault estimation was designed to obtained the fault information. To decouple faults and obtain the value and location information of the fault, the system was separated into two parts through the designed multiple conversion matrices, in which one subsystem was only affected by one actuator fault. This has simplified the design of fault isolation and estimation. A adaptive observer for fault estimation was given. Then, fault information such as the time, location, and size was determined. The observer gain matrices were calculated using linear matrix inequality (LMI). When a fault was detected and diagnosed, a FTC algorithm was devised using the proportional-integral control scheme to compensate the fault as much as possible. It has been shown that even if multiple faults actuator occurred simultaneously, the FTC controller still ensured the output probability density function of the system traced the desired probability density function when a fault occurred. Finally, the expected results were obtained through the simulation example, which confirmed the effectiveness of the method.

42 ENGINEERING↗
DOE OSTI2022

Evaluation of nonlinear control performance of air handling units under variable operation conditions using root distribution approach

The control systems at Air handling units (AHUs) have nonlinear nature, resulting potentially in sluggish, aggressive, or oscillatory responses under variable operation conditions. This paper is to develop an approach for evaluating the nonlinear control performance of AHUs under variable operation conditions and for identifying the impact of varying multiple operation parameters which guides controller design. To do so, an operation parameter-based root distribution technique, intended to sketch the paths traced by closed-loop poles as multiple operation parameters are varied, is first introduced. The technique—which may be viewed as an extension of conventional, single-variable root locus—is then applied to a fan speed control system that includes a motor with a variable frequency drive and a supply fan with an air duct under variable fan speed and duct static pressure. Using the technique, the system’s stability region is graphically identified. The system is also found to be aggressive and gradually lose its stability as the fan speed decreases and the duct static pressure increases, which is validated by the field tests. Here, the root distribution approach is an effective tool to evaluate the performance of any nonlinear control systems at AHUs with multiple variable operation parameters without requiring time-domain simulations.

42 ENGINEERING↗
DOE OSTI2020

Nanoscale Spatial Distribution of Supported Nanoparticles Controls Activity and Stability in Powder Catalysts for CO Oxidation and Photocatalytic H 2 Evolution

Here we discuss, supported metal nanoparticles are essential components of high-performing catalysts, and their structures are intensely researched. In comparison, nanoparticle spatial distribution in powder catalysts is conventionally not quantified, and the influence of this collective property on catalyst performance remains poorly investigated. Here, we demonstrate a general colloidal self-assembly method to control uniformity of nanoparticle spatial distribution on common industrial powder supports. We quantify distributions on the nanoscale using image statistics and show that the type of nanospatial distribution determines not only the stability, but also the activity of heterogeneous catalysts. Widely investigated systems (Au–TiO 2 for CO oxidation thermocatalysis and Pd–TiO 2 for H 2 evolution photocatalysis) were used to showcase the universal importance of nanoparticle spatial organization. Spatially and temporally resolved microkinetic modeling revealed that nonuniformly distributed Au nanoparticles suffer from local depletion of surface oxygen, and therefore lower CO oxidation activity, as compared to uniformly distributed nanoparticles. Nanoparticle spatial distribution also determines the stability of Pd–TiO 2 photocatalysts, because nonuniformly distributed nanoparticles sinter while uniformly distributed nanoparticles do not. This work introduces new tools to evaluate and understand catalyst collective (ensemble) properties in powder catalysts, which thereby pave the way to more active and stable heterogeneous catalysts.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Distribution power system fault control apparatus and method

A method includes detecting a fault in a grid coupled to a distribution power network, the distribution power network comprising a distribution feeder, a plurality of distributed energy resources (DERs) coupled to the distribution feeder and a reference point of applicability (RPA) associated with the plurality of DERs, and in response to detecting the fault, determining an error voltage at the RPA, converting the error voltage into an error signal, broadcasting the error signal to the plurality of DERs, and based on the error signal, reducing the error voltage at the RPA by injecting a plurality of currents from the plurality of DERs to the distribution feeder.

Cintuglu, Mehmet H.↗