Engineering topics

Adetola, Veronica A.

Publications and source records attributed to Adetola, Veronica A..

At least 19 records

DOE OSTI2024

Peer-to-peer communication control for resilient operations of networked cyberphysical systems

This report includes two main accomplishments of the peer-to-peer communication control for resilient operation of networked microgrids project in FY24, which include a scheme for cyberattack-aware coordination of networked microgrids for supporting voltages of bulk power systems and a scheme for price signal-based operations of EV-rich networked microgrids with mixed ownership. First, the cyberattack-aware scheme enables networked microgrids to distributedly determine the amount of reactive power injection to support the voltage of bulk power system (BPS) in a fair manner. In this scheme, a risk-informed algorithm is presented to generate the peer-to- peer (P2P) communication graph with minimal risk of attack on communication links. To deal with cyberattacks on MG controllers, the resilient consensus algorithm (CA) is utilized for MG controllers to robustly estimate the total reactive power headroom, from which the MGs can accurately provide the needed amount of reactive power injection for supporting the voltage of BPS. The CA implementation and performance within the P2P communication framework are demonstrated on the IEEE 39-bus system with 6 microgrids contained in the distribution feeder under different cyberattack scenarios. Second, the price-based scheme enables the usage of the real-time price signal for the operations of electric vehicle (EV)-rich networked-microgrids with mixed ownership, in which not all the microgrids can communicate with the distribution system operator (DSO). In this scheme, a max consensus is introduced to enable the real-time price signal to be propagated from the DSO to all the microgrids, from which each microgrid controller will manage the DERs to balance the load demand and the power injection from the EV charging stations within its microgrid. Numerical results over one day with 288 slots of 5-minute intervals on the modified 123-node test feeder including 3 microgrids with high penetration of EV are presented to evaluate how the price signal affects the operations of networked microgrids under different charging strategies of the EV charging stations. The result indicates that our proposed EVCS (dis)charging strategy, which leverages the flexibility of EVs to support the grid through discharging during peak demand, proves to be a cost-effective solution that reduces operational costs while improving the social welfare of EV charging.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2024

Self-Aware Local Autonomous and Semi-Cooperative Control for Cross-Layered Resilience (SLAC3R)

The objective of this work is to develop and demonstrate novel, adaptive, lightweight algorithms that enable the decision-making agents in a large cyber-physical network to act both autonomously and in collaborative harmony to enforce assured resilience across spatiotemporal layers, even under unforeseen adversarial scenarios (e.g., high- impact-low-probability events). Towards this end, the proposed solution will serve as minimally invasive add-on layers that bridge the existing (faster, reactive) local myopic controls and (slower, predictive) centralized optimization. Importantly, the proposed algorithms will enable the multi-agent network to autonomously and collaboratively enforce resilient operation under no or limited communication environment typical of severe cyber- physical adversarial events. The expected outcome of this effort is a suite of prototype, open-source, software algorithms for safety-aware local autonomous and semi-cooperative control (SLAC3R), demonstrated on networked microgrids (via RD2C/Thrust-1 OPAL-RT testbed).

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Finding MIDDLE Ground: Scalable and Secure Distributed Learning

Edge computing methods allow devices to efficiently train a high-performing, robust, and personalized model for predictive tasks. However, these methods succumb to privacy and scalability concerns such as adversarial data recovery and expensive model communication. Furthermore, edge computing methods unrealistically assume that all devices train an identical model. In practice, edge devices have varying computational and memory constraints which may not allow certain devices to have the space or speed to train a specific model. To overcome these issues, we propose MIDDLE: a model independent distributed learning algorithm which allows heterogeneous edge devices to assist each other’s training while communicating only non-sensitive information. MIDDLE unlocks the ability for edge devices, regardless of computational or memory constraints, to assist each other even with completely different model architectures. Furthermore, MIDDLE does not require model or gradient communication which greatly reduces communication size and time. We prove that MIDDLE attains the optimal convergence rate O(1/sqrt(TM)) of stochastic gradient descent for convex and non-convex smooth optimization (for total iterations T and batch size M). Finally, our experimental results demonstrate that MIDDLE (even in non-IID data settings) attains robust and high-performing models without model or gradient communication.

Bornstein, Marc I.↗

DOE OSTI2024

Improved microgrid resiliency through distributionally robust optimization under a policy-mode framework

Critical energy infrastructure are constantly under stress due to the ever increasing disruptions caused by wildfires, hurricanes, other weather related extreme events and cyber-attacks. Hence it becomes important to make critical infrastructure resilient to threats from such cyber-physical events. However, such events are hard to predict and numerous in nature and type and it becomes infeasible to make a system resilient to every possible such cyber-physical event. Such an approach can make the system operation overly conservative and impractical to operate. Furthermore, distributions of such events are hard to predict and historical data available on such events can be very sparse, making the problem even harder to solve. To deal with these issues, in this paper we present a policy-mode framework that enumerates and predicts the probability of various cyber-physical events and then a distributionally robust optimization (DRO) formulation that is robust to the sparsity of the available historical data. The proposed algorithm is illustrated on an islanded microgrid example: a modified IEEE 123-node feeder with distributed energy resources (DERs) and energy storage. Simulations are carried to validate the resiliency metrics under the sampled disruption events.

Nazir, Mohammad Nawaf↗

DOE OSTI2024

Energy Analysis of Combi Heat Pump System Configurations for Space Conditioning and Domestic Hot Water Heating in Residential Buildings

Combi heat pump systems, also referred to multifunctional variable refrigerant flow heat recovery (MF-VRFHR) systems, are specifically designed for residential applications to manage both space conditioning and domestic hot water (DHW). They have attracted attention due to their potential for energy conservation through heat recovery. The incorporation of a hot water tank introduces various system configurations, each characterized by distinct pros and cons related to energy efficiency, system stability, and maintenance. Despite this, a critical gap exists as the specific energy performance remains unquantified under diverse operational modes (e.g., heating mode and heat recovery mode). This paper aims to bridge this gap by conducting a comprehensive comparative analysis of two prevalent system configurations while considering feasible proposed control logics. Configuration 1 integrates a separate hot water tank and a refrigerant-to-water heat exchanger (HEX), also known as a Hydro Kit while Configuration 2 incorporates a refrigerant-wrapped hot water tank. To facilitate this analysis, we developed high-fidelity system models for both configurations in Modelica, capturing system dynamics and detailed control sequences effectively. These system models were built upon the TIL library for HVAC equipment components and the Buildings library for residential building thermal load calculations. The validation of the simulation testbed utilized data from experiments conducted in the PNNL lab home for Configuration 1. To establish the simulation testbed for Configuration 2, we extended the modeling setup derived from Configuration 1. This extension specifically involved substituting the separate hot water tank and Hydro Kit with a refrigerant-wrapped hot water tank of similar sizing sourced from an actual product. The simulation analysis of heating-only and heat recovery modes reveals that Configuration 2 not only saves energy and maintains warmer tank temperatures but also demonstrates faster water heating capabilities. This is attributed to decreased energy loss and improved heat transfer. The study encompasses a wide range of scenarios, considering diverse thermal loads and water usage patterns across heating and heat recovery modes. Overall, the comprehensive results indicate that Configuration 2 achieves energy savings ranging from 3.5% to 12.2% compared to Configuration 1, depending on factors such as water usage patterns, thermal loads, and operational modes.

Configuration, Comparison, Multi-functional, Resid↗

DOE OSTI2024

Guest Editorial: Special section on Resilient Control of Cyber-Physical Power and Energy Systems

Our power and energy systems are becoming more and more integrated and interconnected. The increasing integration of edge devices and dependence on cyber infrastructure provides both the potential for benefits and risks. The integration enables more dynamic and flexible control paradigms while at the same time increasing the cyberattack surface and uncertainty of behavior. Control methodology in this new world must be designed for resilience and must have the ability to withstand, react, and respond to both physical faults and cyber-induced threats. Finally, understanding system resilience under adverse conditions requires studying control performance and how cyber infrastructure can integrate with and support the overall resilience of the system.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2024

Large-scale simulation-based parametric analysis of an optimal precooling strategy for demand flexibility in a commercial office building

Achieving success with grid-interactive efficient buildings (GEBs) is closely tied to the utilization of flexible loads. A valuable strategy involves the implementation of precooling techniques before high-demand events, such as peak hours, by adjusting zone air temperature setpoints. This leads to a reduction in thermal loads and peak electricity demand during these times, as the building’s thermal mass stores and subsequently releases thermal energy. However, the effectiveness of the pre-cooling optimization is highly contingent on specific conditions such as building thermal properties, weather conditions, utility rate structure, HVAC equipment sizing, etc. Therefore, investigating the impacts of these condition-specific factors is crucial, especially when considering precooling strategies that utilize thermal mass in commercial buildings. In this paper, we first devised a novel heuristic control approach that incorporates parameterized optimal precooling thermostat schedules to enhance demand flexibility in a commercial office building. Subsequently, we conducted a thorough performance evaluation of this control strategy. Here, the optimal thermostat schedule was parameterized using three optimization variables: the precooling start time, the precooling end time, and the precooling temperature setpoint. Utilizing the DOE medium-sized office building as the virtual testbed, we showed that the parameterized schedule effectively approximates model predictive control and requires drastically reduced computational overhead. In addition, we investigated the impact of different influencing factors on the optimal precooling strategy. These factors include building thermal mass, outdoor air conditions, and energy price profiles. Using high-performance computing, we simulated a total of 225 scenarios, consisting of three levels of thermal mass, five typical outdoor air temperature profiles, and fifteen time-of-use price plans. The results demonstrate that optimal thermostat scheduling could save substantial energy cost in medium-sized office buildings with heavy thermal mass but with some energy penalty. Although the potential for cost savings is lower in buildings with low and medium thermal mass, the energy penalty remains consistent in all three thermal mass scenarios. The study also highlights the need to account for zone diversity and recognize that a one-size-fits-all-zone setpoint schedule may not be suitable for all zones and can lead to unnecessary energy wastage. Furthermore, the results highlight that while outdoor air conditions play a role in cost and energy performance, the cooling load exerts a more immediate and substantial influence on cost savings in precooling strategies. Although cost savings are comparable under certain conditions with the same cooling load, observed deviations in energy penalty indicate potential disparities in the efficiency of the HVAC system during the load-shifting process. In addition, the duration of peak pricing and the ratio between peak and off-peak times exhibit clear correlations with cost savings and energy consumption, aligning with intuitive expectations. These findings offer valuable insights for optimizing precooling strategies in office buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2024

Modeling and Validation of a Residential Multi-Functional Variable Refrigerant Flow Heat Pump System with Heat Recovery

To bridge the existing gap in modeling the variable refrigerant flow heat pump systems with heat recovery (VRFHR), we developed a suite of dynamic VRFHR system models in Modelica. These models are specifically tailored for residential multi-functional VRFHR (MF-VRFHR) applications, including space conditioning and domestic hot water (DHW) heating, utilizing both the TIL library for HVAC equipment and the Buildings library for thermal load calculations. The development comprises essential component models, including the newly developed heat recovery unit (HRU), along with system models that integrate the heat pump system and building envelope. These system models accommodate various operational modes such as heating-only, cooling-only, and heating-recovery (including heating-dominant and cooling-dominant) modes. Furthermore, we propose an efficient optimization-based model calibration method that identifies critical model parameters while utilizing a small amount of data obtained from either real systems or manufacturer's specifications. We demonstrate the effectiveness of these models and the proposed calibration method for a MF-VRFHR system installed in Richland, WA. The developed models are calibrated and validated using data collected under different operational modes during both heating and cooling seasons. The results show that the models capture the system dynamics and achieve high accuracy, with the coefficient of the variation of the root-mean-square-error less than 15% for variables such as outdoor unit power consumption, compressor speed, space temperature and DHW temperature. The validated models serve as a reliable representation of the MF-VRFHR system, facilitating the development and validation of optimized controls needed to realize the full benefits of integrated heat pump systems. Future research will utilize these models to develop advanced controls and optimize system performance for improved energy efficiency and demand flexibility.

Modeling, Variable refrigerant flow (VRF) systems,↗

DOE OSTI2024

Building Automation

In this chapter, we focus on both need-based and vision-based control innovation for building automation for HVAC systems. After providing a brief background that describes different HVAC architectures and products, we describe the control challenges and opportunities from a needs-based point of view, at the equipment level, the systems level, and the building level. At the equipment level, increased use of continuously variable actuation such as variable speed compressors and fans, requires application of robust multivariable control that must consider various types of nonlinear behavior across increasingly larger operating envelopes. The objective at this level is to achieve robust and energy efficient operation. At the system level, coupled and interactive dynamics among subsystems are increasingly important to consider, and functional integration of these subsystems, along with set points and operating schedules are designed to minimize energy consumption and improve occupant comfort. At the building level, issues such as integration among other building systems, such as the building envelope and the electric grid, offer opportunities to develop new types of demand response and grid-interactive behaviors and technologies. At the higher levels, system dynamics and robust stability are less of an issue, similar to process control applications, while optimization and integration are more important, although dynamic stability is increasing an issue at the higher levels too. From a vision-driven innovation point of view, we describe three areas that will require sustained research efforts and will eventually impact building automation: Digital Twins, Model Predictive Control, and Grid Interactive Buildings.

Bortoff, Scott↗

DOE OSTI2023

Introduction to ALERT: A User-Interface Tool for Resilient Optimization

As the cyber-physical systems grow in complexity, there is a need for proactive resilience strategies that involve online, adaptive control actions to best prepare for any impending adversarial events. In this technical effort, supported by RD2C LDRD initiative, the project team designed and demonstrated online strategies – referred to as ALERT controls – for proactive and adaptive tuning of existing optimal controls in a microgrid, with quantifiably assured margins of resilience to various cyber-physical adversarial events. This ALERT functionality is made available to the end-users, e.g., the system operators, via an interactive user-interface. The end-users will not only be able to use the interface to visualize the system’s operation under various cyber-physical adversarial scenarios, but also evaluate the amount of tolerance the system has against selected adversarial perturbations of interest (e.g., malfunctioning sensors, suspected attacked measurements) via the adversarial plots. In this technical report, we briefly outline the algorithmic modules of the developed ALERT control technology, and introduce the user-interface tool that allows end-users (e.g., microgrid operators) to enter their system description, specify various operational and resilience requirements, and evaluate the impact of the control decisions via illustrative plots.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Enhancing Cyber Resilience of Networked Microgrids using Vertical Federated Reinforcement Learning

This paper presents a novel federated reinforcement learning (Fed-RL) methodology to inject sufficient resiliency into the operations of the network of microgrids. We consider adversarial actions to the voltage and power control loop reference signals at the grid forming (GFM) inverters in the microgrids which are essential to integrate renewable resources. Therefore, we formulate a resilient reinforcement learning training setup that uses these adversarial injections to generate episodic trajectories and train the RL agents to alleviate their impact on performance. To circumvent the concerns about data-sharing and privacy for different owners of the microgrids in the networked setting, we bring in the aspects of the federated operation to propose novel Fed-RL algorithms. As the dynamics of each microgrid are coupled due to electrical interlinks, the conventional federated RL approaches using decoupled independent environments are not applicable, which leads us to propose a multi-agent vertically federated variation of actor-critic algorithms, namely federated soft actor-critic (FedSAC). We have performed numerical simulations on an IEEE 123-bus benchmark test feeder with three microgrids by creating a customized simulation setup by encapsulating the microgrid dynamic simulations in GridLAB-D/HELICS co-simulation platform with the OpenAI Gym environment and validated the proposed resilient and secured learning methodology.

Artificial Intelligence (AI), reinforcement learni↗

DOE OSTI2023

Disturbance Propagation Stability in Droop-Controlled Microgrids

The disturbance response of the angle dynamics for a droop-controlled islanded microgrid is characterized. Specifically, a notion of propagation stability is defined, which is concerned with spatial attenuation vs amplification of input- output responses in the network in a H8 or H2 sense. Criteria for propagation stability are developed, phrased in terms of the microgrid’s inverter control parameters. The input frequency range over which the network is susceptible to amplification is also characterized, in the case that the criteria are not met. Based on the formal analysis, a the design of resilient controls that trade off coherence and disturbance propagation goals is briefly conceptualized. Finally, the propagation stability analysis is illustrate using a 15-bus example microgrid network.

Roy, Sandip↗

DOE OSTI2023

Resilient Communication Scheme for Distributed Decision of Interconnecting Networks of Microgrids

Networking of microgrids can provide the operational flexibility needed for the increasing number of DERs deployed at the distribution level and supporting end-use demand when there is loss of the bulk power system. But, networked microgrids are vulnerable to cyber-physical attacks and faults due to the complex interconnections. As such, it is necessary To design resilient control systems to support the operations of networked microgrids in responses to cyber-physical attacks and faults. This paper introduces a resilient communication scheme for interconnecting multiple microgrids to support critical demand, in which the interconnection decision can be made distributedly by each microgrid controller even in the presence of cyberattacks to some communication links or microgrid controllers. This scheme blends a randomized peer-to-peer communication network for exchanging information among controllers and resilient consensus algorithms for achieving reliable interconnection agreement. The network of 6 microgrids divided from a modified 123-node test distribution feeder is used to demonstrate the effectiveness of the proposed resilient communication scheme.

Vu, Thanh Long↗

DOE OSTI2022

Data-driven modeling of power generation for a coal power plant under cycling

Increased penetration of renewables for power generation has negatively impacted the dynamics of conventional fossil fuel-based power plants. The power plants operating on the base load are forced to cycle, to adjust to the fluctuating power demands. This results in an inefficient operation of the coal power plants, which leads up to higher operating losses. To overcome such operational challenge associated with cycling and to develop an optimal process control, this work analyzes a set of models for predicting power generation. Moreover, the power generation is intrinsically affected by the state of the power plant components, and therefore our model development also incorporates additional power plant process variables while forecasting the power generation. We present and compare multiple state-of-the-art forecasting data-driven methods for power generation to determine the most adequate and accurate model. We also develop an interpretable attention-based transformer model to explain the importance of process variables during training and forecasting. The trained deep neural network (DNN) LSTM model has good accuracy in predicting gross power generation under various prediction horizons with/without cycling events and outperforms the other models for long-term forecasting. The DNN memory-based models show significant superiority over other state-of-the-art machine learning models for short, medium and long range predictions. The transformer-based model with attention enhances the selection of historical data for multi-horizon forecasting, and also allows to interpret the significance of internal power plant components on the power generation. This newly gained insights can be used by operation engineers to anticipate and monitor the health of power plant equipment during high cycling periods.

01 COAL, LIGNITE, AND PEAT↗

DOE OSTI2022

Optimization-Based Resiliency Verification in Microgrids via Maximal Adversarial Set Characterization

Critical energy infrastructures are increasingly relying on advanced sensing and control technologies for efficient and optimal utilization of flexible energy resources. Algorithmic procedures are needed to ensure that such systems are designed to be resilient to a wide range of cyber-physical adversarial events. This paper provides a robust optimization framework to quantify the largest adversarial perturbation that a system can accommodate without violating pre-specified resiliency metrics. We formulate the maximal adversarial set characterization as a bi-level optimization problem which is solved via Lagrangian relaxations.We illustrate the proposed algorithm on an islanded microgrid example: a modified IEEE 123-node feeder with distributed energy resources. Simulations are carried out to characterize the tolerable adversarial perturbations for varying levels of available flexibility (energy reserves).

Nazir, Mohammad Nawaf↗

DOE OSTI2021

A Secure Learning Control Strategy via Dynamic Camouflaging for Unknown Dynamical Systems under Attacks

This paper presents a secure reinforcement learning (RL) based control method for unknown linear time-invariant cyber-physical systems (CPSs) that are subjected to compositional attacks such as eavesdropping and covert attack. We consider the attack scenario where the attacker learns about the dynamic model during the exploration phase of the learning conducted by the designer to learn a linear quadratic regulator (LQR), and thereafter, use such information to conduct a covert attack on the dynamic system, which we refer to as doubly learning-based control and attack (DLCA) framework. We propose a dynamic camouflaging based attack-resilient reinforcement learning (ARRL) algorithm which can learn the desired optimal controller for the dynamic system, and at the same time, can inject sufficient misinformation in the estimation of system dynamics by the attacker. The algorithm is accompanied by theoretical guarantees and extensive numerical experiments on a consensus multi-agent system and on a benchmark power grid model.

Mukherjee, Sayak↗

DOE OSTI2021

Modeling and Evaluation of Cyber-Attacks on Grid-Interactive Efficient Buildings

Grid-interactive efficient buildings (GEBs) are not only exposed to passive threats (e.g., physical faults) but also active threats such as cyber-attacks launched on the network-based control systems. The impact of cyber-attacks on GEB operation are not yet fully understood, especially as regards the performance of grid services. To quantify the consequences of cyber-attacks on GEBs, this paper proposes a modeling and simulation framework that includes different cyber-attack models and key performance indexes to quantify the performance of GEB operation under cyber-attacks. The framework is numerically demonstrated to model and evaluate cyber-attacks such as data intrusion attacks and Denial-of-Service attacks on a typical medium-sized office building that uses the BACnet/IP protocol for communication networks. Simulation results show that, while different types of attacks could compromise the building systems to different extents, attacks via the remote control of a chiller yield the most significant consequences on a building system’s operation, including both the building service and the grid service. It is also noted that a cyber-attack impacts the building systems during the attack period as well as the post-attack period, which suggests that both periods should be considered to fully evaluate the consequences of a cyber-attack.

Fu, Yanyang↗

DOE OSTI2021

A Flexible and Generic Functional Mock-up Unit Based Threat Injection Framework for Grid-interactive Efficient Buildings: A Case Study in Modelica

Grid-interactive efficient buildings (GEBs) have been considered as an important asset to support the power grid reliability by utilizing the demand flexibility offered by GEBs. GEBs are enabled by advances in sensors and controls, and the communication between building equipment, whole buildings, and the grid. The integration of different building technologies and network-based communication system makes GEBs vulnerable to passive threats such as equipment failure and active threats such as cyber-attacks. Modeling and simulation is an effective way to evaluate the impact of threats on the system performance. This paper proposes a generic and flexible threat injection framework for commonly-used building energy simulators such as EnergyPlus and Modelica to support threat modeling and evaluation. This framework leverages functional mock-up unit (FMU) to develop a general modeling interface for threat injection and simulation. A numerical case study using Modelica as a building energy simulator is conducted to demonstrate the capability of the framework for supporting single/multiple-order threat modeling and simulation of a GEB. Four threats and their combinations are injected on a Modelica-based threat-free building energy and control system, including operating supply fan at its full speed, remotely cycling the chiller on and off, blocking the chiller from receiving the chilled water supply temperature setpoints, and hijacking the global zone air temperature setpoint. Simulation results show that the cyber-attack that leads to short-term signal blocking has small effects on the system operation due to the "self-healing" feature of the heating, ventilation, and air-conditioning (HVAC) interactive control system. The threat that takes control of resetting the global zone air temperature setpoints has the most adverse impact on the system energy use, peak power demand, thermal comfort and the provision of demand flexibility. The combination of four threats have aggregative effects on the system but the effects are less than the additive effects of the individual threat.

Fu, Yanyang↗