Engineering Papers⌕ Search

Engineering topics

Kalsi, Karanjit

Publications and source records attributed to Kalsi, Karanjit.

At least 19 records

Coordinated Frequency Regulation in Grid-Forming Storage Network via Safety-Consensus

Inverter-based storages are poised to play a prominent role in future power grid with massive renewable generation. Grid-forming inverters (GFMs) are emerging as a dominant technology with synchronous generators (SG)-like characteristics through primary control loops. Advanced secondary-layer control schemes, e.g., consensus algorithms, allow GFM-interfaced storage units to participate in frequency regulations and restore nominal frequency following grid disturbances. However, it is imperative to ensure critical frequency safety limits are not violated while the grid transitions from pre- to post-disturbance operating point. This paper presents a novel safety-enforced consensus method, having three distinct objectives: safe transient frequency evolution, minimizing frequency deviation, and coordinated power sharing. The proposed technique is illustrated using a GFM-interfaced grid-wide storage network on the IEEE 68-bus system under multiple grid transient scenarios.

consensus control↗

Convex Q-Learning in Continuous Time with Application to Dispatch of Distributed Energy Resources

Convex Q-learning is a recent approach to reinforcement learning, motivated by the possibility of a firmer theory for convergence, and the possibility of making use of greater a priori knowledge regarding policy or value function structure. This paper explores algorithm design in the continuous time domain, with a finite-horizon optimal control objective. The main contributions are (i) The new Q-ODE: a model-free characterization of the Hamilton-Jacobi-Bellman equation. (ii) A formulation of Convex Q-learning that avoids approximations appearing in prior work. The Bellman error used in the algorithm is defined by filtered measurements, which is necessary in the presence of measurement noise. (iii) Convex Q-learning with linear function approximation is a convex program. It is shown that the constraint region is bounded, subject to an exploration condition on the training input. (iv) The theory is illustrated in application to resource allocation for distributed energy resources, for which the theory is ideally suited.

Lu, Fan↗

Coordination of thermostatically controlled loads

Apparatus and methods for a market-based control framework to coordinate a group of autonomous thermostatically controlled loads (TCL) to achieve system-level objectives with pricing incentives is disclosed. In one example of the disclosed technology, a method of providing power to a load via a power grid by submitting bids to a coordinator includes determining an energy response relating price data for one or more energy prices to quantity data for power to be consumed by the load, sending a bid for power for a finite time period based on the energy response to the coordinator, and receiving a clearing price based on: the bid, on bids received from a plurality of additional loads, and a feeder power constraint. In some examples, the energy response is based at least in part on an equivalent thermal parameter model and a control policy indicating one or more power states for the load.

Lian, Jianming↗

Hierarchal framework for integrating distributed energy resources into distribution systems

Methods and apparatus are disclosed for providing a hierarchical framework for integrating distributed energy resources into power distribution systems. In one example of the disclosed technology, a method implemented with an aggregation server includes receiving a respective utility function associated with each of at least two of a plurality of distributed energy resources representing an amount of energy produced or consumed by the respective associated distributed energy resource as a function of energy price, producing an aggregated utility function associated with the plurality of distributed energy resources based on the received utility functions, transmitting the produced aggregated utility function to a coordinator, receiving a clearing value from the coordinator, and transmitting the received clearing value to each of the plurality of distributed energy resources.

Lian, Jianming↗

Sparse Control Synthesis for Uncertain Responsive Loads With Stochastic Stability Guarantees

In this report, recent studies have demonstrated the potential of flexible loads in providing frequency response services, predominantly due to their availability and cost-effectiveness. However, uncertainty and variability in various weather-related and end-use behavioral factors often impact the reliability of demand-side control performance. This work addresses this problem with the design of a demand-side control to achieve frequency response under load uncertainties. Our approach involves modeling the load uncertainties via stochastic processes that appear as both multiplicative and additive in the power system dynamics. Recently developed mean square exponential stability (MSES) results for continuous-time linear stochastic systems are applied to pose the control synthesis problem which results in an LMI-based optimization problem. Additional costs and constraints are added to the LMI-based controller synthesis to ensure MSES, improve closed-loop transient performance, maximize tolerable uncertainties, and promote sparsity in the controller. Additionally, the fundamental limitations between the tolerable uncertainties and control efforts while ensuring MSES are discussed. Further, the control synthesis problem for the case of the full-state measurement is generalized to the case of partial-state measurements. The proposed control synthesis is illustrated on an IEEE 39 bus system with rigorous studies to demonstrate the role of sparsity, closed-loop transient performance, tolerable uncertainties, and control efforts while ensuring MSES and achieving frequency response.

42 ENGINEERING↗

Control approach for power modulation of end-use loads

Methods, apparatus, and systems are disclosed herein for power modulation control of power grids using end-use loads. At the beginning of a coordination period typically lasting a few minutes, a population of end-use loads (water heaters, air conditioners, plug-in electric vehicles, etc.) is interrogated for their willingness to participate in power modulation by undergoing state transitions from on to off, or off to on. Distribution system flexibilities are calculated from the sums of device powers within distribution systems. Area flexibilities are calculated from the sums of device powers within areas. Thresholds for various devices to change state in response to inter-area oscillation damping or frequency regulation are derived from these flexibilities. Two power functions are monitored in real-time and compared with the device thresholds to trigger state changes which then remain locked throughout the remainder of the coordination period, then the devices are released from the lockout state.

Lian, Jianming↗

Extracting maximal frequency response potential in controllable loads

Methods and apparatus are disclosed for extracting maximal frequency response potential in controllable loads. In one example, a method includes assigning a fitness metric to at least one electrical device coupled to a power grid, assigning a frequency threshold based on the fitness metric, and transmitting the assigned frequency threshold to the at least one electrical device. The fitness metric can be based at least in part on an availability component and a quality component associated with the at least one device and the frequency threshold can cause the at least one electrical device to activate autonomously based on a frequency of the power grid.

Lian, Jianming↗

Scheduling and Control of Flexible Building Loads for Grid Services Based on a Virtual Battery Model

This paper presents a framework for modeling, scheduling, and controlling residential thermostatically controlled loads (TCLs) to provide multiple grid services, such as energy shifting, peak load reduction, and ancillary services. A modeling method is proposed to characterize the aggregate flexibility from heterogeneous TCLs using a battery-equivalent model. Based on the flexibility model, a multi-period optimal scheduling formulation is developed to best utilize the flexibility from building loads and maximize total benefits from stacked value streams. An algorithm is proposed to control individual TCLs to follow the desired power consumption in real-time. The proposed methods are illustrated and validated through simulations.

Wu, Di↗

Transient Safety Filter Design for Grid-Forming Inverters

Unlike conventional generators, inverter-based generation are fundamentally incapable of providing rotational inertia. While grid-forming inverters alleviate some of that problem by synthesizing small inertia via feedback control, additional control mechanisms are needed to ensure safety and security during transients. In this paper, we propose novel real-time safety-constrained feedback controllers (``safety filters'') for droop-based (grid-forming) inverters to ensure transient security of the grid. The safety filter acts as a buffer between the network operational layer and the inverter-control layer, and only lets those dispatch control signals pass to the inverter droop-controller, which are guaranteed to not violate the safety specifications (frequency, voltage, current limits). Using a distributed barrier certificates method, we construct sector-like conditions on the control policies, which guarantee the satisfaction of transient safety specifications. Sum-of-square programming is used to synthesize the safety filters. Numerical simulation results are provided to illustrate the performance of the proposed filter on inverter-based microgrids.

Kundu, Soumya↗

Stochastic Virtual Battery Modeling of Uncertain Electrical Loads using Variational Autoencoder

Effective utilization of flexible loads for grid services, while satisfying end-user preferences and constraints, requires an accurate estimation of the aggregated predictive flexibility offered by the electrical loads. Recently, there have been efforts to quantify the predictive flexibility of thermostatic loads (e.g. residential air-conditioners, electric water-heaters) using the notion of virtual battery (VB), whose state evolution is governed by a first order dynamics including self-dissipation rate, and power and energy capacities. Identifying the VB model parameters for a collection of thermostatic loads, however, is challenging primarily due to uncertainties and lack of information regarding the end-user behavior, underlying device models and parameters. In this paper, we propose a \textit{variational autoencoder}-based deep learning algorithm to identify the parameters of the VB model. Using available sensors and meters data, the proposed algorithm generates not only point estimates of the VB parameters, but also confidence intervals around those values. Effectiveness of the proposed frameworks is demonstrated on a collection of electric water-heater loads, whose operation is driven by uncertain water usage profiles.

virtual battery, deep learning algorithms↗

Flexibility Estimation and Control of Thermostatically Controlled Loads with Lock Time for Regulation Service

A virtual battery model is a simple and general method to quantify aggregate flexibility from thermostatically controlled loads (TCLs), enabling grid operators to effectively coordinate a large number of flexible building loads with supplyside resources in power systems. Lockout controls are designed to avoid wear and tear resulting from short-cycling of hardware. The lock on/off time could significantly affect aggregate flexibility from TCLs to provide ancillary services and may even fail control algorithms designed without considering the lock time constraints. This paper focuses on flexibility estimation and control design for TCLs with lock time constraints to provide frequency regulation service. We first investigate the potential impacts of lock time on TCLs’ aggregate flexibility and control performance. Both control-dependent and control-independent power bounds are derived, based on either previous TCL switching operations or regulation signals. While the control-dependent method provides aggregate flexibility for a given control method, the control-independent method calculates the theoretical maximum of power bounds. Two control algorithms are proposed to better distribute flexibility over time and thereby improve signal tracking performance. The proposed methods are illustrated and validated through simulations.

Wang, Peng↗

Frequency threshold determination for frequency-responsive load controllers

Systems, methods, and computer media for managing frequency response in a power grid are provided herein. Individual grid-connected electrical devices can be turned on and/or off by corresponding frequency-responsive load controllers when frequency deviations beyond a threshold are detected. Each controller selects, for the corresponding electrical device, a frequency threshold from available frequencies in a frequency range. If the selected frequency falls within a deadband frequency range, then the controller sets the frequency threshold to a frequency outside of the deadband (e.g., to a closest available frequency outside of the deadband). On a system-wide level, this approximates a uniform distribution of frequency thresholds over the entire frequency range, including the deadband, and achieves the proper power-to-frequency relationship for grid stability. A supervisory coordinator can determine the frequency range from which a frequency threshold is selected based on aggregated power information for devices and controllers throughout the grid.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Coordination of thermostatically controlled loads

Apparatus and methods for a market-based control framework to coordinate a group of autonomous thermostatically controlled loads (TCL) to achieve system-level objectives with pricing incentives is disclosed. In one example of the disclosed technology, a method of providing power to a load via a power grid by submitting bids to a coordinator includes determining an energy response relating price data for one or more energy prices to quantity data for power to be consumed by the load, sending a bid for power for a finite time period based on the energy response to the coordinator, and receiving a clearing price based on: the bid, on bids received from a plurality of additional loads, and a feeder power constraint. In some examples, the energy response is based at least in part on an equivalent thermal parameter model and a control policy indicating one or more power states for the load.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Distributed Barrier Certificates for Safe Operation of Inverter-Based Microgrids

Inverter-interfaced microgrids differ from the traditional power systems due to their lack of inertia. Vanishing timescale separation between voltage and frequency dynamics makes it critical that faster-timescale stabilizing control laws also guarantee by-construction the satisfaction of voltage limits during transients. In this article, we apply a barrier functions method to compute distributed active and reactive power setpoint control laws that certify satisfaction of voltage limits during transients. Using sum-of-squares optimization tools, we propose an algorithmic construction of these control laws. Numerical simulations are provided to illustrate the proposed method.

Kundu, Soumya↗

Coordinated PEV Charging for Distribution System Management

Plug-in electric vehicles (PEVs) can help to reduce worldwide dependence on petroleum and carbon emissions. In the past a few years, PEVs have received considerable attention as an eco-friendly and cost-effective alternative to conventional gasoline vehicles. PEVs consume higher power from the grid during charging compared to conventional residential loads. Therefore, the emerging fleet of PEVs will introduce a considerable amount of additional load on power system. On the other hand, majority of PEVs are parked for more than 90% of the time, making them ideal for providing various services through Electric Vehicle Supply Equipment (EVSE), a.k.a. charging stations which are PEVs’ connection points to the power system. In this project, coordinated PEV charging are developed to provide distribution system services, considering PEV characteristics, realistic travel pattern, charging behaviors, and EVSE power rating and availability. The main efforts and contributions are summarized as follows. • Mobility models and EVSE charging capability/availability are indispensable for evaluating PEV charging coordination strategies and developing PEV charging control. Many existing studies utilize simplified mobility models assuming that the entire vehicle fleet returns home in the evening and is parked at home until the next morning. Some other PEV models better represent diversified home arrival and departure time, but cannot capture varying charging flexibility and capability at different locations, and therefore are not appropriate to study the impacts of public EVSE on PEV load and utilization. In this work, a mobility and charging flexibility model is proposed to better represent the temporal availability and varying charging capability from PEV onboard charger and EVSE. • Based on the mobility model, a generalized optimization method is proposed to evaluate different PEV charging coordination strategies. In existing literature, different algorithms and methods need to be designed to evaluate each charging strategy from both vehicle owners’ and system’s perspective. With the optimization method proposed in this work, different charging control strategies can be studied and compared by only updating objective functions. Moreover, optimization tricks are provided to convert the optimization problems to equivalent linear programming problems, which can be efficiently solved with existing solvers. • An innovative scheduling and control framework is proposed to enable smart PEV charging for grid services while meeting PEV owners’ travel needs. In the proposed framework, each set of EVSE is equipped with a controller that estimates charging power and energy flexibility based on vehicle characteristics, EVSE power rating, battery energy state, and upcoming trip information. With the simplified charging flexibility model received from each EVSE controller, the central coordinator determines the optimal power allocation for a look-ahead time window for the given grid services. The proposed charging control can help reduce the computational complexity and communication requirement compared with existing methods. It is also scalable to the expanding PEV fleet and robust to uncertainties in upcoming vehicle trips and future system condition. • The proposed charging strategy evaluation and smart charging control methods are applied to one of the prototypical feeders developed by the Pacific Northwest National Laboratory (PNNL) for case studies. Detailed trip information extracted from the National Household Travel Survey (NHTS) is used to represent travel and parking patterns. Different scenarios are simulated to evaluate the performance of the proposed methods and understand how PEV mobility and public EVSE availability affect PEV load and potential grid services.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Incentive-Based Control and Coordination of Distributed Energy Resources. Final Report

The rapid growth of low-inertia renewable energy resources represents an immense opportunity for the U.S. to minimize its carbon footprint, while presenting a challenge for system operators as traditional “spinning” generation resources are displaced. This transformation requires solutions to robustly and cost-effectively manage dynamic changes on the grid while ensuring quality of service. There is growing recognition that distributed energy resources (DERs – loads, distributed generation, storage, electric vehicles, etc.) represent a great potential to perform this function. This report details a scalable hierarchical control strategy for coordinating thousands of heterogeneous DERs in order to provide three ancillary gird services: 1) frequency response, a rapid (within 2 seconds) service used to maintain the grid at 60 Hz; 2) regulation response, a larger response used to balance on-going differences in supply and demand on the grid; and, 3) ramping reserve, used to bring on capacity to replace lost generation. The developed control architecture consists of 1) a Distribution Reliability Coordinator (DRC), 2) aggregator controllers, and finally, 3) DER controllers. The DRC coordinates all the flexible loads and distributed energy resources on the distribution system and bids the aggregate flexibility into the wholesale market. The DRC also performs resource allocation (deciding how the flexible devices on the distribution system will be dispatched) to meet the requirements for each of the three ancillary services. The aggregators control a collection of devices that are geographically co-located and provide a platform to aggregate their flexibility and mitigate uncertainty associated with a single flexible load by managing a large aggregation of similar loads (so that any stochastic effects average out). Finally, DER controllers (for example, thermostats for air conditioners, chargers for electric vehicles) adjust the power consumption of individual devices to ensure accurate and reliable delivery of the requested grid services. Evaluation and validation of this approach was conducted with a mixture of simulation and hardware testing for a range of DERs in residential (air conditioners and water heaters), commercial HVAC (ventilation fans and central chiller plants), and micro-grids (battery energy storage, solar PV etc.). This culminated in DER hardware and simulation models operating in conjunction with grid simulations as part of a large scale federated test-bed demonstration. Simulations of over 10,000 controllable residential devices (a combination of air conditioners, water heaters, batteries, and electric vehicles) demonstrated that this advanced control approach could simultaneously meet all three grid services. Furthermore, hardware-in-the-loop testing was performed with operational micro-grid and commercial building HVAC equipment. The micro-grid equipment (representing PV, battery storage, and back-up generators) demonstrated the ability to meet all frequency response requirements (except ramping time). The commercial building HVAC ventilation equipment successfully provided the regulating response service. An Industry Advisory Board (IAB) was formed and engaged throughout the project to get feed-back on project risks and potential commercialization barriers. Their input was invaluable in identify key risks stemming from regulatory and market access challenges, financial risks from under-performance, and competitive threats from utility-scale solutions such as integrated storage. A phased commercialization plan was developed that addresses continued risk reduction (value proposition refinement and performance uncertainty assessments), piloting through field demonstrations with key stakeholders, and finally, deployment as an emerging standard for DER control.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Coordination of thermostatically controlled loads with unknown parameters

Apparatus and methods are disclosed for coordination of a population of Thermostatically Controlled Loads (TCLs) with unknown parameters to achieve group objectives including bidding and market clearing strategies designed to motivate self-interested users to realize efficient energy allocation subject to a peak power constraint. In one examples of the disclosed technology, a method of operating a load includes estimating a set of values for unmeasured parameters of the load's thermal environment based on output measurements of the thermal environment, determining an energy response based on the estimated set of values for the unmeasured parameters, and transmitting a bid for power for a finite time period based on the determined energy response to the coordinator. A clearing price is received from the coordinator responsive to the transmitted bid and power is sent to the load responsive to the received clearing price.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Scalable Computation of 2D-Minkowski Sum of Arbitrary Non-Convex Domains: Modeling Flexibility in Energy Resources

The flexibility of active ($p$) and reactive power ($q$) consumption in distributed energy resources (DERs) can be represented as a (potentially non-convex) set of points in the $p$-$q$ plane. Modeling of the aggregated flexibility in a heterogeneous ensemble of DERs as a Minkowski sum (M-sum) is computationally intractable even for moderately sized populations. In this article, we propose a scalable method of computing the M-sum of the flexibility domains of a heterogeneous ensemble of DERs, which are allowed to be non-convex, non-compact. In particular, the proposed algorithm computes a guaranteed superset of the true M-sum, with desired accuracy. The worst-case complexity of the algorithm is computed. Special cases are considered, and it is shown that under certain scenarios, it is possible to achieve a complexity that is linear with the size of the ensemble. Numerical examples are provided by computing the aggregated flexibility of different mix of DERs under varying scenarios.

Kundu, Soumya↗