Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “load disaggregation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

A multi-level load shape clustering and disaggregation approach to characterize patterns of energy consumption behavior

This study presents representative electrical load shapes, disaggregated to the end-use level, for over 5000 customer clusters across California’s residential, commercial, industrial and agricultural sectors. We developed a novel, multi-level load shape clustering approach for residential and commercial sectors leveraging interval meter data for over 350,000 California utility customers collected as a part of the Phase 4 California Demand Response (DR) Potential Study. The clustering approach allowed us to identify typical consumption patterns and categorize customers based on their daily load shape displayed throughout the year. For example, we were able to identify customers with particular energy technologies such as electric vehicles and rooftop solar, as well as building occupancy types such as restaurants, grocery stores and even unoccupied buildings, based solely on whole-building interval data. We then combined the load shape-based clusters with other customer information including building type, climate, geographical area, total consumption and low-income status, to create a set of customer clusters based on both demographics and usage patterns. Total cluster electricity demand was then disaggregated into a wide variety of end-uses using weather normalization and other publicly available end-use load shape datasets. The resulting disaggregated cluster load shapes will be released in anonymized form as part of the Phase 4 DR Potential Study. They will have wide-ranging applications in energy research and policy analysis, including estimation of energy efficiency (EE) and DR potential on the end-use level, time-dependent valuation of EE savings, building stock modeling, and developing customer targeting strategies for EE and DR programs.

Murthy, Samanvitha↗
DOE OSTI2020

Phased: Phase-Aware Submodularity-Based Energy Disaggregation

Energy disaggregation is the task of discerning the energy consumption of individual appliances from aggregated measurements, which holds promise for understanding and reducing energy usage. In this paper, we propose PHASED, an optimization approach for energy disaggregation that has two key features: PHASED (i) exploits the structure of power distribution systems to make use of readily available measurements that are neglected by existing methods, and (ii) poses the problem as a minimization of a difference of sub-modular functions. We leverage this form by applying a discrete optimization variant of the majorization-minimization algorithm to iteratively minimize a sequence of global upper bounds of the cost function to obtain high-quality approximate solutions. PHASED improves the disaggregation accuracy of state-of-the-art models by up to 61% and achieves better prediction on heavy load appliances.

ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATION↗
DOE OSTI2020

Joint Estimation of Behind-the-Meter Solar Generation in a Community

Distribution grid planning, control, and optimization require accurate estimation of solar photovoltaic (PV) generation and electric load in the system. Most of the small residential solar PV systems are installed behind-the-meter making only the net load readings available to the utilities. This paper presents an unsupervised framework for joint disaggregation of the net load readings of a group of customers into the solar PV generation and electric load. Our algorithm synergistically combines a physical PV system performance model for individual solar PV generation estimation with a statistical model for joint load estimation. The electric loads for a group of customers are estimated jointly by a mixed hidden Markov model (MHMM) which enables modeling the general load consumption behavior present in all customers while acknowledging the individual differences. At the same time, the model can capture the change in load patterns over a time period by the hidden Markov states. The proposed algorithm is also capable of estimating the key technical parameters of the solar PV systems. Our proposed method is evaluated using the net load, electric load, and solar PV generation data gathered from residential customers located in Austin, Texas. Testing results show that our proposed method reduces the mean squared error of state-of-the-art net-load disaggregation algorithms by 67%.

behind-the-meter solar generation↗
DOE OSTI2024

Bilevel Nodal Behind-the-meter Solar Disaggregation Under Unexpected Extreme Weather Conditions

As the power grid undergoes significant paradigm shift due to the increasing penetration of renewable generation, the ever-growing installation of behind-the-meter (BTM) solar generation in the power grid also has a significant impact on nodal loads, posing challenges on transmission operators. Furthermore, increasing frequent and severe extreme weather events intertwine with ubiquitous BTM solar generations and have amplified the challenges of accurately model nodal load profiles, especially under the lack of ground-truth information for verification. To tackle these challenges, this paper introduces a bilevel model that utilizes year-long data (e.g., proxy solar, zonal load, and individual node load profiles) to disaggregate metered profiles into actual demand and BTM solar generation at each transmission node. The proxy solar not only scales the BTM solar generation of individual nodes but also create a compensation term for enhancing performance on days with unexpected extreme weather events. The proposed algorithm is validated with real-world PJM Interconnection data during unexpected events like the recent Winter Storm Elliott. For quantitative evaluations, a novel Score error is introduced, which is based on mean percentages and load scales and offers a universal assessment method suitable for all nodes and different data formats (e.g., normalized or raw values).

behind-the-meter solar, load disaggregations, load↗
DOE OSTI2020

A Deep Generative Model for Non-Intrusive Identification of EV Charging Profiles

The proliferation of electric vehicles (EVs) brings environmental benefits and technical challenges to power grids. An identification algorithm which can accurately extract individual EV charging profiles out of widely available smart meter measurements has attracted great interests. This paper proposes a non-intrusive identification framework for EV charging profile extraction, which is driven by deep generative models (DGM). First, the proposed DGM is designed as a representation layer embedded into the Markov process and used to model the joint probability distribution of available time-series data. A novel contribution is to approximate posterior distributions by neural networks whose parameters are obtained by variational inference and supervised learning. Second, the EV charging status is inferred from the DGM via dynamic programming. Lastly, the desired EV charging profile can be reconstructed by the rated power of EV models and inferred status. Compared with the benchmark Hidden Markov Models, the proposed framework can better handle noise in data with less computational complexity and better overall accuracy performances with smaller recall. The proposed framework is validated by numerical experiments on the Pecan Street dataset.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2023

County-level assessment of behind-the-meter solar and storage to mitigate long duration power interruptions for residential customers

Customer concerns over electric system resilience could drive early adoption of behind-the-meter solar-plus-storage (BTM PVESS), especially as wildfire, hurricane, and other climate-driven risks to electric grids become more pronounced. However, the resilience benefits of BTM PVESS are poorly understood, especially for residential customers, owing to lack of data and methodological challenges, making it difficult to forecast adoption trends. In this paper, we develop a methodology to model the performance of BTM PVESS in providing backup power across a wide range of customer types, geography / climate conditions, and long duration power interruption scenarios, considering both whole-building backup and backup of specific critical loads. We combine novel, disaggregated end-use load profiles across the continental United States with temporally and geospatially aligned solar generation estimates. We then implement a PVESS dispatch algorithm to calculate the amount of load served during interruptions. We find that PVESS with 10 kWh of storage can meet a limited set of critical loads in most United States counties during any month of the year, though this capability drops to meeting only 86% of critical load, averaged across all counties and months, when heating and cooling are considered critical. Backup performance is lowest in winter months where electric heat is common (southeast and northwest U.S.) and in summer months in places with large cooling loads (southwest and southeast U.S.). Winter backup performance varies by roughly 20% depending on infiltration rates, while summer performance varies by close to 15% depending on the efficiency of the central air-conditioning system. Differences in temperature set-points in Harris County correspond to a 40% range in winter backup performance and a 20% range in summer performance. Economic calculations show that a customer’s resilience value of PVESS must be high to motivate adoption of these systems.

14 SOLAR ENERGY↗
DOE OSTI2020

Non-Intrusive Appliance Identification with Appliance-Specific Networks

The problem of noninstrusive load monitoring (NILM) is usually formulated as a single-channel blind source separation task, whose successful solution enable fast and convenient load identification and energy disaggregation. When applied at test time, NILM algorithms aim to identify the operating characteristics of individual appliances from an aggregate power measurement of the entire house. Recent advances in deep learning gave rise to many methods that mostly focus on learning a direct mapping from aggregate measurement to individual appliance power. However, these methods are not only computationally expensive, but they often suffer from overfitting and do not generalize very well. In this article, we propose a novel NILM method that leverages advances in statistical learning that have not been properly applied in this domain before. The proposed method consists of three stages: first, a Bayesian nonparametric learning-based approach for appliance state extraction; second, synthetic minority oversampling technique for data augmentation and mitigating the heavy imbalance in switching events; and third, appliance-specific lightweight long short-term memory networks for status classification for each appliance. Here, we adopt a “differential” input (the difference before and after the switching event) to reduce the complexity of network training and make the proposed method robust to multiappliance switching events. Experiments are conducted to demonstrate the effectiveness of the proposed method, achieving superior performance when compared to recent methods. An ablation study is conducted to demonstrate the effectiveness of each module of our method. Finally, we investigate the quality of generated synthetic samples.

42 ENGINEERING↗
DOE OSTI2026

Leveraging reVeal for Data Center Siting [Slides]

reVeal (the reV Extension for Analyzing Loads) is an open-source, flexible geospatial platform designed to characterize site suitability, with the goal of informing spatial downscaling and disaggregation of large-scale load projections.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2020

Bayesian Structural Time Series for Behind-the-Meter Photovoltaic Disaggregation: Preprint

Distributed photovoltaic (PV) generation often occurs ``behind the meter": a grid operator can only observe the net load, which is the sum of the gross load and distributed PV generation. This lack of observability poses a challenge to system operation at both bulk level and distribution level. The lack of real-time or near-future disaggregated estimates of gross load and PV generation will lead to over scheduling of energy production and regulation reserves, reliability constraints violations, wear and tear of controller devices, and potentially cascading failures of a system. In this paper we propose the use of a Bayesian Structural Time Series (BSTS) model with local solar irradiance measurements to disaggregate the summed PV generation and gross load signals at a downstream measurement site. BSTSs are a highly expressive model class that blends classic time series models with the powerful Bayesian state space estimation framework. Disaggregation is done probabilistically, which automatically quantifies the uncertainties of the estimated PV generation and gross load consumption. Depending on the data availability in real-time, it can be used to disaggragate PV and gross load at customer site, or can be used at the feeder level. In this paper, we focus on solving the problem at feeder level. We compare the performance of a BSTS model as well as a handful of state-of-the-art methods on a Pecan Street AMI dataset, using the National Solar Radiation Database (NSRDB) to estimate local irradiance.

Bayesian structural time series↗
DOE OSTI2020

Bayesian Structural Time Series for Behind-the-Meter Photovoltaic Disaggregation

Distributed photovoltaic (PV) generation often occurs ``behind the meter": a grid operator can only observe the net load, which is the sum of the gross load and distributed PV generation. This lack of observability poses a challenge to system operation at both bulk level and distribution level. The lack of real-time or near-future disaggregated estimates of gross load and PV generation will lead to over scheduling of energy production and regulation reserves, reliability constraints violations, wear and tear of controller devices, and potentially cascading failures of a system. In this paper we propose the use of a Bayesian Structural Time Series (BSTS) model with local solar irradiance measurements to disaggregate the summed PV generation and gross load signals at a downstream measurement site. BSTSs are a highly expressive model class that blends classic time series models with the powerful Bayesian state space estimation framework. Disaggregation is done probabilistically, which automatically quantifies the uncertainties of the estimated PV generation and gross load consumption. Depending on the data availability in real-time, it can be used to disaggragate PV and gross load at customer site, or can be used at the feeder level. In this paper, we focus on solving the problem at feeder level. We compare the performance of a BSTS model as well as a handful of state-of-the-art methods on a Pecan Street AMI dataset, using the National Solar Radiation Database (NSRDB) to estimate local irradiance.

bayesian structural time series↗
DOE OSTI2024

Occupant-driven end use load models for demand response and flexibility service participation of residential grid-interactive buildings

As demand response becomes increasingly used as a tool to support improved grid flexibility, it is important to consider that there are many potential types of energy end uses that may be used to support such flexibility. Residential appliances, often accounting for 30 % or more of residential energy use, are a currently untapped source of demand flexibility, particularly when aggregated together across homes. To date there has been very limited analysis of residential appliances for use as grid-interactive loads. As such, this research uses disaggregated energy end use data for 564 households, to model the electricity demand flexibility potential of the use of residential dishwashers, clothes washers, clothes dryers, ovens, and ranges (oven + stovetop) on both weekdays and weekends. This includes both at the building level, as well as aggregated to the grid level, specifically the Midcontinent Independent System Operator (MISO) region. This study was divided into two parts. Part 1 focuses on determining appliance-level loads, and Part 2, which involves aggregation to the grid. Findings suggest that among the studied appliances, clothes dryers provide the greatest demand reduction potential for most times of the day, followed by dishwashers and clothes washers. The maximum potential reduction for clothes dryers is found to be approximately at 11:00 a.m. and this potential sustains throughout most of the daytime period. When considering the willingness of households to participate, based on a survey of households in the Midwest region, clothes dryers still have the most potential for demand reduction. The availability of appliances for load modulation on weekdays and weekends indicates similar load reduction potential for all appliances. Overall, the results of this study suggest that there is an opportunity for shifting appliance usage to optimize grid efficiency and enhance demand response strategies.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Disaggregating Customer-Level Behind-the-Meter PV Generation Using Smart Meter Data and Solar Exemplars

Customer-level rooftop photovoltaic (PV) has been widely integrated into distribution systems. In most cases, PVs are installed behind-the-meter (BTM), and only the net demand is recorded. Therefore, the native demand and PV generation are unknown to utilities. Separating native demand and solar generation from net demand is critical for improving grid-edge observability. In this paper, a novel approach is proposed for disaggregating customer-level BTM PV generation using low-resolution but widely available hourly smart meter data. The proposed approach exploits the strong correlation between monthly nocturnal and diurnal native demands and the high similarity among PV generation profiles. First, a joint probability density function (PDF) of monthly nocturnal and diurnal native demands is constructed for customers without PVs, using Gaussian mixture modeling (GMM). Deviation from the constructed PDF is utilized to probabilistically assess the monthly solar generation of customers with PVs. Then, to identify hourly BTM solar generation for these customers, their estimated monthly solar generation is decomposed into an hourly timescale; to do this, we have proposed a maximum likelihood estimation (MLE)-based technique that utilizes hourly typical solar exemplars. Leveraging the strong monthly native demand correlation and high PV generation similarity enhances our approach's robustness against the volatility of customers’ hourly load and enables highly-accurate disaggregation. Furthermore, the proposed approach has been verified using real native demand and PV generation data.

14 SOLAR ENERGY↗
DOE OSTI2020

Network-Cognizant Time-Coupled Aggregate Flexibility of Distribution Systems Under Uncertainties

Increasing integration of distributed energy resources (DERs) within distribution feeders provides unprecedented flexibility at the distribution-transmission interconnection. To exploit this flexibility and to use the capacity potential of aggregate DERs, feasible substation power injection trajectories need to be efficiently characterized. This paper provides an ellipsoidal inner approximation of the set of feasible power injection trajectories at the substation such that for any point in the set, there exists a feasible disaggregation strategy of DERs for any load uncertainty realization. The problem is formulated as one of finding the robust maximum volume ellipsoid inside the flexibility region under uncertainty. Though the problem is NP-hard even in the deterministic case, this paper derives novel approximations of the resulting adaptive robust optimization problem based on optimal second-stage policies. The proposed approach yields less conservative flexibility characterization than existing flexibility region approximation formulations. The efficacy of the proposed method is demonstrated on a realistic distribution feeder.

adaptive robust optimization↗
DOE OSTI2021

Network-Cognizant Time-Coupled Aggregate Flexibility of Distribution Systems Under Uncertainties

Increasing integration of distributed energy resources (DERs) within distribution feeders provides unprecedented flexibility at the distribution-transmission interconnection. To exploit this flexibility and to use the capacity potential of aggregate DERs, feasible substation power injection trajectories need to be efficiently characterized. This paper provides an ellipsoidal inner approximation of the set of feasible power injection trajectories at the substation such that for any point in the set, there exists a feasible disaggregation strategy of DERs for any load uncertainty realization. The problem is formulated as one of finding the robust maximum volume ellipsoid inside the flexibility region under uncertainty. Though the problem is NP-hard even in the deterministic case, this paper derives novel approximations of the resulting adaptive robust optimization problem based on optimal second-stage policies. The proposed approach yields less conservative flexibility characterization than existing flexibility region approximation formulations. The efficacy of the proposed method is demonstrated on a realistic distribution feeder.

aggregates↗
DOE OSTI2022

A Data-Driven Democratized Control Architecture for Regional Transmission Operators

As probably the most complicated and critical infrastructure system, U.S. power grids become increasingly vulnerable to extreme events such as cyber-attacks and severe weather, as well as higher DER penetrations and growing information mismatch among system operators, utilities (transmission or generation owners), and end-users. This paper proposes a data-driven democratized control architecture considering two democratization pathways to assist transmission system operators, with a targeted use case of developing online proactive islanding strategies. Detailed discussions on load capability profiling at transmission buses and disaggregation of DER generations are provided and illustrated with real-world utility data. By Combining network and operational constraints, transmission system operators can be equipped with new tools built on top of this architecture, to derive accurate, proactive, and strategic islanding decisions to incorporate the wide range of dynamic portfolios and needs when facing extreme events or unseen grid contingencies.

Power System Reliability, Islanding, Democratized ↗
DOE OSTI2020

Comparison of time-frequency-analysis techniques applied in building energy data noise cancellation for building load forecasting: A real-building case study

Time-frequency analysis that disaggregates a signal in both time and frequency domain is an important supporting technique for building energy analysis such as noise cancellation in data-driven building load forecasting. There is a gap in the literature related to comparing various time–frequency-analysis techniques, especially discrete wavelet transform (DWT) and empirical mode decomposition (EMD), to guide the selection and tuning of time–frequency-analysis techniques in data-driven building load forecasting. This article provides a framework to conduct a comprehensive comparison among thirteen DWT/EMD techniques with various parameters in a load forecasting modeling task. A real campus building is used as a case study for illustration. The DWT and EMD techniques are also compared under various data-driven modeling algorithms for building load forecasting. The results in the case study show that the load forecasting models trained with noise-cancelled energy data have increased their accuracy to 9.6% on average tested under unseen data. This study also shows that the effectiveness of DWT/EMD techniques depends on the data-driven algorithms used for load forecasting modeling and the training data. Hence, DWT/EMD-based noise cancellation needs customized selection and tuning to optimize their performance for data-driven building load forecasting modeling.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Probabilistic analysis of masked loads with aggregated photovoltaic production

In this paper we present a probabilistic analysis framework to estimate behind-the-meter photovoltaic generation in real time. We develop a forward model consisting of a spatiotemporal stochastic process that represents the photovoltaic generation and a stochastic differential equation with jumps that represents the demand. Here, we employ this model to disaggregate the behind-the-meter photovoltaic generation using net load and irradiance measurements.

14 SOLAR ENERGY↗