Engineering Papers⌕ Search

Engineering topics

Touzani, Samir

Publications and source records attributed to Touzani, Samir.

9 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Controlling distributed energy resources via deep reinforcement learning for load flexibility and energy efficiency

Behind-the-meter distributed energy resources (DERs), including building solar photovoltaic (PV) technology and electric battery storage, are increasingly being considered as solutions to support carbon reduction goals and increase grid reliability and resiliency. However, dynamic control of these resources in concert with traditional building loads, to effect efficiency and demand flexibility, is not yet commonplace in commercial control products. Traditional rule-based control algorithms do not offer integrated closed-loop control to optimize across systems, and most often, PV and battery systems are operated for energy arbitrage and demand charge management, and not for the provision of grid services. More advanced control approaches, such as MPC control have not been widely adopted in industry because they require significant expertise to develop and deploy. Recent advances in deep reinforcement learning (DRL) offer a promising option to optimize the operation of DER systems and building loads with reduced setup effort. However, there are limited studies that evaluate the efficacy of these methods to control multiple building subsystems simultaneously. Additionally, most of the research has been conducted in simulated environments as opposed to real buildings. This paper proposes a DRL approach that uses a deep deterministic policy gradient algorithm for integrated control of HVAC and electric battery storage systems in the presence of on-site PV generation. The DRL algorithm, trained on synthetic data, was deployed in a physical test building and evaluated against a baseline that uses the current best-in-class rule-based control strategies. Performance in delivering energy efficiency, load shift, and load shed was tested using price-based signals. The results showed that the DRL-based controller can produce cost savings of up to 39.6% as compared to the baseline controller, while maintaining similar thermal comfort in the building. The project team has also integrated the simulation components developed during this work as an OpenAIGym environment and made it publicly available so that prospective DRL researchers can leverage this environment to evaluate alternate DRL algorithms.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Open Data and Deep Semantic Segmentation for Automated Extraction of Building Footprints

Advances in machine learning and computer vision, combined with increased access to unstructured data (e.g., images and text), have created an opportunity for automated extraction of building characteristics, cost-effectively, and at scale. These characteristics are relevant to a variety of urban and energy applications, yet are time consuming and costly to acquire with today’s manual methods. Several recent research studies have shown that in comparison to more traditional methods that are based on features engineering approach, an end-to-end learning approach based on deep learning algorithms significantly improved the accuracy of automatic building footprint extraction from remote sensing images. However, these studies used limited benchmark datasets that have been carefully curated and labeled. How the accuracy of these deep learning-based approach holds when using less curated training data has not received enough attention. The aim of this work is to leverage the openly available data to automatically generate a larger training dataset with more variability in term of regions and type of cities, which can be used to build more accurate deep learning models. In contrast to most benchmark datasets, the gathered data have not been manually curated. Thus, the training dataset is not perfectly clean in terms of remote sensing images exactly matching the ground truth building’s foot-print. A workflow that includes data pre-processing, deep learning semantic segmentation modeling, and results post-processing is introduced and applied to a dataset that include remote sensing images from 15 cities and five counties from various region of the USA, which include 8,607,677 buildings. The accuracy of the proposed approach was measured on an out of sample testing dataset corresponding to 364,000 buildings from three USA cities. The results favorably compared to those obtained from Microsoft’s recently released US building footprint dataset.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Aerial 3D Building Reconstruction from Drone Imagery (A3DBR) v1

This toolkit is composed of several modules for extracting buildings geometrical and thermal characteristics from RGB and thermal imagery captured using a drone. - Building 3D reconstruction module: leverage a photogrammetry software to construct a 3D point cloud from RGB drone imagery, which is then used in conjunction with image processing and geometric methods to extract building footprint and building height (i.e., 3D model of the building). - Windows to wall ratio estimation module: leverage deep learning semantic segmentation modeling to detect windows on 2D drone RGB images. The detected windows are then projected onto the extracted building 3D model (using building 3D reconstruction module) and their area is computed to obtain window to wall ratio estimation. - Thermal anomalies detection module: leverage image processing and machine learning algorithm to detect on 2D drone thermal images potential thermal anomalies within building's facades and roofs.

Granderson, Jessica↗
DOE OSTI2021

FlexDRL v1.0

FlexDRL is a framework that can be used as a benchmarking tool to evaluate different Deep Reinforcement Learning algorithms in a building energy management setting. OpenAI Gym was used as wrapper to the co-simulation environment (EnergyPlus for envelope and HVAC and Modelica for battery and PV) to interface with DRL algorithms, which are developed in PyTorch. In order to facilitate the usage of FlexDRL, all the required dependencies have been packaged into a Docker container.

Touzani, Samir↗
DOE OSTI2020

Meter-Based Assessment of the Time and Locational Benefits of a Large Utility’s DSM Portfolio

As decarbonization goals drive increasing levels of renewable generation, there is a need to understand the time- and location-based savings benefits of demand-side management (DSM) programs. The challenges of the 'duck curve' are driving the utility industry to consider how programs can be optimized to match demand profiles with low carbon generation resources. From an infrastructure standpoint, time- and location-targeted DSM could serve as a ‘non-wires alternative’ (NWA) to defer equipment upgrades. Additional DSM value streams are motivating innovation in savings evaluation, providing more resolved insights beyond the total annual program impact. Methods grounded in the principles of billing analysis, leveraging hourly metering at the distribution grid, can provide new visibility into the spatial and temporal savings achieved through DSM. A large body of work has investigated related topics including interval meter-based savings analysis, the time- varying nature of efficiency measures, and NWA. A less studied topic concerns the impact of DSM on the grid, based on metered consumption. This paper presents an analysis of interval data across more than 25,000 customers and twelve substations, from the Sacramento Municipal Utility District. The results show for different locations on the grid: achieved savings and the impact on grid consumption; hourly savings shapes for DSM program participants and non-participants, and how those shapes vary with season; and the impact of the programs on peak demand. These findings show the current impact of DSM, with implications for future, more intentional targeting as the utility continues to pursue aggressive electrification, efficiency, load flexibility, and reliable NWA.

Granderson, Jessica↗
DOE OSTI2020

Deep Reinforcement Learning in Buildings: Implicit Assumptions and their Impact

As deep reinforcement learning (DRL) continues to gain interest in the smart building research community, there is a transition from simulation-based evaluations to deploying DRL control strategies in actual buildings. While the efficacy of a solution could depend on a particular implementation, there are common obstacles that developers have to overcome to deliver an effective controller. Additionally, a deployment in a physical building can invalidate some of the assumptions made during the controller development. Assumptions on the sensor placement or on the equipment behavior can quickly come undone. This paper presents some of the significant assumptions made during the development of DRL based controllers that could affect their operations in a physical building. Furthermore, a preliminary evaluation revealed that controllers developed with some of these assumptions can incur twice the expected costs when they are deployed in a building.

Prakash, Anand Krishnan↗
DOE OSTI2020

Machine Learning for Automated Extraction of Building Geometry

As data science comes to buildings, the promise of using machine learning and novel sources of data has received much attention. Advances in machine learning and computer vision algorithms, combined with increased access to unstructured data (e.g., images and text), have created an opportunity for automated extraction of building characteristics – cost-effectively, and at scale. Acquisition of features such as footprint are time consuming and costly to acquire with today’s manual methods, but can be streamlined through intelligent software-based solutions applied to satellite images. When combined with aerial RGB and thermal images, full 3D geometries and thermal maps can be constructed to determine additional characteristics such as window to wall ratio, height, number of stories and envelope thermal characteristics. In this paper we present three contributions to accelerate these high potential opportunities: (1) a methodical analysis of how these features can be integrated into today’s simulation and data driven software tools to enhance efficiency measure identification and owner/operator decision making; (2) development and accuracy testing of open source deep neural network methods to extract building footprints from satellite imagery, including the curation and application of openly available GIS datasets for training and continued development by others; and (3) an open framework for drone-based image capture and creation of 3D building geometries. This work represents an important bridge between high-level studies that span diverse application areas and those that detail point solutions yet cannot be easily replicated or extended.

Touzani, Samir↗
DOE OSTI2020

Spatio-temporal impacts of a utility’s efficiency portfolio on the distribution grid

Energy Efficiency has historically focused on delivering savings to offset growth in energy supply. Today’s growing emphasis on decarbonization of the energy supply is driving renewables adoption and increased interest in electrification. As a result, energy efficiency is being assessed not just in its ability to offset load growth, but also for its ability to alleviate location-specific constraints on transmission and distribution infrastructure. This work demonstrates that advanced measurement and verification modeling techniques can be used to estimate the spatio-temporal grid impact of a portfolio of energy efficiency programs. It extends measurement-based methods to an entire Demand Side Management portfolio and uses a single model to predict annual as well as seasonal building energy use with near-zero bias. In addition, new metrics are introduced to assess grid level impacts of energy efficiency. The results show that the efficiency program portfolio delivers savings of over 12% at the territory-wide proxy level, with substation and feeder level savings ranging from 0.4% to 26%, and ~5%-42% respectively. Overall, these savings impacted 1.0%–1.4% of the energy used at these locations in the grid. This work provides a methodology with potential to connect efficiency with distribution planning, carrying implications for non-wires alternatives and targeted delivery of efficiency programs.

24 POWER TRANSMISSION AND DISTRIBUTION↗