Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “scalability test”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
NASA NTRS2013

Development and Testing of a Variable Conductance Thermal Acquisition, Transport, and Switching System

This paper describes the development and testing of a scalable thermal management architecture for instruments, subsystems, or systems that must operate in severe space environments with wide variations in sink temperature. The architecture involves a serial linkage of one or more hot-side variable conductance heat pipes (VCHPs) to one or more cold-side loop heat pipes (LHPs). The VCHPs provide wide area heat acquisition, limited distance thermal transport, modest against gravity pumping, concentrated LHP startup heating, and high switching ratio variable conductance operation. The LHPs provide localized heat acquisition, long distance thermal transport, significant against gravity pumping, and high switching ratio variable conductance operation. The single-VCHP, single-LHP system described herein was developed to maintain thermal control of a small robotic lunar lander throughout the lunar day-night thermal cycle. It is also applicable to other variable heat rejection space missions in severe environments. Operationally, despite a 60-70% gas blocked VCHP condenser during ON testing, the system was still able to provide 2-4 W/K ON conductance, 0.01 W/K OFF conductance, and an end-to-end switching ratio of 200-400. The paper provides a detailed analysis of VCHP condenser performance, which quantified the gas blockage situation. Future multi-VCHP/multi-LHP thermal management system concepts that provide power/transport length scalability are also discussed.

Bugby, David C.↗
NASA NTRS2013

Development and Testing of a Variable Conductance Thermal Acquisition, Transport, and Switching System

This paper describes the development and testing of a scalable thermal control architecture for instruments, subsystems, or systems that must operate in severe space environments with wide variations in sink temperature. The architecture is comprised by linking one or more hot-side variable conductance heat pipes (VCHPs) in series with one or more cold-side loop heat pipes (LHPs). The VCHPs provide wide area heat acquisition, limited distance thermal transport, modest against gravity pumping, concentrated LHP startup heating, and high switching ratio variable conductance operation. The LHPs provide localized heat acquisition, long distance thermal transport, significant against gravity pumping, and high switching ratio variable conductance operation. Combining two variable conductance devices in series ensures very high switching ratio isolation from severe environments like the Earth's moon, where each lunar day spans 15 Earth days (270 K sink, with a surface-shielded/space viewing radiator) and each lunar night spans 15 Earth days (80-100 K radiative sink, depending on location). The single VCHP-single LHP system described herein was developed to maintain thermal control of International Lunar Network (ILN) anchor node lander electronics, but it is also applicable to other variable heat rejection space missions in severe environments. The LHPVCHP system utilizes a stainless steel wire mesh wick ammonia VCHP, a Teflon wick propylene LHP, a pair of one-third square meter high  radiators (one capillary-pumped horizontal radiator and a second gravity-fed vertical radiator), a half-meter of transport distance, and a wick-bearing co-located flow regulator (CLFR) to allow operation with a hot (deactivated) radiator. The VCHP was designed with a small reservoir formed by extending the length of its stainless steel heat pipe tubing. The system was able to provide end-to-end switching ratios of 300-500 during thermal vacuum testing at ATK, including 3-5 W/K ON conductance and 0.01 W/K OFF conductance. The test results described herein also include an in-depth analysis of VCHP condenser performance to explain VCHP switching operation in detail. Future multi-VCHP/multi-LHP thermal management system concepts that provide scalability to higher powers/longer transport lengths are also discussed in the paper.

Bugby, D. C.↗
DOE OSTI2021

Quantum-assisted associative adversarial network: applying quantum annealing in deep learning

Abstract Generative models have the capacity to model and generate new examples from a dataset and have an increasingly diverse set of applications driven by commercial and academic interest. In this work, we present an algorithm for learning a latent variable generative model via generative adversarial learning where the canonical uniform noise input is replaced by samples from a graphical model. This graphical model is learned by a Boltzmann machine which learns low-dimensional feature representation of data extracted by the discriminator. A quantum processor can be used to sample from the model to train the Boltzmann machine. This novel hybrid quantum-classical algorithm joins a growing family of algorithms that use a quantum processor sampling subroutine in deep learning, and provides a scalable framework to test the advantages of quantum-assisted learning. For the latent space model, fully connected, symmetric bipartite and Chimera graph topologies are compared on a reduced stochastically binarized MNIST dataset, for both classical and quantum sampling methods. The quantum-assisted associative adversarial network successfully learns a generative model of the MNIST dataset for all topologies. Evaluated using the Fréchet inception distance and inception score, the quantum and classical versions of the algorithm are found to have equivalent performance for learning an implicit generative model of the MNIST dataset. Classical sampling is used to demonstrate the algorithm on the LSUN bedrooms dataset, indicating scalability to larger and color datasets. Though the quantum processor used here is a quantum annealer, the algorithm is general enough such that any quantum processor, such as gate model quantum computers, may be substituted as a sampler.

Wilson, Max (ORCID:0000000207983391)↗
DOE OSTI2022

System Integration of Rationally Designed Dilute Alloy Catalysts for Energy-Efficient Electrochemical CO 2 -To-Fuel Conversion

Energy effiecient electrochemical conversion of CO 2 to high-demand chemicals and transportation fuels using renewable solar and wind energy is a key technology needed for a high-productivity, low-carbon future. However, the development of scalable, low-cost, active, selective, and stable electrocatalysts remains a key challenge that needs to be overcome to enable high-volume conversion of CO 2 to feedstock chemicals for the chemical industry. In previous work, Lawrence Livermore National Laboratory (LLNL) has developed a rational design platform for dilute alloy transition metal electrocatalysts that promise to make electrochemical CO 2 conversion more energy efficient and selective. In this project, we worked with our industrial partners, Twelve and TotalEnergies, to improve scale up, integration, and stability of LLNL’s dilute alloy catalyst technology into an industry-relevant zero gap electrolyzer platform. Through virtual experiments and data analysis, we designed efficient and cost-effective copper-based catalysts. The catalyst was specifically designed to streamline the slowest and most energy-intensive step of the electrochemical chemical transformation of CO 2 to multi-carbon products – that is making the carbon-carbon bond by dimerization of the reaction intermediate carbon monoxide - resulting in up to 10% improvement in energy efficiency for C 2 products while simultaneously increasing the selectivity towards C 2 products. We tested two different scalable catalyst coating technologies and down-selected magnetron sputtering as the technique that provided the best control over catalyst loading, composition, and morphology. Using this technology, we successfully demonstrated integration of our dilute alloy catalysts into a 100 cm 2 electrolyzer platform with Faradaic efficiencies for ethylene production reaching 40% at a current density of 200 mA/cm 2 . We also developed the technology to integrate a well-defined nanoscale porosity by depositing alloy compositions that were compatible with dealloying, that is, selective leaching of an alloy component to generate nanoscale porosity. We observed that integration of the dealloying-derived nanoporosity improved catalyst performance and stability by leading to a more hydrophobic catalyst/anion exchange membrane interface. Unsolved problems that still need to be addressed are corrosion of the Cu catalyst -specifically if the used catalyst is exposed to air - as well as long term stability do to salt formation/deposition and flooding of the catalyst/electrolyzer flow channels, especially at higher current densities. As we only worked on optimization of catalyst composition, coating thickness, and morphology, further performance optimization will require a system level approach that includes optimization of electrolyzer design and membrane technology.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Solution synthesis of two-dimensional zinc oxide (ZnO)/molybdenum disulfide (MoS 2 ) heterostructure through reactive templating for enhanced visible-light degradation of rhodamine B

Numerous inorganic materials have been identified as potential candidates for high-performance photocatalysts. However, their solar-to-energy conversion efficiencies still fail to meet commercial requirements. Here, the main hurdle is the rapid recombination of photoexcited electrons and holes in single-phase materials. A viable predicted approach to suppress charge recombination is coupling two materials to form a two-dimensional (2D) heterostructure that physically separates photoinduced electrons and holes in different layers. In this work, the heterostructure-based paradigm was tested and a scalable solution synthesis of epitaxial ZnO-MoS 2 heterostructure was developed. A 2D ZnO-MoS 2 heterostructure was synthesized under hydrothermal conditions by stabilizing intermediate Zn-hydroxide states on a functionalized MoS 2 surface. Detailed characterization showed the formation of multilayer heterostructure with MoS 2 flakes intercalated between large size ZnO plates. The performance of this heterostructure was evaluated using photocatalytic degradation of rhodamine B. A degradation efficiency of 70% was measured within 90 minutes of visible-light irradiation, almost doubling the efficiency of the corresponding single-phase materials or their physical mixtures.

2D heterostructure↗
DOE OSTI2026

Accelerating Bilevel Optimization With Hierarchical Many-Threaded Parallel Differential Evolution

Bilevel optimization is encountered in many relevant real-world applications. The main feature of this type of problem is that an upper-level optimization problem is constrained by a nested lower-level optimization problem. Because of this nested structure, bilevel problems (BLPs) are usually computationally expensive to solve. Differential evolution (DE) has demonstrated promising results in solving BLPs of relatively small scales. As the problem scale increases, the decision space becomes intrinsically larger, requiring a growing number of function evaluations for the method to work properly. In this context, heavy parallelization and high-performance computing techniques are indispensable to enable the resolution of more complex and challenging optimization problems. Hence, we propose a hierarchical many-threaded parallel DE approach for BLPs, where both levels are parallelized. The computational experiments demonstrate that the parallel implementation achieved runtime speeds ranging from 44 to 2559 times faster than the sequential version on a well-known scalable SMD benchmark test problem when executed on an NVIDIA A100 GPU. The findings indicate that the algorithm’s convergence is strongly influenced by the number of both upper- and lower-level generations. Moreover, the success of experiments with large-scale problems is closely linked to the choice of small population sizes.

Dufek, Amanda S↗
DOE OSTI2021

Seamless Hybrid-integrated Interconnect NEtwork (SHINE)

Large-scale date centers are becoming increasingly limited by the capacity of interconnects due to the rapid increasing power consumption and bandwidth demands driven by the rigorous down scaling of CMOS critical dimensions in according with the Moore’s Law. As a result of the continuing bandwidth scaling, optical interconnects based on parallel optics, where data are simultaneously transmitted along more than one lane, have becoming a preferred interconnected solution over copper cables. To building an efficient optical interconnect system, optical coupling between different elements, such as optical fibers, photonics chips, is a critical step, which is challenging due to the mode mismatch of varies optical ports. In this project, we proposed and demonstrated an optical interfacing scheme, which provided a light coupling approach with low energy loss, broadband operation, high alignment tolerance and compatible with scalable fabrication and testing. Here, the mode transformation is achieved by a total internal reflection from a chip integrated microscale freefrom surface. Due to the enormous light wavefront manipulating ability associated with the gigantic design space, the freeform couplers platform is universally applicable to a wide range of optical coupling scenarios, such as the interfacing between a waveguide to a fiber, another waveguide, surface normal device, or free space.

42 ENGINEERING↗
NASA NTRS2005

Fabrication and Deployment Testing of Solar Sail Quadrants for a 20-Meter Solar Sail Ground Test System Demonstration

A 20-meter Scalable Square Solar Sail (S(sup 4)) System was produced and successfully completed functional vacuum testing in NASA Glenn's Space Power Facility at Plum Brook Station Ohio in May 2005. The S(sup 4) system was designed and developed by ATK Space Systems, and the design and production of the Solar Sails for this system was carried out by SRS Technologies. The S(sup 4) system consists of a central structure with four deployable carbon fiber masts that support four triangular sails. SRS has developed an effective and efficient design for triangular sail quadrants that are supported at three points and provide a flat reflective surface with a high fill factor. This sail design is robust enough for deployments in a one atmosphere, one gravity environment and incorporates several advanced features including adhesiveless seaming of membrane strips, compliant edge borders to allow for film membrane cord strain mismatch without causing wrinkling and low mass (3% of total sail mass) ripstop. This paper will outline some of the sail design and fabrication processes and the mature production, packaging and deployment processes that have been developed. This paper will also detail the successful ambient and vacuum testing of the sails and the ATK spacecraft structure. Based on recent experience and testing, SRS is confidant that high Technology Readiness Level (TRL) 5-6 solar sails in the 40-120-meter size range with areal density in the 4-5 grams per square meters (sail minus structure) range can be produced with existing technology. Additional film production research will lead to further reductions in film thickness to less than 1 micron enabling production of sails with areal densities as low as 2.0 grams per square meters using the current design, resulting in a system areal densities as low as 5.3 grams per square meters (sail and structure). These areal densities are low enough to allow nearly all of the Solar Sail missions that have been proposed by the scientific community. The fundamental technologies required to produce these systems has been demonstrated on the 20-meter S(sup 4) sails that have recently completed ground testing demonstrating a mature and technology suitable for incorporation into future flight validation and future mission. Solar Sails can support NASA's Vision for Space Exploration by allowing communication satellite orbits that can maintain continuous communication with the polar regions of the Moon and Mars and to support solar weather monitoring to provide early warning of solar flares and storms that could threaten the safety of astronauts and other spacecraft.

Laue, Greg↗
NASA NTRS2012

Nuclear Thermal Rocket (Ntr) Propulsion: A Proven Game-Changing Technology for Future Human Exploration Missions

The NTR represents the next evolutionary step in high performance rocket propulsion. It generates high thrust and has a specific impulse (Isp) of approx.900 seconds (s) or more V twice that of today s best chemical rockets. The technology is also proven. During the previous Rover and NERVA (Nuclear Engine for Rocket Vehicle Applications) nuclear rocket programs, 20 rocket reactors were designed, built and ground tested. These tests demonstrated: (1) a wide range of thrust; (2) high temperature carbide-based nuclear fuel; (3) sustained engine operation; (4) accumulated lifetime; and (5) restart capability V all the requirements needed for a human mission to Mars. Ceramic metal cermet fuel was also pursued, as a backup option. The NTR also has significant growth and evolution potential. Configured as a bimodal system, it can generate electrical power for the spacecraft. Adding an oxygen afterburner nozzle introduces a variable thrust and Isp capability and allows bipropellant operation. In NASA s recent Mars Design Reference Architecture (DRA) 5.0 study, the NTR was selected as the preferred propulsion option because of its proven technology, higher performance, lower launch mass, simple assembly and mission operations. In contrast to other advanced propulsion options, NTP requires no large technology scale-ups. In fact, the smallest engine tested during the Rover program V the 25,000 lbf (25 klbf) Pewee engine is sufficient for human Mars missions when used in a clustered engine arrangement. The Copernicus crewed spacecraft design developed in DRA 5.0 has significant capability and a human exploration strategy is outlined here that uses Copernicus and its key components for precursor near Earth asteroid (NEA) and Mars orbital missions prior to a Mars landing mission. Initially, the basic Copernicus vehicle can enable reusable 1-year round trip human missions to candidate NEAs like 1991 JW and Apophis in the late 2020 s to check out vehicle systems. Afterwards, the Copernicus spacecraft and its 2 key components, now configured as an Earth Return Vehicle / propellant tanker, would be used for a short round trip (approx.18 - 20 months)/short orbital stay (60 days) Mars / Phobos survey mission in 2033 using a split mission approach. The paper also discusses NASA s current Foundational Technology Development activities and its pre-decisional plans for future system-level Technology Demonstrations that include ground testing a small (approx.7.5 klbf) scalable NTR before the decade is out with a flight test shortly thereafter.

Borowski, Stanley K.↗
NASA NTRS2018

Streamlining Ground Station Network Compatibility Test for Small Satellites

A team of eight subject matter experts at NASA Goddard Space Flight Center (GSFC) completed a Lean Six Sigma project to identify process improvements for the compatibility test process for small satellites planning to use the NASA Near Earth Network (NEN). Ground station network compatibility testing is designed to reduce the risk to missions by resolving issues between the spacecraft's flight communication and navigation components and the ground systems prior to launch. Compatibility testing, which consists of a series of tests performed over a period of months and documented in reports, is an important step meant to prevent post-launch anomalies that could lead to expensive troubleshooting or mission failure. Compared to traditional missions, small satellite missions typically have a smaller budget and compressed schedules, which can result in small satellite projects' willingness to accept the risk associated with less comprehensive compatibility testing. Optimization and or refinement of the compatibility test process for small satellite missions could alleviate some of the pressures inherent with these factors. The goal of the Lean Six Sigma project was to develop alternative scalable methods of compatibility testing for small satellites. The Lean Six Sigma approach and the results of the project are reviewed in this paper.

Streamlining↗
NASA NTRS2010

Generating a Reduced Gravity Environment on Earth

Since the 1950s several reduced gravity simulators have been designed and utilized in preparing humans for spaceflight and in reduced gravity system development. The Active Response Gravity Offload System (ARGOS) is the newest and most realistic gravity offload simulator. ARGOS provides three degrees of motion within the test area and is scalable for full building deployment. The inertia of the overhead system is eliminated by an active motor and control system. This presentation will discuss what ARGOS is, how it functions, and the unique challenges of interfacing to the human. Test data and video for human and robotic systems will be presented. A major variable in the human machine interaction is the interface of ARGOS to the human. These challenges along with design solutions will be discussed.

Dungan, Larry K.↗
DOE OSTI2026

Scaling kinetic Monte-Carlo simulations of grain growth with combined convolutional and graph neural networks

Graph neural networks (GNN) have emerged as a promising machine learning method for microstructure simulations such as grain growth. However, accurate modeling of realistic grain boundary networks requires large simulation cells, which GNN has difficulty scaling up to. To alleviate the computational costs and memory footprint of GNN, we suggest a hybrid architecture combining a convolutional neural network (CNN) based bijective autoencoder to compress the spatial dimensions, and a GNN that evolves the microstructure in the latent space of reduced spatial sizes. Our results demonstrate that the new design significantly reduces computational costs with using fewer message passing layer (from 12 down to 3) compared with GNN alone. The reduction in computational cost becomes more pronounced as the spatial size increases, indicating strong computational scalability. For the largest mesh evaluated (160 3 ), our method reduces memory usage and runtime in inference by 117× and 115×, respectively, compared with GNN-only baseline. More importantly, it shows higher accuracy and stronger spatiotemporal capability than the GNN-only baseline, especially in long-term testing. Such combination of scalability and accuracy is essential for simulating realistic material microstructures over extended time scales. The improvements can be attributed to the bijective autoencoder’s ability to compress information losslessly from spatial domain into a high dimensional feature space, thereby producing more expressive latent features for the GNN to learn from, while also contributing its own spatiotemporal modeling capability. Training data are generated from stochastic grain growth simulations, providing realistic variability for learning robust microstructure evolution. Comprehensive system validation confirms that the model is accurate, robust, and scalable.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Market Barriers and Drivers for the Next Generation Fault Detection and Diagnostic Tools

Commercial buildings in the U.S. consume as much as 30% excess energy compared to buildings that operate fault free and efficiently. Fault detection and diagnostic (FDD) platforms help to continually identify operational inefficiencies and maintain low-carbon performance. However, the recommendations generated by FDD tools need to be implemented by technicians, resulting in delays or lost savings opportunities. Recent research advances showed fault AUTOcorrection integrating with commercial FDD offerings filled this gap. Seven innovative AUTOcorrection algorithms were integrated into two FDD platforms and deployed across four buildings. The enhanced tools successfully correct faults focusing on incorrectly programmed schedules, override not released, control hunting, rogue zone, and suboptimal setpoints. Although its technical efficacy has been proven in the field, fault AUTO-correction is still early in the deployment cycle and opportunities and barriers need to be understood to reach its full potential in market transformation. This paper broadly introduces the new technology that automatically corrects HVAC faults. The authors describe in detail technology potential, market barriers, and enablers for scalability based on field testing results and interviews with the FDD providers and facility managers. The interviewees agreed that AUTO-correction can reduce the extent to which savings are dependent upon human intervention, scale building operators’ ability to act on FDD findings (especially for facilities with small operation teams), and achieve significant savings. To enable scalable deployment, future efforts are needed to overcome the barriers such as cybersecurity and accountability concerns from building operators and standardization of control parameters used in building automation systems.

Pritoni, Marco↗
NASA NTRSDate not supplied

Alternative Setup for Long-Duration Low-Duty-Cycle 600°C Ambient Testing of SiC Integrated Circuits

A scalable, compact oven testbed system for simultaneously evaluating a multitude of high temperature integrated circuits (ICs) for prolonged operating times of up to 600 °C has been prototyped. The new testbed system enables long-duration high temperature testing in sufficient statistical quantities consistent with standard aerospace electronics engineering standards. This setup is comprised of multiple compact ovens housing chips or packages mounted to ceramic circuit boards. Each oven is a compact 15.2 cm length by 15.2 cm width by 12.7 cm depth with a maximum 400 Watts of heating power. The custom-made silicon oxide ceramic heating block inside each oven is based on a 3D printed design adapted for the easy insertion of the IC device under test (DUT). This innovative design provides the quick insertion of ICs with or without a ceramic package into a 600 °C environment by utilizing a movable 11.43 cm long ceramic substrate with electrical traces extending from the oven hot zone to external standard plastic-based board connectors. Another key oven design feature is the minimization of the DUT exposure to electromagnetic interference (EMI) by utilizing a filtered DC power source to reduce heating element noise. Additionally, the ovens can be configured in a parallel arrangement allowing global data monitoring over a single industrial RS422 serial port. This feature is important for scaling up to test multiple ICs semi-simultaneously. A USB serial port is provided to independently control the operating parameters of each oven such as the oven target temperature and oven ramp rate. The oven temperature can reach up to 600 °C with a confirmed +/- 4 °C maximum deviation across the test zone region. The ramp rate can be programmed from 1 °C/minute up to 10 °C/minute. Furthermore, a programmable switchboard is used to interface with the DUT. This switchboard comprises a National Instruments Peripheral Component Interconnect eXtension for Instrumentation (NI PXI) system and a breakout board to send and receive power, analog or digital test signals. By using this unique oven testbed system, a variety of ICs can now be tested in parallel using the same test components configured for a diverse set of requirements.

DC Powered Oven↗
NASA NTRS2008

Transmissive Diffractive Optical Element Solar Concentrators

Solar-thermal-radiation concentrators in the form of transmissive diffractive optical elements (DOEs) have been proposed as alternatives to mirror-type solar concentrators now in use. In comparison with functionally equivalent mirror-type solar concentrators, the transmissive, diffractive solar concentrators would weigh and cost less, and would be subject to relaxed mechanical tolerances. A DOE concentrator would be made from a thin, flat disk or membrane of a transmissive material having a suitable index of refraction. By virtue of its thinness, the DOE concentrator would have an areal mass density significantly less than that of a functionally equivalent conventional mirror. The DOE concentrator would have a relatively wide aperture--characterized by a focal-length/aperture-diameter ratio ('f number') on the order of 1. A kinoform (a surface-relief phase hologram) of high diffractive order would be microfabricated onto one face of the disk. The kinoform (see figure) would be designed to both diffract and refract incident solar radiation onto a desired focal region, without concern for forming an image of the Sun. The high diffractive order of this kinoform (in contradistinction to the low diffractive orders of some other kinoforms) would be necessary to obtain the desired f number of 1, which, in turn, would be necessary for obtaining a desired concentration ratio of 2,500 or greater. The design process of optimizing the concentration ratio of a proposed DOE solar concentrator includes computing convolutions of the optical bandwidth of the Sun with the optical transmission of the diffractive medium. Because, as in the cases of other non-imaging, light-concentrating optics, image quality is not a design requirement, the process also includes trading image quality against concentration ratio. A baseline design for one example calls for an aperture diameter of 1 m. This baseline design would be scalable to a diameter as large as 10 m, or to a smaller diameter for a laboratory test article. Initial calculations have indicated that the characteristics of the test article would be readily scalable to a full-size unit.

Baron, Richard↗
NASA NTRS2006

Validation of a Scalable Solar Sailcraft

The NASA In-Space Propulsion (ISP) program sponsored intensive solar sail technology and systems design, development, and hardware demonstration activities over the past 3 years. Efforts to validate a scalable solar sail system by functional demonstration in relevant environments, together with test-analysis correlation activities on a scalable solar sail system have recently been successfully completed. A review of the program, with descriptions of the design, results of testing, and analytical model validations of component and assembly functional, strength, stiffness, shape, and dynamic behavior are discussed. The scaled performance of the validated system is projected to demonstrate the applicability to flight demonstration and important NASA road-map missions.

Murphy, D. M.↗
DOE OSTI2022

Defining and applying an electricity demand flexibility benchmarking metrics framework for grid-interactive efficient commercial buildings

Building demand flexibility (DF) research has recently gained attention. To unlock building DF as a predictable grid resource, we must establish a quantitative understanding of the resource size, performance variability, and predictability based on large empirical datasets. Researchers have proposed various sets of theoretical metrics to measure this performance. Some metrics have been applied to simulation results, but most fall short of exploring the complexities in real building applications. There are practical metrics used in individual demand response field studies but they alone cannot fulfil the job of DF benchmarking across a diverse group of buildings. The electrical grid's geographically diverse and changing nature presents challenges to comparing building DF performance measured under different conditions (i.e., benchmarking DF). To address this challenge, a novel DF benchmarking framework focused on load shedding and shifting is presented; the foundation is a set of simple, proven single-event metrics with attributes describing event conditions. These enable benchmarking and visualization in different dimensions for identifying trends that represent how these attributes influence DF. To test its feasibility and scalability, the DF framework was applied to two case studies of 11 office buildings and 121 big-box retail buildings with demand response participation data. Furthermore, these examples provided a pathway for using both building level benchmarking and aggregation to extract insights into building DF about magnitude, consistency, and influential factors. Potential applications of the framework and real-world values have been identified for grid and building stakeholders.

24 POWER TRANSMISSION AND DISTRIBUTION↗