Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “automated verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

105 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Recognition Method of Vehicle Cluster Situation Based on Set Pair Logic considering Driver’s Cognition

The recognition of vehicle cluster situations is one of the critical technologies of advanced driving, such as intelligent driving and automated driving. The accurate recognition of vehicle cluster situations is helpful for behavior decision‐making safe and efficient. In order to accurately and objectively identify the vehicle cluster situation, a vehicle cluster situation model is proposed based on the interval number of set pair logic. The proposed model can express the traffic environment’s knowledge considering each vehicle’s characteristics, grouping relationships, and traffic flow characteristics in the target vehicle’s interest region. A recognition method of vehicle cluster situation is designed to infer the traffic environment and driving conditions based on the connection number of set pair logic. In the proposed model, the uncertainty of the driver’s cognition is fully considered. In the recognition method, the relative uncertainty and relative certainty of driver’s cognition, traffic information, and vehicle cluster situation are fully considered. The verification results show that the proposed recognition method of vehicle cluster situations can realize accurate and objective recognition. The proposed anthropomorphic recognition method could provide a basis for vehicle autonomous behavior decision‐making.

Liu, Shijie↗
DOE OSTI2021

Prognostics and Health Management in Nuclear Power Plants: An Updated Method-Centric Review With Special Focus on Data-Driven Methods

In a carbon-constrained world, future uses of nuclear power technologies can contribute to climate change mitigation as the installed electricity generating capacity and range of applications could be much greater and more diverse than with the current plants. To preserve the nuclear industry competitiveness in the global energy market, prognostics and health management (PHM) of plant assets is expected to be important for supporting and sustaining improvements in the economics associated with operating nuclear power plants (NPPs) while maintaining their high availability. Of interest are long-term operation of the legacy fleet to 80 years through subsequent license renewals and economic operation of new builds of either light water reactors or advanced reactor designs. Recent advances in data-driven analysis methods—largely represented by those in artificial intelligence and machine learning—have enhanced applications ranging from robust anomaly detection to automated control and autonomous operation of complex systems. The NPP equipment PHM is one area where the application of these algorithmic advances can significantly improve the ability to perform asset management. This paper provides an updated method-centric review of the full PHM suite in NPPs focusing on data-driven methods and advances since the last major survey article was published in 2015. The main approaches and the state of practice are described, including those for the tasks of data acquisition, condition monitoring, diagnostics, prognostics, and planning and decision-making. Research advances in non-nuclear power applications are also included to assess findings that may be applicable to the nuclear industry, along with the opportunities and challenges when adapting these developments to NPPs. Finally, this paper identifies key research needs in regard to data availability and quality, verification and validation, and uncertainty quantification.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

AToM: Advanced Tokamak Modeling Environment

Stability constraints play an important role in integrated modeling. The global plasma stability and macro-instabilities such as internal kink modes, neoclassical tearing modes, and edge localized perturbations limit the plasma performance and can result in large-scale transient events and plasma disruptions. These macro-instabilities can be also beneficial to the plasma performance. For example, the peeling models often lead to the edge localized modes (ELMs). However, the formation of stationary edge harmonic oscillations (EHOs) due to nonlinear interaction of peeling modes can result in a transition to the Quiescent H-mode (QH-mode) without ELMs. The profiles predicted with transport models need to be refined using the MHD stability constraints. This is important especially for transient and nonlinear stages of discharges such as ramp-up access to hybrid and steady state operation, and L- to H-mode transition as well as transition to the QH-mode. Several stability and MHD codes are already included in the OMFIT framework. These codes include BALOO, ELITE, GATO, M3DC1, MARS, and NIMROD. However, the verifications of stability constraints are currently mostly excluded from transport modeling workflows. The only exception is the EPED module which includes the ELITE predictions to limit the pedestal height. Here, we improved the OMFIT workflow to include stability calculations. Including the stability conditions to the integrated modeling workflow improved the robustness of the predictive modeling discharges. Being implemented in the workflow, the stability conditions can be also used for the stability analysis of experimental data. This improved the physics understanding of various discharge scenarios and can be used in experiment planning.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Robust Method to Identify Groundwater Affected By Redox Conditions at Los Alamos National Laboratory Legacy Cleanup Site - 20497

To facilitate the mission of the Department of Energy's (DoE's) Environmental Management Program at Los Alamos National Laboratory (LANL), a significant number of groundwater monitoring wells with depths ranging from 152-396 meter were completed for characterization and monitoring. Groundwater at Los Alamos tends to be oxygen saturated with very low concentrations of organic matter. Drilling fluids can introduce residual carbon causing an increase in microbial activity and local reducing conditions around the well, potentially impacting representativeness of groundwater data quality for redox sensitive constituents. We assert that the redox state of the wells can robustly be identified by aqueous solution concentrations of iron and manganese. An automated review process has been built into a computer-based data management system enabling an efficient screening process for identifying reducing conditions that are not caught using standard data-validation protocol, and ensures that important data quality issues are thoroughly identified and addressed in an efficient and timely manner. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2020

Detecting the undetected: Dealing with non-routine events using advanced M&V meter-based savings approaches

In a rapidly evolving energy industry, utilities are dealing with new challenges like integrating distributed energy resources and market saturation for advanced lighting retrofits. Demand-side management programs require new approaches to meet aggressive carbon reduction goals. Advanced measurement & verification (M&V) is an energy data analysis method using smart meter data in combination with analytics to quantify energy efficiency project savings. Advanced M&V shows great promise for supporting next generation commercial programs including retro commissioning, multi-measure retrofits, and behavior change programs. Advanced M&V captures real project impacts at the meter, but sometimes non-project events can also impact consumption (so-called “non-routine events” [NREs]). Accurately detecting and accounting for NREs is important for reducing uncertainty of savings estimates and helps manage investment risk for different stakeholders (e.g., utilities, building owners, ESCOs). Recent research has shown promise in establishing data-driven techniques to identify and adjust for NREs, but fundamental questions still remain, such as: how can you distinguish NREs from acceptable noise in energy consumption profiles? What is the frequency and magnitude of NREs? Can their detection and adjustment be automated and streamlined? This paper documents the state of the art in NRE quantification and analysis. The results of research to quantify the frequency, nature and direction of NREs, and methods and metrics for determining a trigger threshold for taking action on NREs are presented. The paper also documents the latest technical guidance on application of NRE detection and adjustment methods.

Fernandes, Samuel↗
DOE OSTI2020

Real-Time Federated Cyber-Transmission-Distribution Testbed Architecture for the Resiliency Analysis

With the ongoing automation driven by the push toward the smart electric grid and the advancement in associated cyber infrastructure, the interaction between physical [electric transmission and distribution (T&D) systems], cyber (communication, automation, and control), and human (grid operators and decision-makers) is increasingly becoming more complex. This creates the requirement of analyzing the effect of the transmission system on the distribution system and vice versa with consideration of the additional complexity of the cyber infrastructure. Such an integrated testbed will also help with resiliency analysis, where resiliency refers to the ability of the system to continue serving energy to the critical loads even with limited extreme contingencies. Interaction of the physical power grid with the cyber layer can be effectively modeled using real-time (RT) simulator for developing and validating various operational and control algorithms. Testbeds using RT simulators with multiple capabilities have been developed at different institutions. Still, no single existing testbed can offer full scalability while simultaneously meeting high fidelity requirements for resiliency experimentation. Co-simulating federated testbed assets can provide a scalable experimentation platform that can be leveraged for verification and validation. In this article, an architecture is developed for federated cyber-physical testbed. A local federation with two real-time simulators is developed: real-time digital simulator (RTDS) and OPAL-RT have been interfaced using VILLAS framework for end-to-end testing. Also, a real-time linear predictor is developed and integrated here to address the communication latency impact on geographically allocated federated RT simulation. Finally, resiliency analysis tools are formulated and utilized for T&D systems. Finally as an illustrative use case, the resiliency of a T&D test system is simulated, and the results are analyzed. A 179-bus Western Electricity Coordinating Council (WECC) transmission system is developed using OPAL-RT/ HYPERSIM, and a modified IEEE 13 node feeder system is modeled in RTDS/RSCAD and interfaced for resiliency analysis.

42 ENGINEERING↗
DOE OSTI2021

MOOSE Framework Meshing Enhancements to Support Reactor Analysis

MOOSE-based physics codes require an input finite element mesh on which the physics solution is calculated, reported, and transferred to other physics codes. The use of difficult-touse, external licensed software is often required to generate high quality meshes for reactor geometries. High-fidelity geometry modeling also requires elaborate tracking of groups of elements for material property assignment and output reporting which can be considerably complex for the user to identify and maintain. Under the U.S. Department of Energy Office of Nuclear Energy Advanced Modeling and Simulation (NEAMS) program, several meshingrelated enhancements have been developed for the MOOSE framework to address user challenges in creating finite element meshes for advanced reactor geometries. MOOSE mesh generators have been developed to mesh hexagonal geometries (pins, ducted assemblies, and cores) commonly found in liquid-metal cooled fast reactor concepts. The mesh generator used for hexagonal pin cells is generic for regular polygons and therefore may also be used for Cartesian pin cells. Hexagonal pin cells can be stitched into ducted assemblies, and assemblies can be stitched together into a core. The user may specify region ids, region names, and other preferences on the mesh. This control is useful for later material mapping in the MOOSE-based physics codes input. A capability was also developed for meshing rotating control drums including determination of material volume fractions in each mesh element as a function of time. Control drum meshes may be stitched to other hexagonal assemblies to create a core configuration. Additional mesh generators were developed that wrap around the hexagonal meshing capabilities and utilize “extra element integer” ID values on each element. In regular Cartesian or hexagonal assemblies or cores, the bookkeeping of element groups for both material assignment and output reporting can now be automated through assignment of pin, assembly, core, axial and depletion id values stored as extra element integers. The extra element tags on the mesh greatly speed the reactor analyst’s efforts to map materials to meshes, track depletion zones, and parse output such as axial pin power distributions. At the highest level, pin, assembly, and core mesh generators (with this reactor terminology) have also been developed to easily generate regular Cartesian and hexagonal cores, including axial extrusion. These reactor geometry builders call upon the previously mentioned capabilities to produce analysis-ready 3D meshes including material assignments. Open source mesh triangulation capabilities were also investigated for integration into the MOOSE framework to address the need for meshing the core periphery region which extends from the irregular outer assembly border to a cylindrical boundary. Options are limited due to licensing constraints, and the recommendation is pursue building a native MOOSE Delaunay triangulator routine with full functionality. Finally, a series of verification problems were performed with NEAMS physics tools. All developed capabilities will be available in the new open-source “Reactor” module of the MOOSE framework, which is accessible to any MOOSE-based NEAMS physics tool.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Demonstration of the On-the-Fly Shielding Analysis Method: Spent Fuel and Waste Disposition

This report documents work performed supporting the US Department of Energy (DOE) Office of Nuclear Energy (NE) Spent Fuel and Waste Disposition (SFWD) Integrated Waste Management activities under work breakdown structure element 1.08.02.04.01, “Data and Tools Development, Validation, and Maintenance.” In particular, this report fulfills milestone M3SF-21OR020401016, “Implement on-the-fly dose analysis methodology in UNF-ST&DARDS” within work package SF-21OR02040101, “Commercial SNF Characterization - ORNL.” The Used Nuclear Fuel - Storage, Transportation & Disposal Analysis Resource and Data System (UNFST& DARDS) enables automated dose rate calculations for spent nuclear fuel (SNF) transportation packages and storage casks using a Monte Carlo radiation transport code. The explicit method uses a detailed model of the SNF system and its contents. Therefore, a dose rate calculation is required for each as-loaded transportation package or storage cask because the SNF assemblies within a canister typically have unique irradiation characteristics. An alternate method, referred to as the “on-the-fly” shielding analysis method, has been proposed that requires only a set of Monte Carlo dose rate calculations for each transportation packaging/storage cask design. The results of the Monte Carlo dose rate calculations are independent of the SNF assembly irradiation and decay characteristics. The dose rate values may then be combined with the radiation source strength of the SNF assemblies associated with a particular transportation packaging/storage cask design to determine actual dose rates. This report presents on-the-fly dose rate calculations for a representative SNF storage cask and verification of the on-the-fly dose rate calculation results by comparison with reference dose rate calculations using the explicit Monte Carlo dose rate calculation. The on-the-fly shielding analysis method was implemented in UNF-ST&DARDS. A Python program was developed to process the MAVRIC dose rate results obtained by source particle type, energy group, and fuel geometry region. A Python processor created binary files, which were saved as a special UNF-ST&DARDS library for on-the- fly shielding analyses. UNF-ST&DARDS uses the precalculated on-the-fly binary libraries generated by the Python data processor and directly executes the Python code for on-the-fly dose analysis. This Python code unzips the pre-generated binary files mentioned above, reads the data, and combines them with user-specified sources for dose and uncertainty calculations. The Python programs were verified using Excel calculations and by comparison with the values obtained with the MAVRIC post-processing utilities applied to the 3dmap files. This method can currently be used to determine dose rates for as-loaded HI-STORM FW storage casks. The UNF-ST&DARDS analysis wizard for on-the-fly shielding analysis is described in this report.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2026

Portable and Cost-Effective Device for Reliable Detection of Counterfeit and Non-compliant Refrigerants in Diverse Applications

Counterfeit refrigerants pose significant challenges to safety, system reliability, and operational effectiveness due to their harmful contaminants or incompatible chemical compositions. Utilizing these noncompliant products can lead to reduced efficiency, equipment failures, and expensive repairs. Additionally, heightened demand for alternative refrigerants during the industry's transition has created supply gaps, enabling counterfeit products to proliferate. Accurate detection and analysis tools are therefore essential to verify refrigerant authenticity and ensure system integrity in diverse applications. This paper presents the development of a portable device designed for reliable identification and detailed analysis of refrigerant composition. By integrating precision gas sampling, controlled pressure regulation, and automated sensor technology, the device not only detects deviations from standard refrigerant properties but also provides a comprehensive composition breakdown. Pre-calibrated sensors measure the refrigerant gas to identify specific concentrations and contaminants, with an intuitive LED-based indicator system ensuring quick interpretation of results. The user-friendly interface enables operators to select refrigerant types for targeted testing, further enhancing accuracy and usability for field technicians. Comprehensive testing was conducted on mildly flammable A2L refrigerants, showcasing the device’s robustness and adaptability in analyzing composition and detecting discrepancies. The device demonstrated consistent accuracy across a range of refrigerant samples, affirming its reliability in diverse operational environments. Its design minimizes contamination risks during sampling and provides detailed composition results within 90 seconds, ensuring efficient and precise analysis. With a projected price point under $150, the proposed solution delivers affordability alongside its lightweight portability and straightforward operation. Unlike complex and costly alternatives, such as gas chromatography systems, this device provides an accessible option for technicians, customs personnel, and industry operators in need of quick and effective refrigerant verification. Compatible with both current formulations and emerging refrigerant technologies, the device addresses critical counterfeit detection needs across a range of applications. By delivering accurate composition analysis and counterfeit identification, this innovation enhances system performance, safety, and operational reliability in crucial industries.

Cheekatamarla, Praveen [ORNL] (ORCID:0000000248827↗
DOE OSTI2020

Re-Envisioning RCx: Achieving Max Potential HVAC Controls Retrofits through Modernized BAS Hardware and Software

Most existing buildings have sub-optimal heating, ventilation, and air conditioning (HVAC) controls, resulting in wasted energy and occupant discomfort. Retro-commissioning (RCx) addresses many of these issues, but it is a lengthy and highly customized process. Limited capabilities of existing building automation system hardware restricts the scope of most RCx projects. Incentive programs consider building automation system (BAS) hardware retrofits to be high-capital investments and do not allow them in typical RCx programs. This paper describes work that the authors are leading to facilitate technical and market innovation in the BAS industry to unlock large savings in existing commercial buildings through deep retrofits of BAS hardware and software. California and New York research projects are demonstrating BAS retrofits leveraging the American Society of Heating, Refrigeration, and Air Conditioning Engineers’ (ASHRAE) new Guideline 36 high performance sequences of operation to achieve greater than 20 percent whole building energy savings, while saving costs and reducing risk through streamlined processes and standardization across BAS manufacturer product lines and across implementation practices. This paper describes market barriers that impede achieving deep savings from BAS retrofits in custom incentive and traditional RCx programs and presents a new maximum potential BAS retrofit model that addresses these barriers. The new model leverages the authors’ efforts in market enablement through open standards, BAS industry partnerships, and tools for cost-effective scaling that includes tools for project screening, savings calculations, and measurement and verification (M&V). This approach is widely applicable and will be ready for at-scale implementation within two years.

Paliaga, Gwelen↗
DOE OSTI2020

CO 2 Injection Monitoring with a Scalable, Automated Sparse Seismic Array

Conference presentation at American Institute of Chemical Engineers (AIChE) Annual Meeting, Virtual, November 16–20, 2020. The scalable, automated sparse seismic array (SASSA) method has been ideated as a cost-effective alternative or complementary to conventional 3D seismic methods. Based on a sparse array of receivers deployed strategically on Earth’s surface and one or more fixed seismic sources, the SASSA method can be used to study specific portions of the subsurface to detect the movement of CO 2 in a reservoir with lower environmental footprint and shorter turnaround time to deliver results than conventional 3D seismic methods. Energy & Environmental Research Center (EERC) carried out seismic monitoring of an oilfield undergoing CO 2 enhanced oil recovery in Montana, USA, using the SASSA method.

02 PETROLEUM↗
DOE OSTI2025

Identifying synoptic controls on boundary layer thermodynamic and cloud properties in a regional forecast model

Although most of our understanding of boundary layer cloudiness is based on idealized, subtropical, barotropic marine environments, boundary layer clouds exist across a range of conditions. In this study, we use the Naval Research Laboratory's Coupled Ocean/Atmosphere Mesoscale Prediction System (COAMPS) and an automated cold-front-relative analysis framework to explore the boundary layer structure associated with low clouds across a transect through the cold front of a midlatitude synoptic cyclone. The model credibly captures boundary layer structure in line with conceptual models of midlatitude cyclones and ground-based observations at Graciosa Island in the Azores. The warm sector is conditionally unstable, with clouds that are too shallow and with too little liquid water, compared to cloud property retrievals from satellite and surface-based instruments. The cold-frontal region exhibits convection associated with weak stability and ascent. Northwest of the cold front, the boundary layer is well mixed, deeper, and capped by a strong inversion maintained by large-scale subsidence. Simulated clouds in frontal and post-frontal regions are mostly too thick, with too much liquid water and too little cloud base drizzle. The post-frontal clouds are associated with grid-scale updrafts, which appear to be the model's attempt to represent mesoscale organization of cellular convection typically observed in the cold sector of midlatitude cyclones. The deep, well-mixed post-frontal boundary layers and cloudiness are maintained by strong surface fluxes, as in cold air outbreaks. Our analysis framework serves as a unique approach to model verification, and our results offer insights into differences in boundary layer cloud behavior between subtropical and synoptic cold-sector regimes.

Eissner, Jordan M. [Univ. of Kansas, Lawrence, KS ↗
DOE OSTI2026

Locating Undocumented Wells Using Historical Oil and Gas Exploration Maps: A Case Study in Osage County, Oklahoma

Undocumented oil and gas wells lack reliable information about their locations and characteristics, making them difficult to identify. These wells can result in unanticipated delays and costs in the development of nearby surface and subsurface resources, and, if improperly plugged, can cause contamination. This study leverages historical petroleum exploration maps to locate such wells, focusing on Osage County, Oklahoma. Two sets of early 20th century oil and gas exploration maps by the United States Geological Survey were georeferenced and analyzed using a computer vision model to detect well symbols. The locations of detected wells were compared to the location of known wells in the database from the Bureau of Indian Affairs Osage Agency to identify potential undocumented wells. The analysis yielded over 500 potential undocumented wells, with dry holes constituting the largest fraction. Field verification confirmed the presence of some undocumented wells. Comparison with prior work revealed limited overlap, underscoring the complementary value of historical oil and gas maps for locating undocumented wells. This approach demonstrates the utility of integrating historical cartographic resources with modern geospatial and machine learning techniques to improve the identification and management of undocumented wells.

Energy - Petroleum↗
DOE OSTI2022

Verification and Validation of the Stakeholder Tool for Assessing Radioactive Transportation (START) – 22323

The U.S. Department of Energy (DOE) Office of Integrated Waste Management is planning for the eventual transportation, storage, and disposal of spent nuclear fuel (SNF) and high-level radioactive waste (HLW) from nuclear power plant and DOE sites. The Stakeholder Tool for Assessing Radioactive Transportation (START) is a web-based, geospatial decision-support tool developed for evaluating routing options and other aspects of transporting SNF and HLW, covering rail, truck, barge, and intermodal infrastructure and operations in the continental United States. The verification and validation (V&V) process is intended to independently assess START to provide confidence in the ability of START to accurately provide intended results. The V&V process checks the START tool using a variety of methods, ranging from independent hand calculations to comparison of START performance and results to those of other codes. The V&V activity was conducted independently from the START development team with opportunities to provide feedback and collaborate throughout the process. The V&V analyzed attributes of transportation routes produced by START, including route distance and both population and population density captured within buffer zones around routes. Population in the buffer zone, population density in the buffer zone, and route distance were all identified as crucial outputs of the START code and were subject to V&V tasks. Some of the improvements identified through the V&V process were standardizing the underlying population data in START, changing the projection of the population raster data, and changes to the methodology used for population density to improve its applicability for expected users. This collaboration also led to suggested improvements to some of the underlying shape file segments within START. A formal series of test routes went through the V&V process from START version 3.2.1 following the implementation of the recommended improvements to START. The V&V of the buffer zone population and distance reported in START were achieved by utilizing a custom workflow developed in QGIS. This platform was chosen because it is fully independent of START. The buffer zone population and route distances in START showed excellent agreement to independent V&V test results. Over 200 route test cases were run; in all cases, the percent difference in the population within the buffer zone was less than +/- 5%, and the majority of cases were below +/- 1%. These cases were also duplicated in ArcMap, which is Environmental Systems Research Institute’s (ESRI) GIS desktop application. The ArcMap results also show good agreement; however, they cannot be considered independent of START because START also uses ESRI software. The V&V tasks are currently addressing population density and estimated radiation dose in START as well as implementing further automation of the V&V process to allow larger suites of test routes to be run more easily and quickly by less experienced GIS users. These improvements to the V&V process will make it a valuable tool for the development team and the stakeholders so that each new iteration of START can easily be checked for quality and consistency. This paper and presentation will describe the V&V process, findings and implications, and ongoing V&V activities.

START, DOE, Transporation, dose, GIS↗
DOE OSTI2023

The Uniform Methods Project: Smart Thermostat Evaluation Protocol

A smart thermostat is an internet-connected device that controls home heating, ventilation, and air-conditioning (HVAC) equipment and can automatically adjust temperature set points to optimize performance and achieve energy savings. Smart thermostat features often include two way communication, occupancy detection (such as geofencing and occupancy sensors), schedule learning, and seasonal optimization algorithms. Smart thermostats can control most conventional HVAC systems, including central air conditioners, heat pumps, and forced air furnaces. Several types of residential utility programs offer smart thermostats as replacements measures. Working with smart thermostat vendors, utilities can offer separate optimization programs to produce energy savings beyond those achieved by installing a smart thermostat. From an evaluation perspective, smart thermostat programs have several noteworthy features. First, the energy savings from a smart thermostat may change over the life of the device. As a smart thermostat is connected to the internet, original equipment manufacturers can update the thermostat software to improve the thermostat's energy efficiency. Likewise, users can adjust the thermostat settings and schedules over time in response to changes in weather, thermal comfort, energy prices, or preferences for energy efficiency. Additionally, many thermostat manufacturers offer seasonal optimization programs that recommend changes or make minor, automated adjustments to the thermostat settings to improve energy efficiency. These opt-in programs are now standard offerings for many smart thermostat manufacturers and provided at no additional cost to users. The potential for software updates and continuous optimization and the evolving nature of user interactions mean future energy savings may differ from first-year savings and the energy savings of smart thermostats may need to be evaluated more than once. Second, smart thermostats often have small unit energy savings relative to a home's total energy consumption, especially in comparison to whole- home retrofit programs. This can make it difficult to detect the smart thermostat savings in billing or advanced metering infrastructure (AMI) meter consumption data. For example, as cooling loads in many regions average about 20% of annual electricity consumption, smart thermostat savings of 10% of cooling energy use would equate to a 2% reduction in home electricity consumption. Evaluators should use regression analysis of whole-home billing consumption or advanced metering infrastructure (AMI) meter consumption data to evaluate smart thermostat savings because, as explained at greater length below , these data are usually available to evaluators and regression can control for the impacts of weather and other potentially confounding factors on a home's energy consumption. Finally, as with other energy efficiency programs, participation in smart thermostat programs is self-selective. As discussed at greater length below , smart thermostat participants tend to be, among other things, younger, higher-income, and more likely to adopt electric vehicles (EVs) and internet connected devices than nonparticipants. These differences are often unobservable to the evaluator and correlated with a home's energy consumption, creating the potential for bias in estimating savings. Due to the small unit savings of thermostats, errors and biases from self-selection that may not be very consequential when evaluating a whole- home retrofits (e.g., ±2% of home electricity consumption) can have a major impact when evaluating the savings and cost-effectiveness of smart thermostat programs. A percentage point change in the estimated savings could affect the cost-effectiveness of a program. This means it is important for evaluators to assess and to minimize the potential for error from selection bias in estimating smart thermostat program savings. The Uniform Methods Project provides model protocols for determining energy savings and demand reductions that result from specific energy efficiency measures implemented through state and utility programs. In most cases, the measure protocols are based on a particular option identified by the International Performance Verification and Measurement Protocol ; however, this work provides a more detailed approach to implementing that option. Each chapter is written by technical experts in collaboration with their peers, reviewed by industry experts, and subject to public review and comment. The UMP protocols can be used by utilities, program administrators, public utility commissions, evaluators, and other stakeholders for both program planning and evaluation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗