Results for “Error analysis” — Page 58

DOE OSTI2014

Criteria for stochastic pinning control of networks of chaotic maps

This paper investigates the controllability of discrete-time networks of coupled chaotic maps through stochastic pinning. In this control scheme, the network dynamics are steered towards a desired trajectory through a feedback control input that is applied stochastically to the network nodes. The network controllability is studied by analyzing the local mean square stability of the error dynamics with respect to the desired trajectory. Through the analysis of the spectral properties of salient matrices, a toolbox of conditions for controllability are obtained, in terms of the dynamics of the individual maps, algebraic properties of the network, and the probability distribution of the pinning control. We demonstrate the use of these conditions in the design of a stochastic pinning control strategy for networks of Chirikov standard maps. To elucidate the applicability of the approach, we consider different network topologies and compare five different stochastic pinning strategies through extensive numerical simulations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2019

Using Gaia DR2 to constrain local dark matter density and thin dark disk

We use stellar kinematics from the latest Gaia data release (DR2) to measure the local dark matter (DM) density ρ DM in a heliocentric cylinder of radius R= 150 pc and half-height z= 200 pc. We also explore the prospect of using our analysis to estimate the DM density in local substructure by setting constraints on the surface density and scale height of a thin dark disk aligned with the baryonic disk and formed due to dissipative dark matter self-interactions. Performing the statistical analysis within a Bayesian framework for three types of tracers, we obtain ρDM = 0.016 ± 0.010 M ⊙ /pc 3 for A stars; early G stars give a similar result, while F stars yield a significantly higher value. For a thin dark disk, A stars set the strongest constraint: excluding surface densities (5–12) M ⊙ /pc 2 for scale heights below 100 pc with 95% confidence. The upper bound of this constraint implies ≲ 1% of the Milky Way DM mass is present in a dissipative dark sector. Comparing our results with those derived using Tycho-Gaia Astrometric Solution (TGAS) data, we find that the uncertainty in our measurements of the local DM content is dominated by systematic errors that arise from assumptions of our dynamical analysis in the low z region. Furthermore, there will only be a marginal reduction in these uncertainties with more data in the Gaia era. We comment on the robustness of our method and discuss potential improvements for future work.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2013

Planck constraints on holographic dark energy

We perform a detailed investigation on the cosmological constraints on the holographic dark energy (HDE) model by using the Plank data. We find that HDE can provide a good fit to the Plank high-l (l ∼> 40) temperature power spectrum, while the discrepancy at l ≅ 20-40 found in the ΛCDM model remains unsolved in the HDE model. The Plank data alone can lead to strong and reliable constraint on the HDE parameter c. At the 68% confidence level (CL), we obtain c = 0.508 ± 0.207 with Plank+WP+lensing, favoring the present phantom behavior of HDE at the more than 2σ CL. By combining Plank+WP with the external astrophysical data sets, i.e. the BAO measurements from 6dFGS+SDSS DR7(R)+BOSS DR9, the direct Hubble constant measurement result (H{sub 0} = 73.8 ± 2.4 kms{sup −1}Mpc{sup −1}) from the HST, the SNLS3 supernovae data set, and Union2.1 supernovae data set, we get the 68% CL constraint results c = 0.484 ± 0.070, 0.474 ± 0.049, 0.594 ± 0.051, and 0.642 ± 0.066, respectively. The constraints can be improved by 2%-15% if we further add the Plank lensing data into the analysis. Compared with the WMAP-9 results, the Plank results reduce the error by 30%-60%, and prefer a phantom-like HDE at higher significant level. We also investigate the tension between different data sets. We find no evident tension when we combine Plank data with BAO and HST. Especially, we find that the strong correlation between Ω{sub m}h{sup 3} and dark energy parameters is helpful in relieving the tension between the Plank and HST measurements. The residual value of χ{sup 2}{sub Plank+WP+HST}−χ{sup 2}{sub Plank+WP} is 7.8 in the ΛCDM model, and is reduced to 1.0 or 0.3 if we switch the dark energy to w model or the holographic model. When we introduce supernovae data sets into the analysis, some tension appears. We find that the SNLS3 data set is in tension with all other data sets; for example, for the Plank+WP, WMAP-9 and BAO+HST, the corresponding Δχ{sup 2} is equal to 6.4, 3.5 and 4.1, respectively. As a comparison, the Union2.1 data set is consistent with these three data sets, but the combination Union2.1+BAO+HST is in tension with Plank+WP+lensing, corresponding to a large Δχ{sup 2} that is equal to 8.6 (1.4% probability). Thus, combining internal inconsistent data sets (SNIa+BAO+HST with Plank+WP+lensing) can lead to ambiguous results, and it is necessary to perform the HDE data analysis for each independent data sets. Our tightest self-consistent constraint is c = 0.495 ± 0.039 obtained from Plank+WP+BAO+HST+lensing.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2022

Preliminary Sensitivity Analysis for Sensors Impacts on Building Control Performance

This report describes the preliminary sensitivity analysis for sensor impacts on building control performance through the US Department of Energy’s Oak Ridge National Laboratory’s Flexible Research Platform (FRP-2) building. The rooftop unit system provides cooling and heating to the building. The main heating coil is a gas heating coil. Each zone is served by a variable air volume box with an electricity reheat coil. The rooftop unit and variable air volume box controls adopted the practical control sequences from ASHRAE Guideline 36-2018: High-Performance Sequences of Operation. For sensors, the incipient (time-changing) sensor errors, including bias sensor error and precision sensor error, are the inputs of interest. The outputs are energy consumption and thermal comfort (e.g., the predicted percentage of dissatisfied occupants). The large-scale simulation (3,600 cases) was conducted on a cloud platform by integrating sensor errors and ASHRAE Guideline 36 control sequences into an emulator based on the EnergyPlus simulation program with Python energy management system feature. The surrogate models were developed based on cloud simulation results. The uncertainty analysis showed that the sensor errors substantially affect building energy consumption and thermal comfort. The sensitivity analysis shows a ranking of sensor error impacts for each interested output item (e.g., cooling energy, reheat coil heating energy, predicted percentage of dissatisfied occupants). In FY 2022, sensor locations, types, and costs will be evaluated. The field test in Oak Ridge National Laboratory’s Flexible Research Platform building regarding sensor impacts will also be performed. Finally, a comparative analysis will be conducted based on the field test results and emulator results.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2012

A Two-Step Approach to Uncertainty Quantification of Core Simulators

For the multiple sources of error introduced into the standard computational regime for simulating reactor cores, rigorous uncertainty analysis methods are available primarily to quantify the effects of cross section uncertainties. Two methods for propagating cross section uncertainties through core simulators are the XSUSA statistical approach and the “two-step” method. The XSUSA approach, which is based on the SUSA code package, is fundamentally a stochastic sampling method. Alternatively, the two-step method utilizes generalized perturbation theory in the first step and stochastic sampling in the second step. The consistency of these two methods in quantifying uncertainties in the multiplication factor and in the core power distribution was examined in the framework of phase I-3 of the OECD Uncertainty Analysis in Modeling benchmark. With the Three Mile Island Unit 1 core as a base model for analysis, the XSUSA and two-step methods were applied with certain limitations, and the results were compared to those produced by other stochastic sampling-based codes. Based on the uncertainty analysis results, conclusions were drawn as to the method that is currently more viable for computing uncertainties in burnup and transient calculations.

Yankov, Artem↗

DOE OSTI2012

Scripted Building Energy Modeling and Analysis: Preprint

Building energy modeling and analysis is currently a time-intensive, error-prone, and nonreproducible process. This paper describes the scripting platform of the OpenStudio tool suite (http://openstudio.nrel.gov) and demonstrates its use in several contexts. Two classes of scripts are described and demonstrated: measures and free-form scripts. Measures are small, single-purpose scripts thatconform to a predefined interface. Because measures are fairly simple, they can be written or modified by inexperienced programmers.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2015

Single-Isocenter Multiple-Target Stereotactic Radiosurgery: Risk of Compromised Coverage

Purpose: To determine the dosimetric effects of rotational errors on target coverage using volumetric modulated arc therapy (VMAT) for multitarget stereotactic radiosurgery (SRS). Methods and Materials: This retrospective study included 50 SRS cases, each with 2 intracranial planning target volumes (PTVs). Both PTVs were planned for simultaneous treatment to 21 Gy using a single-isocenter, noncoplanar VMAT SRS technique. Rotational errors of 0.5°, 1.0°, and 2.0° were simulated about all axes. The dose to 95% of the PTV (D95) and the volume covered by 95% of the prescribed dose (V95) were evaluated using multivariate analysis to determine how PTV coverage was related to PTV volume, PTV separation, and rotational error. Results: At 0.5° rotational error, D95 values and V95 coverage rates were ≥95% in all cases. For rotational errors of 1.0°, 7% of targets had D95 and V95 values <95%. Coverage worsened substantially when the rotational error increased to 2.0°: D95 and V95 values were >95% for only 63% of the targets. Multivariate analysis showed that PTV volume and distance to isocenter were strong predictors of target coverage. Conclusions: The effects of rotational errors on target coverage were studied across a broad range of SRS cases. In general, the risk of compromised coverage increased with decreasing target volume, increasing rotational error and increasing distance between targets. Multivariate regression models from this study may be used to quantify the dosimetric effects of rotational errors on target coverage given patient-specific input parameters of PTV volume and distance to isocenter.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

DOE OSTI2015

A Method for Assessing Ground-Truth Accuracy of the 5DCT Technique

Purpose: To develop a technique that assesses the accuracy of the breathing phase-specific volume image generation process by patient-specific breathing motion model using the original free-breathing computed tomographic (CT) scans as ground truths. Methods: Sixteen lung cancer patients underwent a previously published protocol in which 25 free-breathing fast helical CT scans were acquired with a simultaneous breathing surrogate. A patient-specific motion model was constructed based on the tissue displacements determined by a state-of-the-art deformable image registration. The first image was arbitrarily selected as the reference image. The motion model was used, along with the free-breathing phase information of the original 25 image datasets, to generate a set of deformation vector fields that mapped the reference image to the 24 nonreference images. The high-pitch helically acquired original scans served as ground truths because they captured the instantaneous tissue positions during free breathing. Image similarity between the simulated and the original scans was assessed using deformable registration that evaluated the pointwise discordance throughout the lungs. Results: Qualitative comparisons using image overlays showed excellent agreement between the simulated images and the original images. Even large 2-cm diaphragm displacements were very well modeled, as was sliding motion across the lung–chest wall boundary. The mean error across the patient cohort was 1.15 ± 0.37 mm, and the mean 95th percentile error was 2.47 ± 0.78 mm. Conclusion: The proposed ground truth–based technique provided voxel-by-voxel accuracy analysis that could identify organ-specific or tumor-specific motion modeling errors for treatment planning. Despite a large variety of breathing patterns and lung deformations during the free-breathing scanning session, the 5-dimensionl CT technique was able to accurately reproduce the original helical CT scans, suggesting its applicability to a wide range of patients.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

DOE OSTI2025

A systematic decision-making methodology to formalize the selection of degree of realism in screening analysis of probabilistic risk assessment

In the nuclear power domain, Probabilistic Risk Assessment (PRA) is used to inform decision-making for Nuclear Power Plants (NPPs). Recently, there has been an increase in the utilization of modeling and simulation (M&S) to support the estimation of PRA inputs. Risk analysts should carefully select the PRA items that require M&S and their degree of realism (DoR) with consideration of the required resources. To support this selection, this article formulates a systematic decision-making approach for the DoR selection. The DoR selection is made based on two predictive decision-making attributes: the predicted differences in safety risk estimate (ΔSaRi) and the cost of analysis (ΔCAN). This research also develops and quantifies causal models to estimate ΔSaRi and ΔCAN. The causal model-based prediction of ΔSaRi and ΔCAN helps reduce the trial-and-error nature of the DoR selection in the PRA screening analysis and provides insights for DoR selection and the gradual refinements of PRA realism. This approach is demonstrated for a case study on fire PRA of NPPs, where an adequate DoR is selected from two fire models: an engineering correlation and a zone model.

Alkhatib, Sari [Department of Nuclear, Plasma, and↗

DOE OSTI2011

THE IDENTIFICATION OF THE X-RAY COUNTERPART TO PSR J2021+4026

We report the probable identification of the X-ray counterpart to the {gamma}-ray pulsar PSR J2021+4026 using imaging with the Chandra X-ray Observatory Advanced CCD Imaging Spectrometer and timing analysis with the Fermi satellite. Given the statistical and systematic errors, the positions determined by both satellites are coincident. The X-ray source position is R.A. 20{sup h}21{sup m}30.{sup s}733, decl. +40 Degree-Sign 26'46.''04 (J2000) with an estimated uncertainty of 1.''3 combined statistical and systematic error. Moreover, both the X-ray to {gamma}-ray and the X-ray to optical flux ratios are sensible assuming a neutron star origin for the X-ray flux. The X-ray source has no cataloged infrared-to-visible counterpart and, through new observations, we set upper limits to its optical emission of i' > 23.0 mag and r' > 25.2 mag. The source exhibits an X-ray spectrum with most likely both a power law and a thermal component. We also report on the X-ray and visible light properties of the 43 other sources detected in our Chandra observation.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2020

Wind turbine aerodynamic measurements using a scanning lidar.

Abstract not provided.

Kelley, Christopher Lee↗

DOE OSTI2025

HOD-dependent systematics in Emission Line Galaxies for the DESI 2024 BAO analysis

The Dark Energy Spectroscopic Instrument (DESI) will provide precise measurements of Baryon Acoustic Oscillations (BAO) to constrain the expansion history of the Universe and set stringent constraints on dark energy. Therefore, precise control of the global error budget due to various systematic effects is required for the DESI 2024 BAO analysis. In this work, we estimate the level of systematics induced in the DESI BAO analysis due the assumed Halo Occupation Distribution (HOD) model for the Emission Line Galaxy (ELG) tracer. We make use of mock galaxy catalogs constructed by fitting various HOD models to early DESI data, namely the One-Percent survey data. Our analysis includes typical HOD models for the ELG tracer used in the literature as well as extensions to the baseline models. Among the extensions, we consider various recipes for galactic conformity and assembly bias. We use 25 AbacusSummit simulations under the ΛCDM cosmology for each HOD model and perform independent analyses in Fourier space and in configuration space. To recover the BAO signal from our mocks we perform BAO reconstruction and apply the control variates technique to reduce sample variance noise. Our BAO analyses can recover the isotropic BAO parameter α iso within 0.1% and the Alcock Paczynski parameter α AP within 0.3%. Overall, we find that the systematic error due to the HOD dependence is below 0.17%, with the Fourier space analysis being more robust against the HOD systematics. We conclude that our analysis pipeline is robust enough against the HOD systematics for the ELG tracer in the DESI 2024 BAO analysis, for the assumptions made.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2017

Mass Spectral Library Quality Assurance by Inter-Library Comparison

A method to discover and correct errors in mass spectral libraries is described. Comparing across a set of highly curated reference libraries compounds that have the same chemical structure quickly identifies entries that are outliers. In cases where three or more entries for the same compound are compared, the outlier as determined by visual inspection was almost always found to contain the error. These errors were either in the spectrum itself or in the chemical descriptors that accompanied it. The method is demonstrated on finding errors in compounds of forensic interest in the NIST/EPA/NIH Mass Spectral Library. The target list of compounds checked was the Scientific Working Group for the Analysis of Seized Drugs (SWGDRUG) mass spectral library. Some examples of errors found are described. A checklist of errors that curators should look for when performing inter-library comparisons is provided. .

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2015

Enrichment Meter Dataset from High-Resolution Gamma Spectroscopy Measurements of U3O8 Enrichment Standards and UF6 Cylinder Wall Equivalents

The Enrichment Meter Principle (EMP) is the basis for a commonly used standard test method for the non-destructive assay of 235 U enrichment in bulk compounds [1]. The technique involves determining the net count rate in the direct 186 keV peak using medium or high energy gamma-ray spectrometry in a fixed geometry. With suitable correction for wall attenuation, compound type, rate loss (live time), and peaked background (if significant), the atom fraction of 235 U may be obtained from the counting rate from a linear relationship through the origin. The widespread use of this method for field verification of enrichment [2,3] together with the fact that the response function rests on fundamental physics considerations (i.e., is not represented by a convenient but arbitrary form) makes it an interesting example of uncertainty quantification, one in which one can expect a valid measurement model can be applied. When applied using NaI(Tl) and region of interest analysis, the technique is susceptible to both interference error and bias [2-4]. When implemented using high-resolution gamma-ray spectroscopy, the spectrum interpretation is considerable simplified and more robust [5]. However, a practical challenge to studying the uncertainty budget of the EMP method (for example, to test linearity, extract wall corrections and so forth using modern methods) is the availability of quality experimental data that can be referenced and shared. To fill this gap, the research team undertook an experimental campaign [6]. A measurement campaign was conducted to produce high-resolution gamma spectroscopy enrichment meter data comparable to UF 6 cylinder measurements. The purpose of this report is to provide both an introduction to and quality assurance (QA) of the raw data produced. This report is intended for the analyst or researcher who uses the raw data. Unfortunately, the raw data (i.e., the spectra files) are too voluminous to include in this report but can be requested from Steven Croft of the Safeguards & Security Technology Group (scroft@ornl.gov 865-241-2834). The complete processed data are tabulated in Appendix A. The analysis techniques used to produce the QA data presented in this report [e.g., three regions-ofinterest (ROI) peak extraction and batch analysis processes] are not the most sophisticated techniques available; analysts are encouraged to reanalyze the raw data using more sensitive techniques and to improve upon the results presented here. With that being said, the analysis techniques used here are more than adequate to present and inspect the quality of the data.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2021

Subsurface Characterization and Machine Learning Predictions at Brady Hot Springs: Preprint

Subsurface data analysis, reservoir modeling, and machine learning (ML) techniques have been applied to the Brady Hot Springs (BHS) geothermal field in Nevada, USA to further characterize the subsurface and assist with optimizing reservoir management. Hundreds of reservoir simulations have been conducted in TETRAD-G and CMG STARS to explore different injection and production fluid flow rates and allocations and to develop a training data set for ML. This process included simulating the historical injection and production since 1979 and prediction of future performance through 2040. ML networks were created and trained using TensorFlow based on multilayer perceptron (MLP), long short-term memory (LSTM), and convolutional neural network (CNN) architectures. These networks took as input selected flow rates, injection temperatures, and historical field operation data and produced estimates of future production temperatures. This approach was first successfully tested on a simplified single fracture doublet system, followed by the application to the BHS reservoir. Using an initial BHS dataset with 37 simulated scenarios, the trained and validated network predicted the production temperature for 6 production wells with the mean absolute percentage error of less than 8%. In a complementary analysis effort, the principal component analysis applied to 13 BHS geological parameters revealed that vertical fracture permeability shows the strongest correlation with fault density and fault intersection density. A new BHS reservoir model was developed considering the fault intersection density as proxy for permeability. This new reservoir model helps to explore under-exploited zones in the reservoir. A data gathering plan to obtain additional subsurface data was developed; it includes temperature surveying for three idle injection wells, at which the reservoir simulations indicate high bottom-hole temperatures. The collected data assist with calibrating the reservoir model and may lead to converting these wells to producers to access under-exploited zones in the reservoir. Data gathering activities are planned for the first quarter of 2021.

40 EE - Geothermal Technologies Office (EE-4G)↗

DOE OSTI2020

Characterization and Analysis of the Energy-Reporting Accuracy of Connected Devices

Emerging energy-efficient building systems increasingly exhibit greater functionality, often requiring multiple operating modes (e.g. white-tunability for lighting products and data traffic for devices with networked, integrated sensors). This increased functionality makes energy consumption estimates more complex. Given that these functions consume energy, the energy performance of such building systems is dependent on what operating modes they use and how much time they spend in each mode. Devices and systems that can report their own energy consumption mitigate this energy-performance uncertainty. This study explores the energy-reporting accuracy of market-available connected electrical outlets. The study considers two residential-market products (five units each, one outlet per unit) and three commercial-market products (two units each, 18 to 24 outlets per unit) with the ability to report power drawn and/or energy consumed by devices connected to their receptacles. The products were purchased through typical market channels. Pacific Northwest National Laboratory (PNNL) conducted testing in December 2018 at its Connected Lighting Test Bed (CLTB), using a custom-developed test setup and method adapted from industry standards. The setup collected energy-consumption data reported by the outlet devices under test (DUTs) at one-minute intervals and compared that data with measurements taken by a reference meter over a range of test conditions. The residential products reported power draw but not interval or cumulative energy consumption. The commercial products reported both power draw and cumulative energy consumption. Relative reporting error (RRE) was calculated for all measurements, and analysis of the results revealed variations across devices and test conditions. The total number of measurements (50 for each residential product, 60 for each commercial product) offers an appreciable comparison of performance at the make/model level. The average RRE of the residential products derived from reported power draw was -0.02% and -1.20%. The average RRE for two of the three the commercial products derived from reported power draw was worse than those of the residential products (-2.40%, -2.72%, -0.36%). The internal integration of power over time, used to calculate cumulative energy consumption, typically occurs at current and voltage sampling rates much higher than once per minute. This suggests that the average commercial-product RRE derived from reported energy consumption should be very consistent and better than performance based on reported power draw. However, the RRE derived from reported energy consumption varied significantly across the three makes of commercial-market products and was uniformly less accurate than performance based on reported power draw. Subsequent analysis identified a number of root causes for this decrease in performance, most of which were related to reporting resolution. The goals of this study are to generate awareness of building systems capable of reporting their own energy consumption, further interest in the value of energy data for a variety of uses, draw attention to how the accuracy of reported metrics can be characterized, and quantify the performance variation found in marketavailable products. The results of this study and subsequent related work may be relevant to stakeholders in industry-specification and standards-development organizations. The methods this study employs could inform test and measurement procedures and performance classifications for connected outlets, lighting products, and other building systems capable of reporting their own energy consumption. The study concludes with stakeholder recommendations, including the following: • Energy-reporting device and system manufacturers developing products that report energy consumption should characterize the accuracy of reported metrics using a reference meter calibrated by an independent laboratory that was accredited by an ILAC MRA signatory (and whose scope of accreditation explicitly covers energy measurement), and should include this information on product data sheets. • Standards and specification development organizations should develop application-specific performance classifications that end users can understand and relate to their energy-data use needs (e.g., 2% accuracy class for utility streetlight energy billing needs, or 10% accuracy class for ESCO performance verification needs). • Current or potential owners, operators, and specifiers of energy-reporting building systems should rigorously analyze the dependency of current and planned energy-data use cases on accuracy, noting in particular the dependence (or lack thereof) on relative vs. absolute accuracy, and on trueness vs. precision (i.e., repeatability), and should communicate use-case needs to industry standards and specification organizations.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2020

Characterization and Analysis of the Energy-Reporting Accuracy of Connected Devices

Emerging energy-efficient building systems increasingly exhibit greater functionality, often requiring multiple operating modes (e.g. white-tunability for lighting products and data traffic for devices with networked, integrated sensors). This increased functionality makes energy consumption estimates more complex. Given that these functions consume energy, the energy performance of such building systems is dependent on what operating modes they use and how much time they spend in each mode. Devices and systems that can report their own energy consumption mitigate this energy-performance uncertainty. This study explores the energy-reporting accuracy of market-available connected electrical outlets. The study considers two residential-market products (five units each, one outlet per unit) and three commercial-market products (two units each, 18 to 24 outlets per unit) with the ability to report power drawn and/or energy consumed by devices connected to their receptacles. The products were purchased through typical market channels. Pacific Northwest National Laboratory (PNNL) conducted testing in December 2018 at its Connected Lighting Test Bed (CLTB), using a custom-developed test setup and method adapted from industry standards. The setup collected energy-consumption data reported by the outlet devices under test (DUTs) at one-minute intervals and compared that data with measurements taken by a reference meter over a range of test conditions. The residential products reported power draw but not interval or cumulative energy consumption. The commercial products reported both power draw and cumulative energy consumption. Relative reporting error (RRE) was calculated for all measurements, and analysis of the results revealed variations across devices and test conditions. The total number of measurements (50 for each residential product, 60 for each commercial product) offers an appreciable comparison of performance at the make/model level. The average RRE of the residential products derived from reported power draw was -0.02% and -1.20%. The average RRE for two of the three the commercial products derived from reported power draw was worse than those of the residential products (-2.40%, -2.72%, -0.36%). The internal integration of power over time, used to calculate cumulative energy consumption, typically occurs at current and voltage sampling rates much higher than once per minute. This suggests that the average commercial-product RRE derived from reported energy consumption should be very consistent and better than performance based on reported power draw. However, the RRE derived from reported energy consumption varied significantly across the three makes of commercial-market products and was uniformly less accurate than performance based on reported power draw. Subsequent analysis identified a number of root causes for this decrease in performance, most of which were related to reporting resolution. The goals of this study are to generate awareness of building systems capable of reporting their own energy consumption, further interest in the value of energy data for a variety of uses, draw attention to how the accuracy of reported metrics can be characterized, and quantify the performance variation found in marketavailable products. The results of this study and subsequent related work may be relevant to stakeholders in industry-specification and standards-development organizations. The methods this study employs could inform test and measurement procedures and performance classifications for connected outlets, lighting products, and other building systems capable of reporting their own energy consumption. The study concludes with stakeholder recommendations, including the following: • Energy-reporting device and system manufacturers developing products that report energy consumption should characterize the accuracy of reported metrics using a reference meter calibrated by an independent laboratory that was accredited by an ILAC MRA signatory (and whose scope of accreditation explicitly covers energy measurement), and should include this information on product data sheets. • Standards and specification development organizations should develop application-specific performance classifications that end users can understand and relate to their energy-data use needs (e.g., 2% accuracy class for utility streetlight energy billing needs, or 10% accuracy class for ESCO performance verification needs). • Current or potential owners, operators, and specifiers of energy-reporting building systems should rigorously analyze the dependency of current and planned energy-data use cases on accuracy, noting in particular the dependence (or lack thereof) on relative vs. absolute accuracy, and on trueness vs. precision (i.e., repeatability), and should communicate use-case needs to industry standards and specification organizations.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2025

Assessing the numerical stability of physics models to equilibrium variation through database comparisons on DIII-D

High fidelity kinetic equilibria are crucial for tokamak modeling and analysis. Manual workflows for constructing kinetic equilibria are time consuming and subject to user error, motivating development of automated equilibrium reconstruction tools to provide accurate and consistent reconstructions for downstream physics analysis. These automated tools also provide access to kinetic equilibria at large database scales, which enables the quantification of general uncertainties arising from equilibrium reconstruction techniques. In this paper, we compare a large database of DIII-D kinetic equilibria generated manually by physics experts to equilibria from automated kinetic reconstruction tools, assessing the impact of reconstruction method on equilibrium parameters and resulting magnetohydrodynamic stability calculations. We find agreement among scalar parameters, whereas profile quantities, such as the bootstrap current, show larger disagreements. We analyze ideal kink and classical tearing stability with DCON and STRIDE respectively, finding that the kink stability calculation is generally more robust than the tearing index Δ' calculation. We find that in 90% of cases, both kink stability classifications are unchanged between the manual expert and automated kinetic equilibria.

CAKE↗