Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data quality analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

CERES : a cryo-EM re-refinement system for continuous improvement of deposited models

The field of electron cryomicroscopy (cryo-EM) has advanced quickly in recent years as the result of numerous technological and methodological developments. This has led to an increase in the number of atomic structures determined using this method. Recently, several tools for the analysis of cryo-EM data and models have been developed within the Phenix software package, such as phenix.real_space_refine for the refinement of atomic models against real-space maps. Also, new validation metrics have been developed for low-resolution cryo-EM models. To understand the quality of deposited cryo-EM structures and how they might be improved, models deposited in the Protein Data Bank that have map resolutions of better than 5 Å were automatically re-refined using current versions of Phenix tools. The results are available on a publicly accessible web page (https://cci.lbl.gov/ceres). The implementation of a Cryo-EM Re-refinement System ( CERES ) for the improvement of models deposited in the wwPDB, and the results of the re-refinements, are described. Based on these results, contents are proposed for a `cryo-EM Table 1', which summarizes experimental details and validation metrics in a similar way to `Table 1' in crystallography. The consistent use of robust metrics for the evaluation of cryo-EM models and data should accompany every structure deposition and be reported in scientific publications.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Single-trial classification of evoked responses to auditory tones using OPM- and SQUID-MEG

Abstract Objective. Optically pumped magnetometers (OPMs) are emerging as a near-room-temperature alternative to superconducting quantum interference devices (SQUIDs) for magnetoencephalography (MEG). In contrast to SQUIDs, OPMs can be placed in a close proximity to subject’s scalp potentially increasing the signal-to-noise ratio and spatial resolution of MEG. However, experimental demonstrations of these suggested benefits are still scarce. Here, to compare a 24-channel OPM-MEG system to a commercial whole-head SQUID system in a data-driven way, we quantified their performance in classifying single-trial evoked responses. Approach. We measured evoked responses to three auditory tones in six participants using both OPM- and SQUID-MEG systems. We performed pairwise temporal classification of the single-trial responses with linear discriminant analysis as well as multiclass classification with both EEGNet convolutional neural network and xDAWN decoding. Main results. OPMs provided higher classification accuracies than SQUIDs having a similar coverage of the left hemisphere of the participant. However, the SQUID sensors covering the whole helmet had classification scores larger than those of OPMs for two of the tone pairs, demonstrating the benefits of a whole-head measurement. Significance. The results demonstrate that the current OPM-MEG system provides high-quality data about the brain with room for improvement for high bandwidth non-invasive brain–computer interfacing.

Iivanainen, Joonas (ORCID:0000000160344604)↗
DOE OSTI2022

A Novel Process for Carbon Dioxide Conversion to Fuel

In this project, TDA developed a new mixed metal oxide-based sorbent that converts CO2 (captured from coal fired power plants) to CO, which can then be combined with renewable H2 generated by water electrolysis or H2 from steam methane reforming to produce different liquid fuels. TDA’s absorbent-based CO2 conversion process uses a redox process, which splits the catalytic reforming of methane with CO2 reaction into two stages: CO2 reduction to CO and CH4 reforming into H2 and CO which eliminates the equilibrium limitations. The CO produced in the two-stage reactor system can then be further reacted with renewable H2 to produce methanol, naphtha, diesel, or gasoline. We worked with the Advanced Power & Energy Program (APEP) of University of California, Irvine (UCI) to design and develop the liquid fuel synthesis process that is built around this new material. We demonstrated the techno-economic viability of the new sorbent based redox process to convert CO2 into synthesis gas by demonstrating continuous carbon dioxide reduction in a prototype test system for over 585 hours while converting up to 10 kg CO2/day. With the successful completion of the R&D effort, the technology is now ready for a larger pilot-scale demonstration and the technology readiness has been raised from TRL 3 to TRL 5. In collaboration with UCI, we completed a high-fidelity process design and economic analysis. The required sale price (RSP) for gasoline (Case 1 NG-MTG) is $4.91/gal and naphtha and diesel (Case 2 NG-FT) are $4.23/gal and $6.07/gal, respectively, on a 2011 dollar basis. To put these costs in perspective, the California prices in current dollars (with its strict specifications) for regular grade gasoline from last year to current year have varied from a low of $3.10/gal in January 2021 to a high of $5.76/gal in March 2022, while prices for diesel from last year to current year have varied from a low of $3.40/gal in January 2021 to a high of $6.41/gal in May 2022 according to the U.S. Energy Information Agency data. It should be noted that the gasoline and diesel produced by these designs of Case 1 and Case 2 would be of very high quality and both nitrogen and sulfur free. These RSPs are based on a cost of imported electricity of $64/MWh based on the low-end current wind generated electricity cost (Genevieve 2011). This cost is by far the largest component of the variable costs used in computing the RSPs. A sensitivity analysis of these RSPs to the cost of imported electricity shows that the cost of the imported electricity has a significant effect on the RSPs. The life cycle analysis (LCA) shows that the total cradle-to-gate CO2 emissions for both liquid fuels (diesel and gasoline) were negative, indicating that overall more CO2 is consumed than released during production of the fuel from CO2 feed stack for both cases (-296 kgCO2 per MT gasoline for Case 1 and -705 kgCO2 per MT diesel for Case 2). On a cradle-to-grave comparison, the use of diesel produced using TDA’s process (2,457 kgCO2 per MT diesel) would release 37.6% less CO2 compared to petroleum based diesel (3,937 kgCO2 per MT diesel) while the use of gasoline produced using TDA’s process (2,792 kgCO2 per MT gasoline) would release 29.3% less CO2 compared to petroleum based gasoline (3,946 kgCO2 per MT gasoline). With the successful completion of the R&D effort, the technology is now ready for a bench-scale demonstration and the technology readiness has been raised from TRL 3 (Analytical and experimental critical function and/or characteristic proof of concept) to TRL 5 (Laboratory scale similar system validation in relevant environment).

20 FOSSIL-FUELED POWER PLANTS↗
DOE OSTI2020

An organogel library for solution NMR analysis of nanoparticle suspensions in non-aqueous samples

Surface contrast solution NMR methods (scNMR) are emerging as powerful tools to investigate the adsorption of small molecule ligands to the surface of nanoparticles (NP), returning fundamental insight into the kinetics and thermodynamics of sorption, as well as structural information on the adsorbed species. A prerequisite for the acquisition of high quality solution NMR data is the preparation of homogeneous and stable samples that return consistent NMR spectra and allow extensive signal averaging. Unfortunately, this condition does not apply to NMR samples containing NPs that often show a tendency to sediment and accumulate at the bottom of the NMR tube over the course of the experiment. We have recently shown that preparing NMR samples in an agarose gel matrix inhibits sedimentation and allows the characterization of small molecule-NP interactions by scNMR. Unfortunately, as the agarose gel only forms in aqueous solution, this sample preparation method cannot be used to stabilize NP suspensions in a non-aqueous environment. In this work, we introduce a library of 48 organogels, based on low molecular-mass organic gelators (LMOGs), to prepare NMR samples of small molecule/NP systems in a wide range of organic solvents. In addition, we present a simple method that takes advantage of 1H transverse relaxation (1H-R2) measurements to screen the library and identify the best gelator to characterize the small molecule-NP interaction of interest in the solvent of choice. We expect the results of this study will enable the preparation of homogeneous and stable samples of NPs in non-aqueous environments, therefore dramatically increasing the applicability of scNMR to the characterization of heterogeneous interactions and to the investigation of the role played by solvent molecules in regulating the kinetics and thermodynamics of sorption.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Value of Information and Data Management Platform Promoting Modern Data Analysis Utilization. STTR Phase I, Final Technical Report

The immense growth in weather and river sensor data availability along with increases in computational power and algorithmic sophistication have enabled the widespread application of physical, machine learning, and artificial intelligence algorithms to river forecasting. The forecasts produced by widely varying model approaches are inherently limited in different ways, such as by the number and quality of training observations, producing biased predictions that achieve optimal skill only over specific ranges of weather and river conditions. Thus, despite the growing availability and new sources of forecasts, hydropower owners cannot fully leverage the information because they lack an effective mechanism to determine the “best” forecast for given conditions or objectives. Tools are needed to consolidate forecast information, demonstrate skill, and extract optimal forecast guidance from the range of possibilities. Such tools will increase uptake and beneficial use of the growing wealth of forecast information, and lead to improved operating decisions, optimal power generation, and enhanced system value. This research proposes to improve the value of forecasts by developing a broadly accessible verification framework and applying machine learning techniques to identify the ‘best’ forecast from an ensemble of sources given the current weather, river, and operating conditions.

13 HYDRO ENERGY↗
DOE OSTI2020

Air quality impact of the Northern California Camp Fire of November 2018

The Northern California Camp Fire that took place in November 2018 was one of the most damaging environmental events in California history. Here, we analyze ground-based station observations of airborne particulate matter that has a diameter <2.5 µm (PM 2.5 ) across Northern California and conduct numerical simulations of the Camp Fire using the Weather Research and Forecasting model online coupled with chemistry (WRF-Chem). Simulations are evaluated against ground-based observations of PM 2.5 , black carbon, and meteorology, as well as satellite measurements, such as Tropospheric Monitoring Instrument (TROPOMI) aerosol layer height and aerosol index. The Camp Fire led to an increase in Bay Area PM 2.5 to over 50 µg m –3 for nearly 2 weeks, with localized peaks exceeding 300 µg m –3 . Using the Visible Infrared Imaging Radiometer Suite (VIIRS) high-resolution fire detection products, the simulations reproduce the magnitude and evolution of surface PM 2.5 concentrations, especially downwind of the wildfire. The overall spatial patterns of simulated aerosol plumes and their heights are comparable with the latest satellite products from TROPOMI. WRF-Chem sensitivity simulations are carried out to analyze uncertainties that arise from fire emissions, meteorological conditions, feedback of aerosol radiative effects on meteorology, and various physical parameterizations, including the planetary boundary layer model and the plume rise model. Downwind PM 2.5 concentrations are sensitive to both flaming and smoldering emissions over the fire, so the uncertainty in the satellite-derived fire emission products can directly affect the air pollution simulations downwind. Our analysis also shows the importance of land surface and boundary layer parameterization in the fire simulation, which can result in large variations in magnitude and trend of surface PM 2.5 . Inclusion of aerosol radiative feedback moderately improves PM 2.5 simulations, especially over the most polluted days. Results of this study can assist in the development of data assimilation systems as well as air quality forecasting of health exposures and economic impact studies.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Uncertainty Visualization of Critical Points of 2D Scalar Fields for Parametric and Nonparametric Probabilistic Models

This paper presents a novel end-to-end framework for closed-form computation and visualization of critical point uncertainty in 2D uncertain scalar fields. Critical points are fundamental topological descriptors used in the visualization and analysis of scalar fields. The uncertainty inherent in data (e.g., observational and experimental data, approximations in simulations, and compression), however, creates uncertainty regarding critical point positions. Uncertainty in critical point positions, therefore, cannot be ignored, given their impact on downstream data analysis tasks. Here, in this work, we study uncertainty in critical points as a function of uncertainty in data modeled with probability distributions. Although Monte Carlo (MC) sampling techniques have been used in prior studies to quantify critical point uncertainty, they are often expensive and are infrequently used in production-quality visualization software. We, therefore, propose a new end-to-end framework to address these challenges that comprises a threefold contribution. First, we derive the critical point uncertainty in closed form, which is more accurate and efficient than the conventional MC sampling methods. Specifically, we provide the closed-form and semianalytical (a mix of closed-form and MC methods) solutions for parametric (e.g., uniform, Epanechnikov) and nonparametric models (e.g., histograms) with finite support. Second, we accelerate critical point probability computations using a parallel implementation with the VTK-m library, which is platform portable. Finally, we demonstrate the integration of our implementation with the ParaView software system to demonstrate near-real-time results for real datasets.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Capturing high‐resolution digital images for use in forensic document examination

Abstract In the past, pattern disciplines within forensic science have periodically faced criticism due to their subjective and qualitative nature and the perceived absence of research evaluating and supporting the foundations of their practices. Recently, however, forensic scientists and researchers in the field of pattern evidence analysis have developed and published approaches that are more quantitative, objective, and data driven. This effort includes automation, algorithms, and measurement sciences, with the end goal of enabling conclusions to be informed by quantitative models. Before employing these tools, forensic evidence must be digitized in a way that adequately balances high‐quality detail and content capture with minimal background noise imparted by the selected technique. While the current work describes the process of optimizing a method to digitize physical documentary evidence for use in semi‐automated trash mark examinations, it could be applied to assist other disciplines where the digitization of physical items of evidence is prevalent. For trash mark examinations specifically, it was found that high‐resolution photography provided optimal digital versions of evidentiary items when compared to high‐resolution scanning.

Riley, Paige↗
DOE OSTI2023

Building 151 NNMA Clean Laboratory Project Soil Sampling and Analysis Plan

This Soil Sampling and Analysis Plan (SAP) was prepared by the Environmental Function Area (EFA)/Technical Services Department (TSD) of the Environment, Safety & Health (ES&H) Directorate for the Project Management Office (PMO) for the proposed Building 151 NNMA Clean Laboratory Project (project) located immediately south of Building 154. The purpose of the SAP was to describe the procedures for collection and analysis of environmental samples and evaluation of analytical data (chemical and radiological) to determine management options of excavated soil during project construction in accordance with Lawrence Livermore National Laboratory’s (LLNL) Soils Screening and Management Plan (SSMP) (LLNL, 2022), which is consistent with U.S. Environmental Protection Agency (EPA) guidance for developing Data Quality Objectives for environmental data (EPA, 2006). The SAP was developed in accordance with the SSMP and based on preliminary design information provided to EFA by PMO. In addition to environmental samples, geotechnical samples will be collected by Consolidated Engineering Laboratories (CEL) on behalf of PMO. Geotechnical samples will be collected from a dedicated geotechnical boring location or co-located with environmental samples. Collection of geotechnical samples is determined by CEL and is therefore not discussed in this SAP.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Building 438 Drainage Channel Soil Sampling and Analysis Plan (February 2023)

This Soil Sampling and Analysis Plan (SAP) was prepared by the Environmental Function Area (EFA)/Technical Services Department (TSD) of the Environment, Safety & Health (ES&H) Directorate for the Project Management Office (PMO) for the proposed Building 438 Drainage Channel Project (project) located near Building 438 (B438) in the southern portion, Building 433 (B433) in the middle portion, and Building 543 (B543) in the northern portion (project area as shown on Figure 1). The purpose of the SAP was to describe the procedures for collection and analysis of environmental samples and evaluation of analytical data (chemical and radiological) to determine management options of excavated soil during project construction in accordance with Lawrence Livermore National Laboratory’s (LLNL) Soils Screening and Management Plan (SSMP) (LLNL 2022), which is consistent with U.S. Environmental Protection Agency (EPA) guidance for developing Data Quality Objectives for environmental data (EPA 2006). The SAP was developed in accordance with the SSMP and based on preliminary design information provided to EFA by PMO.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Raptor

Raptor is an efficient Python-based tool for predicting the formation and morphology of stochastic lack of fusion defects in metal AM processes. A major obstacle for the qualification and certification of additively manufactured parts in critical applications continues to be performance variability caused in part by porosity-related defects. High-fidelity process models that could predict these defect features are currently too computationally expensive for component-level analysis. To address this, Raptor employs a high-performance geometric method to model the dynamic melt pool rather than relying on computationally intensive thermal fluid dynamics. This allows Raptor to rapidly identify regions of unmelted material that correspond to lack of fusion pores. The efficiency of this approach significantly reduces the time and resources needed for generating 3D defect predictions, which enables users to conduct large-scale parameter studies and evaluate how process variations affect part quality. The framework offers operational flexibility; users can execute simulations through a simple command line interface or integrate core functions as a library within larger computational workflows. Simulation outputs include 3D porosity maps for visualization and tools for quantitative morphological analysis. These results are suitable for direct comparison with experimental characterization data from methods such as X-ray computed tomography and can be used for statistical process optimization.

Subraveti, Vamsi [Vanderbilt Univ., Nashville, TN ↗
DOE OSTI2021

Argonne Leadership Computing Facility: 2021 Operational Assessment Report

This Operational Assessment Report describes how the Argonne Leadership Computing Facility (ALCF) met or exceeded every one of its goals for calendar year (CY) 2021 as an advanced scientific computing center. In CY 2021, the ALCF operated its production resource, Theta, an Intel-based Cray XC40 system (11.7-petaflops) augmented with 24 NVIDIA DGX A100-based nodes (3.9-petaflops) that supports diverse workloads, integrating data analytics with artificial intelligence (AI) training and learning in a single platform. In 2021, we began deploying Polaris, our newest 40- petaflops system, and augmented this powerful testbed system with an additional 28 nodes to support the integration of real-time experiments and HPC resources. We also deployed our two largest storage systems yet, named Grand and Eagle, that will bring new services to our users and will power data-driven research for years to come. Last year, Theta delivered a total of 20.8 million node-hours to 16 Innovative and Novel Computational Impact on Theory and Experiment (INCITE) projects and 7.2 million node-hours to ASCR Leadership Computing Challenge (ALCC) projects (32 awarded during the 2020–2021 ALCC year and 17 awarded during the 2021–2022 ALCC year), as well as substantial support to Director’s Discretionary (DD) projects (5.5 million node-hours). As Table ES.1 shows, Theta performed exceptionally well in terms of overall availability (95.1 percent), scheduled availability (99.4 percent), and utilization (98.1 percent; Table 2.1). As of the submission date of this document, ALCF’s user community has published 249 papers in high-quality, peer-reviewed journals and technical proceedings. At the 2021 International Conference for High Performance Computing, Networking, Storage and Analysis (SC’21), Argonne researchers won two HPCwire Readers’ Choice Awards and were part of a Gordon Bell Prize finalist team recognized for developing an AI-enabled, multi-resolution simulation framework for studying complex biomolecular machines. Their framework was used to observe the SARS-CoV-2 replication-transcription machinery in action, by directly integrating experimental data. ALCF also provided a comprehensive program of high-performance computing (HPC) support services to help our community make productive use of the facility’s diverse and growing collection of resources. We are now entering the exascale era, with exascale machines being planned for national laboratories across the country, including Aurora at Argonne National Laboratory (Argonne) in 2023. ALCF researchers have been leading and guiding numerous strategic activities that will push the boundaries of what’s possible in computational science and engineering and allow us to deliver science on day one.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Effectiveness of Residue and Tillage Management on Runoff Pollutant Reduction from Agricultural Areas

Highlights No-till and no-till residue systems were effective in reducing runoff particulate and total nutrients but increased dissolved nutrients. Maintaining >30% residue cover reduced most runoff constituents, irrespective of no-till or tillage. No-till-residue prevented runoff nutrient losses and benefitted farm revenue by avoiding tillage. Abstract. Reduced tillage management conservation practices (No-till and Reduced-till) are widely adopted in agriculture; however, understanding their overall effectiveness for water quality protection is challenging. A meta-analysis was conducted to understand and quantify the effectiveness of residue and tillage management on runoff, sediment, and nutrient losses from agricultural fields. Annual runoff and the associated sediment, and nutrient (nitrogen and phosphorus) loads were compiled from 60 peer reviewed research articles published across the United States and Canada. A total of 1575 site-years of data were categorized into tillage (<30% surface cover), no-tillage (<30% surface cover), tillage with residue (>30% surface cover), no-tillage with residue (>30% surface cover), and pasture management. No-tillage, no-tillage-residue, and tillage-residue managements were evaluated for their effectiveness in reducing runoff, nutrients, and sediment loads compared to tillage. Synthesized and surveyed corn yield data were used to evaluate the economic cost effectiveness of no-tillage-residue management with respect to tillage. Across the site years (1968-2019) studied, median runoff depth for no-tillage and no-tillage-residue were 84% and 70% greater than tillage and tillage-residue management, respectively. No-tillage-residue management had up to 86% less sediment losses than tillage systems, on average, for both >30% and <30% surface cover. No-tillage-residue management was most effective, with a positive performance effectiveness of 65% to 90% in controlling sediments, particulate, and total nutrient losses in runoff compared to tillage. Cost effectiveness analysis revealed the benefits of no-tillage-residue management in reducing nutrient loads and increasing net-farm revenue by avoiding tillage operational costs. Except for dissolved phosphorus, no-tillage-residue management cost effectiveness for sediments and nutrient loads ranged from negative $6 to negative $102 per every Mg or kg of load reduction, indicating it had both economic and environmental benefits compared to tillage management. Overall, these results indicate that over the long-term, no-tillage and tillage, combined with greater than 30% residue cover, can effectively reduce sediment and nutrient losses. This work highlights the importance of crop residues on the soil surface to reduce runoff losses, even in no-tillage systems. Keywords: Conservation tillage, No-tillage, Residue cover, Tillage, Water quality.

Agriculture↗
DOE OSTI2024

Techno-economic and life-cycle analysis of strategies for improving operability and biomass quality in catalytic fast pyrolysis of forest residues

Many of the challenges faced by the first commercial biorefineries were associated with feedstock handling, quality, and cost. Strategies are needed to enable further expansion of biorefineries and meet the growing demand for bio-based fuels and products. Here, we examine 2 key feedstock challenges and mitigation strategies in the context of a catalytic fast pyrolysis (CFP) biorefinery: (1) the operability of the feed system, which may be improved by modifying the minimum particle size fed to the reactor, and (2) the quality of the biomass, which may be improved by employing air classification to remove undesirable material and increase fuel yields. We conduct techno-economic analysis (TEA) and life-cycle analysis for these strategies, employing a discrete event simulation model for biomass preprocessing combined with a series of correlations developed from literature data and a rigorous CFP conversion model. Our results highlight the importance of balancing increased cost and material losses from preprocessing against improved operability and fuel yields. Economics and sustainability were optimized when operating at the lowest minimum particle size, emphasizing the importance of minimizing material losses while maintaining the operability of the process. Economically, additional costs and material losses from air classification could be acceptable due to improved biomass conversion, and an optimum air classification speed was identified; however, the fuel GHG emissions were minimized when air classification was not used. Valorizing material removed during preprocessing as a coproduct could improve economics and sustainability, decreasing the burden of material losses.

09 - BIOMASS FUELS↗
DOE OSTI2023

LCA-PyTorch

LCA-PyTorch is a code repository which contains PyTorch implementations of the Locally Competitive Algorithm (LCA), which is a biologically-plausible sparse coding model. LCA-PyTorch allows for the training, testing, and analysis of single layer LCA networks, multi-layer LCA networks, and hybrid LCA-based deep neural network models on a wide variety of applications and data types. LCA-PyTorch was developed in Python, a high-level programming language that takes advantage of the Python ecosystem of high-quality open-source packages for machine learning. LCA-PyTorch interfaces heavily with the open-source PyTorch Python package.

Teti, Michael↗
DOE OSTI2021

PVInsight (Final Technical Report)

Data generated from real-world photovoltaic (PV) systems represent significant opportunities for the industry–from digital operations and maintenance to real-time planning and forecasting. However, these data also come with substantial, unique challenges. A particular challenge is the analysis of unlabeled PV performance data, which we define as time-series measurements of real power production (or sometimes current or voltage) that do not have corresponding meteorological measurements (irradiance, temperature, etc.) or system configuration information (sometimes called system metadata). These challenges are amplified in the distributed rooftop sector, in which data quality, completeness, and metadata can be very poor.

14 SOLAR ENERGY↗
DOE OSTI2022

A Knowledge-based Framework for Building Energy Model Performance Verification

Building energy modeling (BEM) has been widely used by researchers, regulators, and engineers to quantify building energy performance. Quality assurance (QA) and quality control (QC) of the model's performance are essential parts of such analysis. Currently, QA/QC is done in a manual and ad-hoc manner, which is tedious, error-prone, and time-consuming when QA/QC a large number of models. To solve these challenges, we propose a a dAta-driveN buIlding perforMance verificATion framEwork (ANIMATE), which conducts automated output-based verification of building operations requirements (especially for time-series output-based verification of control requirements). While this framework was developed for verifying energy model performance, it can be extended for other applications such as BEM software testing and performance verification of real buildings in the field.

Chen, Yan↗
DOE OSTI2023

Unbalanced Nested Random Effects Estimation of Variance Components

To investigate the contributing factors of variance in the measurement of an iodine 127 (127I) sample, we implement a nested random effects analysis of variance (ANOVA). Historically, the reported uncertainty on a measurement of 127I has been obtained by methods of forward uncertainty propagation because there is typically only one replicate of a given sample for which to estimate the uncertainty. When samples are processed there are several types of quality control (QC) standards analyzed along-side the unknown samples with two to five replicates for each. Assuming the variance observed in these replicate QC standards is representative of that of the unknown samples, we use these data in a nested random effects ANOVA to estimate the total uncertainty of a measurement. We demonstrate this approach with two sets of measurements from Idaho National Laboratory and compare the results with the forward uncertainty propagation approach. Variance component estimates for the coarsest level of the nesting structure were most imprecise because replicates were most limited at these levels. We find that the results largely agree between forward propagation and ANOVA, and the greatest contributors of variance are due to instrument variation and chemical processing, with human processing being among the smallest contributors. This analysis provides reassurance that the reported uncertainties using forward propagation are reasonable and the process is well controlled. We propose a future designed experiment to increase replicates at the coarsest level of the hierarchy to improve estimates of these variance components.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗