Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “false positive analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Protein Spherical Nucleic Acids for Live-Cell Chemical Analysis

We report the development of a new strategy for the chemical analysis of live cells based on protein spherical nucleic acids (ProSNAs). The ProSNA architecture enables analyte detection via the highly programmable nucleic acid shell or a functional protein core. As a proof-of-concept, we use an i-motif as the nucleic acid recognition element to probe pH in living cells. By interfacing the i-motif with a forced-intercalation readout, we introduce a quencher-free approach that is resistant to false-positive signals, overcoming limitations associated with conventional fluorophore/quencher-based gold NanoFlares. Using glucose oxidase as a functional protein core, we show activity-based, amplified sensing of glucose. This enzymatic system affords greater than 100-fold fluorescence turn on in buffer, is selective for glucose in the presence of close analogs (i.e., glucose-6-phosphate), and can detect glucose above a threshold concentration of ~5 μM, which enables the study of relative changes in intracellular glucose concentrations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Entropy removal of medical diagnostics

Shannon entropy is a core concept in machine learning and information theory, particularly in decision tree modeling. To date, no studies have extensively and quantitatively applied Shannon entropy in a systematic way to quantify the entropy of clinical situations using diagnostic variables (true and false positives and negatives, respectively). Decision tree representations of medical decision-making tools can be generated using diagnostic variables found in literature and entropy removal can be calculated for these tools. This concept of clinical entropy removal has significant potential for further use to bring forth healthcare innovation, such as quantifying the impact of clinical guidelines and value of care and applications to Emergency Medicine scenarios where diagnostic accuracy in a limited time window is paramount. This analysis was done for 623 diagnostic tools and provided unique insights into their utility. For studies that provided detailed data on medical decision-making algorithms, bootstrapped datasets were generated from source data to perform comprehensive machine learning analysis on these algorithms and their constituent steps, which revealed a novel and thorough evaluation of medical diagnostic algorithms.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Pushing the Limits of Pulse Shape Discrimination in a Large Liquid Xenon Detector

The LUX-ZEPLIN (LZ) experiment is a direct-detection dark matter experiment, optimized to search for weakly interacting massive particles (WIMPs) through WIMP-nucleon interactions. The main challenge in dark matter detection is differentiating between WIMP signals and background events. In LZ, the ratio of ionization to scintillation signals (charge-to-light) is the primary method for rejecting electronic recoil (ER) background. Pulse shape discrimination (PSD) offers a method for additional ER backgrounds rejection in liquid xenon detectors. In this paper, the discrimination power of PSD with the LZ experiment is discussed. To precisely characterize the scintillation pulse shape, an analysis framework is developed to reconstruct the detection time of individual photons. Using LZ calibration data, the photon-timing prompt fraction discriminator is optimized and achieves ER leakage as low as $15\%$. For specific background processes such as $^{124}$Xe double electron capture, the leakage is reduced further to about $5\%$. PSD is combined with charge-to-light to form two-factor discrimination (TFD). The optimized TFD performance is compared with the performance of the charge-to-light method, with the corresponding false positive rate reduced by up to a factor of two for large scintillation pulses. Finally, PSD and TFD are applied to data from LZ's WS2024 run and their performance is summarized.

Akerib, D. S. [SLAC; KIPAC, Menlo Park]↗
DOE OSTI2021

Process Anomaly Detection for Sparsely Labeled Events in Nuclear Power Plants

An essential aspect of online monitoring, subtle anomaly detection increases the detection lead time for equipment failure and enables a nuclear power plant (NPP) to mitigate unexpected partial or full outages, resulting in significant cost saving to the plant. Once an anomaly is detected by plant staff, its cause and severity are investigated. Because the vast majority of anomalies require some level of investigation, including some that require time-consuming examination, before they are passed over to the engineering organization for further analysis, plants are often equipped with tools to assist the staff in performing anomaly detection. Those tools operate as a black box and are often based on statistical methods that establish sensor correlations using preconfigured mathematical models and flag correlation deviations as anomalies. Due to the number of anomalies detected at a given NPP on a daily basis, a significant number of flagged anomalies usually await examination for days or weeks. A primary cause of this backlog is that the methods used by the tools generate many false positives. Though this is usually attributed to oversensitive model settings due to very narrow normal operation bands, it can also be associated with the model development being inadequate for the process being monitored, or with missing model inputs that could have explained misclassified positives. The performance of anomaly detection tools impacts their plant acceptance and utilization, especially when the effort to address false positives generated by the tool depletes the value or cost saved by using that tool. Thus, means to advance anomaly detection performance have been investigated by the Department of Energy’s Light Water Reactor Sustainability program. Previous and ongoing efforts have targeted unsupervised machine-learning (ML) methods, which do not require the labeling of any data fed into the ML model. By contrast, in supervised anomaly detection methods, every data point is labeled as either a normal or abnormal process condition, and the model is trained to replicate the classification process. Supervised methods usually outperform unsupervised methods, due to the added value in differentiating normal from anomalous states of the monitored process. An NPP’s corrective action program requires it to track and document, via a dedicated report, the resolution of any issues that occur within the plant. Once created, each report is reviewed by a plant screening committee, and several classifications and decisions are made. Recently, a collaborating NPP developed an artificial intelligence and ML-based classifier to categorize a condition report (CR) into classes that can serve to label the data as normal or anomalous. Applying CRs as labels represents a semi-supervised use case. Semi-supervised ML assumes that labels exist for some data points (i.e., labeled anomalies, in this case) but not for the rest. In this effort, semi-supervised ML methods were used to fuse data from CRs with anomaly detection methods in order to test the hypothesis that partially labeled anomalies would improve the accuracy of the anomaly detection methods. Specifically, two methods were used. The first is the deep Semi-supervised Anomaly Detection (deep SAD) method, which can handle labels ranging from fully unsupervised to fully supervised cases. The second is a newly designed ML method developed specifically for this effort and referred to as the high-order feature (HOF)-based method. To evaluate these two methods in controlled environments, synthetic data generators were developed and used. The first datasets used a spring-mass-damper (SMD) system simulator commonly found in mechanical engineering references. This was used to create two use cases: a one- and a three-mass system. Anomalies were introduced by changing the spring and damper coefficients while the system was actuated by random forces. The second datasets used the commercial Dymola-Modelica software to build a simplified nuclear reactor model. Anomalies were added in the form of corrupted sensor readings and/or control commands. The deep SAD method was tested using the SMD system, while the HOF method was tested using both datasets. Application of the deep SAD semi-supervised ML method demonstrated that labels can generate increased confidence in detecting true anomalies. This helped increase the number of true positives and decrease the number of false negatives—something that would aid in addressing the backlog of possible anomalies. Application of the HOF method demonstrated that labels can aid in down selecting from a candidate set of features to a more optimal subset in order to better differentiate between normal and anomalous conditions.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

OzDES reverberation mapping program: Lag recovery reliability for 6-yr C iv analysis

ABSTRACT We present the statistical methods that have been developed to analyse the OzDES reverberation mapping sample. To perform this statistical analysis we have created a suite of customizable simulations that mimic the characteristics of each source in the OzDES sample. These characteristics include: the variability in the photometric and spectroscopic light curves, the measurement uncertainties, and the observational cadence. By simulating the sources in the OzDES sample that contain the C iv emission line, we developed a set of criteria that rank the reliability of a recovered time-lag depending on the agreement between different recovery methods, the magnitude of the uncertainties, and the rate at which false positives were found in the simulations. These criteria were applied to simulated light curves and these results used to estimate the quality of the resulting Radius–Luminosity relation. We grade the results using three quality levels (gold, silver, and bronze). The input slope of the R–L relation was recovered within 1σ for each of the three quality samples, with the gold standard having the lowest dispersion with a recovered a R–L relation slope of 0.454 ± 0.016 with an input slope of 0.47. Future work will apply these methods to the entire OzDES sample of 771 AGN.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Pushing the limits of pulse shape discrimination in a large liquid xenon detector

Abstract The LUX-ZEPLIN (LZ) experiment is a direct-detection dark matter experiment, optimized to search for weakly interacting massive particles (WIMPs) through WIMP-nucleon interactions. The main challenge in dark matter detection is differentiating between WIMP signals and background events. In LZ, the ratio of ionization to scintillation signals (charge-to-light) is the primary method for rejecting electronic recoil (ER) background. Pulse shape discrimination (PSD) offers a method for additional ER backgrounds rejection in liquid xenon detectors. In this paper, the discrimination power of PSD with the LZ experiment is discussed. To precisely characterize the scintillation pulse shape, an analysis framework is developed to reconstruct the detection time of individual photons. Using LZ calibration data, the photon-timing tail fraction discriminator is optimized and achieves ER leakage as low as $$15\%$$ 15 % . For specific background processes such as $$^{124}$$ 124 Xe double electron capture, the leakage is reduced further to about $$5\%$$ 5 % . PSD is combined with charge-to-light to form two-factor discrimination (TFD). The optimized TFD performance is compared with the performance of the charge-to-light method, with the corresponding false positive rate reduced by up to a factor of two for large scintillation pulses. Finally, PSD and TFD are applied to data from LZ’s WS2024 run and their performance is summarized.

Akerib, D. S. [SLAC National Accelerator Laborator↗
DOE OSTI2024

Inferring precocial Chinook Salmon production through single‐parentage assignments

Abstract Objective Parentage analysis is a routine methodology in fisheries research, but study systems exist where it is impractical to sample both parents. The ability to reliably assign offspring to a single parent is beneficial in these situations. We applied single‐parentage assignments to a naturally spawning population of Chinook Salmon Oncorhynchus tshawytscha to quantify production of anadromous returns by unsampled precocial males. Methods We used an approach that focused on two important aspects of parentage analyses: (1) addressing the presence of family structure within the set of sampled parents and (2) controlling for false‐positive and false‐negative assignments. Result Results indicated that 30% of reproductively successful males were precocial males, which produced 20% of the returning anadromous offspring. Conclusion This study provides a framework for applying single‐parent assignments in a salmonid study system while explicitly addressing sources of assignment errors.

Steele, Craig A.↗
DOE OSTI2022

Demonstration of no catalytical activity of Fe–N–C and Nb–N–C electrocatalysts toward nitrogen reduction using in–line quantification

Ammonia (NH 3 ) production via the electrochemical nitrogen reduction reaction (NRR) is a promising method for sustainable generation of this important chemical. Efforts are ongoing in finding an efficient, stable, and selective catalyst that will enable the reaction. However, progress is hindered in the field due to lack of reproducibility, most likely a consequence of reports of false-positive results due to improper measurement control and methods. In this study, we explore the NRR activity of a promising class of single atom catalysts, transition metal-nitrogen-carbon (M-N-C) electrocatalysts. Using a state-of-the-art in-line ammonia quantification methodology, with detection limit as low as 1 ppb for ammonia, we show that single atom Nb and Fe embedded in a stable carbon and nitrogen framework do not electrochemically reduce N 2 to NH 3 . Critically, this demonstrates that our experimental setup with in-line sequential injection analysis successfully excludes ammonia contamination from the gas supply and atmospheric sources, allowing for thorough and high-throughput examination of potential NRR catalysts.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Characterisation and comparative analysis of mitochondrial genomes of false, yellow, black and blushing morels provide insights on their structure and evolution

Morchella species have considerable significance in terrestrial ecosystems, exhibiting a range of ecological lifestyles along the saprotrophism-to-symbiosis continuum. However, the mitochondrial genomes of these ascomycetous fungi have not been thoroughly studied, thereby impeding a comprehensive understanding of their genetic makeup and ecological role. In this study, we analysed the mitogenomes of 30 Morchellaceae species, including yellow, black, blushing and false morels. These mitogenomes are either circular or linear DNA molecules with lengths ranging from 217 to 565 kbp and GC content ranging from 38% to 48%. Fifteen core protein-coding genes, 28–37 tRNA genes and 3–8 rRNA genes were identified in these Morchellaceae mitogenomes. The gene order demonstrated a high level of conservation, with the cox1 gene consistently positioned adjacent to the rnS gene and cob gene flanked by apt genes. Some exceptions were observed, such as the rearrangement of atp6 and rps3 in Morchella importuna and the reversed order of atp6 and atp8 in certain morel mitogenomes. However, the arrangement of the tRNA genes remains conserved. We additionally investigated the distribution and phylogeny of homing endonuclease genes (HEGs) of the LAGLIDADG (LAGs) and GIY-YIG (GIYs) families. A total of 925 LAG and GIY sequences were detected, with individual species containing 19–48HEGs. These HEGs were primarily located in the cox1, cob, cox2 and nad5 introns and their presence and distribution displayed significant diversity amongst morel species. These elements significantly contribute to shaping their mitogenome diversity. Overall, this study provides novel insights into the phylogeny and evolution of the Morchellaceae.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Archetype-based Redshift Estimation for the Dark Energy Spectroscopic Instrument Survey

We present a computationally efficient galaxy archetype-based redshift estimation and spectral classification method for the Dark Energy Survey Instrument (DESI) survey. The DESI survey currently relies on a redshift fitter and spectral classifier using a linear combination of principal component analysis–derived templates, which is very efficient in processing large volumes of DESI spectra within a short time frame. However, this method occasionally yields unphysical model fits for galaxies and fails to adequately absorb calibration errors that may still be occasionally visible in the reduced spectra. Our proposed approach improves upon this existing method by refitting the spectra with carefully generated physical galaxy archetypes combined with additional terms designed to absorb data reduction defects and provide more physical models to the DESI spectra. We test our method on an extensive data set derived from the survey validation (SV) and Year 1 (Y1) data of DESI. Our findings indicate that the new method delivers marginally better redshift success for SV tiles while reducing catastrophic redshift failure by 10%–30%. At the same time, results from millions of targets from the main survey show that our model has relatively higher redshift success and purity rates (0.5%–0.8% higher) for galaxy targets while having similar success for QSOs. These improvements also demonstrate that the main DESI redshift pipeline is generally robust. Additionally, it reduces the false-positive redshift estimation by 5%–40% for sky fibers. We also discuss the generic nature of our method and how it can be extended to other large spectroscopic surveys, along with possible future improvements.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Impact of genotype‐calling methodologies on genome‐wide association and genomic prediction in polyploids

Abstract Discovery and analysis of genetic variants underlying agriculturally important traits are key to molecular breeding of crops. Reduced representation approaches have provided cost‐efficient genotyping using next‐generation sequencing. However, accurate genotype calling from next‐generation sequencing data is challenging, particularly in polyploid species due to their genome complexity. Recently developed Bayesian statistical methods implemented in available software packages, polyRAD, EBG, and updog, incorporate error rates and population parameters to accurately estimate allelic dosage across any ploidy. We used empirical and simulated data to evaluate the three Bayesian algorithms and demonstrated their impact on the power of genome‐wide association study (GWAS) analysis and the accuracy of genomic prediction. We further incorporated uncertainty in allelic dosage estimation by testing continuous genotype calls and comparing their performance to discrete genotypes in GWAS and genomic prediction. We tested the genotype‐calling methods using data from two autotetraploid species, Miscanthus sacchariflorus and Vaccinium corymbosum , and performed GWAS and genomic prediction. In the empirical study, the tested Bayesian genotype‐calling algorithms differed in their downstream effects on GWAS and genomic prediction, with some showing advantages over others. Through subsequent simulation studies, we observed that at low read depth, polyRAD was advantageous in its effect on GWAS power and limit of false positives. Additionally, we found that continuous genotypes increased the accuracy of genomic prediction, by reducing genotyping error, particularly at low sequencing depth. Our results indicate that by using the Bayesian algorithm implemented in polyRAD and continuous genotypes, we can accurately and cost‐efficiently implement GWAS and genomic prediction in polyploid crops.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Fragment-based drug nanoaggregation reveals drivers of self-assembly

Drug nanoaggregates are particles that can deleteriously cause false positive results during drug screening efforts, but alternatively, they may be used to improve pharmacokinetics when developed for drug delivery purposes. The structural features of molecules that drive nanoaggregate formation remain elusive, however, and the prediction of intracellular aggregation and rational design of nanoaggregate-based carriers are still challenging. We investigate nanoaggregate self-assembly mechanisms using small molecule fragments to identify the critical molecular forces that contribute to self-assembly. We find that aromatic groups and hydrogen bond acceptors/donors are essential for nanoaggregate formation, suggesting that both π-π stacking and hydrogen bonding are drivers of nanoaggregation. We apply structure-assembly-relationship analysis to the drug sorafenib and discover that nanoaggregate formation can be predicted entirely using drug fragment substructures. We also find that drug nanoaggregates are stabilized in an amorphous core-shell structure. These findings demonstrate that rational design can address intracellular aggregation and pharmacologic/delivery challenges in conventional and fragment-based drug development processes.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2024

Predictive analytics of selections of russet potatoes

We explore the application of machine learning algorithms specifically to enhance the selection process of Russet potato (Solanum tuberosum L.) clones in breeding trials by predicting their suitability for advancement. This study addresses the challenge of efficiently identifying high-yield, disease-resistant, and climate-resilient potato varieties that meet processing industry standards. Leveraging manually collected data from trials in the state of Oregon, we investigate the potential of a wide variety of state-of-the-art binary classification models. The dataset includes 1086 clones, with data on 38 attributes recorded for each clone, focusing on yield, size, appearance, and frying characteristics, with several control varieties planted consistently across four Oregon regions from 2013 to 2021. We conduct a comprehensive analysis of the dataset that includes preprocessing, feature engineering, and imputation to address missing values. We focus on several key metrics such as accuracy, F1-score, and Matthews correlation coefficient (MCC) for model evaluation. The top-performing models, namely a feedforward neural network classifier (Neural Net), a histogram-based gradient boosting classifier (HGBC), and a support vector machine classifier (SVM), demonstrate consistent and significant results. To further validate our findings, we conducted a simulation study using the aims, data-generating mechanisms, estimands, methods, and performance measures (ADEMP) framework, simulating different data-generating scenarios to assess model robustness and performance through true positive, true negative, false positive, and false negative distributions, area under the receiver operating characteristic curve (AUC-ROC) and MCC. The simulation results highlight that non-linear models like SVM and HGBC consistently show higher AUC-ROC and MCC than logistic regression, thus outperforming the traditional linear model across various distributions, and emphasizing the importance of model selection and tuning in agricultural trials. Variable selection further enhances model performance and identifies influential features in predicting trial outcomes. The findings emphasize the potential of machine learning in streamlining the selection process for potato varieties, offering benefits such as increased efficiency, substantial cost savings, and judicious resource utilization. Our study contributes insights into precision agriculture and showcases the relevance of advanced technologies for informed decision-making in breeding programs.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Data Analytics Applied to Coal Fired Boilers for Detecting Leaks

Data analytics were used to detect boiler leaks from five different coal-fired boilers including both subcritical and supercritical systems. Discriminant functions were developed that detected leaks up to two weeks prior to forced plant shutdowns for repairs. The leaks were identified to occur at different sections of the boiler for each plant, including waterwalls, economizer and superheater using conventional process measurement data. Leaking conditions were detected with a high degree of confidence (≪ 1% misclassified observations) and were able to distinguish normal operations from those time periods with steam leaks even while operating the power plants in power cycling mode.Multivariable statistical analyses, including Principal Component (PCA), cluster, and Fischer Discriminant Analysis (FDA) were used to characterize the leak occurrence. Normal and operational states with steam leaks were provided in the original process datasets. These datasets were split into two different groups for training and validation purposes. The data were sorted chronologically, and every third observation was assigned to training the Discriminant Function Model (DFM) while the rest were reserved for validation. PCA was used to reduce dimensionality of the original datasets. Canonical and FDA analyses were used to investigate the relationship between process variables. The outcome of the analyses revealed that nearly 35,000 observations were classified correctly; less than 0.05% of total observations were misclassified to be leaking, i.e. both false positives and false negatives.

Indrawan, Natarianto↗
DOE OSTI2021

Validation of Scale-Derived Ages in Wild Juvenile and Adult Steelhead Using Parental-Based Tagging

Abstract Accurate age information is a critical component in fisheries monitoring, management, and research. The ability to assign accurate ages to fish by using nonlethal structures is vital in calculating cohort productivity for fish species with low abundances and variable life histories. A common nonlethal method to assign ages is by interpretation of patterns in scales. Validation of ages is not easily obtained for free-ranging fishes; however, the development of genetic “tags” has expanded age validation opportunities. In this study, we used parental-based genetic tagging to validate ages determined from scales collected from juvenile and adult steelhead Oncorhynchus mykiss in two streams within the Snake River basin. Juvenile scale ages were in agreement with 93% of the known ages. Adult scale ages were in agreement with 89% of the known ages. Although overall bias in juvenile ages was very low, we saw a slight positive bias in younger fish (young of the year and age 1) and a small negative bias in older juveniles (ages 2–4). A small negative bias in ages of adults was a consequence of errors in freshwater age. The errors observed did not significantly bias age compositions because the 90% confidence intervals about the age proportions based on scales contained the known proportions; therefore, scale analysis is an acceptable method for assigning ages to Snake River steelhead. We discuss the value of validated known-age scales as a reference collection, and as an illustrative use, we constructed a circulus count guide to aid technicians in identifying missing annuli and distinguishing true from false annuli. To demonstrate the use of the circulus guidelines, we reanalyzed samples with age discrepancies, applying the circulus count data and the known age to identify mistakes.

Reinhardt, Leslie↗
DOE OSTI2023

Realistic application of short-lived fission product delayed neutron, gamma-ray analysis for simultaneous nondestructive trace quantification of U, Pu mixtures on cellulose swipes

Detection and characterization of fissile traces are of interest to the international nuclear nonproliferation community, including the International Atomic Energy Agency. Pre-inspection check samples are analyzed by neutron activation analysis at the High Flux Isotope Reactor operated by the Oak Ridge National Laboratory under the umbrella of the IAEA Network of Analytical Laboratories. The simultaneous quantification of U and Pu mixtures was accomplished using the combined delayed neutron (DN) delayed gamma-ray (DG) method to analyze cellulose swipes with actinide loading <1ng in a blind field trial. The total fissile quantity was measured by the DN counts and the relative proportions of U, Pu were determined by calibration of the 104 Tc / 141 Ba fission product count ratio using known mixtures. The DNDG method demonstrated high accuracy in flagging the presence of 239 Pu in uranium down to <100 pg mass loading. In conclusion, peak significance tests helped to control false positive Pu flagging and simultaneous quantification of U and Pu loading was accomplished on samples that passed the significance tests.

36 MATERIALS SCIENCE↗
DOE OSTI2022

AviSense: A Real-time System for Detection, Classification, and Analysis of Aviation Signals

Wireless systems are an integral part of aviation. Apart from their apparent use in air-to-ground communication, wireless systems play a crucial role in avionic functions including navigation and landing. An interference-free wireless environment is therefore critical for the uninterrupted operation and safety of an aircraft. Hence, there is an urgency for airport facilities to acquire the capability to continuously monitor aviation frequency bands for real-time detection of interference and anomalies. To meet this critical need, we design and build AviSense, an SDR-based real-time, versatile system for monitoring aviation bands. AviSense detects and characterizes signal activities to enable practical and effective anomaly detection. We identify and tackle the challenges posed by a diverse set of critical aviation bands and technologies. We evaluate our methodology with real-world aviation signal measurements and two custom datasets of anomalous signals. We find that our signal classification capability achieves a true positive rate of ~99%, with few exceptions, and a false positive rate of less than 4%. We also demonstrate that AviSense can effectively distinguish between different types of anomalies. We build and evaluate a prototype implementation of AviSense that supports distributed monitoring.

42 ENGINEERING↗
DOE OSTI2021

Analysis of Automated Fault Detection and Diagnosis Records as an Indicator of HVAC Fault Prevalence: Methodology and Preliminary Results

Faults in commercial buildings can cause energy waste and other performance problems such as reduced occupant comfort, reduced equipment longevity, and increased noise. However, it is currently unknown how commonly faults occur in different equipment types. A method has been developed to estimate the prevalence of faults in air handling units, air terminal units, and rooftop units. This method includes two types of data. The first is data from several automated fault detection and diagnostics (AFDD) software technologies. This type of data provides a large sample that represents a wide range of building types, geographical locations, and equipment types. It includes fault diagnoses from thousands of buildings around the United States, as well as anonymized metadata describing the building and equipment characteristics. The number of fault records is in the order of 107. However, despite the size and richness of the data sample, this data contains some degree of inaccuracy, i.e., false positive and false negative findings. Therefore, the study includes a second type of data, coming from manual inspection of buildings that have had the same AFDD methods applied to them (from the commercial AFDD offerings). Since the field tests are conducted in buildings with AFDD-generated fault prevalence data, they can be combined with the larger sample size to provide insight into the potential biases or lower sensitivity of the AFDD data. Once a library of fault prevalence data is built, it will be studied to provide further insight into the drivers of fault prevalence, for example, whether prevalence is correlated with building type, geographical location (which is tied to climate and to utility rates), building size, etc. This paper describes the methods developed for this study and illustrates them with preliminary data. It discusses some of the challenges of harmonizing disparate outputs from multiple AFDD vendors, application of a unifying fault taxonomy, and fault prevalence metrics.

Ebrahimi Fakhar, Amir↗