Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Task Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

Saltstone third quarter calendar year 2019 (3QCY19) toxicity characteristic leaching procedure (TCLP) results

The aqueous waste from Tank 50 (salt solution) is sampled quarterly for transfers to the Saltstone Production Facility (SPF). Salt solution is treated at SPF and disposed of in the Saltstone Disposal Facility (SDF). Per request of customer, X-TAR-Z-00008, Revision 01, two SDF waste form (saltstone) samples were prepared in the Savannah River National Laboratory (SRNL) from the Tank 50 Waste Acceptance Criteria (WAC) sample and Z-Area premix material for the third quarter of calendar year 2019 (3QCY19). One sample contained a Full Premix which included 10:45:45 (by weight) of cement, slag and fly ash. The second sample contained 60:40 (by weight) of slag and fly ash only referred to as the “Cement-Free grout sample”. Results from this technical report support Task 2: ‘Grout Leaching Analyses’ of the Task Technical Request (TTR) prepared by Savannah River Remediation (SRR). After a 28 day cure, a sample of each of the SDF waste forms was collected and shipped to a certified laboratory for analysis using the Toxicity Characteristic Leaching Procedure (TCLP). The 3QCY19 saltstone (Full Premix) and the Cement-Free grout samples met the South Carolina (SC) Code of Regulations for Hazardous Waste Management Regulations (HWMR) 61-79.261.24 and 61-79-268.48 requirements for a non-hazardous waste form with respect to Resource Conservation and Recovery Act (RCRA) metals and Underlying Hazardous Constituents (UHCs), and also met the SPF WAC.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

GraphAlign: Graph-Enabled Machine Learning for Seismic Event Filtering

This report summarizes results from a 2 year effort to improve the current automated seismic event processing system by leveraging machine learning models that can operated over the inherent graph data structure of a seismic sensor network. Specifically, the GraphAlign project seeks to utilize prior information on which stations are more likely to detect signals originating from particular geographic regions to inform event filtering. To date, the GraphAlign team has developed a Graphical Neural Network (GNN) model to filter out false events generated by the Global Associator (GA) algorithm. The algorithm operates directly on waveform data that has been associated to an event by building a variable sized graph of station waveforms nodes with edge relations to an event location node. This builds off of previous work where random forest models were used to do the same task using hand crafted features. The GNN model performance was analyzed using an 8 week IMS/IDC dataset, and it was demonstrated that the GNN outperforms the random forest baseline. We provide additional error analysis of which events the GNN model performs well and poorly against concluded by future directions for improvements.

58 GEOSCIENCES↗

Williston Basin CORE-CM Initiative Final Report

The University of North Dakota Energy & Environmental Research Center (EERC) is leading the Williston Basin Carbon Ore, Rare Earth, and Critical Minerals (CORE-CM) Initiative to drive the expansion and transformation of coal and coal-based resource usage within the Williston Basin to produce rare-earth elements (REEs), CMs, and nonfuel carbon-based products (CBPs). This project is the first phase in a long-term program and set the stage for future work by assessing resource, market, technology, and infrastructure knowledge; identifying knowledge gaps; developing a series of plans to be carried out in future work; and initiating stakeholder engagement. Composed of several tasks, the project sought to identify, characterize, and assess several necessary aspects vital to make this future work a reality. The project’s fundamental task was to characterize the Williston Basin CORE-CM resources. Over 2500 samples from multiple sources were utilized to begin the assessment. Several locations were identified in western North Dakota where sample analysis identified the total REE (TREE) concentration as being over 500 parts per million (ppm), which is at a concentration level that would be suitable to consider for mining and extraction. Current operating coal mines have sufficient concentrations of TREEs for consideration. However, the current data across the basin are still not adequate to fully characterize REE and CM content nor give reliable estimates of the total resource potential. Waste stream reuse was also considered, and several streams were identified which ranged from potential energy sources to chemicals to material wastes. This includes streams that result from oil and gas production. These streams are not fully characterized, and further data are needed before they can be accurately assessed. Infrastructure within the Williston Basin is suitable for expansion of a new industry to mine, extract, and concentrate REEs and CMs. The development of this industry will not only preserve many existing jobs in the coal-mining industry but produce many new jobs. The supply chain for REEs and CMs is currently controlled outside of the United States in nations such as China, but the potential to develop the supply chain within the basin is considered possible. Processing of the mined materials for REEs and CMs needs further research. The technology and knowhow exist outside of the United States, and within the country much of the knowledge has been lost and must be regained. To develop the supply chain and regain lost processing technology, the creation of technology innovation centers (TICs) is crucial. The Williston Basin contains several similar centers and entrepreneurial assistance for other industries that can be applied in the development of REE and CM innovation centers. Education to develop the new skill sets required is also needed. Outreach is important for the development of the REE and CM industry within the basin. Understanding throughout federal and state governments, state agencies, industry, and resource end users is vital for the industry to form and grow. Through this project these groups have been contacted through bulletins, presentations, webinars, and annual symposiums. The report is a summary of the work conducted and throughout refers to a series of appendixes which contain more thorough and specific information about each section.

01 COAL, LIGNITE, AND PEAT↗

April 2024 Semiannual Composite Salt Waste Processing Facility (SWPF) Decontaminated Salt Solution (DSS) Toxicity Characteristic Leaching Procedure (TCLP) Results

The aqueous waste from the Salt Waste Processing Facility (SWPF) is sampled semiannually for transfers to the Saltstone Production Facility (SPF). Salt solution is treated at SPF and disposed of in the Saltstone Disposal Facility (SDF). Per request of customer, X-TTR-Z-00027, Revision 0, one SDF waste form (saltstone) sample was prepared in the Savannah River National Laboratory (SRNL) from the SWPF Decontaminated Salt Solution (DSS) Waste Acceptance Criteria (WAC) sample and Z-area premix material for the April 2024 semiannual Toxicity Characteristic Leaching Procedure (TCLP) sample. The sample contained 60:40 (by weight) of slag and fly ash (referred to as the “Cement-Free grout sample”). Results from the technical report support Task 2: ‘Grout Leaching Analyses’ of the Task Technical Request (TTR) prepared by Savannah River Mission Completion (SRMC). After at least 28 days cured, a sample of the SDF waste form was collected and shipped to a certified laboratory for analysis using the Toxicity Characteristic Leaching Procedure (TCLP). The April 2024 semiannual Cement-Free grout sample met the South Carolina (SC) Code of Regulations for Hazardous Waste Management Regulations (HWMR) 61-79.261.24 and 61-79.268.48 requirements for a non-hazardous waste form with respect to the Resource Conservation and Recovery Act (RCRA) metals and Underlying Hazardous Constituents (UHCs), and met the SPF WAC that was in effect at the time of the tank sampling.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Adaptive elasticity policies for staging-based in situ visualization

In situ processing aims to alleviate the growing gap between computation and I/O capabilities by performing data processing close to the data source. In situ processing is widely used to process data generated by multiple data sources, including observation data from edge devices or scientific observational facilities and the simulation data generated by scientific computation on a high-performance computing (HPC) platform. For a scientific workflow that is run on an HPC platform and composed of a simulation program and an in situ data analytics or visualization (abbreviated as ana/vis) task, there is an implicit assumption that the computing resources assigned to the workflow keep static during the workflow execution. However, with the converging trend between the HPC and cloud computing platform, running the in situ ana/vis task in an elastic way is promising to decrease its overhead and improve its resource utilization rate. Resource elasticity represents the ability to change resource configurations such as the number of computing nodes/processes during workflow execution. An elastic job may dynamically adjust resource configurations; it may use a few resources at the beginning and more resources toward the end of the job when interesting data appear. However, it is hard to predict a priori how many computing nodes/processes need to be added/removed during the workflow execution to adapt to changing workflow needs. How to efficiently guide elasticity operations, such as growing or shrinking the number of processes used for in situ analysis during workflow execution, is an open-ended research question. In this article, we present adaptive elasticity policies that adopt workflow runtime information collected during workflow execution to predict how to trigger the addition/removal of processes in order to minimize in situ processing overhead. Taking in situ visualization tasks as an example, we integrate the presented elasticity policies into a staging-based elastic workflow and evaluate its efficiency in multiple elasticity scenarios. Compared with the situation without elasticity or with a static elasticity policy that uses a fixed number of processes for each rescaling operation, the adaptive elasticity policy can save overhead in finding a proper resource configuration and improve resource utilization efficiency. Furthermore, one experiment illustrates that the adaptive elasticity policy saves 41% of core-hours compared with the situation without the resource elasticity.

97 MATHEMATICS AND COMPUTING↗

Combining Deep Learning and scatterControl for High-Throughput X-ray CT Based Non-Destructive Characterization of Large-Scale Casted Metallic Components

X-ray computed tomography (XCT) is essential for nondestructive evaluation and quality control of large-scale metal components. XCT imaging, however, faces significant challenges from metal artifacts, particularly those caused by Compton scattering, which degrade image quality and obscure critical details. Hardware-based solutions (e.g. scatterControl) offer advancements by intercepting scattered photons and reducing artifacts, but they can be time-consuming and require additional processing. Here, we propose modifying and leveraging a novel deep learning (DL) framework, Simurgh, to enhance and accelerate scatter correction in XCT. By combining scatterControl with DL-based artifact removal, we demonstrate significant reduction in scan time while producing high-quality reconstructions. Through extensive evaluation on industrial XCT data, we show that our methods reduce scan time by up to more than 10 x while preserving flaw detectability. Quantitative analysis across multiple segmentation techniques confirms that Simurgh-based reconstructions consistently outperform traditional Feldkamp-Davis-Kress, model-based iterative reconstruction, and commercial DL models in both pixel-level and task-specific evaluations, enabling scalable, high-throughput XCT workflows for characterization of large scale components in applications such as casting and metal additive manufacturing.

Complex metal parts↗

GPS-supported smartphone app-based integrated travel diary and time-use data collection: challenges and lessons learned

Travel behaviour and time-use data are two vital data sources for travel demand modelling. Travel behaviour is traditionally collected through household travel surveys, enhanced by using GPS-supported smartphone apps for passive location data collection. However, recruiting individuals willing to install these apps with sustained motivation to continue participation has been a critical challenge. This paper shares insights from a travel and time-use data collection procedure in Chicago and Sydney using the Fourstep app. Social media platforms were utilised as a solution to recruit participants in Chicago, where an international market research company failed to accomplish the task. This paper also discusses the challenges we faced and suggests ways to overcome them, offering valuable guidance to researchers in recruiting participants for smartphone application-based data collection. It also offers an analysis of travel, time-use, and travel-based multitasking behaviours based on the data collected from the Chicago and Sydney samples.

GPS-supported smartphone apps↗

Optimal Balance of Privacy and Utility with Differential Privacy Deep Learning Frameworks

As the number of online services has increased, the amount of sensitive data being recorded is rising. Simultaneously, the decision-making process has improved by using the vast amounts of data, where machine learning has transformed entire industries. This paper addresses the development of optimal private deep neural networks and discusses the challenges associated with this task. We focus on differential privacy implementations and finding the optimal balance between accuracy and privacy, benefits and limitations of existing libraries, and challenges of applying private machine learning models in practical applications. Our analysis shows that learning rate, and privacy budget are the key factors that impact the results, and we discuss options for these settings.

Kotevska, Olivera↗

Exploring Benchmarks for Self-Driving Labs using Color Matching

Self Driving Labs (SDLs) that combine automation of experimental procedures with autonomous decision making are gaining popularity as a means of increasing the throughput of scientific workflows. The task of identifying quantities of supplied colored pigments that match a target color, the color matching problem, provides a simple and flexible SDL test case, as it requires experiment proposal, sample creation, and sample analysis, three common components in autonomous discovery applications. We present a robotic solution to the color matching problem that allows for fully autonomous execution of a color matching protocol. Our solution leverages the WEI science factory platform to enable portability across different robotic hardware, the use of alternative optimization methods for continuous refinement, and automated publication of results for experiment tracking and post-hoc analysis.

Artificial intelligence↗

Saltstone First Quarter Calendar Year 2021 (1QCY21) Toxicity Characteristic Leaching Procedure (TCLP) Results

The aqueous waste from Tank 50 (salt solution) is sampled quarterly for transfers to the Saltstone Production Facility (SPF). Salt solution is treated at SPF and disposed of in the Saltstone Disposal Facility (SDF). Per request of customer, X-TTR-Z00023, Revision 0, two SDF waste form (saltstone) samples were prepared in the Savannah River National Laboratory (SRNL) from the Tank 50 Waste Acceptance Criteria (WAC) sample and Z-Area premix material for the first quarter of calendar year 2021(1QCY21). One sample contained a Full Premix which included 10:45:45 (by weight) of cement, slag and fly ash. The second sample contained 60:40 (by weight) of slag and fly ash only referred to as the “Cement-Free grout sample”. Results from this technical report support Task 2: ‘Grout Leaching Analyses’ of the Task Technical Request (TTR) prepared by Savannah River Remediation (SRR). After at least 28 days cured, a sample of each of the SDF waste forms was collected and shipped to a certified laboratory for analysis using the Toxicity Characteristic Leaching Procedure (TCLP). The 1QCY21 saltstone (Full Premix) and the Cement-Free grout samples met the South Carolina (SC) Code of Regulations for Hazardous Waste Management Regulations (HWMR) 61-79.261.24 and 61-79-268.48 requirements for a non-hazardous waste form with respect to Resource Conservation and Recovery Act (RCRA) metals and Underlying Hazardous Constituents (UHCs), and also met the SPF WAC that was in effect at the time of the tank sampling.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Saltstone Third Quarter Calendar Year 2021 (3QCY21) Toxicity Characteristic Leading Procedure (TCLP) Results

The aqueous waste from Tank 50 (salt solution) is sampled quarterly for transfers to the Saltstone Production Facility (SPF). Salt solution is treated at SPF and disposed of in the Saltstone Disposal Facility (SDF). Per request of customer, X-TTR-Z-00023, Revision 0, two SDF waste form (saltstone) samples were prepared in the Savannah River National Laboratory (SRNL) from the Tank 50 Waste Acceptance Criteria (WAC) sample and Z-Area premix material for the third quarter of calendar year 2021(3QCY21). One sample contained a Full Premix which included 10:45:45 (by weight) of cement, slag and fly ash. The second sample contained 60:40 (by weight) of slag and fly ash only referred to as the “Cement-Free grout sample”. Results from this technical report support Task 2: ‘Grout Leaching Analyses’ of the Task Technical Request (TTR) prepared by Savannah River Remediation (SRR). After at least 28 days cured, a sample of each of the SDF waste forms was collected and shipped to a certified laboratory for analysis using the Toxicity Characteristic Leaching Procedure (TCLP). The 3QCY21 saltstone (Full Premix) and the Cement-Free grout samples met the South Carolina (SC) Code of Regulations for Hazardous Waste Management Regulations (HWMR) 61-79.261.24 and 61-79-268.48 requirements for a non-hazardous waste form with respect to Resource Conservation and Recovery Act (RCRA) metals and Underlying Hazardous Constituents (UHCs), and also met the SPF WAC that was in effect at the time of the tank sampling.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Artificial Intelligence for Accelerating Nuclear Applications, Science, and Technology

Artificial intelligence (AI) and machine learning (ML) methods have had significant impacts in science and technology in recent years. These methods for generating models from datasets or logic-based algorithms that emulate aspects of human performance can similarly accelerate the fields of nuclear applications, science, and technology toward the IAEA goals of contributing to peace, health, and prosperity. In order to accomplish advances with AI in general and ML in particular across these fields, IAEA can play a significant role by establishing, hosting and curating centralised resources, including databases, adhering to FAIR (findable, accessible, interoperable and reusable) principles and Open Science best practices, providing stewardship of data sharing, supporting training efforts and development of relevant workforces, as well as enabling connections among the scientific, technology, mathematics, AI and ethics communities. Many areas can benefit from the use of AI in the realm of nuclear applications. In human health, these areas include clinical research, epidemiology, nutrition, medical imaging, radiotherapy and education of health professionals. AI-based tools are also being used to facilitate different clinical tasks in imaging, computer-assisted diagnosis in mammography and lung cancer screening programmes, and dose prediction in nuclear medicine procedures. ML methods in particular may also increase the efficiency and accuracy of the analysis of computerised tomography and dual-energy absorptiometry scans for body composition and bone analysis. The application of AI methods to nuclear and related technologies in food and agriculture can lead to significant advances and improved efficiency in the optimisation of agricultural production, food product development, management of supply chains, food safety and food authenticity control. In the water and environmental sector, AI can help inform policies to mitigate the world’s water problems. The application of AI techniques to hydrology and environmental sciences is expected to improve patterns identification and enable model predictions under a changing climate.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Taming the Wild West: Assessing Impacts-Relevant Climate Data Products (Abbreviated Report)

Impacts-relevant Earth system data refers to observational and ESM data that are downscaled, debiased, validated, and provisioned for use by decision-makers. Impacts-relevant Earth system data is essential for mitigation and adaptation planning across a variety of regions and sectors. A vast number of these data products have emerged in recent years, which has led to confusion among stakeholders and scientists as to the best product to use. With no standard evaluation protocol available for these products, the decision on which product to use was sometimes made because it was pragmatic rather than the best product to use. This project sought to develop foundational capabilities around impacts-relevant data products that would support more informed selection and application of these products. This work has been immensely successful, driving several academic publications and supported the development of a community of practice around impacts-relevant data products. Over the project’s three years we have addressed six tasks: First, the development of standard evaluation metrics for impacts-relevant climate data; second, the development of a novel suite of atmospheric river metrics; third, the development of novel metrics for precipitation feature analysis; fourth, the development of novel metrics for assessing co-variances between temperature and precipitation; fifth, the development of a dashboard for interactive examination of impacts-relevant climate data; and sixth, the establishment of a community of practice around impacts-relevant climate data that will continue beyond the conclusion of this project.

54 ENVIRONMENTAL SCIENCES↗

BETO 2021 Peer Review - Analytical Development & Support WBS 2.5.1.101

The objective of the Analytical Development and Support (ADS) Project is to produce and maintain the critical analytical methods and tools that enable evaluation of emerging biofuels R&D at NREL and in the broader biofuels research community. Our project is divided into two tasks: one task to develop novel analytical techniques and improve existing methods and one task to maintain existing analytical capabilities at NREL and provide outreach to the wider community. The ADS Project is world-recognized for our Laboratory Analytical Procedures (LAPS) which provide detailed procedures for compositional analysis of biomass and have been adopted as the de facto standards within the biofuels community largely due to the transparency of the methods and the high reputation of NREL's research. Our dialog with stakeholders allows us to provide robust, precise, accurate, and publicly available analytical procedures for better valuation of scientific tools such as our recent accomplishment in developing a cellulose assay to support the EPA and industry in calculation of converted cellulose during starch ethanol production. We continue to develop analytical capabilities to support BETO's directives to research cost advantaged fuels such as animal wastes and novel bioproducts like 2,3-Butane-diol.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Screening and Brief Interventions for Alcohol Use During Pregnancy: Practices Among US Primary Care Clinicians, DocStyles 2019

Alcohol use during pregnancy can cause birth defects and developmental disabilities. From 2018 through 2020, 13.5% of pregnant women reported current drinking. The US Preventive Services Task Force recommends evidence-based tools (eg, AUDIT-C and SASQ) for implementing screening and brief interventions to reduce excessive alcohol use among adults, including pregnant people, for whom any alcohol use is considered excessive. We used DocStyles 2019 data to conduct a cross-sectional analysis to examine current screening and brief intervention practices that primary care clinicians conduct among pregnant patients; clinicians’ confidence levels in conducting screening, brief interventions, and referral to treatment; and the documentation of brief interventions in the medical record. A total of 1,500 US adult medicine clinicians completed the entire survey. Among the respondents who conduct screening (N = 1,373) and brief interventions (N = 1,357) in their practice, nearly all reported implementing screening (94.6%) and brief interventions (94.9%) with their pregnant patients for alcohol use, but fewer than half felt confident about conducting their screening practices (46.5%). Two-thirds (64%) reported using a tool that met the criteria recommended by the US Preventive Services Task Force (USPSTF). Over half documented brief interventions in electronic health record notes (51.7%) or designated space (50.7%). Pregnancy presents a unique opportunity for clinicians to incorporate screening into routine obstetric care and encourage behavior change among patients. Most providers reported always screening their pregnant patients for alcohol use, but fewer used evidence-based USPSTF-recommended screening tools. Increased clinician confidence in screening and brief intervention, the use of standardized screening tools tailored to pregnant people, and maximal use of electronic health record technology may enhance the benefits of their application to alcohol use, which ultimately can reduce adverse outcomes associated with alcohol use during pregnancy.

60 APPLIED LIFE SCIENCES↗

New NDA Methods for Thorium Fuel Cycle Safeguards (Mid-Project Report)

This project is developing new Non-Destructive Assay (NDA) safeguards techniques for emergent thorium fuel cycles based on Neutron Resonance Transmission Analysis (NRTA), which can assay 233 U and 235 U when they are present together in a sample with potentially high gamma-ray backgrounds from fission products and 232 U. Existing passive techniques face large challenges for this task so new active interrogation methods are needed. This effort is also exploring how gamma-ray signatures can complement NRTA for enhanced assayed performance. This project leverages an NRTA system being developed at PNNL in collaboration with MIT, which uses a commercially available deuterium-tritium neutron generator at short standoff (~2 m). We aim to assess the feasibility and performance of these new NDA techniques for the range of relevant samples in thorium fuel cycles. Key advancements described in this mid-project report include NRTA system design for thorium safeguards measurements, characterization of 233 U oxide powder at PNNL, a survey of detector technologies suitable for NRTA in high gamma background environments, successful preliminary demonstration of a quantitative isotopic estimation algorithm, and first NRTA measurements of a thorium sample.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

RU-net for automatic characterization of TRISO fuel cross sections

During irradiation, phenomena such as kernel swelling and buffer densification may impact the performance of tristructural isotropic (TRISO) particle fuel. Post-irradiation microscopy is often used to identify these irradiation-induced morphologic changes. However, each fuel compact generally contains thousands of TRISO particles. Manually performing the work to get statistical information on these phenomena is cumbersome and subjective. Here, to reduce the subjectivity inherent in that process and to accelerate data analysis, we used convolutional neural networks (CNNs) to automatically segment cross-sectional images of microscopic TRISO layers. CNNs are a class of machine-learning algorithms specifically designed for processing structured grid data. They have gained popularity in recent years due to their remarkable performance in various computer vision tasks, including image classification, object detection, and image segmentation. In this research, we generated a large irradiated TRISO layer dataset with more than 2,000 microscopic images of cross-sectional TRISO particles and the corresponding annotated images. Based on these annotated images, we used different CNNs to automatically segment different TRISO layers. These CNNs include RU-Net (developed in this study), as well as three existing architectures: U-Net, Residual Network (ResNet), and Attention U-Net. The preliminary results show that the model based on RU-Net performs best in terms of Intersection over Union (IoU). Using CNN models, we can expedite the analysis of TRISO particle cross sections, significantly reducing the manual labor involved and improving the objectivity of the segmentation results.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Condition monitoring and anomaly detection in cyber-physical systems

The modern industrial environment is equipping myriads of smart manufacturing machines where the state of each device can be monitored continuously. Such monitoring can help identify possible future failures and develop a cost-effective maintenance plan. However, it is a daunting task to perform early detection with low false positives and negatives from the huge volume of collected data. This requires developing a holistic machine learning framework to address the issues in condition monitoring of high priority components and develop efficient techniques to detect anomalies that can detect and possibly localize the faulty components. This paper presents a comparative analysis of recent machine learning approaches for robust, cost-effective anomaly detection in cyber-physical systems. While detection has been extensively studied, very few researchers have analyzed the localization of the anomalies. We show that supervised learning outperforms unsupervised algorithms. For supervised cases, we achieve near-perfect accuracy of 98% (specifically for tree-based algorithms). In contrast, the best-case accuracy in the unsupervised cases was 63%—the area under the receiver operating characteristic curve (AUC) exhibits similar outcomes as an additional metric.

Marfo, William↗