Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “label quality”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Investigation of the Performance and Explainability Tradeoffs for Machine-Learning Models for Predictive Maintenance of Circulating Water Systems in Nuclear Power Plants

Predictive maintenance (PdM) has shown great potential for achieving substantial cost savings and enhancing the economic competitiveness of nuclear power plants (NPPs) in today's energy market. Among the different modeling approaches that exist, machine learning (ML) tools in particular have a demonstrated ability to handle high dimensional and multivariate data and to extract hidden relationships within data in industrial environments. While ML methods show great potential, their lack of explainability---especially for black-box models---is a major hurdle to their adoption. Moreover, considering the supposed trade-off between explainability and performance challenges, careful consideration must be made as to which of these quality aspects takes precedence in light of multiple modeling options, resource availability, and domain characteristics. The present work evaluates the performance of six ML models, each with a different degree of explainability, in classifying the conditions of circulating water pumps (CWPs) by utilizing sensor data from nuclear power plants. To determine the drivers behind the trade-offs presented by this array of models, this work also tests different combinations of CWP units as the training and testing data, degrees of data imbalance, and objective functions for hyperparameter tuning. It was found that black-box models tend to afford superior performance in cases where there are far more instances of one type of labeled data than of any other type. It is recommended that a guided procedure be followed for designing and delivering an ML system that is sufficiently explainable to all involved stakeholders.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Unsupervised Anomaly Detection in High-Dimensional Flight Data Using Convolutional Variational Auto-Encoder

The modern National Airspace System (NAS) is an extremely safe system. The industry has experienced a steady decrease in fatalities over the years. This can be contributed to both improved flight critical systems with redundant hardware and software protections as well as an increased focus on active monitoring and response to real time and historically identified vulnerabilities by implementing more resilient procedures and protocols. The main practice for identifying vulnerabilities in operations leverages domain expertise using knowledge about how the system should behave with the expected tolerances to known safety margins. This approach works well when the system has a well-defined operating condition. However, the operations in the NAS can be highly complex with various nuances that render it difficult to clearly pre-define all known safety vulnerabilities. With the advancement of data science and machine learning techniques, the potential to automatically identify emerging vulnerabilities in the observed operations has become more practical in recent years. The state-of-the-art anomaly detection approaches in aerospace data usually rely on supervised or semi-supervised learning. However, in many real-world problems such as flight safety creating labels for the data requires huge amount of efforts and is largely expensive. As a result, in this article, we develop a Convolutional Variational Auto-Encoder (CVAE), an unsupervised learning approach for anomaly detection in high-dimensional heterogeneous time-series data. We validate performance of CVAE compared to the state-of-the-art supervised learning approach (as an upper bound) as well as an supervised clustering based on K-Means (as a lower bound) on Yahoo!'s benchmark time series anomaly detection data. Finally, we showcase performance of CVAE on a case study of identifying anomalies in the first 60 seconds of commercial flights' take-offs using Flight Operational Quality Assurance (FOQA) data.

Milad Memarzadeh↗

Unsupervised Anomaly Detection in High-Dimensional Flight Data Using Convolutional Variational Auto-Encoder

The modern National Airspace System (NAS) is an extremely safe system and the aviation industry has experienced a steady decrease in fatalities over the years. This can be attributed to both improved flight critical systems with redundant hardware and software protections, as well as an increased focus on active monitoring and response to real time and historically identified vulnerabilities by implementing more resilient procedures and protocols. The main approach for identifying vulnerabilities in operations leverages domain expertise using knowledge about how the system should behave within the expected tolerances to known safety margins. This approach works well when the system has a well-defined operating condition. However, the operations in the NAS can be highly complex with various nuances that render it difficult to clearly pre-define all known safety vulnerabilities. With the advancement of data science and machine learning techniques, the potential to automatically identify emerging vulnerabilities in the observed operations has become more practical in recent years. The state-of-the-art anomaly detection approaches in aerospace data usually rely on supervised or semi-supervised learning. However, in many real-world problems such as flight safety, creating labels for the data requires huge amount of effort and is largely impractical. To address this challenge, we developed a Convolutional Variational Auto-Encoder (CVAE), which is an unsupervised learning approach for anomaly detection in high-dimensional heterogeneous time-series data. We validate performance of CVAE compared to the state-of-the-art supervised learning approach as well as unsupervised clustering-based approach using KMeans++ and kernel-based approach using One-Class Support Vector Machine (OC-SVM) on Yahoo!'s benchmark time series anomaly detection data. Finally, we showcase performance of CVAE on a case study of identifying anomalies in the first 60 seconds of commercial flights' take-offs using Flight Operational Quality Assurance (FOQA) data.

Memarzadeh, Milad↗

Mechanical ventilation and indoor air quality in recently constructed U.S. homes in marine and cold-dry climates

Data were collected to characterize whole-house mechanical ventilation (WHMV) and indoor air quality (IAQ) in 55 homes in the Marine climate of Oregon and the Cold-Dry climate of Colorado in the U.S. Sixteen homes were monitored for two weeks, with and without WHMV operating. Ventilation airflows; airtightness; time-resolved CO 2 , PM2.5 and radon; and time-integrated NO 2 , NO X and formaldehyde were measured. Participants provided information about IAQ-impacting activities, perceptions and ventilation use. All homes had operational cooktop ventilation and bathroom exhaust. Thirty homes had equipment that could meet the ASHRAE 62.2–2010 standard with continuous or controlled runtime and 34 had some WHMV operating as found. Thirty-five of 46 participants with WHMV reported they did not know how to operate it, and only half of the systems were properly labeled. Two-week homes had lower formaldehyde, radon, CO 2 and NO (NO X -NO 2 ) when operated with WHMV, and had faster PM 2.5 decays following indoor emission events. Overall IAQ satisfaction was similar in Oregon and Colorado, but more Colorado participants (19% vs 3%) felt their IAQ could be improved and more reported dryness as a problem (58% vs. 14%). The collected data indicate that there are benefits of operating WHMV, even when continuous use may not be needed because outdoor pollutant concentrations are low and indoor sources do not present substantial challenges.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Adaptive optical third-harmonic generation microscopy for in vivo imaging of tissues

Third-harmonic generation microscopy is a powerful label-free nonlinear imaging technique, providing essential information about structural characteristics of cells and tissues without requiring external labelling agents. In this work, we integrated a recently developed compact adaptive optics module into a third-harmonic generation microscope, to measure and correct for optical aberrations in complex tissues. Taking advantage of the high sensitivity of the third-harmonic generation process to material interfaces and thin membranes, along with the 1,300-nm excitation wavelength used here, our adaptive optical third-harmonic generation microscope enabled high-resolution in vivo imaging within highly scattering biological model systems. Examples include imaging of myelinated axons and vascular structures within the mouse spinal cord and deep cortical layers of the mouse brain, along with imaging of key anatomical features in the roots of the model plant Brachypodium distachyon. In all instances, aberration correction led to enhancements in image quality.

60 APPLIED LIFE SCIENCES↗

A robust method of nuclei isolation for single-cell RNA sequencing of solid tissues from the plant genus Populus

Single-cell transcriptome analysis has been extensively applied in humans and animal models to uncover gene expression heterogeneity between the different cell types of a tissue or an organ. It demonstrated its capability to discover key regulatory elements that determine cell fate during developmental programs. Single-cell analysis requires the isolation and labeling of the messenger RNA (mRNA) derived from each cell. These challenges were primarily addressed in mammals by developing microfluidic-based approaches. For plant species whose cells contain cell walls, these approaches have generally required the generation of isolated protoplasts. Many plant tissues’ secondary cell wall hinders enzymatic digestion required for individual protoplast isolation, resulting in an unequal representation of cell types in a protoplast population. This limitation is especially critical for cell types located in the inner layers of a tissue or the inner tissues of an organ. Consequently, single-cell RNA sequencing (scRNA-seq) studies using microfluidic approaches in plants have mainly been restricted to Arabidopsis roots, for which well-established procedures of protoplast isolation are available. Here we present a simple alternative approach to generating high-quality protoplasts from plant tissue by characterizing the mRNA extracted from individual nuclei instead of whole cells. We developed the protocol using two different plant materials with varying cellular complexity levels and cell wall structure, Populus shoot apices, and more lignified stems. Using the 10× Genomics Chromium technology, we show that this procedure results in intact mRNA isolation and limited leakage, with a broad representation of individual cell transcriptomes.

54 ENVIRONMENTAL SCIENCES↗

Classification and Localization of Fracture-Hit Events in Low-Frequency Distributed Acoustic Sensing Strain Rate with Convolutional Neural Networks

Summary Distributed acoustic sensing (DAS) has been used in the oil and gas industry as an advanced technology for surveillance and diagnostics. Operators use DAS to monitor hydraulic fracturing activities, examine well stimulation efficacy, and estimate complex fracture system geometries. Particularly, low-frequency DAS can detect geomechanical events such as fracture hits because hydraulic fractures propagate and create strain rate variations in the rock. Analysis of DAS data today is mostly done post-job and subject to interpretation methods. However, the continuous and dense data stream generated live by DAS poses the opportunity for more efficient and accurate real-time data-driven analysis. The objective of this study is to develop a machine learning-based workflow that can identify and locate fracture-hit events in simulated strain rate responses correlated with low-frequency DAS data. In this paper, “fracture hit” refers to a hydraulic fracture originating from a stimulated well intersecting an offset well. We start with building a single fracture propagation model to produce strain rate patterns observed at a hypothetical monitoring well. This model is used to generate two sets of strain rate responses with one set containing fracture-hit events. The labeled synthetic data are then used to train a custom convolutional neural network (CNN) model for identifying the presence of fracture-hit events. The same model is trained again for locating the event with the output layer of the model replaced with linear units. We achieved near-perfect predictions for both event classification and localization. These promising results prove the feasibility of using CNN for real-time event detection from fiber-optic sensing data. Additionally, we use edge detection techniques to recognize fracture-hit event patterns in strain rate images. The fracture-hit location can be identified using recognized pixels in the image. The accuracy of edge detection-based location identification is also plausible, but edge detection is dependent on the assumption of pattern shape and image quality, hence it is less robust compared to CNN models. This comparison further supports the need for CNN applications in image-based real-time fiber-optic sensing event detection.

Engineering↗

AI Model Benchmarking for Nonproliferation Applications: Steel Thread Benchmarking Task Force Technical Report (Rev. 2)

Steel Thread is a NA-22 venture that seeks to build trustworthy, reliable AI models that can be used in a wide variety of nonproliferation tasks. A key aspect of building these models is developing appropriate benchmarks and evaluation methods, which will enable the venture to identify and adapt models to provide the most value in the nonproliferation domain. Benchmarks must be relevant to key tasks in this domain, such as question answering, information retrieval, document summarization and classification, consensus analysis, and image and data analysis. This report 1) provides an overview of benchmark design, evaluation, and challenges; 2) reviews a variety of open benchmarks, with a focus on language models and tasks; and 3) identifies benchmarks that are most relevant to Steel Thread. This report is intended to serve as a basis for further efforts to classify and evaluate benchmarks and their correlation with success on nonproliferation-specific tasks. The Steel Thread venture has defined benchmarks to be a particular combination of a dataset (or datasets) and a metric (or metrics) conceptualized as representing one or more specific tasks or sets of abilities for a specific modality. It is adopted by a research community as a shared framework for comparing methods.1 It includes 1) Data: Labeled (a designated subset not used for training, which could be all the data), 2) Metric: A way to quantify performance, 3) Task/Ability: What the benchmark is testing, 4) Protocol: A structured and repeatable evaluation process, 5) Baseline/Reference Model: For comparison; could be statistical, rule-based, SME-derived, or another model, and 6) Maintenance Plan: to update with new information over time; important for long-term utility. For further clarity, the definition includes what a benchmark, in this context, is not. It is not a corpus of training data, specific to a model (it is intended to apply to a range of models), a universal evaluation of performance, a guarantee that the ‘top’ model on the leaderboard will be the best fit for every specific use case, an all-encompassing proof of a model’s universal quality, nor is it a one-size-fits-all measure of success. It does not cover every real-world constraint (like operational, ethical, or cost considerations), a systems integration test, or a unit test. This definition was inspired by and resulted from discussions within the Steel Thread Benchmarking Task Force. This group was formed to define what we would mean as a benchmark within Steel Thread but persisted as the need to develop a thorough understanding of the large and expanding existing benchmarking space. This technical report is a result of the group’s divide and conquer approach to exploring this space. The release of benchmarks might not be progressing as quickly as model development, but it is moving very fast, as many benchmarks quickly become saturated, when state-of-the-art models score so close to the benchmark’s ceiling that their results are virtually indistinguishable. At that point, the test no longer differentiates between new systems, so researchers usually stop reporting scores as the benchmark no longer informs about improvements from the next generation of models. In the OpenAI announcement of GPT-5, they reported results on six flagship public benchmarks (AIME 2025, SWE-bench Verified, Aider Polyglot, MMMU, HealthBench Hard, GPQA) but the full system-card covers roughly thirty-five separate evaluations, comprising hundreds of test task items in total. There have been some efforts to summarize benchmarks in specific fields, like for text-to-image generation, but these surveys have had a narrow methodology scope. Therefore, a comprehensive survey of all benchmarks or even all benchmarks that could be relevant to Steel Thread is outside of the scope of this report. We chose some specific benchmarks to investigate in detail.

97 MATHEMATICS AND COMPUTING↗

AssistTaxi: A Comprehensive Dataset for Taxiway Analysis and Autonomous Operations

The availability of high-quality datasets play a crucial role in advancing research and development especially, for safety critical and autonomous systems. This poster presents AssistTaxi, which is a comprehensive novel dataset which is a collection of images for runway and taxiway analysis. The dataset comprises of more than 300,000 frames of diverse and carefully collected data, gathered from Melbourne (MLB) and Grant-Valkaria (X59) general aviation airports. The importance of AssistTaxi lies in its potential to advance autonomous operations, enabling researchers and developers to train and evaluate algorithms for efficient and safe taxiing. Researchers can utilize AssistTaxi to benchmark their algorithms, assess performance, and explore novel approaches for runway and taxiway analysis. Additionally, the dataset serves as a valuable resource for validating and enhancing existing algorithms as well as facilitating innovation in autonomous operations for aviation. We also propose an initial approach to label the dataset using a contour based detection and line extraction technique.

Data Collection↗

Unsupervised Power System Event Detection and Classification Using Unlabeled PMU Data

This paper proposes a novel data-driven power system event detection and classification method based on 5TB of actual PMU measurements collected from the US western interconnect. Firstly, a set of comprehensive power quality rules are proposed to pre-filter the raw data and extract the regions of interest (ROI). Six distinct event categories are defined and corresponding patterns are chosen as references. Meanwhile, detailed characteristics of patterns are summarized to enhance our understanding of the actual events. Then, the time-independent feature vectors are generated by extracting the statistical, temporal, and spectral features from the raw time-series data. Furthermore, an ensemble model is proposed to cluster the events by combining multiple K-means clustering models using a voting strategy. Besides, both system-level and PMU-level clustering models are developed. The accuracy and robustness of the event detection method are further improved through interactive evaluation of the two-level clustering results. This paper summarizes the actual characteristics of each event category and provides a reliable basis for accurate label generation. The experiments demonstrate the effectiveness of the proposed event detection and classification method.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Unsupervised Power System Event Detection and Classification Using Unlabeled PMU Data

This paper proposes a novel data-driven power system event detection and classification method based on 5TB of actual PMU measurements collected from the US western interconnect. Firstly, a set of comprehensive power quality rules are proposed to pre-filter the raw data and extract the regions of interest (ROI). Six distinct event categories are defined and corresponding patterns are chosen as references. Meanwhile, detailed characteristics of patterns are summarized to enhance our understanding of the actual events. Then, the time-independent feature vectors are generated by extracting the statistical, temporal, and spectral features from the raw time-series data. Furthermore, an ensemble model is proposed to cluster the events by combining multiple K-means clustering models using a voting strategy. Besides, both system-level and PMU-level clustering models are developed. The accuracy and robustness of the event detection method are further improved through interactive evaluation of the two-level clustering results. This paper summarizes the actual characteristics of each event category and provides a reliable basis for accurate label generation. The experiments demonstrate the effectiveness of the proposed event detection and classification method.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Evaluation of artificial neural network performance for classification of potato plants infected with potato virus Y using spectral data on multiple varieties and genotypes

Potato virus Y (Potyviridae, PVY) is a plant virus that poses a significant threat to potato producers on a global basis. The pathogen has disrupted seed potato supplies and negatively impacted yield and quality of commercial potato crops. The potato industry currently manages PVY infection levels via insecticide applications, regional seed certification programs that rely on field scouting to visually assess individual plants for infection status, and destructive and costly tissue sampling coupled with laboratory assays. Despite these efforts, PVY continues to confound potato industry stakeholders resulting in economic harm. Remote sensing and machine learning provide for the development of new tools to more accurately detect and spatially quantify PVY-infected plants versus the current state of the art. However, there is a need to understand how the occurrence of many different potato varieties impact the dynamics of developing models to detect potato plants impacted with PVY and their potential effectiveness. This study evaluates classification modelling outcomes using spectral datasets collected in different temporal and spatial environments (greenhouse and a production field) on multiple potato varieties consisting of labelled instances of plants infected with PVY and those not infected with the virus. A modelling framework was developed to support iterative modelling runs using artificial neural network (ANN) architectures configured as binary classifiers to develop sample populations to support statistical analysis on model performance using specific spectral subsets. When using spectral data to detect PVY-infected plants, ANN models achieved the highest mean accuracy of 0.894 on a single variety. Conversely, the same ANN model architecture only achieved a mean accuracy of 0.575 on a spectral data set representing 29 potato breeding lines. Additionally, statistical analysis indicates spectral regions including the red edge, near infrared and shortwave infrared contain more important spectral features for the ANN classifier introduced in this research.

60 APPLIED LIFE SCIENCES↗

Acquisition of a Gas Chromatograph/Mass Spectrometer System for Laboratory Study of Prebiotic Organic Geochemical Processes on the Early Earth, Mars, and Meteorites

This was a major equipment grant that provided funds ($72K) for purchase of a benchtop gas chromatograph-mass spectrometer (GC-MS) for use in experimental studies of prebiotic organic compounds. An Agilent model 689015973 GC-MS was purchased and installed in the PI's lab in August of 2003. The instrument is now being used for a variety of research projects. The primary use of the instrument is to analyze and quantify organic products of laboratory experiments conducted by the PI. One example is shown, which shows organic products (predominantly n-alkanes) formed during Fischer-Tropsch-type abiotic synthesis under hydrothermal conditions. The analytical capabilities of the GC- MS allowed identification of the numerous organic products of this as well as other laboratory experiments. A key use of the instrument in this research is that the mass spectrometer capabilities allow use of isotopically labeled reactants to trace the progress of reactions and evaluate background contaminants. collaborative projects with other scientists involved in exobiology & astrobiology research (e.g., Mitch Schulte, NASA Ames; Katrina Edwards, Woods Hole Oceanographic Institution). For instance, an analysis of membrane lipids of an lithoautotrophic iron-oxidizing bacteria being grown on basalt as a source of metabolic energy, a project where the instrument is being used to evaluate possible biomarker compounds from these organisms is shown. These iron oxidizers are thought to be similar to those living within the ocean crust, and are being investigated as possible analog organisms to those on the early Earth or crust of Mars. The instrument has also been used by an outside investigator (graduate student Brandon Canfeld, Arizona State University) for identification and isotopic characterization of experimental products of abiotic organic synthesis experiments he is conducting with Dr. John Holloway. analysis of quality control samples for other NASA-funded projects. For instance, an analysis of residual hydrocarbon contaminants on the internal surface of the shell of an atmospheric sounding rocket is shown. This analysis was used to help determine the source of the contaminating compounds. In the future, the instrument will continue to be used for quality control analysis in clean rooms and instrument construction facilities within the Laboratory for Atmospheric and Space Physics, where the GC-MS is housed.

McCollom, Thomas↗

Label-free quantum super-resolution imaging using entangled multi-mode squeezed light

Abstract In this study, we explore the theoretical application of entangled multi-mode squeezed light for label-free optical super-resolution imaging. By generating massively entangled multi-mode squeezed light through an array of balanced beam splitters, using a single-mode squeezed light input, we create a multi-mode quantum light state with exceptional entanglement and noise suppression below the shot noise level. This significantly reduces imaging measurement errors compared to classical coherent state light imaging when the same number of photons are used on the imaging sample. We demonstrate how to optimize the imaging system’s parameters to achieve the Heisenberg imaging error limit, taking into account the number of entangled modes and photons used. We also examine the effects of optical losses in the imaging system, necessitating adjustments to the optimized parameters based on the degree of optical loss. In practical applications, this new quantum imaging approach reduces the number of photons needed to achieve the same image quality by two orders of magnitude compared to classical imaging methods that use non-entangled, non-squeezed coherent state light.

Soh, Daniel (ORCID:0000000325625675)↗

Indoor air quality in California homes with code-required mechanical ventilation

Data were collected in 70 detached houses built in 2011-2017 in compliance with the mechanical ventilation requirements of California's building energy efficiency standards. Each home was monitored for a 1-week period with windows closed and the central mechanical ventilation system operating. Pollutant measurements included time-resolved fine particulate matter (PM 2.5 ) indoors and outdoors and formaldehyde and carbon dioxide (CO 2 ) indoors. Time-integrated measurements were made for formaldehyde, NO 2 , and nitrogen oxides (NO X ) indoors and outdoors. Operation of the cooktop, range hood, and other exhaust fans was continuously recorded during the monitoring period. Onetime diagnostic measurements included mechanical airflows and envelope and duct system air leakage. All homes met or were very close to meeting the ventilation requirements. On average, the dwelling unit ventilation fan moved 50% more airflow than the minimum requirement. Pollutant concentrations were similar to or lower than those reported in a 2006-2007 study of California new homes built in 2002-2005. Mean and median indoor concentrations were lower by 44% and 38% for formaldehyde and 44% and 54% for PM 2.5 . Ventilation fans were operating in only 26% of homes when first visited, and the control switches in many homes did not have informative labels as required by building standards.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Deep learning with mixup augmentation for improved pore detection during additive manufacturing

In additive manufacturing (AM), process defects such as keyhole pores are difficult to anticipate, affecting the quality and integrity of the AM-produced materials. Hence, considerable efforts have aimed to predict these process defects by training machine learning (ML) models using passive measurements such as acoustic emissions. This work considered a dataset in which keyhole pores of a laser powder bed fusion (LPBF) experiment were identified using X-ray radiography and then registered both in space and time to acoustic measurements recorded during the LPBF experiment. Due to AM’s intrinsic process controls, where a pore-forming event is relatively rare, the acoustic datasets collected during monitoring include more non-pores than pores. In other words, the dataset for ML model development is imbalanced. Moreover, this imbalanced and sparse data phenomenon remains ubiquitous across many AM monitoring schemes since training data is nontrivial to collect. Hence, we propose a machine learning approach to improve this dataset imbalance and enhance the prediction accuracy of pore-labeled data. Specifically, we investigate how data augmentation helps predict pores and non-pores better. This imbalance is improved using recent advances in data augmentation called Mixup, a weak-supervised learning method. Convolutional neural networks (CNNs) are trained on original and augmented datasets, and an appreciable increase in performance is reported when testing on five different experimental trials. When ML models are trained on original and augmented datasets, they achieve an accuracy of 95% and 99% on test datasets, respectively. We also provide information on how dataset size affects model performance. Lastly, we investigate the optimal Mixup parameters for augmentation in the context of CNN performance.

36 MATERIALS SCIENCE↗

Deep learning with mixup augmentation for improved pore detection during additive manufacturing

In additive manufacturing (AM), process defects such as keyhole pores are difficult to anticipate, affecting the quality and integrity of the AM-produced materials. Hence, considerable efforts have aimed to predict these process defects by training machine learning (ML) models using passive measurements such as acoustic emissions. This work considered a dataset in which keyhole pores of a laser powder bed fusion (LPBF) experiment were identified using X-ray radiography and then registered both in space and time to acoustic measurements recorded during the LPBF experiment. Due to AM’s intrinsic process controls, where a pore-forming event is relatively rare, the acoustic datasets collected during monitoring include more non-pores than pores. In other words, the dataset for ML model development is imbalanced. Moreover, this imbalanced and sparse data phenomenon remains ubiquitous across many AM monitoring schemes since training data is nontrivial to collect. Hence, we propose a machine learning approach to improve this dataset imbalance and enhance the prediction accuracy of pore-labeled data. Specifically, we investigate how data augmentation helps predict pores and non-pores better. This imbalance is improved using recent advances in data augmentation called Mixup, a weak-supervised learning method. Convolutional neural networks (CNNs) are trained on original and augmented datasets, and an appreciable increase in performance is reported when testing on five different experimental trials. When ML models are trained on original and augmented datasets, they achieve an accuracy of 95% and 99% on test datasets, respectively. We also provide information on how dataset size affects model performance. Lastly, we investigate the optimal Mixup parameters for augmentation in the context of CNN performance.

42 ENGINEERING↗

Development of 52Mn Labeled Trastuzumab for Extended Time Point PET Imaging of HER2

Abstract Purpose Due to their long circulation time in the blood, monoclonal antibodies (mAbs) such as trastuzumab, are usually radiolabeled with long-lived positron emitters for the development of agents for Positron Emission Tomography (PET) imaging. Manganese-52 ( 52 Mn, t 1/2 = 5.6 d, β + = 29.6%, E(β ave ) = 242 keV) is suitable for imaging at longer time points providing a complementary technique to Zirconium-89 ( 89 Zr, t 1/2 = 3.3 d, β + = 22.7%, E(β ave ) = 396 keV)) because of its long half-life and low positron energy. To exploit these properties, we aimed to investigate suitable bifunctional chelators that could be readily conjugated to antibodies and labeled with 52 Mn under mild conditions using trastuzumab as a proof-of-concept. Procedures Trastuzumab was incubated with S-2-(4-isothiocyanatobenzyl)-1,4,7,10-tetraazacyclododecane tetraacetic acid (p-SCN-Bn-DOTA), 1-Oxa-4,7,10-tetraazacyclododecane-5-S-(4-isothiocyantobenzyl)-4,7,10-triacetic acid (p-SCN-Bn-Oxo-DO3A), and 3,6,9,15-tetraazabicyclo[9.3.1] pentadeca-1(15),11,13-triene-4-S-(4-isothiocyanatobenzyl)-3,6,9-triacetic acid (p-SCN-Bn-PCTA) at a tenfold molar excess. The immunoconjugates were purified, combined with [ 52 Mn]MnCl 2 at different ratios, and the labeling efficiency was assessed by iTLC. The immunoreactive fraction of the radiocomplex was determined through a Lindmo assay. Cell studies were conducted in HER2 + (BT474) and HER2- (MDA-MB-468) cell lines followed by in vivo studies. Results Trastuzumab-Oxo-DO3A was labeled within 30 min at 37 °C with a radiochemical yield (RCY) of 90 ± 1.5% and with the highest specific activity of the chelators investigated of 16.64 MBq/nmol. The labeled compound was purified with a resulting radiochemical purity of > 98% and retained a 67 ± 1.2% immunoreactivity. DOTA and PCTA immunoconjugates resulted in < 50 ± 2.5% (RCY) with similar specific activity. Mouse serum stability studies of [ 52 Mn]Mn-Oxo-DO3A-trastuzumab showed 95% intact complex for over 5 days. Cell uptake studies showed higher uptake in HER2 + (12.51 ± 0.83% /mg) cells compared to HER2- (0.85 ± 0.10%/mg) cells. PET images of mice bearing BT474 tumors showed high tumor uptake that was consistent with the biodistribution (42.02 ± 2.16%ID/g, 14 d) compared to MDA-MB-468 tumors (2.20 ± 0.80%ID/g, 14 d). Additionally, both models exhibited low bone uptake of < 1% ID/g. Conclusion The bifunctional chelator p-SCN-Bn-Oxo-DO3A is promising for the development of 52 Mn radiopharmaceuticals as it was easily conjugated, radiolabeled at mild conditions, and illustrated stability for a prolonged duration both in vitro and in vivo . High-quality PET/CT images of [ 52 Mn]Mn-Oxo-DO3A-trastuzumab were obtained 14 d post-injection. This study illustrates the potential of [ 52 Mn]Mn-Oxo-DO3A for the evaluation of antibodies using PET imaging.

Omweri, James M.↗