Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “label transfer”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

RADAMS: Resilient and adaptive alert and attention management strategy against Informational Denial-of-Service (IDoS) attacks

Attacks exploiting human attentional vulnerability have posed severe threats to cybersecurity. In this work, we identify and formally define a new type of proactive attentional attacks called Informational Denial-of-Service (IDoS) attacks that generate a large volume of feint attacks to overload human operators and hide real attacks among feints. Here, we incorporate human factors (e.g., levels of expertise, stress, and efficiency) and empirical psychological results (e.g., the Yerkes-Dodson law and the sunk cost fallacy) to model the operators’ attention dynamics and their decision-making processes along with the real-time alert monitoring and inspection. To assist human operators in dismissing the feints and escalating the real attacks timely and accurately, we develop a Resilient and Adaptive Data-driven alert and Attention Management Strategy (RADAMS) that de-emphasizes alerts selectively based on the abstracted category labels of the alerts. RADAMS uses reinforcement learning to achieve a customized and transferable design for various human operators and evolving IDoS attacks. The integrated modeling and theoretical analysis lead to the Product Principle of Attention (PPoA), fundamental limits, and the tradeoff among crucial human and economic factors. Experimental results corroborate that the proposed strategy outperforms the default strategy and can reduce the IDoS risk by as much as 20%. Besides, the strategy is resilient to large variations of costs, attack frequencies, and human attention capacities. We have recognized interesting phenomena such as attentional risk equivalency, attacker’s dilemma, and the half-truth optimal attack strategy.

97 MATHEMATICS AND COMPUTING↗

Fine-tuning TrailMap: The utility of transfer learning to improve the performance of deep learning in axon segmentation of light-sheet microscopy images

Light-sheet microscopy has made possible the 3D imaging of both fixed and live biological tissue, with samples as large as the entire mouse brain. However, segmentation and quantification of that data remains a time-consuming manual undertaking. Machine learning methods promise the possibility of automating this process. This study seeks to advance the performance of prior models through optimizing transfer learning. We fine-tuned the existing TrailMap model using expert-labeled data from noradrenergic axonal structures in the mouse brain. By changing the cross-entropy weights and using augmentation, we demonstrate a generally improved adjusted F1-score over using the originally trained TrailMap model within our test datasets.

97 MATHEMATICS AND COMPUTING↗

Deep Domain Adaptation based Cloud Type Detection using Active and Passive Satellite Data

Domain adaptation techniques have been developed to handle data from multiple sources or domains. Most existing domain adaptation models assume that source and target domains are homogeneous, i.e., they have the same feature space. Nevertheless, many real world applications often deal with data from heterogeneous domains that come from completely different feature spaces. In our remote sensing application, data in source domain (from an active spaceborne Lidar sensor CALIOP onboard CALIPSO satellite) contain 25 attributes, while data in target domain (from a passive spectroradiometer sensor VIIRS onboard Suomi-NPP satellite) contain 20 different attributes. CALIOP has better representation capability and sensitivity to aerosol types and cloud phase, while VIIRS has wide swaths and better spatial coverage but has inherent weakness in differentiating atmospheric objects on different vertical levels. To address this mismatch of features across the domains/sensors, we propose a novel end-to-end deep domain adaptation with domain mapping and correlation alignment (DAMA) to align the heterogeneous source and target domains in active and passive satellite remote sensing data. It can learn domain invariant representation from source and target domains by transferring knowledge across these domains, and achieve additional performance improvement by incorporating weak label information into the model (DAMA-WL). Our experiments on a collocated CALIOP and VIIRS dataset show that DAMA and DAMA-WL can achieve higher classification accuracy in predicting cloud types.

domain adaptation↗

Increasing Linear Dynamic Range of a CMOS Image Sensor

A generic design and a corresponding operating sequence have been developed for increasing the linear-response dynamic range of a complementary metal oxide/semiconductor (CMOS) image sensor. The design provides for linear calibrated dual-gain pixels that operate at high gain at a low signal level and at low gain at a signal level above a preset threshold. Unlike most prior designs for increasing dynamic range of an image sensor, this design does not entail any increase in noise (including fixed-pattern noise), decrease in responsivity or linearity, or degradation of photometric calibration. The figure is a simplified schematic diagram showing the circuit of one pixel and pertinent parts of its column readout circuitry. The conventional part of the pixel circuit includes a photodiode having a small capacitance, CD. The unconventional part includes an additional larger capacitance, CL, that can be connected to the photodiode via a transfer gate controlled in part by a latch. In the high-gain mode, the signal labeled TSR in the figure is held low through the latch, which also helps to adapt the gain on a pixel-by-pixel basis. Light must be coupled to the pixel through a microlens or by back illumination in order to obtain a high effective fill factor; this is necessary to ensure high quantum efficiency, a loss of which would minimize the efficacy of the dynamic- range-enhancement scheme. Once the level of illumination of the pixel exceeds the threshold, TSR is turned on, causing the transfer gate to conduct, thereby adding CL to the pixel capacitance. The added capacitance reduces the conversion gain, and increases the pixel electron-handling capacity, thereby providing an extension of the dynamic range. By use of an array of comparators also at the bottom of the column, photocharge voltages on sampling capacitors in each column are compared with a reference voltage to determine whether it is necessary to switch from the high-gain to the low-gain mode. Depending upon the built-in offset in each pixel and in each comparator, the point at which the gain change occurs will be different, adding gain-dependent fixed pattern noise in each pixel. The offset, and hence the fixed pattern noise, is eliminated by sampling the pixel readout charge four times by use of four capacitors (instead of two such capacitors as in conventional design) connected to the bottom of the column via electronic switches SHS1, SHR1, SHS2, and SHR2, respectively, corresponding to high and low values of the signals TSR and RST. The samples are combined in an appropriate fashion to cancel offset-induced errors, and provide spurious-free imaging with extended dynamic range.

Pain, Bedabrata↗

Phosphorothioate-Based Site-Specific Labeling of Large RNAs for Structural and Dynamic Studies

Pulsed electron-electron double resonance (PELDOR) spectroscopy, X-ray scattering interferometry (XSI), and single-molecule Forster resonance energy transfer (smFRET) are molecular rulers that provide inter- or intramolecular pair-wise distance distributions in the nanometer range, thus being ideally suitable for structural and dynamic studies of biomolecules including RNAs. The prerequisite for such applications requires site-specific labeling of biomolecules with spin labels, gold nanoparticles, and fluorescent tags, respectively. Recently, site-specific labeling of large RNAs has been achieved by a combination of transcription of an expanded genetic alphabet containing A-T/G-C base pairs and NaM-TPT3 unnatural base pair (UBP) with posttranscriptional modifications at UBP bases by click chemistry or amine-NHS ester reactions. However, due to the bulky sizes of functional groups or labeling probes used, such strategies might cause structural perturbation and decrease the accuracy of distance measurements. Here, we synthesize an a-thiophosphorylated variant of rTPT3TP (rTPT3aS), which allows for post-transcriptional site-specific labeling of large RNAs at the internal a-phosphate backbone via maleimide-modified probes. Subsequent PELDOR, XSI, and smFRET measurements result in narrower distance distributions than labeling at the TPT3 base. The presented strategy provides a new route to empower the molecular rulers for structural and dynamic studies of large RNA and its complex.

59 BASIC BIOLOGICAL SCIENCES↗

Three-dimensional feature matching improves coverage for single-cell proteomics based on ion mobility filtering

Single-cell proteomics (scProteomics) promises to advance our understanding of cell functions within complex biological systems. However, a major challenge of current methods is their inability to identify and provide accurate quantitative information for low abundance proteins. Herein, we describe an ion mobility-enhanced mass spectrometry acquisition and peptide identification method, TIFF (Transferring Identification based on FAIMS Filtering), to improve the sensitivity and accuracy of label-free scProteomics. TIFF extends the ion accumulation times for peptide ions by filtering out singly charged ions. The peptide identities are assigned by a three-dimensional MS1 feature matching approach (retention time, accurate mass, and FAIMS compensation voltage). TIFF method enabled unbiased proteome analysis to a depth of >1,700 proteins in single HeLa cells with >1,100 proteins consistently identified. As a demonstration, we applied the TIFF method to obtain temporal proteome profiles of >150 single murine macrophage cells during lipopolysaccharide stimulation and identified time-dependent proteome changes.

59 BASIC BIOLOGICAL SCIENCES↗

Historical land management alters new soil carbon inputs by annual and perennial bioenergy crops

Bioenergy and bioproduct markets are expanding to meet demand for climate friendly goods and services. Perennial biomass crops are particularly well suited for this goal because of their high yields, low input requirements, and potential to increase soil carbon (C). However, it is unclear how much C is allocated into belowground pools by perennial bioenergy crops and whether the belowground benefits vary with nitrogen (N) fertilizer inputs. Using in situ 13C pulse-chase labeling, we tested whether the sterile perennial grass Miscanthus × giganteus ( miscanthus ) or annual maize transfers more photosynthetic C to belowground pools. The experiment took place at two sites in Central and Northwest (NW) Iowa with different management histories and two nitrogen (N) fertilizer rates (0 and 224 kg N ha-1 yr-1) to determine if the fate of plant-derived soil C depends on soil fertility and crop type (perennial or annual). Maize allocated a greater percentage of total new 13C to roots than miscanthus, but miscanthus had greater new 13C in total and belowground plant biomass. We found strong interactions between site and most soil measurements – including new 13C in mineral and particulate soil organic matter (SOM) pools –which appear to be driven by differences in historical fertilizer management. The NW Iowa site, with a history of manure inputs, had greater plant-available nutrients (phosphorus, potassium, and ammonium) in soils, and resulted in less 13C from miscanthus in SOM pools compared to maize (approximately 64% less in POM and 70% less in MAOM). In more nutrient-limited soils (Central site), miscanthus transferred 4.5 times more 13C than maize to the more stable mineral-associated SOM pool. Our results suggest that past management, including historical manure inputs that affect a site’s soil fertility, can influence the net C benefits of bioenergy crops.

Keiser, Ashley [Stockbridge School of Agriculture,↗

Impact of nutritional history, prey quality, and quantity on grazing and photophysiological responses in the mixoplanktonic dinoflagellate Karenia brevis

The mixotrophic toxic dinoflagellate Karenia brevis forms red tides almost annually along Florida's Gulf coast. We hypothesize that the nutritional status and abundance of its prey, the picocyanobacterium Synechococcus , will affect its feeding rates and growth responses, with implications for bloom dynamics. This study investigated how prey nutritional quality and quantity (absolute and relative) impact grazing rates by K. brevis initially exponentially growing and in nitrogen (N)-limited conditions, and how grazing, in turn, affects the photophysiological responses of predator and prey. Prey quality was manipulated by providing Synechococcus grown under different ratios of N : phosphorus (P). Synechococcus quality did not significantly affect ingestion rates (measured as prey death rate) but grazing rates increased with increasing prey : grazer ratios (R 2 = 0.7). Compared to control, the growth of exponentially growing grazers doubled when Synechococcus was provided, whereas there was no growth enhancement when Synechococcus of varying qualities was provided to N-limited, chemostat-seeded grazers. Despite this doubled growth, 15 N labeling of the prey and nanoscale secondary ion mass spectrometry (nanoSIMS) detected low Synechococcus -N transfer into grazer biomass after 3 d (< 1% on a cell basis). This suggests the potential of grazers benefiting from alternative N sources (e.g., microbiome-N) or other constituents (e.g., vitamins or metals) not measured in this study. Prey photosynthetic efficiency declined under grazing conditions, demonstrating that grazers can directly affect prey abundance through grazing and indirectly affect prey photophysiology, potentially via allelopathy, supporting previous findings of an inverse relationship between grazers and prey along the Florida Gulf Coast.

Ahn, So Hyun [Univ. of Maryland, Cambridge, MD (Un↗

The ‘photosynthetic C 1 pathway’ links carbon assimilation and growth in California poplar

Although primarily studied in relation to photorespiration, serine metabolism in chloroplasts may play a key role in plant CO 2 fertilization responses by linking CO 2 assimilation with growth. Here, we show that the phosphorylated serine pathway is part of a 'photosynthetic C 1 pathway' and demonstrate its high activity in foliage of a C 3 tree where it rapidly integrates photosynthesis and C 1 metabolism contributing to new biomass via methyl transfer reactions, imparting a large natural 13 C-depleted signature. Using 13 CO 2 -labelling, we show that leaf serine, the S-methyl group of leaf methionine, pectin methyl esters, and the associated methanol released during cell wall expansion during growth, are directly produced from photosynthetically-linked C 1 metabolism, within minutes of light exposure. We speculate that the photosynthetic C 1 pathway is highly conserved across the photosynthetic tree of life, is responsible for synthesis of the greenhouse gas methane, and may have evolved with oxygenic photosynthesis by providing a mechanism of directly linking carbon and ammonia assimilation with growth. Although the rise in atmospheric CO 2 inhibits major metabolic pathways like photorespiration, our results suggest that the photosynthetic C 1 pathway may accelerate and represents a missing link between enhanced photosynthesis and plant growth rates during CO 2 fertilization under a changing climate.

59 BASIC BIOLOGICAL SCIENCES↗

Impact of Small-Alkane Solvents on Polyolefin Hydrogenolysis over a Ruthenium Catalyst

Selective catalytic hydrogenolysis of polyolefins is a promising route to convert plastic waste into valuable liquid products, such as lubricants, waxes, and surfactants. However, the high viscosity of polymer melts imposes mass transfer limitations on this reaction. Solvents can mitigate these challenges, but their effects on reaction kinetics and product selectivity remain underexplored. Here, we systematically explore the effects of small n-alkanes and cycloalkanes on the hydrogenolysis of polyethylene and polypropylene over a Ru/TiO 2 catalyst. Using kinetic measurements and isotopic labeling, we show that n-octane at high mass fractions alters the mechanism from direct hydrogenation to solvent-mediated hydrogen transfer, reducing the rate of C–C bond cleavage. Longer alkanes further inhibit reactivity due to stronger surface binding. 1,4-Dimethylcyclohexane suppresses methane formation, favoring heavier products, while decalin likely forms surface-bound aromatics that poison the catalyst. Overall, alkane solvents modulate product selectivity and reduce the yield of methane byproduct, allowing for ∼35–40% selectivity to valuable C 20 -C 30 alkane products. This work highlights the complex impact of polymer–alkane mixtures on hydrogenolysis kinetics relevant to the design of commercial-scale plastic waste valorization processes.

Catalysts↗

Method for simultaneous characterization and expansion of reference libraries for small molecule identification

A variational autoencoder (VAE) has been developed to learn a continuous numerical, or latent, representation of molecular structure to expand reference libraries for small molecule identification. The VAE has been extended to include a chemical property decoder, trained as a multitask network, to shape the latent representation such that it assembles according to desired chemical properties. The approach is unique in its application to metabolomics and small molecule identification, focused on properties that are obtained from experimental measurements (m/z, CCS) paired with its training paradigm, which involves a cascade of transfer learning iterations. First, molecular representation is learned from a large dataset of structures with m/z labels. Next, in silico property values are used to continue training. Finally, the network is further refined by being trained with the experimental data. The trained network is used to predict chemical properties directly from structure and generate candidate structures with desired chemical properties. The network is extensible to other training data and molecular representations, and for use with other analytical platforms, for both chemical property and feature prediction as well as molecular structure generation.

Colby, Sean M.↗

Carbon Nanostructures in Biological Sensors for Space and Terrestrial Applications

Biosensing devices comprised of carbon nanotubes and nanofibers have been developed for astronaut crew point-of-care. Their inherent nanometer scale, high conductivity, wide potential window, good biocompatibility and well-defined surface chemistry make them ideal candidates as biosensor electrodes. Here, we report two studies using carbon nanotube and carbon nanofiber electrodes for biomedical applications. First, a 3x3 electrode device, with each electrode containing 40,000 carbon nanofiber nanoelectrodes was fabricated on silicon using traditional microfabrication processing. The device was demonstrated as a multiplexed immunosensor for simultaneous, label-free detection of cardiac troponin-I, C-reactive protein and myoglobin. Antibodies specific to cardiac troponin-I, C-reactive protein and myoglobin were covalently bound to the CNF surface and were characterized using electrochemical impedance spectroscopy and differential pulse voltammetry. Each step of the modification process resulted in changes in resistance to charge transfer due to the changes at the electrode surface upon antibody immobilization and binding to the specific cardiac protein. The real-time label free detection of the three cardiac markers from pure components and mixtures was demonstrated with high sensitivity, down to 0.2 ng/mL, and good selectivity. Detection in human blood serum did not present false positives from non-specific protein adsorption. More recently, this detection scheme has been applied to inkjet printed carbon nanotube electrodes on Kapton and paper. Printed devices have several unique advantages including simple and inexpensive fabrication. The results demonstrate that these sensors can serve a miniaturized, low cost device for detection of proteins in complex mixtures making this platform a good candidate for early stage diagnosis of myocardial infarction. Future inkjet printed devices can be fabricated have the added advantage in their suitability to be manufactured in an in-space, microgravity environment.

carbon nanotubes↗

Carbon Nanomaterials for Biosensing Applications

Biosensing devices comprised of carbon nanotubes and nanofibers have been developed for astronaut crew point-of-care. Their inherent nanometer scale, high conductivity, wide potential window, good biocompatibility and well-defined surface chemistry make them ideal candidates as biosensor electrodes. Here, we report two studies using carbon nanotube and carbon nanofiber electrodes for biomedical applications. First, a 3x3 electrode device, with each electrode containing 40,000 carbon nanofiber nanoelectrodes was fabricated on silicon using traditional microfabrication processing. The device was demonstrated as a multiplexed immunosensor for simultaneous, label-free detection of cardiac troponin-I, C-reactive protein and myoglobin. Antibodies specific to cardiac troponin-I, C-reactive protein and myoglobin were covalently bound to the CNF surface and were characterized using electrochemical impedance spectroscopy and differential pulse voltammetry. Each step of the modification process resulted in changes in resistance to charge transfer due to the changes at the electrode surface upon antibody immobilization and binding to the specific cardiac protein. The real-time label free detection of the three cardiac markers from pure components and mixtures was demonstrated with high sensitivity, down to 0.2 ng/mL, and good selectivity. Detection in human blood serum did not present false positives from non-specific protein adsorption. More recently, this detection scheme has been applied to inkjet printed carbon nanotube electrodes on Kapton and paper. Printed devices have several unique advantages including simple and inexpensive fabrication. The results demonstrate that these sensors can serve a miniaturized, low cost device for detection of proteins in complex mixtures making this platform a good candidate for early stage diagnosis of myocardial infarction. Future inkjet printed devices can be fabricated have the added advantage in their suitability to be manufactured in an in-space, microgravity environment.

carbon nanotubes↗

Sim-to-real supervised domain adaptation for radioisotope identification

Machine learning has the potential to improve the speed and reliability of radioisotope identification using gamma spectroscopy. However, meticulously labeling an experimental dataset for training is often prohibitively expensive, while training models purely on synthetic data is risky due to the domain gap between simulated and experimental measurements. In this research, we demonstrate that supervised domain adaptation can substantially improve the performance of radioisotope identification models by transferring knowledge between synthetic and experimental data domains. We consider two domain adaptation scenarios: (1) a simulation-to-simulation adaptation, where we perform multi-label proportion estimation using simulated high-purity germanium detectors, and (2) a simulation-to-experimental adaptation, where we perform multi-class, single-label classification using measured spectra from handheld lanthanum bromide (LaBr) and sodium iodide (NaI) detectors. We begin by pretraining a spectral classifier on synthetic data using a custom transformer-based neural network. After subsequent fine-tuning on just 64 labeled experimental spectra, we achieve a test accuracy of 96% in the sim-to-real scenario with a LaBr detector, far surpassing a synthetic-only baseline model (75%) and a model trained from scratch (80%) on the same 64 spectra. Furthermore, we demonstrate that domain-adapted models learn more human-interpretable features than experiment-only baseline models. Overall, our results highlight the potential for supervised domain adaptation techniques to bridge the sim-to-real gap in radioisotope identification, enabling the development of accurate and explainable classifiers even in real-world scenarios where access to experimental data is limited.

Lalor, Peter W.↗

De Novo Design of Proteins That Bind Naphthalenediimides, Powerful Photooxidants with Tunable Photophysical Properties

De novo protein design provides a framework to test our understanding of protein function and build proteins with cofactors and functions not found in nature. Here, we report the design of proteins designed to bind powerful photooxidants and the evaluation of the use of these proteins to generate diffusible small-molecule reactive species. Because excited-state dynamics are influenced by the dynamics and hydration of a photooxidant’s environment, it was important to not only design a binding site but also to evaluate its dynamic properties. Thus, we used computational design in conjunction with molecular dynamics (MD) simulations to design a protein, designated NBP (NDI Binding Protein), that held a naphthalenediimide (NDI), a powerful photooxidant, in a programmable molecular environment. Solution NMR confirmed the structure of the complex. We evaluated two NDI cofactors in this de novo protein using ultrafast pump–probe spectroscopy to evaluate light-triggered intra- and intermolecular electron transfer function. Moreover, we demonstrated the utility of this platform to activate multiple molecular probes for protein labeling.

carbonyls↗

Polyethylene Upcycling to Liquid Alkanes in Molten Salts under Neat and External Hydrogen Source-Free Conditions

Development of facile approaches to convert plastic waste into liquid fuels under neat conditions is highly desired but challenging, particularly without noble metal catalysts and an external hydrogen source. Herein, highly efficient and selective polyethylene-to-gasoline oil (branched C 6 –C 12 alkanes) conversion was achieved under mild conditions (<170 °C) using commercially available AlCl 3 -containing molten salts as reaction media and to provide catalytic sites (no extra solvents, additives, or hydrogen feeding). The high catalytic efficiency and selectivity was ensured by the abundant active Al sites with strong Lewis acidity (comparable to the Al type in acidic zeolite) and highly ionic nature of the molten salts to stabilize the carbenium intermediates. Dynamic genesis of the Al sites was elucidated via time-resolved Al K-edge soft X-ray and 27 Al NMR, confirming the tricoordinated Al 3+ as active sites and its coordination with the as-generated alkene/aromatic intermediates. Further, the carbenium formation and polyethylene chain variation was illustrated by inelastic neutron scattering (INS) and an isotope-labeling experiment. Theoretical simulations further demonstrated the successive hydride abstraction, β-scission, isomerization, and internal hydrogen transfer reaction pathway with AlCl 3 as active sites. This facile catalytic system can further achieve the conversion of robust, densely assembled, and high molecular weight plastic model compounds to liquid alkane products in the diesel range.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Enhancing Nanoparticle Detection in Interferometric Scattering (iSCAT) Microscopy Using a Mask R-CNN

Interferometric scattering microscopy (iSCAT) is a label-free optical microscopy technique that enables imaging of individual nano-objects such as nanoparticles, viruses, and proteins. Essential to this technique is the suppression of background scattering and identification of signals from nano-objects. In the presence of substrates with high roughness, scattering heterogeneities in the background, when coupled with tiny stage movements, cause features in the background to be manifested in background-suppressed iSCAT images. Traditional computer vision algorithms detect these background features as particles, limiting the accuracy of object detection in iSCAT experiments. Here, in this paper, we present a pathway to improve particle detection in such situations using supervised machine learning via a mask region-based convolutional neural network (mask R-CNN). Using a model iSCAT experiment of 19.2 nm gold nanoparticles adsorbing to a rough layer-by-layer polyelectrolyte film, we develop a method to generate labeled datasets using experimental background images and simulated particle signals and train the mask R-CNN using limited computational resources via transfer learning. We then compare the performance of the mask R-CNN trained with and without inclusion of experimental backgrounds in the dataset against that of a traditional computer vision object detection algorithm, Haar-like feature detection, by analyzing data from the model experiment. Results demonstrate that including representative backgrounds in training datasets improved the mask R-CNN in differentiating between background and particle signals and elevated performance by markedly reducing false positives. The methodology for creating a labeled dataset with representative experimental backgrounds and simulated signals facilitates the application of machine learning in iSCAT experiments with strong background scattering and thus provides a useful workflow for future researchers to improve their image processing capabilities.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Microstructure Segmentation With Deep Learning Encoders Pre-Trained on a Large Microscopy Dataset

This study examined the improvement of microscopy segmentation intersection over union accuracy by transfer learning from a large dataset of microscopy images called MicroNet. Many neural network encoder architectures were trained on over 100,000 labeled microscopy images from 54 material classes. These pre-trained encoders were then embedded into multiple segmentation architectures including UNet and DeepLabV3+ to evaluate segmentation performance on created benchmark microscopy datasets. Compared to ImageNet pre-training, models pre-trained on MicroNet generalized better to out-of-distribution micrographs taken under different imaging and sample conditions and were more accurate with less training data. When training with only a single Ni-superalloy image, pre-training on MicroNet produced a 72.2% reduction in relative intersection over union error. These results suggest that transfer learning from large in-domain datasets generate models with learned feature representations that are more useful for downstream tasks and will likely improve any microscopy image analysis technique that can leverage pre-trained encoders.

machine learning↗