A Transfer Learning Framework for Power System Event Identification
Not Available
24 POWER TRANSMISSION AND DISTRIBUTION↗
SEARCH · Engineering Papers
Results for “label transfer”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
BioADAPT-MRC: adversarial learning-based domain adaptation improves biomedical machine reading comprehension task
ABSTRACT Motivation Biomedical machine reading comprehension (biomedical-MRC) aims to comprehend complex biomedical narratives and assist healthcare professionals in retrieving information from them. The high performance of modern neural network-based MRC systems depends on high-quality, large-scale, human-annotated training datasets. In the biomedical domain, a crucial challenge in creating such datasets is the requirement for domain knowledge, inducing the scarcity of labeled data and the need for transfer learning from the labeled general-purpose (source) domain to the biomedical (target) domain. However, there is a discrepancy in marginal distributions between the general-purpose and biomedical domains due to the variances in topics. Therefore, direct-transferring of learned representations from a model trained on a general-purpose domain to the biomedical domain can hurt the model’s performance. Results We present an adversarial learning-based domain adaptation framework for the biomedical machine reading comprehension task (BioADAPT-MRC), a neural network-based method to address the discrepancies in the marginal distributions between the general and biomedical domain datasets. BioADAPT-MRC relaxes the need for generating pseudo labels for training a well-performing biomedical-MRC model. We extensively evaluate the performance of BioADAPT-MRC by comparing it with the best existing methods on three widely used benchmark biomedical-MRC datasets—BioASQ-7b, BioASQ-8b and BioASQ-9b. Our results suggest that without using any synthetic or human-annotated data from the biomedical domain, BioADAPT-MRC can achieve state-of-the-art performance on these datasets. Availability and implementation BioADAPT-MRC is freely available as an open-source project at https://github.com/mmahbub/BioADAPT-MRC. Supplementary information Supplementary data are available at Bioinformatics online.
60 APPLIED LIFE SCIENCES↗
Belowground plant carbon and nitrogen exchange: plant-derived carbon inputs and pore structure formation
Belowground plant transfer of carbon (C) and nitrogen (N) can benefit soil ecosystems, increasing soil C gains and plant N availability, while improving soil pore structure. We explored such transfers among three plant species of North American prairie, where C and N were transferred from a grass (Panicum virgatum L., switchgrass (Sgrass)) to either a legume (Lespedeza capitata Michx., bush clover (Bclover)), a forb (Rudbeckia hirta L., black-eyed Susan (BSforb)), or a mixture of the two. The plants were grown either with/out direct root contact, thus allowing assessment of the relative contributions of fungal- and root-based transfer pathways. The Sgrass was labeled with 13 C and 15 N, and C and N transfers were assessed by measuring isotope enrichment of roots and aboveground biomass of neighboring plants. Soil inputs of plant-derived C and N were assessed by isotope analyses of the rhizosphere soil. X-ray computed tomography was used for pore structure analyses. Carbon transfer was much higher in the presence of direct/close root contact between source and recipient plants, yet N transfers appeared to be mainly fungal driven. Here, while C and N were readily transferred from Sgrass to other Sgrass and Bclover neighbors, transfers to BSforb were negligible. However, in a three species system, the presence of the legume enhanced C and N transfers to BSforb, suggesting non-additive influences of diverse plant community composition. The more plant-derived C and N was found in the rhizosphere of recipient plants, the greater C and N transfers through roots. Greater C and N transfers were associated with increases in 8–30 μm diameter pores and decreases in >150 μm pores. Summarily, diverse plant communities, especially those with legumes, increase C and N transfers, which then benefit soil C inputs and its protection via changes in pore structure.
13 CO 2 pulse labeling↗
Contrastive Machine Learning with Gamma Spectroscopy Data Augmentations for Detecting Shielded Radiological Material Transfers
Data analysis techniques can be powerful tools for rapidly analyzing data and extracting information that can be used in a latent space for categorizing observations between classes of data. Machine learning models that exploit learned data relationships can address a variety of nuclear nonproliferation challenges like the detection and tracking of shielded radiological material transfers. The high resource cost of manually labeling radiation spectra is a hindrance to the rapid analysis of data collected from persistent monitoring and to the adoption of supervised machine learning methods that require large volumes of curated training data. Instead, contrastive self-supervised learning on unlabeled spectra can enhance models that are built on limited labeled radiation datasets. This work demonstrates that contrastive machine learning is an effective technique for leveraging unlabeled data in detecting and characterizing nuclear material transfers demonstrated on radiation measurements collected at an Oak Ridge National Laboratory testbed, where sodium iodide detectors measure gamma radiation emitted by material transfers between the High Flux Isotope Reactor and the Radiochemical Engineering Development Center. Label-invariant data augmentations tailored for gamma radiation detection physics are used on unlabeled spectra to contrastively train an encoder, learning a complex, embedded state space with self-supervision. A linear classifier is then trained on a limited set of labeled data to distinguish transfer spectra between byproducts and tracked nuclear material using representations from the contrastively trained encoder. The optimized hyperparameter model achieves a balanced accuracy score of 80.30%. Any given model—that is, a trained encoder and classifier—shows preferential treatment for specific subclasses of transfer types. Regardless of the classifier complexity, a supervised classifier using contrastively trained representations achieves higher accuracy than using spectra when trained and tested on limited labeled data.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
A Modified Sequence-to-point HVAC Load Disaggregation Algorithm
This paper presents a modified sequence-to-point (S2P) algorithm for disaggregating the heat, ventilation, and air conditioning (HVAC) load from the total building electricity consumption. The original S2P model is convolutional neural network (CNN) based, which uses load profiles as inputs. We propose three modifications. First, the input convolution layer is changed from 1D to 2D so that normalized temperature profiles are also used inputs to the S2P model. Second, a drop-out layer is added to improve adaptability and generalizability so that the model trained in one area can be transferred to other geographical areas without labelled HVAC data. Third, a fine-tuning process is proposed for areas with a small amount of labelled HVAC data so that the pre-trained S2P model can be fine-tuned to achieve higher disaggregation accuracy (i.e., better transferability) in other areas. The model is first trained and tested using smart meter and sub-metered HVAC data collected in Austin, Texas. Then, the trained model is tested on two other areas: Boulder, Colorado and San Diego, California. Simulation results show that the proposed modified S2P algorithm outperforms the original S2P model and the support-vector machine based approach in accuracy, adaptability, and transferability.
Ye, Kai↗
Power system transfer learning to identify event types with or without event labels
Not Available
Engineering↗
Highly active, ultra-low loading single-atom iron catalysts for catalytic transfer hydrogenation
Highly effective and selective noble metal-free catalysts attract significant attention. Here, a single-atom iron catalyst is fabricated by saturated adsorption of trace iron onto zeolitic imidazolate framework-8 (ZIF-8) followed by pyrolysis. Its performance toward catalytic transfer hydrogenation of furfural is comparable to state-of-the-art catalysts and up to four orders higher than other Fe catalysts. Isotopic labeling experiments demonstrate an intermolecular hydride transfer mechanism. First principles simulations, spectroscopic calculations and experiments, and kinetic correlations reveal that the synthesis creates pyrrolic Fe(II)-plN 3 as the active center whose flexibility manifested by being pulled out of the plane, enabled by defects, is crucial for collocating the reagents and allowing the chemistry to proceed. The catalyst catalyzes chemoselectively several substrates and possesses a unique trait whereby the chemistry is hindered for more acidic substrates than the hydrogen donors. This work paves the way toward noble-metal free single-atom catalysts for important chemical reactions.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Machine learning for reactor power monitoring with limited labeled data
Real-time reactor power monitoring is critical for a variety of nuclear applications, spanning safety, security, operations, and maintenance. While machine learning methods have shown promise in monitoring reactor power levels, there is limited research on their efficacy in label-starved environments. The goal of this work is to assess the feasibility of classifying nuclear reactor power level using multisource data in scenarios with limited labels. Data were collected using low-resolution multisensors at four nuclear reactor facilities: two large research reactors and two TRIGA reactors. Within each pair, one reactor dataset served as the source and the other as the target in a transfer learning paradigm. Twenty-three supervised models were trained on labeled sequences of magnetic field and acceleration data from each of the target sites. Self-learning and transfer learning methods were applied to the top performing models to assess their classification performance with increasing amounts of labeled data. While reactor power level classification was achieved with a Matthews Correlation Coefficient of up to 0.739 ± 0.003 and 0.622 ± 0.009 with only 400 sequences per power state for the large research reactor and TRIGA target sites, respectively, self-learning and transfer learning leveraging source site data did not improve target classification performance. These findings suggest that alternative methods, such as higher sensitivity sensors, digital twins, or the use of physics-informed models, are required to enable high-performance classification in machine learning approaches to reactor monitoring with a dearth of target ground truth.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
Integrated fluorescence light microscopy-guided cryo-focused ion beam-milling for in situ montage cryo-ET
Cryogenic-electron tomography (cryo-ET) permits the in situ visualization of biological macromolecules at the molecular level. Owing to the variable thickness of cells, tissues and organisms, frozen specimens may need to be thinned by cryo-focused ion beam (FIB) milling to produce thin (<500 nm) cryo-lamellae suitable for cryo-ET. Locating regions of interest remains a challenge because untargeted milling can lead to inadvertent ablation and removal of regions of interest. Correlative light and electron microscopy, combined with cryo-FIB milling, can guide the identification of labeled targets in the cellular milieu. Multiple transfers between cryo-imaging instruments, cumbersome correlation algorithms, limited accuracy and low throughput have hindered the routine adoption of cryo-FIB milling within a multimodal correlative workflow for in situ structural biology. Here, in this study, we present a workflow for 3D correlative cryo-fluorescence light microscopy-FIB-ET that streamlines fluorescence light microscopy-guided FIB milling, improving throughput while preserving both structural and contextual information. The complete integration of hardware and software described here minimizes sample contamination from cross-platform exchanges and greatly enhances the efficiency of 3D targeting in cryo-milling. We then describe procedures for implementing montage parallel array cryo-ET (MPACT), which can be easily adapted to any modern life-science transmission electron microscope. MPACT supports high-throughput cryo-ET acquisitions (10 tilt series in 1.5 h) for structure determination and comprehensive contextual understanding of macromolecules within their native surroundings. A complete session from sample preparation to MPACT data processing takes 5−7 d for an individual experienced in both cryo-EM and cryo-FIB milling.
Yang, Jie E. [Univ. of Wisconsin, Madison, WI (Uni↗
Mechanisms Underlying Plastocyanin-Cytochrome f Electron Transfer Investigated via Site-Specific Linear and Two-dimensional Infrared Spectroscopy
The goal of this research is to further our understanding of biological electron transfer in photosynthesis through the development and application of new methods for studying proteins with high spatial and temporal detail. Biological electron transfer occurs between metal sites imbedded in proteins where the environment and its motions can be very different from those of normal bulk liquids. Moreover, electron transfer between two proteins typically involves short-lived binding interactions within a highly mobile complex. We have directed our studies at photosynthetic electron transfer proteins plastocyanin and cytochrome f. We have labeled two key ligands to the copper ion of plastocyanin with carbon deuterium probe vibrations that enable their selective analysis by infrared spectroscopy. This analysis has shown that association of plastocyanin with cytochrome f leads to large changes in the bonding between the copper ion and ligands. In addition, the probes have been used to assess the contribution of the protein scaffold of plastocyanin in dictating the copper coordination geometry. We also have made progress to extend our experiments from equilibrium to non-equilibrium studies. The studies help to illuminate how proteins are tuned to control biological electron transfer. A better understanding of electron transfer reactions in natural photosynthesis will bolster efforts to develop artificial systems for energy production.
59 BASIC BIOLOGICAL SCIENCES↗
High-throughput Single-Cell Proteomics and Transcriptomics from the Same Cells with a Nanoliter-Scale Spin-Transfer Approach
Single-cell multiomic platforms provide a comprehensive snapshot of cellular states and cell types by offering critical insights into the spatiotemporal regulation of biomolecular networks at a systems level, thereby defining the basis of multicellularity. Here, we introduce nanoSPINS, an advanced platform that enables high-throughput profiling and integrative analysis of the transcriptome and proteome from the same single cells using RNA sequencing and isobaric labeling LC-MS-based proteomics, respectively. NanoSPINS can efficiently transfer mRNA-containing droplets across two microarrays via a centrifugation-based approach, while proteins are retained on the initial platform. Benchmarking of nanoSPINS on two cell lines demonstrates its ability to generate global proteomic and transcriptomic profiles that align well with previously established methodologies/platforms. The incorporation of isobaric TMTpro labeling into this single-cell multiomics platform significantly enhances the throughput of single-cell proteomic analyses. Through the high-throughput quantification of the proteome and transcriptome, nanoSPINS not only facilitates the identification of molecular features at both mRNA and protein level but also provides larger sample sizes for improved statistical power in clustering and differential abundance. Given the broad applicability of single-cell multiomics in biological research and clinical settings, we believe nanoSPINS represents a powerful platform for the characterization of heterogeneous cell populations.
multi 'omics↗
A machine-learning-driven data labeling pipeline for scientific analysis in MLExchange
This study introduces a novel labeling pipeline to accelerate the labeling process of scientific data sets by using artificial intelligence (AI)-guided tagging techniques. This pipeline includes a set of interconnected web-based graphical user interfaces (GUIs), where Data Clinic and MLCoach enable the preparation of machine learning (ML) models for data reduction and classification, respectively, while Label Maker is used for label assignment. Throughout this pipeline, data can be accessed through a direct connection to a file system or through Tiled for access through Hypertext Transfer Protocol (HTTP). Our experimental results present three use cases where this labeling pipeline has been instrumental for the study of large X-ray scattering data sets in the area of pattern recognition, the remote analysis of resonant soft X-ray scattering data and the fine-tuning process of foundation models. These use cases highlight the labeling capabilities of this pipeline, including the ability to label large data sets in a short period of time, to perform remote data analysis while minimizing data movement and to enhance the fine-tuning process of complex ML models with human involvement.
Chavez, Tanny (ORCID:0000000193172896)↗
Deep transfer operator learning for partial differential equations under conditional shift
Transfer learning enables the transfer of knowledge gained while learning to perform one task (source) to a related but different task (target), hence addressing the expense of data acquisition and labelling, potential computational power limitations and dataset distribution mismatches. Here, we propose a new transfer learning framework for task-specific learning (functional regression in partial differential equations) under conditional shift based on the deep operator network (DeepONet). Task-specific operator learning is accomplished by fine-tuning task-specific layers of the target DeepONet using a hybrid loss function that allows for the matching of individual target samples while also preserving the global properties of the conditional distribution of the target data. Inspired by conditional embedding operator theory, we minimize the statistical distance between labelled target data and the surrogate prediction on unlabelled target data by embedding conditional distributions onto a reproducing kernel Hilbert space. We demonstrate the advantages of our approach for various transfer learning scenarios involving nonlinear partial differential equations under diverse conditions due to shifts in the geometric domain and model dynamics. Our transfer learning framework enables fast and efficient learning of heterogeneous tasks despite considerable differences between the source and target domains.
42 ENGINEERING↗
Chemically Separable Ruthenium Hydride Isomers with Distinct Hydride Transfer Properties
Transition metal hydrides are key intermediates in biological and industrial catalysis, where control over hydride donor ability (hydricity) is essential for optimizing reactivity. Herein, we report a series of isomeric ruthenium hydrides in which the ligand trans to the ruthenium hydride bond–either an N-heterocyclic carbene or pyridine–modulates the thermodynamic hydricity by up to 8 kcal mol –1 . These hydrides exhibited distinct reactivity toward CO 2 and various organic hydride acceptors, enabling detailed kinetic and mechanistic analysis. Stopped-flow experiments, isotopic labeling, and computational studies supported an outer-sphere hydride transfer mechanism. Linear free energy relationships (LFERs) and Marcus relationships were utilized to correlate the changes in thermodynamics and kinetics, revealing that ligands with strong trans effects and trans influence can disrupt conventional scaling relationships, which can be a powerful strategy for promoting new reactivity paradigms in hydride transfer reactions.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Transfer learning for probabilistic localization of hidden cracks in concrete structures
Abstract The utility of discriminative supervised learning models built using multiple training-data sources is investigated for hidden crack localization in concrete. Feed-forward neural network (FFNN) is chosen as the model architecture, and transfer learning is used to assimilate the information obtained from different sources (computational physics simulations and laboratory experiments). The labeled training data consists of values of a damage index and the known locations of hidden cracks. The classification models need to learn how the presence of damage (hidden cracks) affects the damage index at different sensors for different test conditions. To this end, diagnostic FFNN models are built by sequentially adding and training new hidden layers to assimilate labeled information from computer models (different model geometries, test conditions, crack lengths, crack locations) and laboratory experiments on a plain cement slab. These transfer learning-based models are then used to localize damage in concrete specimens that reflect real-world conditions (i.e., specimens with steel reinforcement and randomly distributed aggregate). The actual damage state in these specimens is determined by extracting cores and performing petrographic studies on the extracted cores. The damage probability estimated by transfer learning-based models is compared with the petrographic damage rating index (DRI) to identify the most suitable approach to train the diagnostic models. The transfer learning-based diagnostic methodology shows promise and could be used in various structural health monitoring applications, where sufficient labeled data are typically not available from a single data source.
Miele, S.↗
Ammonia Electrosynthesis from Nitrate Using a Ruthenium–Copper Cocatalyst System: A Full Concentration Range Study
Electrochemical synthesis of ammonia via the nitrate reduction reaction (NO3RR) has been intensively researched as an alternative to the traditional Haber–Bosch process. Most research focuses on the low concentration range representative of the nitrate level in wastewater, leaving the high concentration range, which exists in nuclear and fertilizer wastes, unexplored. The use of a concentrated electrolyte (≥1 M) for higher rate production is hampered by poor hydrogen transfer kinetics. Herein, we demonstrate that a cocatalytic system of Ru/Cu 2 O catalyst enables NO3RR at 10.0 A in 1 M nitrate electrolyte in a 16 cm 2 flow electrolyzer, with 100% faradaic efficiency toward ammonia. Detailed mechanistic studies by deuterium labeling and operando Fourier transform infrared (FTIR) spectroscopy allow us to probe the hydrogen transfer rate and intermediate species on Ru/Cu 2 O. Ab initio molecular dynamics (AIMD) simulations reveal that adsorbed hydroxide on Ru nanoparticles increases the density of the hydrogen-bonded water network near the Cu 2 O surface, which promotes the hydrogen transfer rate. Finally, our work highlights the importance of engineering synergistic interactions in cocatalysts for addressing the kinetic bottleneck in electrosynthesis.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
A transfer learning approach for acoustic emission zonal localization on steel plate-like structure using numerical simulation and unsupervised domain adaptation
The detection and localization of damage in metallic structures using acoustic emission (AE) monitoring and artificial intelligence technology such as deep learning has been widely studied. However, a current challenge of this approach is the difficulty of obtaining sufficient labeled historical AE signals for the training process of deep learning models. This problem can be approached through the implementation of transfer learning. The innovation of this paper lies in the development of a transfer learning approach for AE source localization on a stainless-steel structure when no historical labeled AE signals are available for training. A finite element model is developed to generate numerical AE signals for the training. Unsupervised domain adaptation (UDA) technology is utilized to reduce the distribution difference between the numerical and the realistic AE signals and to derive the localization results of the unlabeled realistic AE signals. Finally, the results suggest that the proposed approach is capable of localizing AE signals with high accuracy in the absence of labeled training data.
42 ENGINEERING↗
Arbuscular mycorrhiza convey significant plant carbon to a diverse hyphosphere microbial food web and mineral‐associated organic matter
Summary Arbuscular mycorrhizal fungi (AMF) transport substantial plant carbon (C) that serves as a substrate for soil organisms, a precursor of soil organic matter (SOM), and a driver of soil microbial dynamics. Using two‐chamber microcosms where an air gap isolated AMF from roots, we 13 CO 2 ‐labeled Avena barbata for 6 wk and measured the C Rhizophagus intraradices transferred to SOM and hyphosphere microorganisms. NanoSIMS imaging revealed hyphae and roots had similar 13 C enrichment. SOM density fractionation, 13 C NMR, and IRMS showed AMF transferred 0.77 mg C g −1 of soil (increasing total C by 2% relative to non‐mycorrhizal controls); 33% was found in occluded or mineral‐associated pools. In the AMF hyphosphere, there was no overall change in community diversity but 36 bacterial ASVs significantly changed in relative abundance. With stable isotope probing (SIP)‐enabled shotgun sequencing, we found taxa from the Solibacterales, Sphingobacteriales, Myxococcales, and Nitrososphaerales (ammonium oxidizing archaea) were highly enriched in AMF‐imported 13 C (> 20 atom%). Mapping sequences from 13 C‐SIP metagenomes to total ASVs showed at least 92 bacteria and archaea were significantly 13 C‐enriched. Our results illustrate the quantitative and ecological impact of hyphal C transport on the formation of potentially protective SOM pools and microbial roles in the AMF hyphosphere soil food web.
13C SIP↗