A Transfer Learning Framework for Power System Event Identification
Not Available
24 POWER TRANSMISSION AND DISTRIBUTION↗
SEARCH · Engineering Papers
Results for “label transfer”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
BioADAPT-MRC: adversarial learning-based domain adaptation improves biomedical machine reading comprehension task
ABSTRACT Motivation Biomedical machine reading comprehension (biomedical-MRC) aims to comprehend complex biomedical narratives and assist healthcare professionals in retrieving information from them. The high performance of modern neural network-based MRC systems depends on high-quality, large-scale, human-annotated training datasets. In the biomedical domain, a crucial challenge in creating such datasets is the requirement for domain knowledge, inducing the scarcity of labeled data and the need for transfer learning from the labeled general-purpose (source) domain to the biomedical (target) domain. However, there is a discrepancy in marginal distributions between the general-purpose and biomedical domains due to the variances in topics. Therefore, direct-transferring of learned representations from a model trained on a general-purpose domain to the biomedical domain can hurt the model’s performance. Results We present an adversarial learning-based domain adaptation framework for the biomedical machine reading comprehension task (BioADAPT-MRC), a neural network-based method to address the discrepancies in the marginal distributions between the general and biomedical domain datasets. BioADAPT-MRC relaxes the need for generating pseudo labels for training a well-performing biomedical-MRC model. We extensively evaluate the performance of BioADAPT-MRC by comparing it with the best existing methods on three widely used benchmark biomedical-MRC datasets—BioASQ-7b, BioASQ-8b and BioASQ-9b. Our results suggest that without using any synthetic or human-annotated data from the biomedical domain, BioADAPT-MRC can achieve state-of-the-art performance on these datasets. Availability and implementation BioADAPT-MRC is freely available as an open-source project at https://github.com/mmahbub/BioADAPT-MRC. Supplementary information Supplementary data are available at Bioinformatics online.
60 APPLIED LIFE SCIENCES↗
Belowground plant carbon and nitrogen exchange: plant-derived carbon inputs and pore structure formation
Belowground plant transfer of carbon (C) and nitrogen (N) can benefit soil ecosystems, increasing soil C gains and plant N availability, while improving soil pore structure. We explored such transfers among three plant species of North American prairie, where C and N were transferred from a grass (Panicum virgatum L., switchgrass (Sgrass)) to either a legume (Lespedeza capitata Michx., bush clover (Bclover)), a forb (Rudbeckia hirta L., black-eyed Susan (BSforb)), or a mixture of the two. The plants were grown either with/out direct root contact, thus allowing assessment of the relative contributions of fungal- and root-based transfer pathways. The Sgrass was labeled with 13 C and 15 N, and C and N transfers were assessed by measuring isotope enrichment of roots and aboveground biomass of neighboring plants. Soil inputs of plant-derived C and N were assessed by isotope analyses of the rhizosphere soil. X-ray computed tomography was used for pore structure analyses. Carbon transfer was much higher in the presence of direct/close root contact between source and recipient plants, yet N transfers appeared to be mainly fungal driven. Here, while C and N were readily transferred from Sgrass to other Sgrass and Bclover neighbors, transfers to BSforb were negligible. However, in a three species system, the presence of the legume enhanced C and N transfers to BSforb, suggesting non-additive influences of diverse plant community composition. The more plant-derived C and N was found in the rhizosphere of recipient plants, the greater C and N transfers through roots. Greater C and N transfers were associated with increases in 8–30 μm diameter pores and decreases in >150 μm pores. Summarily, diverse plant communities, especially those with legumes, increase C and N transfers, which then benefit soil C inputs and its protection via changes in pore structure.
13 CO 2 pulse labeling↗
Contrastive Machine Learning with Gamma Spectroscopy Data Augmentations for Detecting Shielded Radiological Material Transfers
Data analysis techniques can be powerful tools for rapidly analyzing data and extracting information that can be used in a latent space for categorizing observations between classes of data. Machine learning models that exploit learned data relationships can address a variety of nuclear nonproliferation challenges like the detection and tracking of shielded radiological material transfers. The high resource cost of manually labeling radiation spectra is a hindrance to the rapid analysis of data collected from persistent monitoring and to the adoption of supervised machine learning methods that require large volumes of curated training data. Instead, contrastive self-supervised learning on unlabeled spectra can enhance models that are built on limited labeled radiation datasets. This work demonstrates that contrastive machine learning is an effective technique for leveraging unlabeled data in detecting and characterizing nuclear material transfers demonstrated on radiation measurements collected at an Oak Ridge National Laboratory testbed, where sodium iodide detectors measure gamma radiation emitted by material transfers between the High Flux Isotope Reactor and the Radiochemical Engineering Development Center. Label-invariant data augmentations tailored for gamma radiation detection physics are used on unlabeled spectra to contrastively train an encoder, learning a complex, embedded state space with self-supervision. A linear classifier is then trained on a limited set of labeled data to distinguish transfer spectra between byproducts and tracked nuclear material using representations from the contrastively trained encoder. The optimized hyperparameter model achieves a balanced accuracy score of 80.30%. Any given model—that is, a trained encoder and classifier—shows preferential treatment for specific subclasses of transfer types. Regardless of the classifier complexity, a supervised classifier using contrastively trained representations achieves higher accuracy than using spectra when trained and tested on limited labeled data.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
A Modified Sequence-to-point HVAC Load Disaggregation Algorithm
This paper presents a modified sequence-to-point (S2P) algorithm for disaggregating the heat, ventilation, and air conditioning (HVAC) load from the total building electricity consumption. The original S2P model is convolutional neural network (CNN) based, which uses load profiles as inputs. We propose three modifications. First, the input convolution layer is changed from 1D to 2D so that normalized temperature profiles are also used inputs to the S2P model. Second, a drop-out layer is added to improve adaptability and generalizability so that the model trained in one area can be transferred to other geographical areas without labelled HVAC data. Third, a fine-tuning process is proposed for areas with a small amount of labelled HVAC data so that the pre-trained S2P model can be fine-tuned to achieve higher disaggregation accuracy (i.e., better transferability) in other areas. The model is first trained and tested using smart meter and sub-metered HVAC data collected in Austin, Texas. Then, the trained model is tested on two other areas: Boulder, Colorado and San Diego, California. Simulation results show that the proposed modified S2P algorithm outperforms the original S2P model and the support-vector machine based approach in accuracy, adaptability, and transferability.
Ye, Kai↗
Power system transfer learning to identify event types with or without event labels
Not Available
Engineering↗
Highly active, ultra-low loading single-atom iron catalysts for catalytic transfer hydrogenation
Highly effective and selective noble metal-free catalysts attract significant attention. Here, a single-atom iron catalyst is fabricated by saturated adsorption of trace iron onto zeolitic imidazolate framework-8 (ZIF-8) followed by pyrolysis. Its performance toward catalytic transfer hydrogenation of furfural is comparable to state-of-the-art catalysts and up to four orders higher than other Fe catalysts. Isotopic labeling experiments demonstrate an intermolecular hydride transfer mechanism. First principles simulations, spectroscopic calculations and experiments, and kinetic correlations reveal that the synthesis creates pyrrolic Fe(II)-plN 3 as the active center whose flexibility manifested by being pulled out of the plane, enabled by defects, is crucial for collocating the reagents and allowing the chemistry to proceed. The catalyst catalyzes chemoselectively several substrates and possesses a unique trait whereby the chemistry is hindered for more acidic substrates than the hydrogen donors. This work paves the way toward noble-metal free single-atom catalysts for important chemical reactions.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
A predictive theoretical model for electron tunneling pathways in proteins
A practical method is presented for calculating the dependence of electron transfer rates on details of the protein medium intervening between donor and acceptor. The method takes proper account of the relative energetics and mutual interactions of the donor, acceptor, and peptide groups. It also provides a quantitative search scheme for determining the important tunneling pathways (specific sequences of localized bonding and antibonding orbitals of the protein which dominate the donor-acceptor electronic coupling) in native and tailored proteins, a tool for designing new proteins with prescribed electron transfer rates, and a consistent description of observed electron transfer rates in existing redox labeled metalloproteins and small molecule model compounds.
Onuchic, Jose Nelson↗
Interactive Visualization of High-Dimensional Petascale Ocean Data
We describe an application for interactive visualization of 5 petabytes of time-varying multivariate data from a high-resolution global ocean circulation model. The input data are 10311 hourly (ocean time) time steps of various 2D and 3D fields from a 22-billion point 1/48- degree “lat-lon cap” configuration of the MIT General Circulation Model (MITgcm). We map the global horizontal model domain onto our 128-screen (8x16) tiled display wall to produce a canonical tiling with approximately one MITgcm grid point per display pixel, and using this tiling we encode the entire time series for multiple native and computed scalar quantities at a collection of ocean depths. We reduce disk bandwidth requirements by converting the model’s floating point data to 16-bit fixed point values, and compressing those values with a lossless video encoder, which together allow synchronized playback at 24 time steps per second across all 128 displays. The application allows dynamic assignment of any two encoded tiles to any display, and has multiple interfaces for quickly specifying various orderly arrangements of tiles. All subsequent rendering is done on the fly, with run time control of colormaps, transfer functions, histogram equalization, and labeling. The two data streams on each screen can be rendered independently and combined in various ways, including blending, differencing, horizontal/ vertical wipes, and checkerboarding. The two data streams on any screen can optionally be displayed as a scatterplot in their joint attribute space. All scatterplots and map-view plots from the same x/y location and depth are linked so they all show the current brushable selection. Ocean scientists have used the system, and have found previously unidentified features in the data.
Interactive↗
GEONEX: Progressive Conditional Generative Adversarial Training Using Transfer learning
Obtaining accurate segmentation on large scale images is an open problem in deep learning. The main problem is the amount of labeled data that exists for large scale images. Traditionally, the common solution to this problem is to crop the large images into smaller images to increase the amount of available data and train a Conditional Generative Adversarial Network (CGAN). CGANs are currently the state of the art in image to image translation and provide better accuracy than the traditional method of training a encoder based conv-net architecture to minimize the loss at each pixel. This method can produce noisy and discontinuous images with inaccurate results. We seek to solve this problem by utilizing the concepts of transfer learning and progressive training to create a CGAN that can segment large scale images with a limited amount of labeled data. In transfer learning we recognize that many learned features are applicable to many classes from multiple domains. This introduces the concept of feature reusability, which is the basis for finetuning. Progressive training got its start in training models on the same images at different resolutions. In this work we instead train a GAN on increasing image scales by transferring the weights from the smaller scales to the larger scales. The learned features at the smaller scales are continually reused and applied to larger scales to create a CGAN that can perform accurate segmentation on large scale images. We apply this method to detect building footprints on very high-resolution overhead imagery (e.g Digital Globe and high resolution airborne platforms).
GEONEX↗
Machine learning for reactor power monitoring with limited labeled data
Real-time reactor power monitoring is critical for a variety of nuclear applications, spanning safety, security, operations, and maintenance. While machine learning methods have shown promise in monitoring reactor power levels, there is limited research on their efficacy in label-starved environments. The goal of this work is to assess the feasibility of classifying nuclear reactor power level using multisource data in scenarios with limited labels. Data were collected using low-resolution multisensors at four nuclear reactor facilities: two large research reactors and two TRIGA reactors. Within each pair, one reactor dataset served as the source and the other as the target in a transfer learning paradigm. Twenty-three supervised models were trained on labeled sequences of magnetic field and acceleration data from each of the target sites. Self-learning and transfer learning methods were applied to the top performing models to assess their classification performance with increasing amounts of labeled data. While reactor power level classification was achieved with a Matthews Correlation Coefficient of up to 0.739 ± 0.003 and 0.622 ± 0.009 with only 400 sequences per power state for the large research reactor and TRIGA target sites, respectively, self-learning and transfer learning leveraging source site data did not improve target classification performance. These findings suggest that alternative methods, such as higher sensitivity sensors, digital twins, or the use of physics-informed models, are required to enable high-performance classification in machine learning approaches to reactor monitoring with a dearth of target ground truth.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
Integrated fluorescence light microscopy-guided cryo-focused ion beam-milling for in situ montage cryo-ET
Cryogenic-electron tomography (cryo-ET) permits the in situ visualization of biological macromolecules at the molecular level. Owing to the variable thickness of cells, tissues and organisms, frozen specimens may need to be thinned by cryo-focused ion beam (FIB) milling to produce thin (<500 nm) cryo-lamellae suitable for cryo-ET. Locating regions of interest remains a challenge because untargeted milling can lead to inadvertent ablation and removal of regions of interest. Correlative light and electron microscopy, combined with cryo-FIB milling, can guide the identification of labeled targets in the cellular milieu. Multiple transfers between cryo-imaging instruments, cumbersome correlation algorithms, limited accuracy and low throughput have hindered the routine adoption of cryo-FIB milling within a multimodal correlative workflow for in situ structural biology. Here, in this study, we present a workflow for 3D correlative cryo-fluorescence light microscopy-FIB-ET that streamlines fluorescence light microscopy-guided FIB milling, improving throughput while preserving both structural and contextual information. The complete integration of hardware and software described here minimizes sample contamination from cross-platform exchanges and greatly enhances the efficiency of 3D targeting in cryo-milling. We then describe procedures for implementing montage parallel array cryo-ET (MPACT), which can be easily adapted to any modern life-science transmission electron microscope. MPACT supports high-throughput cryo-ET acquisitions (10 tilt series in 1.5 h) for structure determination and comprehensive contextual understanding of macromolecules within their native surroundings. A complete session from sample preparation to MPACT data processing takes 5−7 d for an individual experienced in both cryo-EM and cryo-FIB milling.
Yang, Jie E. [Univ. of Wisconsin, Madison, WI (Uni↗
Mechanisms Underlying Plastocyanin-Cytochrome f Electron Transfer Investigated via Site-Specific Linear and Two-dimensional Infrared Spectroscopy
The goal of this research is to further our understanding of biological electron transfer in photosynthesis through the development and application of new methods for studying proteins with high spatial and temporal detail. Biological electron transfer occurs between metal sites imbedded in proteins where the environment and its motions can be very different from those of normal bulk liquids. Moreover, electron transfer between two proteins typically involves short-lived binding interactions within a highly mobile complex. We have directed our studies at photosynthetic electron transfer proteins plastocyanin and cytochrome f. We have labeled two key ligands to the copper ion of plastocyanin with carbon deuterium probe vibrations that enable their selective analysis by infrared spectroscopy. This analysis has shown that association of plastocyanin with cytochrome f leads to large changes in the bonding between the copper ion and ligands. In addition, the probes have been used to assess the contribution of the protein scaffold of plastocyanin in dictating the copper coordination geometry. We also have made progress to extend our experiments from equilibrium to non-equilibrium studies. The studies help to illuminate how proteins are tuned to control biological electron transfer. A better understanding of electron transfer reactions in natural photosynthesis will bolster efforts to develop artificial systems for energy production.
59 BASIC BIOLOGICAL SCIENCES↗
Facilitating information transfer in the EOS era
A simple interactive demonstration program has been written in C to allow a user to input data field descriptions as label format. This program generates a full RECFMT (record format) description and the complete transfer syntax description notation (TSDN) file. It is intended that this program be upgraded to operational quality and be made available to users to simplify the description and TSDN file construction task. The total set of capabilities, from the standard formatted data unit packaging of related files and consistent segment structures, through the type definition techniques and the call server, will constitute a unique tool for the systematic transfer of data. This software on each end may be independent, one end from the other. With it available, local software that will be needed to convert user files to and from the canonical interface will be appreciably simplified.
Billingsley, Frederic C.↗
High-throughput Single-Cell Proteomics and Transcriptomics from the Same Cells with a Nanoliter-Scale Spin-Transfer Approach
Single-cell multiomic platforms provide a comprehensive snapshot of cellular states and cell types by offering critical insights into the spatiotemporal regulation of biomolecular networks at a systems level, thereby defining the basis of multicellularity. Here, we introduce nanoSPINS, an advanced platform that enables high-throughput profiling and integrative analysis of the transcriptome and proteome from the same single cells using RNA sequencing and isobaric labeling LC-MS-based proteomics, respectively. NanoSPINS can efficiently transfer mRNA-containing droplets across two microarrays via a centrifugation-based approach, while proteins are retained on the initial platform. Benchmarking of nanoSPINS on two cell lines demonstrates its ability to generate global proteomic and transcriptomic profiles that align well with previously established methodologies/platforms. The incorporation of isobaric TMTpro labeling into this single-cell multiomics platform significantly enhances the throughput of single-cell proteomic analyses. Through the high-throughput quantification of the proteome and transcriptome, nanoSPINS not only facilitates the identification of molecular features at both mRNA and protein level but also provides larger sample sizes for improved statistical power in clustering and differential abundance. Given the broad applicability of single-cell multiomics in biological research and clinical settings, we believe nanoSPINS represents a powerful platform for the characterization of heterogeneous cell populations.
multi 'omics↗
A machine-learning-driven data labeling pipeline for scientific analysis in MLExchange
This study introduces a novel labeling pipeline to accelerate the labeling process of scientific data sets by using artificial intelligence (AI)-guided tagging techniques. This pipeline includes a set of interconnected web-based graphical user interfaces (GUIs), where Data Clinic and MLCoach enable the preparation of machine learning (ML) models for data reduction and classification, respectively, while Label Maker is used for label assignment. Throughout this pipeline, data can be accessed through a direct connection to a file system or through Tiled for access through Hypertext Transfer Protocol (HTTP). Our experimental results present three use cases where this labeling pipeline has been instrumental for the study of large X-ray scattering data sets in the area of pattern recognition, the remote analysis of resonant soft X-ray scattering data and the fine-tuning process of foundation models. These use cases highlight the labeling capabilities of this pipeline, including the ability to label large data sets in a short period of time, to perform remote data analysis while minimizing data movement and to enhance the fine-tuning process of complex ML models with human involvement.
Chavez, Tanny (ORCID:0000000193172896)↗
MULTI-OBJECTIVE REINFORCEMENT LEARNING FOR LOW-THRUST TRANSFER DESIGN BETWEEN LIBRATION POINT ORBITS
Multi-Reward Proximal Policy Optimization (MRPPO) is a multi-objective reinforcement learning algorithm used to construct low-thrust transfers between periodic orbits in multi-body systems. Previous implementations of MRPPO have relied on a predefined reference transfer to successfully train each policy. In this paper, an algorithmic modification labeled the ‘moving reference’, is introduced to autonomously construct these reference trajectories during training. With this modification, MRPPO is used to recover various low-thrust transfers between two periodic orbits in the Earth-Moon circular restricted three-body problem to solve a multi-objective optimization problem. These results are then compared with the solutions recovered via a traditional optimization formulation.
algorithm↗
MULTI-OBJECTIVE REINFORCEMENT LEARNING FOR LOW-THRUST TRANSFER DESIGN BETWEEN LIBRATION POINT ORBITS
Multi-Reward Proximal Policy Optimization (MRPPO) is a multi-objective reinforcement learning algorithm used to construct low-thrust transfers between periodic orbits in multi-body systems. Previous implementations of MRPPO have relied on a predefined reference transfer to successfully train each policy. In this paper, an algorithmic modification labeled the ‘moving reference’, is introduced to autonomously construct these reference trajectories during training. With this modification, MRPPO is used to recover various low-thrust transfers between two periodic orbits in the Earth-Moon circular restricted three-body problem to solve a multi-objective optimization problem. These results are then compared with the solutions recovered via a gradient descent optimization scheme to validate the performance of MRPPO with the moving reference modification.
Christopher J. Sullivan↗