Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “THROUGHPUT”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

High Throughput WAN Data Transfer with Hadoop-Based Storage

Hadoop distributed file system (HDFS) is becoming more popular in recent years as a key building block of integrated grid storage solution in the field of scientific computing. Wide Area Network (WAN) data transfer is one of the important data operations for large high energy physics experiments to manage, share and process datasets of PetaBytes scale in a highly distributed grid computing environment. In this paper, we present the experience of high throughput WAN data transfer with HDFS-based Storage Element. Two protocols, GridFTP and fast data transfer (FDT), are used to characterize the network performance of WAN data transfer.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Heterogeneous high throughput scientific computing with APM X-Gene and Intel Xeon Phi

Electrical power requirements will be a constraint on the future growth of Distributed High Throughput Computing (DHTC) as used by High Energy Physics. Performance-per-watt is a critical metric for the evaluation of computer architectures for cost- efficient computing. Additionally, future performance growth will come from heterogeneous, many-core, and high computing density platforms with specialized processors. In this paper, we examine the Intel Xeon Phi Many Integrated Cores (MIC) co-processor and Applied Micro X-Gene ARMv8 64-bit low-power server system-on-a-chip (SoC) solutions for scientific computing applications. As a result, we report our experience on software porting, performance and energy efficiency and evaluate the potential for use of such technologies in the context of distributed computing systems such as the Worldwide LHC Computing Grid (WLCG).

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

SetBERT: the deep learning platform for contextualized embeddings and explainable predictions from high-throughput sequencing

MOTIVATION: High-throughput sequencing (HTS) is a modern sequencing technology used to profile microbiomes by sequencing thousands of short genomic fragments from the microorganisms within a given sample. This technology presents a unique opportunity for artificial intelligence to comprehend the underlying functional relationships of microbial communities. However, due to the unstructured nature of HTS data, nearly all computational models are limited to processing DNA sequences individually. This limitation causes them to miss out on key interactions between microorganisms, significantly hindering our understanding of how these interactions influence the microbial communities as a whole. Furthermore, most computational methods rely on post-processing of samples which could inadvertently introduce unintentional protocol-specific bias. RESULTS: Addressing these concerns, we present SetBERT, a robust pre-training methodology for creating generalized deep learning models for processing HTS data to produce contextualized embeddings and be fine-tuned for downstream tasks with explainable predictions. By leveraging sequence interactions, we show that SetBERT significantly outperforms other models in taxonomic classification with genus-level classification accuracy of 95%. Furthermore, we demonstrate that SetBERT is able to accurately explain its predictions autonomously by confirming the biological-relevance of taxa identified by the model. AVAILABILITY AND IMPLEMENTATION: All source code is available at https://github.com/DLii-Research/setbert. SetBERT may be used through the q2-deepdna QIIME 2 plugin whose source code is available at https://github.com/DLii-Research/q2-deepdna.

Ludwig, David W↗

Broom: application for non-redundant storage of high throughput sequencing data

Abstract Motivation The data generation capabilities of high throughput sequencing (HTS) instruments have exponentially increased over the last few years, while the cost of sequencing has dramatically decreased allowing this technology to become widely used in biomedical studies. For small labs and individual researchers, however, storage and transfer of large amounts of HTS data present a significant challenge. The recent trends in increased sequencing quality and genome coverage can be used to reconsider HTS data storage strategies. Results We present Broom, a stand-alone application designed to select and store only high-quality sequencing reads at extremely high compression rates. Written in C++, the application accepts single and paired-end reads in FASTQ and FASTA formats and decompresses data in FASTA format. Availability and implementation C++ code available at https://scsb.utmb.edu/labgroups/fofanov/broom.asp. Supplementary information Supplementary data are available at Bioinformatics online.

Albayrak, Levent↗

A novel two-layer-integrated microfluidic device for high-throughput yeast proteomic dynamics analysis at the single-cell level

Abstract Current microfluidic methods for studying multicell strains (e.g., m-types) with multienvironments (e.g., n-types) require large numbers of inlets/outlets (m*n), a complicated procedure or expensive machinery. Here, we developed a novel two-layer-integrated method to combine different PDMS microchannel layers with different functions into one chip by a PDMS through-hole array, which improved the design of a PDMS-based microfluidic system. Using this method, we succeeded in converting 2 × m × n inlets/outlets into m + n inlets/outlets and reduced the time cost of loading processing (from m × n to m) of the device for studying multicell strains (e.g., m-types) in varied multitemporal environments (i.e., n-types). Using this device, the dynamic behavior of the cell-stress-response proteins was studied when the glucose concentration decreased from 2% to a series of lower concentrations. Our device could also be widely used in high-throughput studies of various stress responses, and the new concept of a multilayer-integrated fabrication method could greatly improve the design of PDMS-based microfluidic systems.

Chen, Kaiyue↗

sppIDer: A Species Identification Tool to Investigate Hybrid Genomes with High-Throughput Sequencing

The genomics era has expanded our knowledge about the diversity of the living world, yet harnessing high-throughput sequencing data to investigate alternative evolutionary trajectories, such as hybridization, is still challenging. Here we present sppIDer, a pipeline for the characterization of interspecies hybrids and pure species, that illuminates the complete composition of genomes. sppIDer maps short-read sequencing data to a combination genome built from reference genomes of several species of interest and assesses the genomic contribution and relative ploidy of each parental species, producing a series of colorful graphical outputs ready for publication. As a proof-of-concept, we use the genus Saccharomyces to detect and visualize both interspecies hybrids and pure strains, even with missing parental reference genomes. Through simulation, we show that sppIDer is robust to variable reference genome qualities and performs well with low-coverage data. We further demonstrate the power of this approach in plants, animals, and other fungi. sppIDer is robust to many different inputs and provides visually intuitive insight into genome composition that enables the rapid identification of species and their interspecies hybrids. sppIDer exists as a Docker image, which is a reusable, reproducible, transparent, and simple-to-run package that automates the pipeline and installation of the required dependencies (https://github.com/GLBRC/sppIDer; last accessed September 6, 2018).

59 BASIC BIOLOGICAL SCIENCES↗

High-throughput, dynamic, multi-dimensional: an expanding repertoire of plant respiration measurements

A recent burst of technological innovation and adaptation has greatly improved our ability to capture respiration rate data from plant sources. At the tissue level, several independent respiration measurement options are now available, each with distinct advantages and suitability, including high-throughput sampling capacity. These advancements facilitate the inclusion of respiration rate data into large-scale biological studies such as genetic screens, ecological surveys, crop breeding trials, and multi-omics molecular studies. As a result, our understanding of the correlations of respiration with other biological and biochemical measurements is rapidly increasing. Difficult questions persist concerning the interpretation and utilization of respiration data; concepts such as allocation of respiration to growth versus maintenance, the unnecessary or inefficient use of carbon and energy by respiration, and predictions of future respiration rates in response to environmental change are all insufficiently grounded in empirical data. However, we emphasize that new experimental designs involving novel combinations of respiration rate data with other measurements will flesh-out our current theories of respiration. Furthermore, dynamic recordings of respiration rate, which have long been used at the scale of mitochondria, are increasingly being used at larger scales of size and time to reflect processes of cellular signal transduction and physiological response to the environment. Herein, we also highlight how respiratory methods are being better adapted to different plant tissues including roots and seeds, which have been somewhat neglected historically.

59 BASIC BIOLOGICAL SCIENCES↗

Signature analysis of high-throughput transcriptomics screening data for mechanistic inference and chemical grouping

Abstract High-throughput transcriptomics (HTTr) uses gene expression profiling to characterize the biological activity of chemicals in in vitro cell-based test systems. As an extension of a previous study testing 44 chemicals, HTTr was used to screen an additional 1,751 unique chemicals from the EPA’s ToxCast collection in MCF7 cells using 8 concentrations and an exposure duration of 6 h. We hypothesized that concentration-response modeling of signature scores could be used to identify putative molecular targets and cluster chemicals with similar bioactivity. Clustering and enrichment analyses were conducted based on signature catalog annotations and ToxPrint chemotypes to facilitate molecular target prediction and grouping of chemicals with similar bioactivity profiles. Enrichment analysis based on signature catalog annotation identified known mechanisms of action (MeOAs) associated with well-studied chemicals and generated putative MeOAs for other active chemicals. Chemicals with predicted MeOAs included those targeting estrogen receptor (ER), glucocorticoid receptor (GR), retinoic acid receptor (RAR), the NRF2/KEAP/ARE pathway, AP-1 activation, and others. Using reference chemicals for ER modulation, the study demonstrated that HTTr in MCF7 cells was able to stratify chemicals in terms of agonist potency, distinguish ER agonists from antagonists, and cluster chemicals with similar activities as predicted by the ToxCast ER Pathway model. Uniform manifold approximation and projection (UMAP) embedding of signature-level results identified novel ER modulators with no ToxCast ER Pathway model predictions. Finally, UMAP combined with ToxPrint chemotype enrichment was used to explore the biological activity of structurally related chemicals. The study demonstrates that HTTr can be used to inform chemical risk assessment by determining in vitro points of departure, predicting chemicals’ MeOA and grouping chemicals with similar bioactivity profiles.

Toxicology↗

High-throughput mapping of the phage resistance landscape in E. coli

Bacteriophages (phages) are critical players in the dynamics and function of microbial communities and drive processes as diverse as global biogeochemical cycles and human health. Phages tend to be predators finely tuned to attack specific hosts, even down to the strain level, which in turn defend themselves using an array of mechanisms. However, to date, efforts to rapidly and comprehensively identify bacterial host factors important in phage infection and resistance have yet to be fully realized. Here, we globally map the host genetic determinants involved in resistance to 14 phylogenetically diverse double-stranded DNA phages using two model Escherichia coli strains (K-12 and BL21) with known sequence divergence to demonstrate strain-specific differences. Using genome-wide loss-of-function and gain-of-function genetic technologies, we are able to confirm previously described phage receptors as well as uncover a number of previously unknown host factors that confer resistance to one or more of these phages. We uncover differences in resistance factors that strongly align with the susceptibility of K-12 and BL21 to specific phage. We also identify both phage specific mechanisms, such as the unexpected role of cyclic-di-GMP in host sensitivity to phage N4, and more generic defenses, such as the overproduction of colanic acid capsular polysaccharide that defends against a wide array of phages. Our results indicate that host responses to phages can occur via diverse cellular mechanisms. Our systematic and high-throughput genetic workflow to characterize phage-host interaction determinants can be extended to diverse bacteria to generate datasets that allow predictive models of how phage-mediated selection will shape bacterial phenotype and evolution. The results of this study and future efforts to map the phage resistance landscape will lead to new insights into the coevolution of hosts and their phage, which can ultimately be used to design better phage therapeutic treatments and tools for precision microbiome engineering.

59 BASIC BIOLOGICAL SCIENCES↗

Characterization of Metalloproteins by High-throughput X-ray Absorption Spectroscopy

High-throughput X-ray absorption spectroscopy was used to measure transition metal content based on quantitative detection of X-ray fluorescence signals for 3879 purified proteins from several hundred different protein families generated by the New York SGX Research Center for Structural Genomics. Approximately 9% of the proteins analyzed showed the presence of transition metal atoms (Zn, Cu, Ni, Co, Fe, or Mn) in stoichiometric amounts. The method is highly automated and highly reliable based on comparison of the results to crystal structure data derived from the same protein set. To leverage the experimental metalloprotein annotations, we used a sequence-based de novo prediction method, MetalDetector, to identify Cys and His residues that bind to transition metals for the redundancy reduced subset of 2411 sequences sharing <70% sequence identity and having at least one His or Cys. As the HT-XAS identifies metal type and protein binding, while the bioinformatics analysis identifies metal-binding residues, the results were combined to identify putative metal-binding sites in the proteins and their associated families. We explored the combination of this data with homology models to generate detailed structure models of metal-binding sites for representative proteins. Finally, we used extended X-ray absorption fine structure data from two of the purified Zn metalloproteins to validate predicted metalloprotein binding site structures. This combination of experimental and bioinformatics approaches provides comprehensive active site analysis on the genome scale for metalloproteins as a class, revealing new insights into metalloprotein structure and function.

59 BASIC BIOLOGICAL SCIENCES↗

Management of metadata and automation for mail-in measurements with the APS 11-BM high throughput, high-resolution synchrotron powder diffractometer.

A high-resolution and high-throughput synchrotron powder diffractometer has been automated for use with samples that are mailed in by Advanced Photon Source users. Implementation of a relational database with web interfaces for both outside users and beamline staff, which is integrated into the facility-wide proposal and safety system, allows all aspects of beamline management to be integrated. This system permits users to request kits for mounting samples, to provide sample safety information, to obtain their collected data and to provide usage information upon project completion in a quick and simple manner. Beamline staff use a separate interface to note receipt of samples, schedule and collect diffraction data, post-process and quality-check data, and dispose of samples. The design of the software and database are discussed in detail.

43 PARTICLE ACCELERATORS↗

BioSAXS Sample Changer: a robotic sample changer for rapid and reliable high-throughput X-ray solution scattering experiments

A robotic sample changer for solution X-ray scattering experiments optimized for speed and to use the minimum amount of material has been developed. This system is now in routine use at three high-brilliance European synchrotron sites, each capable of several hundred measurements per day. Small-angle X-ray scattering (SAXS) of macromolecules in solution is in increasing demand by an ever more diverse research community, both academic and industrial. To better serve user needs, and to allow automated and high-throughput operation, a sample changer (BioSAXS Sample Changer) that is able to perform unattended measurements of up to several hundred samples per day has been developed. The Sample Changer is able to handle and expose sample volumes of down to 5 µl with a measurement/cleaning cycle of under 1 min. The samples are stored in standard 96-well plates and the data are collected in a vacuum-mounted capillary with automated positioning of the solution in the X-ray beam. Fast and efficient capillary cleaning avoids cross-contamination and ensures reproducibility of the measurements. Independent temperature control for the well storage and for the measurement capillary allows the samples to be kept cool while still collecting data at physiological temperatures. The Sample Changer has been installed at three major third-generation synchrotrons: on the BM29 beamline at the European Synchrotron Radiation Facility (ESRF), the P12 beamline at the PETRA-III synchrotron (EMBL@PETRA-III) and the I22/B21 beamlines at Diamond Light Source, with the latter being the first commercial unit supplied by Bruker ASC.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Remote and automated high-throughput powder diffraction measurements enabled by a robotic sample changer at SSRL beamline 2-1

The general-purpose powder diffractometer beamline (BL2-1) at the Stanford Synchrotron Radiation Lightsource (SSRL) is described. The evolution of design and performance of BL2-1 are presented, in addition to current operating specifications, applications and measurement capabilities. Recent developments involve a robotic sample changer enabling high-throughput X-ray diffraction measurements, applicable to mail-in and remote operations. In situ and operando capabilities to measure samples with different form factors ( e.g. capillary, flat plate or thin film, and transmission) and under variable experimental conditions are discussed. Several example datasets and accompanying Rietveld refinements are presented.

43 PARTICLE ACCELERATORS↗

A high-throughput energy-dispersive tender X-ray spectrometer for shot-to-shot sulfur measurements

An X-ray emission spectrometer that can detect the sulfur K α emission lines with large throughput and a high energy resolution is presented. The instrument is based on a large d -spacing perfect Bragg analyzer that diffracts the sulfur K α emission at close to backscattering angles. This facilitates the application of efficient concepts routinely employed in hard X-ray spectrometers towards the tender X-ray regime. The instrument described in this work is based on an energy-dispersive von Hamos geometry that is well suited for photon-in photon-out spectroscopy at X-ray free-electron laser and synchrotron sources. Comparison of its performance with previously used instrumentation is presented through measurements using sulfur-containing species performed at the LCLS. It is shown that the overall signal intensity is increased by a factor of ∼15. Implementation of this approach in the design of a tender X-ray spectroscopy endstation for LCLS-II is also discussed.

36 MATERIALS SCIENCE↗

Sagittal collimating diaboloid: a new grazing-incidence mirror surface for higher-throughput resonant inelastic X-ray scattering spectrometers

A major challenge in soft X-ray spectroscopy is the efficient collection of the emitted X-rays by grazing-incidence mirrors. In this energy range, grazing-incidence mirrors are widely used as optics for the collection of light. The small angle of incidence necessarily limits the collection solid angle of soft X-ray spectrometers. We present a new mirror surface, a sagittal collimating diaboloid, that can both collect and focus light from a point source in an aberration-free manner. The usefulness of this optic in increasing throughput is demonstrated with a realistic example design of a moderate-sized (3 m) medium-resolution resonant inelastic X-ray scattering spectrometer.

36 MATERIALS SCIENCE↗

High-Throughput Computing on High-Performance Platforms: A Case Study

The computing systems used by LHC experiments has historically consisted of the federation of hundreds to thousands of distributed resources, ranging from small to mid-size resource. In spite of the impressive scale of the existing distributed computing solutions, the federation of small to mid-size resources will be insufficient to meet projected future demands. This paper is a case study of how the ATLAS experiment has embraced Titan -- a DOE leadership facility in conjunction with traditional distributed high- throughput computing to reach sustained production scales of approximately 52M core-hours a years. The three main contributions of this paper are: (i) a critical evaluation of design and operational considerations to support the sustained, scalable and production usage of Titan; (ii) a preliminary characterization of a next generation executor for PanDA to support new workloads and advanced execution modes; and (iii) early lessons for how current and future experimental and observational systems can be integrated with production supercomputers and other platforms in a general and extensible manner.

Oleynik, D↗

ISOBAR Preconditioner for Effective and High-throughput Lossless Data Compression

Efficient handling of large volumes of data is a necessity for exascale scientific applications and database systems. To address the growing imbalance between the amount of available storage and the amount of data being produced by high speed (FLOPS) processors on the system, data must be compressed to reduce the total amount of data placed on the file systems. General-purpose loss less compression frameworks, such as zlib and bzlib2, are commonly used on datasets requiring loss less compression. Quite often, however, many scientific data sets compress poorly, referred to as hard-to-compress datasets, due to the negative impact of highly entropic content represented within the data. An important problem in better loss less data compression is to identify the hard-to-compress information and subsequently optimize the compression techniques at the byte-level. To address this challenge, we introduce the In-Situ Orthogonal Byte Aggregate Reduction Compression (ISOBAR-compress) methodology as a preconditioner of loss less compression to identify and optimize the compression efficiency and throughput of hard-to-compress datasets.

Computer Science↗

A Custom High-Throughput Optical Mapping Instrument for Accelerated Stress Testing of PV Module Materials

The performance and integrity of photovoltaic (PV) modules and materials may be assessed through optical characterizations. We have developed a custom optical mapping instrument (OMI) to improve measurement throughput time, facilitate automated measurements, allow for localized specimen examination, obtain spatial information relative to commercial benchtop spectrophotometer instruments, and provide automated data analysis. Both the key components and the methods used to improve the measurements are described. The measurement precision for the OMI is benchmarked for hemispherical transmittance relative to a previous round-robin study for commercial spectrophotometers. In addition to the unique instrument developed in this study, new insights have emerged from the examination of specimens from previous experiments, including: the depletion of the UV absorber is revealed for specimens beyond a certain size after artificial ultraviolet (UV) weathering; an optical degradation by internal haze formation is confirmed following Damp Heat (85 °C/85% relative humidity) testing; the better uniformity of the wear pattern for falling sand abrasion is used to select the DIN 52348 fixture over the ASTM D968 fixture; and the greater local (in the order of millimeters) heterogeneity of surface contamination in the soiling-prone location of Dubai relative to Kuwait. The results of the UV study have already been used to improve the standardized weathering of encapsulants. The example for Damp Heat testing is given to increase awareness of a degradation believed to be ubiquitously occurring in safety and design-type qualification testing of PV modules.

14 SOLAR ENERGY↗