Engineering Papers⌕ Search

Engineering topics

Samatova, Nagiza F

Publications and source records attributed to Samatova, Nagiza F.

Response-Guided Community Detection: Application to Climate Index Discovery

Discovering climate indices-time series that summarize spatiotemporal climate patterns-is a key task in the climate science domain. In this work, we approach this task as a problem of response-guided community detection; that is, identifying communities in a graph associated with a response variable of interest. To this end, we propose a general strategy for response-guided community detection that explicitly incorporates information of the response variable during the community detection process, and introduce a graph representation of spatiotemporal data that leverages information from multiple variables. We apply our proposed methodology to the discovery of climate indices associated with seasonal rainfall variability. Our results suggest that our methodology is able to capture the underlying patterns known to be associated with the response variable of interest and to improve its predictability compared to existing methodologies for data-driven climate index discovery and official forecasts.

AFRICA↗

Damsel - A Data Model Storage Library for Exascale Science

The goal of this project is to enable exascale computational science applications to interact conveniently and efficiently with storage through abstractions that match their data models. We will accomplish this through three major activities: (1) identifying major data model motifs in computational science applications and developing representative benchmarks; (2) developing a data model storage library, called Damsel, that supports these motifs, provides efficient storage data layouts, incorporates optimizations to enable exascale operation, and is tolerant to failures; and (3) productizing Damsel and working with computational scientists to encourage adoption of this library by the scientific community.

97 MATHEMATICS AND COMPUTING↗

Transparent in Situ Data Transformations in ADIOS

Though an abundance of novel "data transformation" technologies have been developed (such as compression, level-of-detail, layout optimization, and indexing), there remains a notable gap in the adoption of such services by scientific applications. In response, we develop an in situ data transformation framework in the ADIOS I/O middleware with a "plug in" interface, thus greatly simplifying both the deployment and use of data transform services in scientific applications. Our approach ensures user-transparency, runtime-configurability, compatibility with existing I/O optimizations, and the potential for exploiting read-optimizing transforms (such as level-of-detail) to achieve I/O reduction. We demonstrate use of our framework with the QLG simulation at up to 8,192 cores on the leadership-class Titan supercomputer, showing negligible overhead. We also explore the read performance implications of data transforms with respect to parameters such as chunk size, access pattern, and the "opacity" of different transform methods including compression and level-of-detail.

Computer Science↗

PARLO: PArallel Run-Time Layout Optimization for Scientific Data Explorations with Heterogeneous Access Pattern

Download Citation Email Print Request Permissions Save to Project The size and scope of cutting-edge scientific simulations are growing much faster than the I/O and storage capabilities of their run-time environments. The growing gap is exacerbated by exploratory, data-intensive analytics, such as querying simulation data with multivariate, spatio-temporal constraints, which induces heterogeneous access patterns that stress the performance of the underlying storage system. Previous work addresses data layout and indexing techniques to improve query performance for a single access pattern, which is not sufficient for complex analytics jobs. We present PARLO a parallel run-time layout optimization framework, to achieve multi-level data layout optimization for scientific applications at run-time before data is written to storage. The layout schemes optimize for heterogeneous access patterns with user-specified priorities. PARLO is integrated with ADIOS, a high-performance parallel I/O middleware for large-scale HPC applications, to achieve user-transparent, light-weight layout optimization for scientific datasets. It offers simple XML-based configuration for users to achieve flexible layout optimization without the need to modify or recompile application codes. Experiments show that PARLO improves performance by 2 to 26 times for queries with heterogeneous access patterns compared to state-of-the-art scientific database management systems. Compared to traditional post-processing approaches, its underlying run-time layout optimization achieves a 56% savings in processing time and a reduction in storage overhead of up to 50%. PARLO also exhibits a low run-time resource requirement, while also limiting the performance impact on running applications to a reasonable level.

Gong, Zhenhuan↗

The Scientific Data Management Center: Available Technologies and Highlights

Managing scientific data has been identified by the scientific community as one of the most important emerging needs because of the sheer volume and increasing complexity of data being collected. Effectively generating, managing, and analyzing this information requires a comprehensive, end-to-end approach to data management that encompasses all of the stages from the initial data acquisition to the final analysis of the data. Based on community input, we have identified three significant requirements. First, more efficient access to storage systems is needed. In particular, parallel file system and I/O system improvements are needed to write and read large volumes of data without slowing a simulation. Second, scientists require technologies to facilitate better understanding of their data, in particular the ability to effectively perform complex data analysis and searches over extremely large data sets. Furthermore, exploratory analysis requires techniques for efficiently selecting subsets of the data. Third, generating the data, collecting and storing the results, keeping track of data provenance, data post-processing, and analysis of results is a tedious, fragmented process. Tools for automation of this process in a robust, tractable, and recoverable fashion are required to enhance scientific exploration.

99 GENERAL AND MISCELLANEOUS↗

Quantitative proteomic analyses of the response of acidophilic microbial communities to different pH conditions

Extensive genomic characterization of multi-species acid mine drainage microbial consortia combined with laboratory cultivation has enabled the application of quantitative proteomic analyses at the community level. In this study, quantitative proteomic comparisons were used to functionally characterize laboratory-cultivated acidophilic communities sustained in pH 1.45 or 0.85 conditions. The distributions of all proteins identified for individual organisms indicated biases for either high or low pH, and suggests pH-specific niche partitioning for low abundance bacteria and archaea. Although the proteome of the dominant bacterium, Leptospirillum group II, was largely unaffected by pH treatments, analysis of functional categories indicated proteins involved in amino acid and nucleotide metabolism, as well as cell membrane/envelope biogenesis were overrepresented at high pH. Comparison of specific protein abundances indicates higher pH conditions favor Leptospirillum group III, whereas low pH conditions promote the growth of certain archaea. Thus, quantitative proteomic comparisons revealed distinct differences in community composition and metabolic function of individual organisms during different pH treatments. Proteomic analysis revealed other aspects of community function. Different numbers of phage proteins were identified across biological replicates, indicating stochastic spatial heterogeneity of phage outbreaks. Additionally, proteomic data were used to identify a previously unknown genotypic variant of Leptospirillum group II, an indication of selection for a specific Leptospirillum group II population in laboratory communities. Our results confirm the importance of pH and related geochemical factors in fine-tuning acidophilic microbial community structure and function at the species and strain level, and demonstrate the broad utility of proteomics in laboratory community studies.

54 ENVIRONMENTAL SCIENCES↗

Cultivation and quantitative proteomic analyses of acidophilic microbial communities

Acid mine drainage (AMD), an extreme environment characterized by low pH and high metal concentrations, can support dense acidophilic microbial biofilm communities that rely on chemoautotrophic production based on iron oxidation. Field determined production rates indicate that, despite the extreme conditions, these communities are sufficiently well adapted to their habitats to achieve primary production rates comparable to those of microbial communities occurring in some non-extreme environments. To enable laboratory studies of growth, production and ecology of AMD microbial communities, a culturing system was designed to reproduce natural biofilms, including organisms recalcitrant to cultivation. A comprehensive metabolic labeling-based quantitative proteomic analysis was used to verify that natural and laboratory communities were comparable at the functional level. Results confirmed that the composition and core metabolic activities of laboratory-grown communities were similar to a natural community, including the presence of active, low abundance bacteria and archaea that have not yet been isolated. However, laboratory growth rates were slow compared with natural communities, and this correlated with increased abundance of stress response proteins for the dominant bacteria in laboratory communities. Modification of cultivation conditions reduced the abundance of stress response proteins and increased laboratory community growth rates. The research presented here represents the first description of the application of a metabolic labeling-based quantitative proteomic analysis at the community level and resulted in a model microbial community system ideal for testing physiological and ecological hypotheses.

54 ENVIRONMENTAL SCIENCES↗

A high-throughput de novo sequencing approach for shotgun proteomics using high-resolution tandem mass spectrometry

High-resolution tandem mass spectra can now readily be acquired with hybrid instruments, such as LTQ-Orbitrap and LTQ-FT, in high-throughput shotgun proteomics workflows. In this study, a new de novo sequencing algorithm, Vonode, has been developed specifically for such high-resolution tandem mass spectra. To fully exploit the high mass accuracy, sparse noise, and low background of these spectra, a unique scoring system is used to evaluate sequence tags based mainly on mass accuracy information of fragment ions. Consensus sequence tags were inferred for 11,422 spectra with an average peptide length of 5.5 residues from a total of 40,297 input spectra acquired in a 24-hour proteomics measurement of Rhodopseudomonas palustris. The accuracy of inferred consensus sequence tags was 84%. The performance of Vonode was shown to be superior to the PepNovo v2.0 algorithm, especially in term of the number of de novo sequenced spectra.

59 BASIC BIOLOGICAL SCIENCES↗

Phenotype fingerprinting suggests the involvement of single-genotype consortia in degradation of aromatic compounds by Rhodopseudomonas palustris

Understanding of cellular processes involved in the anaerobic degradation of complex organic compounds by microorganisms is crucial for development of innovative biotechnologies for bioethanol production and for efficient degradation of toxic organic compounds. In natural environment the degradation is usually accomplished by syntrophic consortia comprised of different bacterial species. Here we show that the metabolically versatile phototrophic bacterium Rhodopseudomonas palustris may form its own syntrophic consortia, when it grows anaerobically on p-coumarate or benzoate as a sole carbon source. In the study we reveal the consortia from a comparison of large-scale measurements of mRNA and protein expressions under p-coumarate and benzoate degrading conditions using a novel computational approach referred as phenotype fingerprinting. In this approach marker genes for known R. palustris phenotypes are employed to calculate their expression from the gene and protein expressions in each studied condition. Subpopulations of the consortia are inferred from the expression of phenotypes and known metabolic modes of the R. palustris growth. We find that p-coumarate degrading condition leads to at least three R. palustris subpopulations utilizing p-coumarate, benzoate, and CO2 and H2. Benzoate degrading condition also produces at least three subpopulations utilizing benzoate, CO2 and H2, and N2 and formate. Communication among syntrophs and inter-syntrophic dynamics in each consortium are indicated by up-regulation of transporters and genes involved in the curli formation and chemotaxis. The photoautotrphic subpopulation found in both consortia is characterized by activation of two cbb operons and the uptake hydrogenase system. A specificity of N2-fixing subpopulation in the benzoate degrading consortium is the preferential activation of the vanadium nitrogenase over the molybdenum nitrogenase. The N2-fixing subpopulation in the consortium is confirmed by consumption of dissolved nitrogen gas under the benzoate degrading conditions.

59 BASIC BIOLOGICAL SCIENCES↗

Data driven computing for Biological Systems

Biological breakthroughs that can lead to improved diagnosis and treatment of diseases, generation of clean energy, and solutions to other critical societal problems require high performance, data-intensive computational tools that have the ability to process, analyze and cohesively integrate massive amounts of data and information in real time. Biological computing problems are typically data-intensive and must share very large sets of data effectively across many processors. However, the various components of biological systems, composed of complex networks and pathways, must be integrated to gain a coherent understanding of the system. The more different types of data that can be integrated, the deeper the insights into the biology of the system being studied. Conventional analysis software, however, hasn’t been able to efficiently deal with such massive data set. The goal of the Data-Intensive Computing for Complex Biological Systems (BioPilot) project, a multiyear project funded by the U.S. Department of Energy’s Office of Advanced Scientific Computing Research (ASCR), is to create an integrated suite of highly flexible, highly adaptable pipelines of computational tools for analyzing large-scale data sets that will be used to address specific challenges facing the U.S. Department of Energy (DOE) and our society.

59 BASIC BIOLOGICAL SCIENCES↗