EDGE Bioinformatics
This report gives an overview of Empowering the Development of Genomics Expertise (EDGE) Bioinformatics software.
59 BASIC BIOLOGICAL SCIENCES↗
SEARCH · Engineering Papers
Results for “EDGE Bioinformatics”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Enabling the democratization of the genomics revolution with a fully integrated web-based bioinformatics platform, Version 1.5 and 1.x.
EDGE bioinformatics was developed to help biologists process Next Generation Sequencing data (in the form of raw FASTQ files), even if they have little to no bioinformatics expertise. EDGE is a highly integrated and interactive web-based platform that is capable of running many of the standard analyses that biologists require for viral, bacterial/archaeal, and metagenomic samples. EDGE provides the following analytical workflows: quality trimming and host removal, assembly and annotation, comparisons against known references, taxonomy classification of reads and contigs, whole genome SNP-based phylogenetic analysis, and PCR analysis. EDGE provides an intuitive web-based interface for user input, allows users to visualize and interact with selected results (e.g. JBrowse genome browser), and generates a final detailed PDF report. Results in the form of tables, text files, graphic files, and PDFs can be downloaded. A user management system allows tracking of an individual’s EDGE runs, along with the ability to share, post publicly, delete, or archive their results.
Chain, Patrick↗
Enabling the democratization of the genomics revolution with a fully integrated web-based bioinformatics platform, Version 1.5 and 1.x.
EDGE bioinformatics was developed to help biologists process Next Generation Sequencing data (in the form of raw FASTQ files), even if they have little to no bioinformatics expertise. EDGE is a highly integrated and interactive web-based platform that is capable of running many of the standard analyses that biologists require for viral, bacterial/archaeal, and metagenomic samples. EDGE provides the following analytical workflows: quality trimming and host removal, assembly and annotation, comparisons against known references, taxonomy classification of reads and contigs, whole genome SNP-based phylogenetic analysis, and PCR analysis. EDGE provides an intuitive web-based interface for user input, allows users to visualize and interact with selected results (e.g. JBrowse genome browser), and generates a final detailed PDF report. Results in the form of tables, text files, graphic files, and PDFs can be downloaded. A user management system allows tracking of an individual’s EDGE runs, along with the ability to share, post publicly, delete, or archive their results.
Chain, Patrick↗
Genomics for Everyone
Genomics — the genetic mapping and DNA sequencing of sets of genes or the complete genomes of organisms, along with related genome analysis and database work — is emerging as one of the transformative sciences of the 21st century. But current bioinformatics tools are not accessible to most biological researchers. Now, a new computational and web-based tool called EDGE Bioinformatics is working to fulfill the promise of democratizing genomics.
59 BASIC BIOLOGICAL SCIENCES↗
Modularization of EDGE Workflows Using Nextflow: Improving the Efficiency and Maintainability of Bioinformatics Software
EDGE is a bioinformatics platform developed in 2016 by researchers at Los Alamos National Laboratory (LANL) to facilitate the analysis of next-generation sequencing data by researchers with varying levels of experience in bioinformatics (Li et al., 2017). Users with single-end, paired-end or long-read sequencing data can provide their reads as input to EDGE and select the combination of workflows to run that are most useful for their research (e.g., quality control of reads, genome assembly, or the taxonomic classification of input reads). Table 1 summarizes the modules available in EDGE. EDGE is available as a web platform at https://edgebioinformatics.org, as installable source code maintained on GitHub under a GPLv3 license, and as a publicly hosted Docker image.
59 BASIC BIOLOGICAL SCIENCES↗
Enabling the democratization of the genomics revolution with a fully integrated web-based bioinformatics platform
Continued advancements in sequencing technologies have fueled the development of new sequencing applications and promise to flood current databases with raw data. A number of factors prevent the seamless and easy use of these data, including the breadth of project goals, the wide array of tools that individually perform fractions of any given analysis, the large number of associated software/hardware dependencies, and the detailed expertise required to perform these analyses. To address these issues, we have developed an intuitive web-based environment with a wide assortment of integrated and cutting-edge bioinformatics tools in pre-configured workflows. These workflows, coupled with the ease of use of the environment, provide even novice next-generation sequencing users with the ability to perform many complex analyses with only a few mouse clicks and, within the context of the same environment, to visualize and further interrogate their results. As a result, this bioinformatics platform is an initial attempt at Empowering the Development of Genomics Expertise (EDGE) in a wide range of applications for microbial research.
59 BASIC BIOLOGICAL SCIENCES↗
Transboundary determinants of avian zoonotic infectious diseases: challenges for strengthening research capacity and connecting surveillance networks
As the climate changes, global systems have become increasingly unstable and unpredictable. This is particularly true for many disease systems, including subtypes of highly pathogenic avian influenzas (HPAIs) that are circulating the world. Ecological patterns once thought stable are changing, bringing new populations and organisms into contact with one another. Wild birds continue to be hosts and reservoirs for numerous zoonotic pathogens, and strains of HPAI and other pathogens have been introduced into new regions via migrating birds and transboundary trade of wild birds. With these expanding environmental changes, it is even more crucial that regions or counties that previously did not have surveillance programs develop the appropriate skills to sample wild birds and add to the understanding of pathogens in migratory and breeding birds through research. For example, little is known about wild bird infectious diseases and migration along the Mediterranean and Black Sea Flyway (MBSF), which connects Europe, Asia, and Africa. Focusing on avian influenza and the microbiome in migratory wild birds along the MBSF, this project seeks to understand the determinants of transboundary disease propagation and coinfection in regions that are connected by this flyway. Through the creation of a threat reduction network for avian diseases (Avian Zoonotic Disease Network, AZDN) in three countries along the MBSF (Georgia, Ukraine, and Jordan), this project is strengthening capacities for disease diagnostics; microbiomes; ecoimmunology; field biosafety; proper wildlife capture and handling; experimental design; statistical analysis; and vector sampling and biology. Here, we cover what is required to build a wild bird infectious disease research and surveillance program, which includes learning skills in proper bird capture and handling; biosafety and biosecurity; permits; next generation sequencing; leading-edge bioinformatics and statistical analyses; and vector and environmental sampling. Creating connected networks for avian influenzas and other pathogen surveillance will increase coordination and strengthen biosurveillance globally in wild birds.
54 ENVIRONMENTAL SCIENCES↗
Standardized and accessible multi-omics bioinformatics workflows through the NMDC EDGE resource
Not Available
59 BASIC BIOLOGICAL SCIENCES↗
Sequencing and analysis of 131 SARS-CoV-2 isolates in previously sampled and unsampled regions of Jordan from 2020 to 2023
The Hashemite Kingdom of Jordan remains an understudied country for next generation sequencing analysis of SARS-CoV-2 genomes collected during the 2019 pandemic. Here we provide 131 additional reference genomes collected between 2020–2023 from SARS-CoV-2-positive patients across Jordan. Phylogenetic analysis supports existing pandemic narratives of changing clade dominance over time and adds genomes in novel Jordanian locations and timepoints to make Jordan SARS-CoV-2 databases more comprehensive. Samples from the less-sequenced cities of Ajloun, Jaresh, Karak, and Madaba identified previously unreported lineages while Amman, Irbid, and Zarqa have existing sequencing efforts bolstered. Despite many incomplete patient records and a relatively small sample size, we observe interesting symptom patterns that support existing global and Jordanian pandemic narratives. We note how in-country COVID-19 pandemic genomic studies showcase Jordan’s efforts to expand next generation sequencing capabilities, especially through the leveraging of EDGE COVID-19, a bioinformatics platform for performing rapid, batched analysis of SARS-CoV-2 sequencing that streamlines sample processing prepared from a network of hospital locations.
60 APPLIED LIFE SCIENCES↗
HDBind: encoding of molecular structure with hyperdimensional binary representations
Traditional methods for identifying “hit” molecules from a large collection of potential drug-like candidates rely on biophysical theory to compute approximations to the Gibbs free energy of the binding interaction between the drug and its protein target. These approaches have a significant limitation in that they require exceptional computing capabilities for even relatively small collections of molecules. Increasingly large and complex state-of-the-art deep learning approaches have gained popularity with the promise to improve the productivity of drug design, notorious for its numerous failures. However, as deep learning models increase in their size and complexity, their acceleration at the hardware level becomes more challenging. Hyperdimensional Computing (HDC) has recently gained attention in the computer hardware community due to its algorithmic simplicity relative to deep learning approaches. The HDC learning paradigm, which represents data with high-dimension binary vectors, allows the use of low-precision binary vector arithmetic to create models of the data that can be learned without the need for the gradient-based optimization required in many conventional machine learning and deep learning methods. This algorithmic simplicity allows for acceleration in hardware that has been previously demonstrated in a range of application areas (computer vision, bioinformatics, mass spectrometery, remote sensing, edge devices, etc.). To the best of our knowledge, our work is the first to consider HDC for the task of fast and efficient screening of modern drug-like compound libraries. We also propose the first HDC graph-based encoding methods for molecular data, demonstrating consistent and substantial improvement over previous work. We compare our approaches to alternative approaches on the well-studied MoleculeNet dataset and the recently proposed LIT-PCBA dataset derived from high quality PubChem assays. We demonstrate our methods on multiple target hardware platforms, including Graphics Processing Units (GPUs) and Field Programmable Gate Arrays (FPGAs), showing at least an order of magnitude improvement in energy efficiency versus even our smallest neural network baseline model with a single hidden layer. Our work thus motivates further investigation into molecular representation learning to develop ultra-efficient pre-screening tools. We make our code publicly available at https://github.com/LLNL/hdbind.
59 BASIC BIOLOGICAL SCIENCES↗
Using Machine Learning for Quantum Annealing Accuracy Prediction
Quantum annealers, such as the device built by D-Wave Systems, Inc., offer a way to compute solutions of NP-hard problems that can be expressed in Ising or quadratic unconstrained binary optimization (QUBO) form. Although such solutions are typically of very high quality, problem instances are usually not solved to optimality due to imperfections of the current generations quantum annealers. In this contribution, we aim to understand some of the factors contributing to the hardness of a problem instance, and to use machine learning models to predict the accuracy of the D-Wave 2000Q annealer for solving specific problems. We focus on the maximum clique problem, a classic NP-hard problem with important applications in network analysis, bioinformatics, and computational chemistry. By training a machine learning classification model on basic problem characteristics such as the number of edges in the graph, or annealing parameters, such as the D-Wave’s chain strength, we are able to rank certain features in the order of their contribution to the solution hardness, and present a simple decision tree which allows to predict whether a problem will be solvable to optimality with the D-Wave 2000Q. We extend these results by training a machine learning regression model that predicts the clique size found by D-Wave.
97 MATHEMATICS AND COMPUTING↗
cuAlign: Scalable Network Alignment on GPU Accelerators
Given two graphs, the objective of network alignment is to find the best one-to-one mapping of vertices in one graph (??) to vertices in the other (??), such that the number of overlaps is maximized. We say that edges(??, ??) ???and(??', ??') ??? are overlapped if ?? is mapped to ??' and ?? is mapped to??'. Network alignment is an important optimization problem with several applications in bioinformatics, computer vision and ontology matching. Since it is an NP-hard problem, efficient heuristics and scalable implementations are necessary. In this work, we introduce a new framework that combines the concepts of intra-network proximity using vertex embedding,Belief Propagation (BP) and approximate weighted matching, and provides qualitative improvements up to22%over state-of-the-art approaches. We also provide scalable implementations on GPU accelerators, demonstrating up to19×speedup for Belief Propagation and 3× speedup for approximate weighted matching relative to previous multithreaded implementation. A combination of combinatorial and algebraic kernels within the network alignment algorithm poses significant hurdles for parallelization. Load imbalance and irregular DRAM traffic limit achievable performance on GPUs. Our novel approach identifies and exploits unique structural proper-ties of the BP-based algorithm and employs code fusion to reduce data movement between different steps of the algorithm. Using a diverse set of inputs, we demonstrate qualitative improvements of our algorithms, and performance gains of our GPU-accelerated implementation. We believe that our work will enable algorithmic improvements and practical applications of network alignment.
Xiang, Lizhi↗
Scalable deep text comprehension for Cancer surveillance on high-performance computing
Background: Deep Learning (DL) has advanced the state-of-the-art capabilities in bioinformatics applications which has resulted in trends of increasingly sophisticated and computationally demanding models trained by larger and larger data sets. This vastly increased computational demand challenges the feasibility of conducting cutting-edge research. One solution is to distribute the vast computational workload across multiple computing cluster nodes with data parallelism algorithms. In this study, we used a High-Performance Computing environment and implemented the Downpour Stochastic Gradient Descent algorithm for data parallelism to train a Convolutional Neural Network (CNN) for the natural language processing task of information extraction from a massive dataset of cancer pathology reports. We evaluated the scalability improvements using data parallelism training and the Titan supercomputer at Oak Ridge Leadership Computing Facility. To evaluate scalability, we used different numbers of worker nodes and performed a set of experiments comparing the effects of different training batch sizes and optimizer functions.Results: We found that Adadelta would consistently converge at a lower validation loss, though requiring over twice as many training epochs as the fastest converging optimizer, RMSProp. The Adam optimizer consistently achieved a close 2nd place minimum validation loss significantly faster; using a batch size of 16 and 32 allowed the network to converge in only 4.5 training epochs.Conclusions: We demonstrated that the networked training process is scalable across multiple compute nodes communicating with message passing interface while achieving higher classification accuracy compared to a traditional machine learning algorithm.
Qiu, John X.↗
Temporal network alignment via GoT-WAVE
Abstract Motivation Network alignment (NA) finds conserved regions between two networks. NA methods optimize node conservation (NC) and edge conservation. Dynamic graphlet degree vectors are a state-of-the-art dynamic NC measure, used within the fastest and most accurate NA method for temporal networks: DynaWAVE. Here, we use graphlet-orbit transitions (GoTs), a different graphlet-based measure of temporal node similarity, as a new dynamic NC measure within DynaWAVE, resulting in GoT-WAVE. Results On synthetic networks, GoT-WAVE improves DynaWAVE’s accuracy by 30% and speed by 64%. On real networks, when optimizing only dynamic NC, the methods are complementary. Furthermore, only GoT-WAVE supports directed edges. Hence, GoT-WAVE is a promising new temporal NA algorithm, which efficiently optimizes dynamic NC. We provide a user-friendly user interface and source code for GoT-WAVE. Availability and implementation http://www.dcc.fc.up.pt/got-wave/ Supplementary information Supplementary data are available at Bioinformatics online.
Aparício, David↗
DOE BSSD Performance Management Metrics Report Q1
Microbes play key roles in our biosphere, from driving global nutrient cycling to impacting plant, animal and human health and disease. Complex data from microbial genomes, proteins, and metabolites provide a window into these tiny engines that drive life on our planet. Yet these data are dispersed among researchers’ laboratories and various repositories, making it difficult to access. This calls for new ways of managing data, improving data interoperability, advancing community standards, and creating an infrastructure where data are shared efficiently. We have built the National Microbiome Data Collaborative (NMDC) to advance how scientists create, use, and reuse data to redefine the way we understand and harness the power of microbes. The vision of the National Microbiome Data Collaborative (NMDC) is to drive a microbiome data sharing network connecting data, people, and ideas to advance microbiome innovation and discovery. The NMDC was launched in 2019 and brought together DOE National Laboratories to collaborate across resources, capabilities, and expertise. The NMDC team was strategically assembled to include software developers, microbial researchers, metadata experts, and multi-omics specialists. The diversity of the NMDC team reflects the inherently interdisciplinary nature of microbiome science, and we leverage the strengths of the DOE National Laboratory system. Towards BER’s goal of advancing an iterative systems biology approach to the understanding of microbial genomes, the NMDC serves as a foundation for infrastructure, data standards, and community building. Together with the flagship DOE User Facilities, the Joint Genome Institute (JGI) and the Environmental Molecular Sciences Laboratory (EMSL), we are developing core capabilities in metadata standards for environmental descriptors and sample handling and processing; standardized bioinformatic workflows; an interface for data search and access; and robust community engagement activities. The NMDC production platform supports long-term data infrastructure and community building for BER’s bioenergy and environmental research goals. Our approach leverages lessons learned and an ambitious framework for collaborative, interdisciplinary data infrastructure to support microbiome research. The NMDC supports data, information, and knowledge access through three defined software tools – the Submission Portal, NMDC EDGE, and the Data Portal – driven by community needs. Herein, we describe the value proposition for the microbiome research community, our overarching strategy, and challenges and opportunities for developing the NMDC as both an infrastructure and community engagement program.
59 BASIC BIOLOGICAL SCIENCES↗
EDGE COVID-19: a web platform to generate submission-ready genomes from SARS-CoV-2 sequencing efforts
Abstract Summary Genomics has become an essential technology for surveilling emerging infectious disease outbreaks. A range of technologies and strategies for pathogen genome enrichment and sequencing are being used by laboratories worldwide, together with different and sometimes ad hoc, analytical procedures for generating genome sequences. A fully integrated analytical process for raw sequence to consensus genome determination, suited to outbreaks such as the ongoing COVID-19 pandemic, is critical to provide a solid genomic basis for epidemiological analyses and well-informed decision making. We have developed a web-based platform and integrated bioinformatic workflows that help to provide consistent high-quality analysis of SARS-CoV-2 sequencing data generated with either the Illumina or Oxford Nanopore Technologies (ONT). Using an intuitive web-based interface, this workflow automates data quality control, SARS-CoV-2 reference-based genome variant and consensus calling, lineage determination and provides the ability to submit the consensus sequence and necessary metadata to GenBank, GISAID and INSDC raw data repositories. We tested workflow usability using real world data and validated the accuracy of variant and lineage analysis using several test datasets, and further performed detailed comparisons with results from the COVID-19 Galaxy Project workflow. Our analyses indicate that EC-19 workflows generate high-quality SARS-CoV-2 genomes. Finally, we share a perspective on patterns and impact observed with Illumina versus ONT technologies on workflow congruence and differences. Availability and implementation https://edge-covid19.edgebioinformatics.org, and https://github.com/LANL-Bioinformatics/EDGE/tree/SARS-CoV2. Supplementary information Supplementary data are available at Bioinformatics online.
59 BASIC BIOLOGICAL SCIENCES↗
Pathways to Carbon Liberation: A Systems Approach to Understanding Carbon Transformations and Losses from Thawing Permafrost
Our objective in this project was to discover how microbial communities mediate the fate of carbon in thawing permafrost under climate change. We proposed a systems approach integrating (a) molecular microbial and viral ecology, (b) molecular organic chemistry and stable and radiocarbon isotopes, and (c) state-of-the-art modeling, along a chronosequence of permafrost thaw in subarctic Sweden. The fate of carbon (C) in thawing permafrost is an outstanding challenge of modern biogeochemistry and climate change. Permafrost C pools are large (~1700 PgC), and C dynamics of thawing permafrost complex: old C decomposes as it is liberated from thawing permafrost as CO 2 or CH 4 , with a significant fraction cycling through lake sediments, even as new C accumulates due to thaw-initiated ecological succession. Our work is allowing better prediction of the net effect of these processes. Microbes mediate C dynamics in thawing permafrost, but a mechanistic understanding of how to scale microbial population dynamics, genomic potential, and expression to ecosystem-scale processes has been missing. A key question was: What is the interplay of microbial communities and organic matter chemical structure in the decomposition/preservation of organic C across a thaw gradient? And intriguingly, what (if any) is the role of phage (viruses that infect prokaryotic cells) in mediating these processes? Viruses appear to play a large role in driving oceanic function, but these phenomena are virtually unstudied in terrestrial systems. This endeavor linking microbial and viral dynamics, organic geochemistry and trace gas production will improve models of C cycling in permafrost systems, and clarify the fate of C under future climates. Technical Approach – We conducted a study at Stordalen Mire, Sweden, along a permafrost thaw chronosequence encompassing permafrost palsas and their initial collapse stage, thawing bog sites (dominated by Sphagnum moss), fully-thawed and inundated fen sites (dominated by Eriophorum spp or Carex spp.), and lakes. Our project used cutting edge technologies in both biogeochemistry and molecular microbial ecology to advance systems biology research on microbial carbon cycling through: (a) systems-level mapping of chemical states and ages of organic matter (via FT-ICR-MS and 14 C analysis) along thaw gradients to associated microbial communities, biochemical potentials, and activities (via meta-genomics, -transcriptomics, –proteomics, and viral genomics), and to CO 2 and CH 4 fluxes; (b) experimental incubations using Quantum Dot Probing, to test key hypotheses, arising from (a), about particular microbially-driven biochemical degradation pathways; (c) bioinformatics designed to simultaneously enhance the DOE Knowledgebase, and (d) integrated ecosystem C-cycle modeling testable by soil organic chemical and microbial data. Results from this project spanned 4 categories: (i) integrative across disciplines, and disciplinarily-focused in (ii) microbiology, (iii) biogeochemistry, and (iv) modeling. In integrated understanding of the system, we answered the questions posed above, mapping resident microbes to carbon transformations to reveal a carbon-processing shift with permafrost thaw, and discovering abundant, diverse and habitat-specific viruses that appear to be impacting carbon cycling, while also relating microbial communities to modeled processes. In microbiology-specific papers, we dug into viromes, microbial community networks, and informatic methods, while also introducing a new permafrost-associated phylum and its ecogenomic context. Relevance to DOE FOA - With a focus on discovering how microbial communities mediate the fate of old and new carbon in permafrost systems with climate change, our work directly responds to the call for “–omics driven basic research on the contribution of... microbial communities to C cycling processes in terrestrial ecosystems.” We bridge all three of the focal areas of the call, including (i) “Systems biology studies”, and development of –omics approaches (ii) “to investigate microbial community functional processes”, and (iii) “for imaging and analysis of microbially-mediated carbon cycling.”
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
From Structure to Functions: Metagenomics-Enabled Predictive Understanding of Soil Microbial Feedbacks to Climate Change
Understanding the responses, adaptations and feedback mechanisms of biological communities to climate change is critical to project future states of earth and climate systems. Although a significant amount of knowledge is available on the feedbacks of aboveground communities to climate change, the responses of belowground microbial communities are still poorly understood. This is due to challenges in analyzing soil microbial communities in terms of their diversity, structure and function. Thus, the ultimate goal of this study is to advance system-level predictive understanding of the feedbacks of belowground microbial communities to multiple climate change factors and their impacts on soil carbon (C) cycling processes. For this, cutting-edge integrated metagenomic technologies are employed to establish mechanistic linkages among aboveground plant communities, belowground microbial communities, ecosystem processes and functions and climate change. Towards this goal, the following four specific objectives are pursued: (i) To determine the responses of microbial community structure, functions and activities to climate warming, altered precipitation, soil moisture regime and/or clipping in the tundra and temperate grassland ecosystems; (ii) To determine the temperature sensitivity and the effect of substrate priming on recalcitrant C decomposition; (iii) To determine microbiological bases underlying temperature sensitivity of recalcitrant C decomposition; and (iv) To develop integrated bioinformatics and modeling approaches to scale information across different organizational levels towards predictive understanding of ecosystem responses to multiple climate change factors in collaboration with the Knowledge Base (KBase) and integrated into their database. Warming experiments in an Alaskan tundra permafrost soil (AK) as well as an Oklahoma temperate grassland soil (OK) provide a more complete picture of the effects of warming on belowground microbial communities of different (key) soil ecosystems. Numerous research activities have been carried out by the institutions under the support of this program. For brevity, a few key results and their significance are highlighted in this report.
54 ENVIRONMENTAL SCIENCES↗