Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data replication”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Coupling between DNA replication, segregation, and the onset of constriction in Escherichia coli

Escherichia coli cell cycle features two critical cell-cycle checkpoints: initiation of replication and the onset of constriction. While the initiation of DNA replication has been extensively studied, it is less clear what triggers the onset of constriction and when exactly it occurs during the cell cycle. Here, using high-throughput fluorescence microscopy in microfluidic devices, we determine the timing for the onset of constriction relative to the replication cycle in different growth rates. Our single-cell data and modeling indicate that the initiation of constriction is coupled to replication-related processes in slow growth conditions. Furthermore, our data suggest that this coupling involves the mid-cell chromosome blocking the onset of constriction via some form of nucleoid occlusion occurring independently of SlmA and the Ter linkage proteins. This work highlights the coupling between replication and division cycles and brings up a new nucleoid mediated control mechanism in E. coli.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2018

Deletion of the Clostridium thermocellum recA gene reveals that it is required for thermophilic plasmid replication but not plasmid integration at homologous DNA sequences

Abstract A limitation to the engineering of cellulolytic thermophiles is the availability of functional, thermostable (≥ 60 °C) replicating plasmid vectors for rapid expression and testing of genes that provide improved or novel fuel molecule production pathways. A series of plasmid vectors for genetic manipulation of the cellulolytic thermophile Caldicellulosiruptor bescii has recently been extended to Clostridium thermocellum, another cellulolytic thermophile that very efficiently solubilizes plant biomass and produces ethanol. While the C. bescii pBAS2 replicon on these plasmids is thermostable, the use of homologous promoters, signal sequences and genes led to undesired integration into the bacterial chromosome, a result also observed with less thermostable replicating vectors. In an attempt to overcome undesired plasmid integration in C. thermocellum, a deletion of recA was constructed. As expected, C. thermocellum ∆recA showed impaired growth in chemically defined medium and an increased susceptibility to UV damage. Interestingly, we also found that recA is required for replication of the C. bescii thermophilic plasmid pBAS2 in C. thermocellum, but it is not required for replication of plasmid pNW33N. In addition, the C. thermocellum recA mutant retained the ability to integrate homologous DNA into the C. thermocellum chromosome. These data indicate that recA can be required for replication of certain plasmids, and that a recA-independent mechanism exists for the integration of homologous DNA into the C. thermocellum chromosome. Understanding thermophilic plasmid replication is not only important for engineering of these cellulolytic thermophiles, but also for developing genetic systems in similar new potentially useful non-model organisms.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Generative large language models for predictive maintenance planning

Maintenance planning and the generation of necessary components for tasks can prove time-consuming and complex. Automating the creation of recurring or similar tasks by leveraging previous planning packages and data, while uncovering insights to automate planning package generation, presents an opportunity to conserve valuable time and resources. This work aims to harness the textual and probabilistic capabilities of large language models (LLMs) to automate the generation of planning packages. Utilizing diverse data sources ranging from raw data to handwritten text, both singular and collaborative LLMs are trained and tested. Results demonstrate their capability to generate essential planning package components, effectively replicating the statistical patterns in the data. This demonstrates the use of these tools inside a digital asset for automated planning. This work outlines a methodology for constructing datasets, a training suite, and evaluation methods for LLM-based textual and conversational planning tools utilized in an asset digital twin. Results indicate that the fine-tuned models generate estimated planning information within the statistical ranges observed in real maintenance data. The models achieve high accuracy (>90%) in document question-answering and instruction generation tasks. Furthermore, the conversational retrieval-augmented generation (RAG) assistant system achieves 100% document retrieval accuracy, while conversational information capture exceeds 98% across the majority of work-package assistant modules.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2001

Pilot-Induced Oscillation Prediction With Three Levels of Simulation Motion Displacement

Simulator motion platform characteristics were examined to determine if the amount of motion affects pilot-induced oscillation (PIO) prediction. Five test pilots evaluated how susceptible 18 different sets of pitch dynamics were to PIOs with three different levels of simulation motion platform displacement: large, small, and none. The pitch dynamics were those of a previous in-flight experiment, some of which elicited PIOs These in-flight results served as truth data for the simulation. As such, the in-flight experiment was replicated as much as possible. Objective and subjective data were collected and analyzed With large motion, PIO and handling qualities ratings matched the flight data more closely than did small motion or no motion. Also, regardless of the aircraft dynamics, large motion increased pilot confidence in assigning handling qualifies ratings, reduced safety pilot trips, and lowered touchdown velocities. While both large and small motion provided a pitch rate cue of high fidelity, only large motion presented the pilot with a high fidelity vertical acceleration cue.

Schroeder, Jeffery A.↗
NASA NTRS2005

Evaluation of Decision Trees for Cloud Detection from AVHRR Data

Automated cloud detection and tracking is an important step in assessing changes in radiation budgets associated with global climate change via remote sensing. Data products based on satellite imagery are available to the scientific community for studying trends in the Earth's atmosphere. The data products include pixel-based cloud masks that assign cloud-cover classifications to pixels. Many cloud-mask algorithms have the form of decision trees. The decision trees employ sequential tests that scientists designed based on empirical astrophysics studies and simulations. Limitations of existing cloud masks restrict our ability to accurately track changes in cloud patterns over time. In a previous study we compared automatically learned decision trees to cloud masks included in Advanced Very High Resolution Radiometer (AVHRR) data products from the year 2000. In this paper we report the replication of the study for five-year data, and for a gold standard based on surface observations performed by scientists at weather stations in the British Islands. For our sample data, the accuracy of automatically learned decision trees was greater than the accuracy of the cloud masks p < 0.001.

AVHRR (ADVANCED VERY HIGH RESOLUTION RADIOMETER)↗
NASA NTRS1972

The application of remote sensing techniques to inter and intra urban analysis

This is an effort to assess the applicability of air and spaceborne photography toward providing data inputs to urban and regional planning, management, and research. Through evaluation of remote sensing inputs to urban change detection systems, analyzing an effort to replicate an existing urban land use data file using remotely sensed data, estimating population and dwelling units from imagery, and by identifying and evaluating a system of urban places ultilizing space photography, it was determined that remote sensing can provide data concerning land use, changes in commercial structure, data for transportation planning, housing quality, residential dynamics, and population density.

Horton, F. E.↗
NASA NTRSDate not supplied

Lessons learned from replicating services for flood prediction and monitoring in Asia to the assessment of hurricane impacts in Central America

In October and November 2020, two dangerous back-to-back hurricanes, Eta and Iota, made landfall in Central America. The SERVIR program - a joint effort of NASA and the U.S. Agency for International Development, and whose motto is “connecting space to village” was able to leverage two tools originally developed for use in other regions for predicting and assessing the flood impacts of the hurricanes. The GEOGLoWS Streamflow Prediction tool - originally implemented in the Hindu Kush Himalayan region - was used for predicting potential flooding ahead of landfall by Eta and Iota. In conjunction, the Hydrologic Remote Sensing Analysis for Floods (HYDRAFloods) framework - originally developed along with SERVIR-Mekong - was used for post-event flood mapping, leveraging its ability to map floods in cloud-covered areas using synthetic aperture radar (SAR) imagery from the Copernicus program. Both tools were used in support of disaster coordination efforts being led by the Central American Regional Disaster Prevention Center (CEPREDENAC), in conjunction with its sister agency, the Regional Water Resources Committee (CRRH). The support provided to regional entities - and to their stakeholder national governments - served as an example of rapid generation of Earth observation products for disaster response. Feedback on those products was also provided, especially in terms of the implications of (i) calibration of predicted river volumes, and (ii) the latency of the input Earth observation imagery and attempts to map the floods’ maximum extents. An upcoming NASA DEVELOP project will also seek to strengthen the capability of CEPREDENAC and CRRH to apply HYDRAFloods for future extreme events. The application of the tools also provides a useful case study on capacity building, in terms of how Earth observation data and models can be replicated across regions.

Capacity building↗
DOE OSTI2018

Toward a Compatible Reproducibility Taxonomy for Computational and Computing Sciences

Reproducibility is an essential ingredient of the scientific enterprise. The ability to reproduce results builds trust that we can rely on the results as foundations for future scientific exploration. Presently, the fields of computational and computing sciences provide two opposing definitions of reproducible and replicable. In computational sciences, reproducible research means authors provide all necessary data and computer codes to run analyses again, so others can re-obtain the results (J. Claerbout et al., 1992). The concept was adopted and extended by several communities, where it was distinguished from replication: collecting new data to address the same question, and arriving at consistent findings (Peng et al. 2006). The Association of Computing Machinery (ACM), representing computer science and industry professionals, recently established a reproducibility initiative, adopting essentially opposite definitions. The purpose of this report is to raise awareness of the opposite definitions and propose a path to a compatible taxonomy.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2001

The First SeaWiFS HPLC Analysis Round-Robin Experiment (SeaHARRE-1)

Four laboratories, which had contributed to various aspects of SeaWiFS calibration and validation activities, participated in the first SeaWiFS HPLC Analysis Round-Robin Experiment (SeaHARRE-1): Horn Point Laboratory (USA), the Joint Research Centre (Italy), the Laboratoire de Physique et Chimie Marines (France), and the Marine and Coastal Management group (South Africa). The analyses of the data are presented in Chapter 1 and the individual methods of the four groups are presented in Chapters 2-5. The average (or overall) conclusions of the round-robin are derived from 12 in situ stations occupied during a cruise in the Mediterranean Sea, although, only 11 stations are used in the analyses. The data set is composed of 12 replicates taken during each sampling opportunity with 3 replicates going to each of the 4 laboratories. The average (or overall) results from the intercomparison of 15 pigments or pigment associations are as follows (in some cases, data subsets that exclude pigments which were not analyzed by all the laboratories, or that had unusually large variances, are used to exclude a variety of problematic pigments): a) the accuracy of the four methods in determining the concentration of total chlorophyll a is 7.9%, (one method did not separate mono- and divinyl chlorophyll a, and if the samples containing significant divinyl chlorophyll a concentrations are ignored, the four methods have an accuracy of 6.7%); b) the accuracy in determining the full set of pigments is 19.1%; c) there is a reduction in accuracy of approximately - 12.2% for every decade (factor of 10) decrease in concentration (based on a data subset); d) the precision of the four methods using a subset data is 8.617( 6.2% for an edited subset); e) the repeatability of the four methods using the subset data is 9.2% (7.2%; for an edited subset, and f) the reproducibility of the four methods using the subset data is 21.31% (15.0% for an edited subset).

Hooker, Stanford B.↗
DOE OSTI2018

Rapidly Assessing the Quality of Targeted Proteomics Experiments through Monitoring Stable-Isotope Labeled Standards

Selected reaction monitoring (SRM), also known as multiple reaction monitoring (MRM), is a data acquisition technique used in targeted analysis of molecules, including targeted proteomic studies. It exploits the unique capability of triple-quadrupole (QQQ) mass spectrometers to monitor the predefined precursor and fragment ion pairs of specific molecules of interest throughout a liquid chromatography (LC) elution profile. Compared to shotgun proteomics, targeted proteomics using SRM has high selectivity, high sensitivity, and a wide linear dynamic range,(1-3) which makes it especially useful in the accurate and reproducible quantification of low-abundance proteins in highly complex biological samples. SRM has been widely used in the fields of biomarker discovery,(4-7) analysis of protein post-translational modifications(8) and characterization of biological protein networks.(4,9) In the recent years, multiple technical advances have greatly improved the throughput of SRM analyses, allowing for the quantification of hundreds of peptides in a single analysis.(6,7,10) For example, a single 800-plex SRM assay (e.g., 400 unlabeled and heavy-labeled peptide pairs and 2400 transitions with retention time scheduling) using ultrahigh-performance liquid chromatography (UHPLC) has been developed to quantify proteins in plasma.(11) Advanced labeling techniques utilizing in vitro proteome-assisted MRM for protein absolute quantification (iMPAQT) demonstrated the capability of SRM in genome-wide protein quantification of over 18?000 human proteins.(12) Moreover, the scan speed of QQQ instrumentation has been greatly improved in recent releases of commercial instrumentation. The newly developed TSQ Altis (released in 2017) can scan more than 600 transitions per second, which is 6 times more than a traditional QQQ scan speed of 100 transitions per second. The breadth of measurement enabled by these technological improvements to QQQ mass spectrometry has increased the feasibility and popularity of large scale targeted proteomics studies,(13) a major application of which will be in clinical studies in which up to hundreds of protein candidates need to be quantified in hundreds of clinical specimens.(14) Quantitative accuracy is a primary motivating factor for utilizing a targeted proteomics protocol. The precise and reproducible absolute quantification produced by SRM assays is essential to many clinical and laboratory experiments.(15,16) Because the abundance of an endogenous peptide is calculated from the measurement of the spiked-in reference standard, it is essential to assess the data quality of these references.(17) In early applications of targeted proteomics, when instrument speed greatly limited the number of transitions that could be monitored, much of this quality assessment was done manually. However, recent improvements in instrument performance and experimental design have enabled a dramatic increase in the number of target peptides and associated SRM transitions, which makes manual quality assessment an untenable and laborious task. A variety of computational tools assist in SRM experiment design and data analysis. The first task in creating an SRM experiment is the choice of proteins and representative peptides to monitor. Achieving a reliable protein abundance requires appropriately choosing peptides that have a strong signal and are free from interferences in the biological matrix. Numerous computational tools exist to facilitate assay design by identifying peptides and refining SRM transitions.(18-21) To help share these assays and eliminate time spent designing the same transitions at multiple institutions, community portals have begun to host well-designed and vetted assays.(22-24) Analyzing the experimental data requires significant computational effort to align files across replicates and experimental conditions, pick peaks and produce quantitative values, normalize data and perform statistical tests, etc.(25-27)

Gibbons, Bryson C.↗
DOE OSTI2018

Hepatitis B virus suppresses the secretion of insulin-like growth factor binding protein 1 to facilitate anti-apoptotic IGF-1 effects in HepG2 cells

Highlights: • HBV replication alters host cell gene expression in HepG2 cells. • HBV replication downregulates IGFBP1 expression and secretion. • HBx expression alone is sufficient to modulate IGFBP1 expression. • Knockdown of IGFBP1 reduces thapsigargin- and staurosporine-induced apoptosis. • IGFBP1 inhibits the anti-apoptotic effects of IGF-1. Hepatitis B virus (HBV) infection is a major global health burden as chronic hepatitis B (CHB) is associated with the development of liver diseases including hepatocellular carcinoma (HCC). To gain insight into the mechanisms causing HBV-related HCC, we investigated the effects of HBV replication on global host cell gene expression using human HepG2 liver cells. By microarray analysis, we identified 54 differentially expressed genes in HBV-replicating HepG2 cells. One of the differentially-expressed genes was insulin-like growth factor binding protein 1 (IGFBP1) which was downregulated in HBV-replicating cells. Consistent with the gene expression data, IGFBP1 was suppressed at both the cellular and secreted protein levels in the presence of HBV replication. Transient transfection experiments with an inducible plasmid encoding the HBV X protein (HBx) revealed that HBx alone was sufficient to modulate IGFBP1 expression. Small interference RNA (siRNA)-mediated loss of function studies revealed that knockdown of IGFBP1 reduced apoptosis induced by either thapsigargin (TG) or staurosporine (STS). Treatment of cells with recombinant insulin-like growth factor 1 (IGF-1) decreased both TG- or STS-induced apoptosis. Interestingly, addition of recombinant IGFBP1 reversed the anti-apoptotic effect of IGF-1 on TG-induced, but not STS-induced, apoptosis. In conclusion, our results suggest an anti-apoptotic autocrine function of HBV-mediated downregulation of IGFBP1 in HepG2 cells. Such an effect may contribute to the development of HBV-mediated HCC by increasing pro-survival and anti-apoptotic IGF-1 effects.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Dark Energy Survey Year 3 Results: Galaxy mock catalogs for BAO analysis

The calibration and validation of scientific analysis in simulations is a fundamental tool to ensure unbiased and robust results in observational cosmology. In particular, mock galaxy catalogs are a crucial resource to achieve these goals in the measurement of baryon acoustic oscillation (BAO) in the clustering of galaxies. Here we present a set of 1952 galaxy mock catalogs designed to mimic the Dark Energy Survey Year 3 BAO sample over its full photometric redshift range 0.6 < zphoto < 1.1. The mocks are based upon 488 ICE-COLA fast N-body simulations of full-sky light cones and were created by populating halos with galaxies, using a hybrid halo occupation distribution – halo abundance matching model. This model has ten free parameters, which were determined, for the first time, using an automatic likelihood minimization procedure. We also introduced a novel technique to assign photometric redshift for simulated galaxies, following a two-dimensional probability distribution with VIMOS Public Extragalactic Redshift Survey data. The calibration was designed to match the observed abundance of galaxies as a function of photometric redshift, the distribution of photometric redshift errors, and the clustering amplitude on scales smaller than those used for BAO measurements. An exhaustive analysis was done to ensure that the mocks reproduce the input properties. Finally, mocks were tested by comparing the angular correlation function w(θ), angular power spectrum Cℓ, and projected clustering ξp(r⊥) to theoretical predictions and data. The impact of volume replication in the estimate of the covariance is also investigated. The success in accurately reproducing the photometric redshift uncertainties and the galaxy clustering as a function of redshift render this mock creation pipeline as a benchmark for future analyses of photometric galaxy surveys.Key words: catalogs / large-scale structure of Universe / galaxies: distances and redshifts / Galaxy: halo / methods: numerical

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

High-Fidelity CFD Modeling of Cryogenic Hydrogen Isotope Extrusion for Fusion Reactor Pellet Fueling

This study investigates the extrusion processes of deuterium and protium using ANSYS-Polyflow. The geometries and computational fluid dynamics (CFD) settings closely replicate the experimental setups and data acquired from the extruder experiments at Oak Ridge National Laboratory (ORNL) for validation purposes. We explore the impacts of (1) slip versus non-slip boundary conditions and (2) the use of constant, temperature-, and shear rate–dependent viscosities, concluding that the implementation of non-slip wall boundary conditions combined with shear rate–dependent viscosity produced more accurate predictions. The simulations achieved excellent agreement with the experimental data, with relative differences of only 5% for deuterium, and 3% to 6% for protium. This is the first time that experimental extrusion data at ORNL have been accurately predicted through high-fidelity CFD modeling. In conclusion, the advancements offer valuable insights and a foundational modeling tool for optimizing pellet injectors for ITER and other future reactor-scale devices.

ANSYS-Polyflow↗
DOE OSTI2018

Chameleon: An Adaptive Wear Balancer for Flash Clusters

NAND flash-based Solid State Devices (SSDs) offer the desirable features of high performance, energy efficiency, and fast growing capacity. Thus, the use of SSDs is increasing in distributed storage systems. A key obstacle in this context is that the natural unbalance in distributed I/O workloads can result in wear imbalance across the SSDs in a distributed setting. This, in turn can have significant impact on the reliability, performance, and lifetime of the storage deployment. Extant load balancers for storage systems do not consider SSD wear imbalance when placing data, as the main design goal of such balancers is to extract higher performance. Consequently, data migration is the only common technique for tackling wear imbalance, where existing data is moved from highly loaded servers to the least loaded ones. In this paper, we explore an innovative holistic approach, Chameleon, that employs data redundancy techniques such as replication and erasure-coding, coupled with endurance-aware write offloading, to mitigate wear level imbalance in distributed SSD-based storage. Chameleon aims to balance the wear among different flash servers while meeting desirable objectives of: extending life of flash servers; improving I/O performance; and avoiding bottlenecks. Evaluation with a 50 node SSD cluster shows that Chameleon reduces the wear distribution deviation by 81% while improving the write performance by up to 33%.

Zhao, Nannan↗
DOE OSTI2015

Radon Exposure, IL-6 Promoter Variants, and Lung Squamous Cell Carcinoma in Former Uranium Miners

Background: High radon exposure is a risk factor for squamous cell carcinoma, a major lung cancer histology observed in former uranium miners. Radon exposure can cause oxidative stress, leading to pulmonary inflammation. Interleukin-6 (IL-6) is a pro-carcinogenic inflammatory cytokine that plays a pivotal role in lung cancer development. Objectives: We assessed whether single nucleotide polymorphisms (SNPs) in the IL6 promoter are associated with lung cancer in former uranium miners with high occupational exposure to radon gas. Methods: Genetic associations were assessed in a case–control study of former uranium miners (242 cases and 336 controls). A replication study was performed using data from the Gene Environment Association Studies (GENEVA) Genome Wide Association Study (GWAS) of Lung Cancer and Smoking. Functional relevance of the SNPs was characterized using in vitro approaches. Results: We found that rs1800797 was associated with squamous cell carcinoma in miners and with a shorter time between the midpoint of the period of substantial exposure and diagnosis among the cases. Furthermore, rs1800797 was also associated with lung cancer among never smokers in the GENEVA dataset. Functional studies identified that the risk allele was associated with increased basal IL-6 mRNA level and greater promoter activity. Furthermore, fibroblasts with the risk allele showed greater induction of IL-6 secretion by hydrogen peroxide or benzo[a]pyrene diolepoxide treatments. Conclusions: An IL6 promoter variant was associated with lung cancer in uranium miners and never smokers in two external study populations. Lastly, the associations are strongly supported by the functional relevance that the IL6 promoter SNP affects basal expression and carcinogen-induced IL-6 secretion

60 APPLIED LIFE SCIENCES↗
NASA NTRS1988

Mathematical algorithms for approximate reasoning

Most state of the art expert system environments contain a single and often ad hoc strategy for approximate reasoning. Some environments provide facilities to program the approximate reasoning algorithms. However, the next generation of expert systems should have an environment which contain a choice of several mathematical algorithms for approximate reasoning. To meet the need for validatable and verifiable coding, the expert system environment must no longer depend upon ad hoc reasoning techniques but instead must include mathematically rigorous techniques for approximate reasoning. Popular approximate reasoning techniques are reviewed, including: certainty factors, belief measures, Bayesian probabilities, fuzzy logic, and Shafer-Dempster techniques for reasoning. A group of mathematically rigorous algorithms for approximate reasoning are focused on that could form the basis of a next generation expert system environment. These algorithms are based upon the axioms of set theory and probability theory. To separate these algorithms for approximate reasoning various conditions of mutual exclusivity and independence are imposed upon the assertions. Approximate reasoning algorithms presented include: reasoning with statistically independent assertions, reasoning with mutually exclusive assertions, reasoning with assertions that exhibit minimum overlay within the state space, reasoning with assertions that exhibit maximum overlay within the state space (i.e. fuzzy logic), pessimistic reasoning (i.e. worst case analysis), optimistic reasoning (i.e. best case analysis), and reasoning with assertions with absolutely no knowledge of the possible dependency among the assertions. A robust environment for expert system construction should include the two modes of inference: modus ponens and modus tollens. Modus ponens inference is based upon reasoning towards the conclusion in a statement of logical implication, whereas modus tollens inference is based upon reasoning away from the conclusion. These algorithms allow one to reason accurately with uncertain data. The above environment can replicate state-f-the-art expert system environments which provides a continuity between the current expert systems which cannot be validated or verified and future expert systems which should be both validated and verified

Murphy, John H.↗
DOE OSTI2015

GOTTCHA, Version2

One major challenge in the field of shotgun metagenomics is the accurate identification of the organisms present within the community, based on classification of short sequence reads. Though microbial community profiling methods have emerged to attempt to rapidly classify the millions of reads output from contemporary sequencers, the combination of incomplete databases, similarity among otherwise divergent genomes, and the large volumes of sequencing data required for metagenome sequencing has led to unacceptably high false discovery rates (FDR). Here we present the application of a novel, gene-independent and signature-based metagenomic taxonomic profiling tool with significantly smaller FDR, which is also capable of classifying never-before seen genomes into the appropriate parent taxa.The algorithm is based upon three primary computational phases: (I) genomic decomposition into bit vectors, (II) bit vector intersections to identify shared regions, and (III) bit vector subtractions to remove shared regions and reveal unique, signature regions. In the Decomposition phase, genomic data is first masked to highlight only the valid (non-ambiguous) regions and then decomposed into overlapping 24-mers. The k-mers are sorted along with their start positions, de-replicated, and then prefixed, to minimize data duplication. The prefixes are indexed and an identical data structure is created for the start positions to mimic that of the k-mer data structure. During the Intersection phase -- which is the most computationally intensive phase -- as an all-vs-all comparison is made, the number of comparisons is first reduced by four methods: (a) Prefix restriction, (b) Overlap detection, (c) Overlap restriction, and (d) Result recording. In Prefix restriction, only k-mers of the same prefix are compared. Within that group, potential overlap of k-mer suffixes that would result in a non-empty set intersection are screened for. If such an overlap exists, the region which intersects is first reduced by performing a binary search of the boundary suffixes of the smaller set into the larger set, which defines the limits of the zipper-based intersection process. Rather than recording the actual k-mers of the intersection, another data structure of identical "shape" is created which consists of only bit vectors so that only a 1 or 0 will be stored in the location of the k-mer suffix that was found in the intersection. This reduces the amount of data generated and stored considerably. During the Subtraction phase, relevant intersection bitmasks are first unionized together to form a single bitmask which is then applied over the original genome to reveal only those regions of the genome that are unique. These regions are then exported to disk in FASTA format and used in the application of determining the constituents of an unknown metagenomic community.

Freitas, Tracey↗