Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Text Analytics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

230 records · Page 13

P SI4 1.4: Open-source software for high-throughput quantum chemistry

PSI4 is a free and open-source ab initio electronic structure program providing implementations of Hartree–Fock, density functional theory, many-body perturbation theory, configuration interaction, density cumulant theory, symmetry-adapted perturbation theory, and coupled-cluster theory. Most of the methods are quite efficient, thanks to density fitting and multi-core parallelism. The program is a hybrid of C++ and Python, and calculations may be run with very simple text files or using the Python API, facilitating post-processing and complex workflows; method developers also have access to most of PSI4 's core functionalities via Python. Job specification may be passed using The Molecular Sciences Software Institute (MolSSI) QCSCHEMA data format, facilitating interoperability. We announce a rewrite of our top-level computation driver, and concomitant adoption of the MolSSI QCARCHIVE INFRASTRUCTURE project, makes the latest version of PSI4 well suited to distributed computation of large numbers of independent tasks. The project has fostered the development of independent software components that may be reused in other quantum chemistry programs.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Risk-based area of review estimation in overpressured reservoirs to support injection well storage facility permit requirements for CO 2 storage projects

This paper by the Energy & Environmental Research Center presents a workflow and modeling approach for delineating a risk-based area of review (AOR) to support a U.S. Environmental Protection Agency (EPA) Class VI permit for a carbon dioxide (CO 2 ) storage project. The approach combines semianalytical solutions for estimating formation fluid leakage through a hypothetical leaky wellbore with the results of numerical reservoir simulations to define the AOR. The modeling utilizes 1) semianalytical solutions from the peer-reviewed literature for formation fluid leakage through abandoned wellbores by Raven (1990) and Avci (1994), 2) a FORTRAN model compiled and described in Cihan et al. (2011, 2012) called ASLMA (Analytical Solution for Leakage in Multilayered Aquifers), and 3) a computational framework for estimating a risk-based AOR first proposed by Oldenburg et al. (2014, 2016). Therefore, the approach builds upon well-established research and underlying hydrogeological principles that have been upheld for nearly three decades. Moreover, the ASLMA model has been broadly applied to an array of storage projects. The work presented herein extends these earlier works using a custom wrapper written in the software environment, R (R Core Team, 2020), which was developed to perform multiple runs of the ASLMA model using given ranges for one or more input parameters. In addition, the current work simulates the pressure buildup within the storage reservoir in response to CO 2 injection using a compositional simulator to better accommodate the temporospatial evolution of pressure buildup within the storage reservoir that is more accurately modeled using a heterogeneous geologic model and a compositional simulator that accounts for the multiphase interactions. The workflow is demonstrated using a case study for a 180,000-metric-ton-per-year storage project located in the PCOR (Plains CO 2 Reduction) Partnership region. For the storage project evaluated here, under the scenario where the leaky wellbore is open to a saline aquifer (thief zone) between the overlying seal (cap rock) and the underground sources of drinking water (USDW), the risk-based AOR essentially collapses to the areal extent of the CO 2 plume in the storage reservoir because the pressure buildup in the storage reservoir beyond the CO 2 plume is insufficient to drive formation fluids up a hypothetical leaky wellbore into the USDW. However, even under the conservative assumption that the leaky wellbore is not open to a thief zone, beyond the areal extent of the CO 2 plume, the incremental leakage is less than 400 m 3 over 20 years, which represents ~0.0001% or less of the total volume of water contained within the USDW rock volume. As discussed in the text, the threshold criterion for defining the risk-based AOR is site-specific and should be informed by the results of the sensitivity analysis and available site characterization data. The approach outlined in this paper is designed to be protective of USDWs and, therefore, comply with the Safe Drinking Water Act requirements and provisions for the U.S. EPA Class VI Underground Injection Control (UIC) Program (Class VI Rule) and North Dakota Administrative Code Chapter 43-05-01.

54 ENVIRONMENTAL SCIENCES↗

Assessing the distinguishable cluster approximation based on the triple bond-breaking in the nitrogen molecule

Obtaining the correct potential energy curves for the dissociation of multiple bonds is a challenging problem for ab initio methods which are affected by the choice of a spin-restricted reference function. Coupled cluster (CC) methods such as CCSD (coupled cluster singles and doubles model) and CCSD(T) (CCSD + perturbative triples) correctly predict the geometry and properties at equilibrium but the process of bond dissociation, particularly when more than one bond is simultaneously broken, is much more complicated. New modifications of CC theory suggest that the deleterious role of the reference function can be diminished, provided a particular subset of terms is retained in the CC equations. The Distinguishable Cluster (DC) approach of Kats and Manby [J. Chem. Phys. 139, 021102 (2013)], seemingly overcomes the deficiencies for some bond-dissociation problems and might be of use in quasi-degenerate situations in general. DC along with other approximate coupled cluster methods such as ACCD (approximate coupled cluster doubles), ACP-D45, ACP-D14, 2CC, and pCCSD(α, β) (all defined in text) falls under a category of methods that are basically obtained by the deletion of some quadratic terms in the double excitation amplitude equation for CCD/CCSD (coupled cluster doubles model/coupled cluster singles and doubles model). Here these approximate methods, particularly those based on the DC approach, are studied in detail for the nitrogen molecule bond-breaking. The N{sub 2} problem is further addressed with conventional single reference methods but based on spatial symmetry-broken restricted Hartree–Fock (HF) solutions to assess the use of these references for correlated calculations in the situation where CC methods using fully symmetry adapted SCF solutions fail. The distinguishable cluster method is generalized: 1) to different orbitals for different spins (unrestricted HF based DCD and DCSD), 2) by adding triples correction perturbatively (DCSD(T)) and iteratively (DCSDT-n), and 3) via an excited state approximation through the equation of motion (EOM) approach (EOM-DCD, EOM-DCSD). The EOM-CC method is used to identify lower-energy CC solutions to overcome singularities in the CC potential energy curves. It is also shown that UHF based CC and DC methods behave very similarly in bond-breaking of N{sub 2}, and that using spatially broken but spin preserving SCF references makes the CCSD solutions better than those for DCSD.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

ANI-1: an extensible neural network potential with DFT accuracy at force field computational cost

Deep learning is revolutionizing many areas of science and technology, especially image, text, and speech recognition. In this paper, we demonstrate how a deep neural network (NN) trained on quantum mechanical (QM) DFT calculations can learn an accurate and transferable potential for organic molecules. We introduce ANAKIN-ME (Accurate NeurAl networK engINe for Molecular Energies) or ANI for short. ANI is a new method designed with the intent of developing transferable neural network potentials that utilize a highly-modified version of the Behler and Parrinello symmetry functions to build single-atom atomic environment vectors (AEV) as a molecular representation. AEVs provide the ability to train neural networks to data that spans both configurational and conformational space, a feat not previously accomplished on this scale. We utilized ANI to build a potential called ANI-1, which was trained on a subset of the GDB databases with up to 8 heavy atoms in order to predict total energies for organic molecules containing four atom types: H, C, N, and O. To obtain an accelerated but physically relevant sampling of molecular potential surfaces, we also proposed a Normal Mode Sampling (NMS) method for generating molecular conformations. Through a series of case studies, we show that ANI-1 is chemically accurate compared to reference DFT calculations on much larger molecular systems (up to 54 atoms) than those included in the training data set.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Erratum: “History of atomic layer deposition and its relationship with the American Vacuum Society” [J. Vac. Sci. Technol. A 31, 050818 (2013)]

The authors of this review article published in 20131 would like to correct some text and references relating to the first observations and publications on molecular layering. In Sec. II, “Early Years of Atomic Layer Processes” in the original article,1 the first two sentences of the fourth paragraph should instead say “The ALD principle, where surface reactions follow a binary sequence of self-limiting half-reactions, was reported under the name ‘molecular layering’ in the 1960s by S. I. Kol’tsov from Leningrad Technological Institute.2–6 These experiments were conducted under the scientific supervision of V. B. Aleskovskii. The ‘framework hypothesis,’ an antecedent to molecular layering, was proposed by V. B. Aleskovskii in 1952.6” In addition, again in this same section and paragraph, the last two sentences should instead say “In the 1969 article,3 the authors report that the initial reaction between TiCl4 and Si–OH tends to involve 3 Si–OH, forming one Ti–Cl, whereas after the first water step, the second TiCl4 exposure reacts with 2 Ti–OH, forming Ti–Cl2 groups. In the 1969 paper,3 a planar thin film was not produced or evaluated, although nanolayers were prepared by molecular layering at that time.6” These corrections do not affect other sections or the conclusions drawn in the article.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Correction to “Ruthenium Dye Excitations and Relaxations in Natural Sunlight”

An error in computing the optical rate coefficients for dye RuP was discovered in Table S4 of the Supporting Information Section S8 Model S? for this article, published in J. Phys. Chem. A, 2021, 125, 4365-4372, 10.1021/acs.jpca.1c02386. The optical rate coefficients include absorption, stimulated emission, and ground-state bleach associated with the ground state and the singlet and triplet excited states as well as for the excited-state absorption between the excited states and implicit higher-energy excited states. The optical rate coefficients for continuous solar irradiance were computed using eq 3 of the main text in which the product of the individual signal components and the solar spectrum are integrated and multiplied by the fundamental optical rate coefficient. We determined the incorrect signal components were used for RuP in the published Supporting Information Table S4. The corrected Table S4 column for RuP is presented with the reported values from the original paper in the corrected Supporting Information. New simulations have been performed using the corrected values, and the results were used to update Figures 5 and 6 and also Figure S9 in the corrected Supporting Information. The published conclusions are unchanged. The populations of RuP excited states, Figure 5, are only marginally smaller, which should be expected with minor changes to the optical rate coefficients. There is not a significant change in the results for the number of radiative and nonradiative interactions per dye per second (the optical transitions and nonradiative transitions increased, respectively, by approximately 2% and 10%, Figure 6A). The occurrence of excited-state absorption (ESA) and excited-state emission (ESE) events, Figure 6C, both decreased from the original simulation results by 20% and 33%. The most notable difference is exhibited in Figure 6B; the fraction of population moving from the lowest-energy singlet state (i.e., intersystem crossing or ultrafast nonradiative relaxation) and nonradiative relaxation from the triplet state have decreased from ~0.45 to ~0.4 and increased from ~0.35 to ~0.4, respectively..

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A Nonlinear Theory of Atmospheric Blocking: A Potential Vorticity Gradient View

In this paper, an extended nonlinear multiscale interaction model of blocking events in the equivalent barotropic atmosphere is used to investigate the effect of a slowly varying zonal wind in the meridional direction on dipole blocking that is regarded as a nonlinear Rossby wave packet. It is shown that the meridional gradient of potential vorticity [Formula: see text] prior to the blocking onset, which is related to the background zonal wind and its nonuniform meridional shear, can significantly affect the lifetime, intensity, and north–south asymmetry of dipole blocking, while the blocking dipole itself is driven by preexisting incident synoptic-scale eddies. The magnitude of the background PV y determines the energy dispersion and nonlinearity of blocking. It is revealed that a small background PV y is a prerequisite for strong and long-lived eddy-driven blocking that behaves as a persistent meandering westerly jet stream, while the blocking establishment further reduces the PV y within the blocking region, resulting in a positive feedback between blocking and PV y . When the core of the background westerly jet shifts from higher to lower latitudes, the blocking shows a northwest–southeast-oriented dipole with a strong anticyclonic anomaly to the northwest and a weak cyclonic anomaly to the southeast as its northern pole moves westward more rapidly and has weaker energy dispersion and stronger nonlinearity than its southern pole because of the smaller PV y in higher latitudes. The opposite is true when the background jet shifts toward higher latitudes. The asymmetry of dipole blocking vanishes when the background jet shows a symmetric double-peak structure. Thus, a small prior PV y is a favorable precursor for the occurrence of long-lived and large-amplitude blocking.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Mechanical properties of metal dihydrides

First-principles calculations are used to characterize the bulk elastic properties of cubic and tetragonal phase metal dihydrides, $\text{M}{{\text{H}}_{2}}$ {$\text{M}$ = Sc, Y, Ti, Zr, Hf, lanthanides} to gain insight into the mechanical properties that govern the aging behavior of rare-earth di-tritides as the constituent 3 H, tritium, decays into 3 He. As tritium decays, helium is inserted in the lattice, the helium migrates and collects into bubbles, that then can ultimately create sufficient internal pressure to rupture the material. The elastic properties of the materials are needed to construct effective mesoscale models of the process of bubble growth and fracture. Dihydrides of the scandium column and most of the rare-earths crystalize into a cubic phase, while dihydrides from the next column, Ti, Zr, and Hf, distort instead into the tetragonal phase, indicating incipient instabilities in the phase and potentially significant changes in elastic properties. We report the computed elastic properties of these dihydrides, and also investigate the off-stoichiometric phases as He or vacancies accumulate. As helium builds up in the cubic phase, the shear moduli greatly soften, converting to the tetragonal phase. Conversely, the tetragonal phases convert very quickly to cubic with the removal of H from the lattice, while the cubic phases show little change with removal of H. Finally, the source and magnitude of the numerical and physical uncertainties in the modeling are analyzed and quantified to establish the level of confidence that can be placed in the computational results, and this quantified confidence is used to justify using the results to augment and even supplant experimental measurements.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

H2OI95: A Stand-Alone Fortran Code for Evaluating the IAPWS-95 Equation-of-State Model for Water (Rev. 1)

H2OI95 is a stand-alone Fortran code for evaluating the IAPWS-95 equation-of-state model for the thermodynamic properties of water. It also evaluates the corresponding thermochemical properties of water consistent with the CODATA recommendations. The IAPWS-95 model is based on a model equation for the dimensionless Helmholtz energy for which the primary variables are the inverse reduced temperature (τ = T cr /T ) and reduced density (δ = ρ/ρ cr ). Here T is the absolute temperature (K), ρ is density (kg/m³), and the subscript “ cr ” refers to the critical point of water (647.096 K and 22.064 MPa pressure in this model, for which ρ cr is 322 kg/m³). The code solves four basic types of problems, distinguished by the specified inputs: 1. Temperature (K) and density (ρ kg/m³) or reduced density (δ) 2. Temperature (K) and pressure (MPa). 3. Temperature (K) on the saturation (liquid-vapor equilibrium) curve 4. Pressure (MPa) on the saturation curve. Each type of problem is run using a corresponding input (text) file. All but the first type of problem require iteration. For example, to solve for desired temperature and pressure, the reduced density must be adjusted to give the desired pressure. Iteration is accomplished using the Newton-Raphson method, though the secant method is also used in solving the fourth type of problem. For the last three types of problems, H2OI95 has been used to conduct numerical studies of convergence and the problem of multiple numerical solutions, some of which are not physically valid. Obtaining valid results depends mainly on appropriate choice of starting values for the density. The default values used in H2OI95 appear to consistently lead to generally desired results. With modification (not addressed here), H2OI95 can be used to support SUPCRT92 and similar codes that compute chemical thermodynamic properties of species and reactions over a wide range of temperature and pressure (273.16-1273K and 0-1000 MPa). Version 1.1 of this software calculates an extended set of water properties, including some derivable solely from IAPWS-95, such as the isobaric thermal expansivity and the isothermal compressibility, and still other properties based on supplementary models sanctioned by IAPWS, including the dynamic viscosity, thermal conductivity, surface tension, and static dielectric constant, and various other properties (notably Debye-Hückel parameters) derivable from the dielectric constant and its partial derivatives with respect to temperature and pressure. A coding error in Version 1.0 was identified while testing the implementation of the viscosity model. This error is described in Appendix C. It mainly affects calculation of “higher order” properties such as compressibility and heat capacity near the critical point.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

MechBERT: Language Models for Extracting Chemical and Property Relationships about Mechanical Stress and Strain

Language models are transforming materials-aware naturallanguage processing by enabling the extraction of dynamic, context-rich information from unstructured text, thus, moving beyond the limitations of traditional information-extraction methods. Moreover, small language models are on the rise because some of them can perform better than large language models (LLMs) when given domain-specific questionanswer tasks, especially about an application area that relies on a highly specialized vernacular, such as materials science. We therefore present a new class of MechBERT language models for understanding mechanical stress and strain in materials. These employ Bidirectional Encoder Representations for transformer (BERT) architectures. We showcase four MechBERT models, all of which were pretrained on a corpus of documents that are textually rich in chemicals and their stress–strain properties and were fine-tuned on question-answering tasks. We evaluated the level of performance of our models on domain-specific as well as general English-language question-answer tasks and also explored the influence of the size and type of BERT architectures on model performance. We find that our MechBERT models outperform BERT-based models of the same size and maintain relevancy better than much larger BERT-based models when tasked with domain-specific question-answering tasks within the stress–strain engineering sector. These small language models also enable much faster processing and require a much smaller fraction of data to pretrain them, affording them greater operational efficiency and energy sustainability than LLMs.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Rapid Adaptation of Chemical Named Entity Recognition Using Few-Shot Learning and LLM Distillation

Named entity recognition (NER) has been widely used in chemical text mining for the automatic identification and extraction of chemical entities. However, existing chemical NER systems primarily focus on scenarios with abundant training data, requiring significant human effort on annotations. This poses challenges for applications in the chemical field, such as catalysis, where many advancements have traditionally relied on trial-and-error investigations and incremental adjustment of variables. This hinders catalysis science and technology progress in addressing emerging energy and environmental crises. In this work, we propose a few-shot NER model that can quickly adapt to extract new types of chemical entities by using only a limited number of annotated examples. Our model employs a metric-learning approach to transfer entity similarity knowledge from high-resource chemical domains (with abundant annotations) to enable effective entity recognition in low-resource specialized domains (limited annotation). We validate the effectiveness of our model on a few-shot chemical NER benchmark built based on six existing chemical NER data sets. Experiments show that the proposed few-shot NER model can achieve reasonable performance with only 5 examples per entity type and shows consistent improvement as the number of examples increases. Furthermore, we demonstrate how the proposed model can be trained with large language model (LLM) annotated data, opening a new pathway for rapid adaptation of NER systems. Furthermore, our approach leverages the knowledge broadness of large language models for chemistry while distilling this knowledge into a lightweight model suitable for efficient and in-house use.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

IMAGINE BioSecurity: Mesocosm-Based Methods to Evaluate Biocontainment Strategies and Impact of Industrial Microbes Upon Native Ecosystems

Project Goals: The Integrative Modeling and Genome-scale Engineering for Biosystems Security (IMAGINE BioSecurity) SFA project seeks to establish an understanding of the behavior of engineered microbes in controlled versus environmental conditions to predictively devise new strategies for responding to biological escape. To this end, the IMAGINE Team has established a plant-soil mesocosm platform to track and quantify the fate of industrial microbes in environmental systems and assess the efficacy of biocontainment constraints upon genetically engineered microbe escape frequency and the impact of industrial microbes upon native ecological microbiomes. Abstract Text: Genetically modified industrial production microbes and their associated bioproducts have emerged as an integral component of a sustainable bioeconomy. However, the rapid development of these innovative technologies raises biosecurity concerns, namely, the risk of environmental escape. Thus, the realization of a bioeconomy hinges not only on the development and deployment of microbial production hosts, but also on the development of secure biosystems and biocontainment designs. Current laboratory-based biocontainment testing systems do not accurately reflect complexities found in natural environments, necessitating an environmentally relevant analysis pipeline that allows for the detection of rare escapees, the effect of associated bio-products, and the impact on native ecologies. To this end, we have developed an approach that utilizes soil mesocosms and integrated systems analyses to evaluate the efficacy of novel biocontainment strategies and to assess the impact of production systems upon terrestrial microbiome dynamics. We demonstrate the utility of this approach by modeling a contamination with industrial microbial chasses versus their biocontained counterparts. Here we demonstrate the broad utility of this system by highlighting findings from both strains of Saccharomyces cerevisiae that are contained with an inducible toxin anti-toxin system, and stains of Escherichia coli that are contained via genomic recoding. The resultant data demonstrate that this system has broad utility across diverse microbial chassis and biocontainment strategies, enables us to track the fate of our contaminating microbe with high sensitivity in the soil, as well as monitor broader impacts of the perturbation on the underlying soil system. The findings presented here support the use of this mesocosm-based approach to assess the environmental impact of industrial microbes and to validate biocontainment strategies.

BASIC BIOLOGICAL SCIENCES,INORGANIC, ORGANIC, PHYS↗

Synthesis, structure, electronic characterization, and halogenation of gold(III) phlorin complexes

The metalation chemistry of the phlorin, which is a non-aromatic tetrapyrrole macrocycle containing a single sp 3 -hybridized meso-carbon has remained underdeveloped, as compared to that of more traditional tetrapyrroles such as porphyrins, corroles and phthalocyanines. There have been few prior efforts to prepare metallophlorins, and those that have been reported have relied on either reduction or nucleophilic attack of parent metalloporphyrins, rather than direct metalation of freebase phlorin constructs. In this work, an alternate synthetic approach for preparation of gold(III) phlorin complexes that involves the first direct metalation of two different freebase phlorin derivatives (3H(Phl tBu ) and 3H(Phl F )) with AuBr 3 to produce the stable and fully isolable gold(III) phlorin complexes Au(Phl tBu ) and Au(Phl F ) is reported. The first structural characterization of a metallophlorin bearing geminal dimethyl substituents at the sp 3 -hybridized meso-carbon via X-ray crystallography is also reported. In addition to the preparation of Au(Phl tBu ) and Au(Phl F ), the UV-vis absorption and redox properties of these two gold(III) phlorins in comparison to those of their freebase homologues is also detailed. Notably, the metallophlorins are characterized by panchromatic absorbance profiles and intense and broad bands that span the long-visible and into the near-IR regions, as well as two fully reversible oxidation and reduction waves as probed by cyclic voltammetry. Lastly, the chlorination of Au(Phl tBu ) using PhI(Cl 2 ) was probed and it was found that this regioslective reaction generates monochlorinated (Au(Phl tBu Cl)) and dichlorinated (Au(Phl tBu Cl 2 )) products, which were both structurally characterized by X-ray crystallography.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Epi Archive: automated data collection of notifiable disease data

LANL has built a software program that automatically collects global notifiable disease data—particularly data stored in files—and makes it available and shareable within the Biosurveillance Ecosystem(BSVE) as a new data source. This will improve the prediction and early warning of disease events and other applications. Most countries do not report national notifiable disease data in a machine-readable format. Data are often in the form of a file that contains text, tables and graphs summarizing weekly or monthly disease counts. This presents a problem when information is needed for more data intensive approaches to epidemiology, biosurveillance and public health as exemplified by the Biosurveillance Ecosystem(BSVE).While most nations do likely store their data in a machine-readable format, the governments are often hesitant to share data openly for a variety of reasons that include technical, political, economic, and motivational issues. For example, an attempt by LANL to obtain a weekly version of openly available monthly data, reported by the Australian government, resulted in an onerous bureaucratic reply. The obstacles to obtaining data included: paperwork to request data from each of the Australian states and territories, a long delay to obtain data (up to 3 months) and extensive limitations on the data’s use that prohibit collaboration and sharing. This type of experience when attempting to contact public health departments or ministries of health for data is not uncommon. A survey conducted by LANL of notifiable disease data reporting in 52 countries identified only 10 as being machine-readable and 42 being reported in pdf files on a regular basis. Within the 42 nations that report in pdf files, 32 report in a structured, tabular format and10 in a non-structured way. As a result, LANL has developed a tool-Epi Archive (formerly known as EPIC)-to automatically and continuously collect global notifiable disease data and make it readily accessible. We conducted a survey of the national notifiable disease reporting systems notating how the data is reported in two important dimensions: date standards and case definitions. The development of software to regularly ingests notifiable disease data frand makes this data available involved four main steps scraping, extracting, parsing and persisting. For scraping: we would examine website designs and determine reporting mechanisms for each country/website as well as what varies across the reporting mechanisms. We then designed and wrote code to automate the downloading of report pdf files, for each country. We stored report pdfs along with appropriate metadata for extracting and parsing. For extracting: we developed software that can extract notifiable disease data presented in tabular form from a pdf file. We combined the methodology of figure placement detection with the in-house developed table extraction and annotation heuristics. For parsing: we determined what to extract from each pdf dataset from the survey conducted. We then parsed the extracted data into uniform data structures correctly accommodating the dimensions surveyed and the various human languages. This task involved ingesting notifiable disease data in many disparate formats extracted from pdf files and coalescing the data into a standardized format. For persisting: We then store the data in the Epi Archive PostgreSQL database and make it available through the BSVE. The EpiArchive tool currently contains subnational notifiable disease data from 10 nations. When a user accesses the EpiArchive site, they are prompted with four fields: country, region, disease, and date duration. These fields allow the user to specify the location(down to the state level), the disease of interest, and the duration of interest. Upon form submission, a time series is generated from the users’ specifications. The generated time series can then be downloaded into a csv file if a user is interested in performing personal analysis. Additionally, the data from EpiArchive can be reached through an API. LANL as part of a currently funded DTRA effort so that it will automatically and continuously collect global notifiable disease data—particularly data stored in pdf files—and make it available and shareable within the Biosurveillance Ecosystem (BSVE) as a new data source. This will provide data to analytics and users that will improve the prediction and early warning of disease events and other applications.

59 BASIC BIOLOGICAL SCIENCES↗