NETL's SmartSearch Deep Learning Tool, Scalable Data Search and Parse for Carbon Storage Data Discovery
NETL's SmartSearch Deep Learning Tool, Scalable Data Search and Parse for Carbon Storage Data Discovery
Baker, David Victor↗
SEARCH · Engineering Papers
Results for “Data search”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
High-speed data search
The high-speed data search system developed for KSC incorporates existing and emerging information retrieval technology to help a user intelligently and rapidly locate information found in large textual databases. This technology includes: natural language input; statistical ranking of retrieved information; an artificial intelligence concept called semantics, where 'surface level' knowledge found in text is used to improve the ranking of retrieved information; and relevance feedback, where user judgements about viewed information are used to automatically modify the search for further information. Semantics and relevance feedback are features of the system which are not available commercially. The system further demonstrates focus on paragraphs of information to decide relevance; and it can be used (without modification) to intelligently search all kinds of document collections, such as collections of legal documents medical documents, news stories, patents, and so forth. The purpose of this paper is to demonstrate the usefulness of statistical ranking, our semantic improvement, and relevance feedback.
Driscoll, James N.↗
Application of a Dataset-Publication Knowledge Graph for Improving Earth Science Data Search
Finding a dataset at a NASA data center that is the best fit for the researcher’s application presents a challenge, not only for a novice user but for an experienced one, due to the data complexity and a multitude of choices of the existing data. Users often search for the data based on the application they are interested in, their research domain, phenomena, research topic, etc. As existing dataset metadata may not cover these search terms, the user may not obtain the most relevant results for their purpose. This problem was addressed by leveraging the content of the titles and abstracts of the research papers that utilize NASA datasets. For this, features from the paper titles and abstracts were extracted, and then a knowledge graph (KG) was used to link these features to the datasets used in that paper. The search for the datasets was tested by querying this knowledge graph through various terms extracted from Earth Science ontologies such as Semantic Web for Earth and Environment Technology (SWEET), and it was shown that this KG search outperforms the existing search that exclusively queries the dataset metadata.
Kristina Stoyanova↗
FAIR Interfaces for Geospatial Scientific Data Searches
Several factors must be considered in designing a highly accurate, reliable, scalable, and user-friendly geospatial data search interfaces. This paper examines four critical questions that ought to be considered during design phase: (1) Is the search interface or API that provides the search capability useable by both humans and machines? (2) Are the results consistent and reliable? (3) Is the output response format free to use, community-defined, and non-propriety? (4) Does the API clearly state the usage clauses? This paper discusses how certain data repositories at the US Department of Energy's Oak Ridge National Laboratory apply FAIR data principles to enable geospatial searches and address the above-mentioned questions.
Devarakonda, Ranjeet↗
GeneLab Phase 2: Integrated Search Data Federation of Space Biology Experimental Data
The GeneLab project is a science initiative to maximize the scientific return of omics data collected from spaceflight and from ground simulations of microgravity and radiation experiments, supported by a data system for a public bioinformatics repository and collaborative analysis tools for these data. The mission of GeneLab is to maximize the utilization of the valuable biological research resources aboard the ISS by collecting genomic, transcriptomic, proteomic and metabolomic (so-called omics) data to enable the exploration of the molecular network responses of terrestrial biology to space environments using a systems biology approach. All GeneLab data are made available to a worldwide network of researchers through its open-access data system. GeneLab is currently being developed by NASA to support Open Science biomedical research in order to enable the human exploration of space and improve life on earth. Open access to Phase 1 of the GeneLab Data Systems (GLDS) was implemented in April 2015. Download volumes have grown steadily, mirroring the growth in curated space biology research data sets (61 as of June 2016), now exceeding 10 TB/month, with over 10,000 file downloads since the start of Phase 1. For the period April 2015 to May 2016, most frequently downloaded were data from studies of Mus musculus (39) followed closely by Arabidopsis thaliana (30), with the remaining downloads roughly equally split across 12 other organisms (each 10 of total downloads). GLDS Phase 2 is focusing on interoperability, supporting data federation, including integrated search capabilities, of GLDS-housed data sets with external data sources, such as gene expression data from NIHNCBIs Gene Expression Omnibus (GEO), proteomic data from EBIs PRIDE system, and metagenomic data from Argonne National Laboratory's MG-RAST. GEO and MG-RAST employ specifications for investigation metadata that are different from those used by the GLDS and PRIDE (e.g., ISA-Tab). The GLDS Phase 2 system will implement a Google-like, full-text search engine using a Service-Oriented Architecture by utilizing publicly available RESTful web services Application Programming Interfaces (e.g., GEO Entrez Programming Utilities) and a Common Metadata Model (CMM) in order to accommodate the different metadata formats between the heterogeneous bioinformatics databases. GLDS Phase 2 completion with fully implemented capabilities will be made available to the general public in September 2017.
Space Biology↗
NASA’s Environmental Justice Data Search Interface: Enabling Discovery of NASA’s Earth Observation Data for Environmental Justice Research
Explore the source record for details and available documents.
Helen Blue Parache↗
Investigating the Future of Scientific Data Search [Slides]
Searching for usable, actionable, data in a trustworthy manner is a challenge across scientific communities. Artificial Intelligence (AI) and Machine Learning (ML) techniques may be leveraged to increase the utility of scientific data by: Demystify unstructured data to aid curation & sharing Surfacing hard to find datasets. User Experience (UX) Research can help uncover scientists needs & challenges finding data and using AI/ML enabled tools.
97 MATHEMATICS AND COMPUTING↗
Facilitating Heliophysics Research by the Virtual Wave Observatory (VWO) Context Data Search Capability
Wave phenomena, ranging from freely propagating electromagnetic radiation (e.g., solar radio bursts, AKR) to plasma wave modes trapped in various plasma regimes (e.g., whistlers, Langmuir and ULF waves) and atmospheric gravity waves, are ubiquitous in the heliosphere. Because waves can propagate, wave data obtained at a given observing location may pertain to wave oscillations generated locally or from afar. While wave data analysis requires knowledge of wave characteristics specific to different wave modes, the search for appropriate data for heliophysics wave studies also requires knowledge of wave phenomena. In addition to deciding whether the interested wave activity is electrostatic (i.e., locally trapped) or electromagnetic (with propagation over distances), considerations must be given to the dependence of the wave activity on observer's location or viewing geometry, propagating frequency range and whether the wave data were acquired by passive or active observations. Occurances of natural wave emissions i the magnetosphere (e.g, auroral kilometric radiation) are often dependent also on the state (e.e., context) of the magnetosphere that varies with the changing solar wind, IMF and geomagnetic conditions. Fung and Shao [2008] showed recently that magnetospheric state can be specified by a set of suitably time-shifted solar wind, IMF and the multi-scale geomagnetic response parameters. These parameters form a magnetospheric state vector that provides the basis for searching magnetospheric wave data by their context conditions. Using the IMAGE Radio Plasma Imager (RPI) data and the NASA Magnetospheric State Query System (MSOS) [Fung, 2004], this presentation demonstrates the VWO context data search capability under development and solicits feedback from the Heliophysics research community for improvements.
Fung, Shing F.↗
ISIS Topside-Sounder Plasma-Wave Investigations as Guides to Desired Virtual Wave Observatory (VWO) Data Search Capabilities
Many plasma-wave phenomena, observed by space-borne radio sounders, cannot be properly explained in terms of wave propagation in a cold plasma consisting of mobile electrons and infinitely massive positive ions. These phenomena include signals known as plasma resonances. The principal resonances at the harmonics of the electron cyclotron frequency, the plasma frequency, and the upper-hybrid frequency are well explained by the warm-plasma propagation of sounder-generated electrostatic waves, Other resonances have been attributed to sounder-stimulated plasma instability and non-linear effects, eigenmodes of cylindrical electromagnetic plasma oscillations, and plasma memory processes. Data from the topside sounders of the International Satellites for Ionospheric Studies (ISIS) program played a major role in these interpretations. A data transformation and preservation effort at the Goddard Space Flight Center has produced digital ISIS topside ionograms and a metadata search program that has enabled some recent discoveries pertaining to the physics of these plasma resonances. For example, data records were obtained that enabled the long-standing question (several decades) of the origin of the plasma resonance at the fundamental electron cyclotron frequency to be explained [Muldrew, Radio Sci., 2006]. These data-search capabilities, and the science enabled by them, will be presented as a guide to desired data search capabilities to be included in the Virtual Wave Observatory (VWO).
Benson, Robert F.↗
Evaluation of a scientific data search infrastructure
The ability to search over large scientific datasets has become crucial to next-generation scientific discoveries as data generated from scientific facilities grow dramatically. In previous work, we developed and deployed ScienceSearch, a search infrastructure for scientific data which uses machine learning to automate metadata creation. Our current deployment is deployed atop a container based platform at a HPC center. In this article, we present an evaluation and discuss our experiences with the ScienceSearch infrastructure. Specifically, we present a performance evaluation of ScienceSearch's infrastructure focusing on scalability trends. The obtained results show that ScienceSearch is able to serve up to 130 queries/min with latency under 3 s. We discuss our infrastructure setup and evaluation results to provide our experiences and a perspective on opportunities and challenges of our search infrastructure.
96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
Improving GES Disc Data Search and Discovery Through AI Metadata Augmentation
NASA’s Goddard Earth Science (GES) Data and Information Services Center (DISC) is one of twelve data centers in NASA's Science Mission Directorate (SMD), providing vital earth science data to a diverse user base. To enhance the discoverability of this data, GES DISC employs a keyword search system, which leverages scientific keywords embedded in dataset metadata. However, the evolving nature of scientific applications of our data necessitates regular review and augmentation of these keywords. To address this, we developed a service to automatically predict missing science keywords in the metadata. This service constructs a knowledge graph from the latest GES DISC metadata within NASA’s Common Metadata Repository (CMR). Using an open-source library, we trained a machine learning model to predict absent science keywords in the metadata. Our preliminary results indicate that the model has high levels of accuracy at predicting science keywords in the dataset metadata when exposed to data not included in its training. These predicted keywords were then evaluated by GES DISC data curation scientists and compared against other AI tools for metadata augmentation. We aim to enhance the overall usability and accessibility of NASA’s earth science data by implementing this tool in our data curation processes.
Kendall Gilbert↗
AD – Elog Data Search Using Natural Language Processing Techniques
The goal of this project is to develop and evaluate a Machine Learning model using natural language processing techniques to categorize AD E-Log entries efficiently. AD E-Logs, which play a vital role in Fermilab's projects as a system to record and manage various data, often suffer from slow search processing and imprecise results. To address this issue, we preprocessed the data and employed the Doc2Vec model for training. The resulting model enables us to identify and retrieve the most relevant entries, thus enhancing user experience in accessing desired information.
Muse, Amiin↗
Threat Sources for Creating Synthetic Urban Search Data
Equivalent point source energy emission distributions were computed for various threat sources for use in simulating the detector responses for urban search scenarios. The sources include standard isotopic sources used in detector testing, medical and industrial sources occasionally encountered in urban searches, and several types of special nuclear materials. Most of the equivalent point source distributions represent small sources inside some amount of shielding, but the special nuclear material sources represent volumetrically distributed sources in spheres of metal. Text-based inputs for emission distributions are available for the Monte Carlo transport codes Monte Carlo N-Particle, SCALE/MAVRIC, and Omnibus/Shift, any of which can easily be converted to other formats. These sources were developed for use in the Radiological Anomaly Detection and Identification (RADAI) project and the follow-on project, the RADAI-Extended project, sponsored by the National Nuclear Security Administration Office of Defense Nuclear Nonproliferation Research and Development.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
Selecting Approaches for Enabling Enterprise Data Search: NASA’s Science Mission Directorate (SMD) Catalog
NASA’s Science Mission Directorate (SMD) is working to build an open-source science infrastructure to accelerate open, collaborative and interdisciplinary science. One key component in the open-source science infrastructure is the SMD data catalog. In this paper, we present our process for selecting a technical approach to building a NASA SMD enterprise-wide integrated search capability for science users across multiple science disciplines to support discovery and access to complex scientific data.
Kaylin Bugbee↗
NASA Environmental Justice Data Search Interface Overview
NASA’s Earth Science Division (ESD) is committed to empower Environmental Justice (EJ) communities by expanding awareness, accessibility, and use of Earth science data to enable contributions to Earth science research and applications. To that end, the NASA Earth Science Data Systems (ESDS) Program developed an EJ Data Catalog, a simple guide to NASA datasets and socioeconomic datasets that may be useful in EJ research. The EJ Data Catalog is divided by topics—such as disasters, urban flooding, extreme heat, food availability, water availability, climate, and health and air quality—and possible use cases for each dataset. The new version of the EJ Data Catalog is now integrated into NASA’s Science Discovery Engine (SDE), an open-source science infrastructure to enable collaborative and interdisciplinary science. In this workshop you will learn about NASA’s Equity and Environmental Justice (EEJ) activities and opportunities as well as participate on an interactive live demo of the new Science Discovery Engine for Environmental Justice.
environmental justice↗
A-Train Data Search and Visualization to Facilitate Multi-Instrument Cloud Studies
Now that the A-Train suite of datasets have become more mature, new and innovative science utilizing the various products has become more reliable and challenging. To perform multi-satellite research with A-Train data originating from heterogenous missions, scientists must access, subset visualize and analyze user specified datasets in ways unique to the dataset. Then hte datasets need to be co-registered and maybe merged. The A-Train Data Depot (ATDD) has been developed to save each scientist the effort and expense of developing these functions individually.
Kempler, Steven↗
Fast and flexible analysis of direct dark matter search data with machine learning
We present the results from combining machine learning with the profile likelihood fit procedure, using data from the Large Underground Xenon (LUX) dark matter experiment. This approach demonstrates reduction in computation time by a factor of 30 when compared with the previous approach, without loss of performance on real data. We establish its flexibility to capture non-linear correlations between variables (such as smearing in light and charge signals due to position variation) by achieving equal performance using pulse areas with and without position-corrections applied. Its efficiency and scalability furthermore enables searching for dark matter using additional variables without significant computational burden. We demonstrate this by including a light signal pulse shape variable alongside more traditional inputs such as light and charge signal strengths. Furthermore, this technique can be exploited by future dark matter experiments to make use of additional information, reduce computational resources needed for signal searches and simulations, and make inclusion of physical nuisance parameters in fits tractable.
72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
Technology utilization data searches
Technology Use Studies Center activities, functions, and services are reported for this period. Transfers and searches are described. Characteristics of TUSC searches are tabulated.
Gold, C. H.↗