Results for “data sciences” — Page 17

DOE OSTI2022

HL-LHC Computing Review Stage 2, Common Software Projects: Data Science Tools for Analysis

This paper was prepared by the HEP Software Foundation (HSF) PyHEP Working Group as input to the second phase of the LHCC review of High-Luminosity LHC (HL-LHC) computing, which took place in November, 2021. It describes the adoption of Python and data science tools in HEP, discusses the likelihood of future scenarios, and recommendations for action by the HEP community.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2024

Using Data Science Tools to Reveal and Understand Subtle Relationships of Inhibitor Structure in Frontal Ring-Opening Metathesis Polymerization

The rate of frontal ring-opening metathesis polymerization (FROMP) using the Grubbs generation II catalyst is impacted by both the concentration and choice of monomers and inhibitors, usually organophosphorus derivatives. Herein we report a data-science-driven workflow to evaluate how these factors impact both the rate of FROMP and how long the formulation of the mixture is stable (pot life). Using this workflow, we built a classification model using a single-node decision tree to determine how a simple phosphine structural descriptor (V bur-near ) can bin long versus short pot life. Additionally, we applied a nonlinear kernel ridge regression model to predict how the inhibitor and selection/concentration of comonomers impact the FROMP rate. Furthermore, the analysis provides selection criteria for material network structures that span from highly cross-linked thermosets to non-cross-linked thermoplastics as well as degradable and nondegradable materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

NASA NTRS1994

Use of Multimission System for Cost Effective Support of Planetary Science Data Processing

JPL's Multimission Operations System Office (MOSO) provides a multimission facility at JPL for processing science instrument data from NASA's planetary missions.

system↗

NASA NTRS2020

The XRISM Science Data Center: Optimizing the Scientific Return from a Unique X-ray Observatory

The X-Ray Imaging and Spectroscopy Mission, XRISM, is currently scheduled to launch in 2022 with the objective of building on the brief, but significant, successes of the ASTRO-H (Hitomi) mission in solving outstanding astrophysical questions using high resolution X-ray spectroscopy. The XRISM Science Operations Team (SOT) consists of the JAXA-led Science Operations Center (SOC) and NASA-led Science Data Center (SDC), which work together to optimize the scientific output from the Resolve high-resolution spectrometer and the Xtend wide-field imager through planning and scheduling of observations, processing and distribution of data, development and distribution of software tools and the calibration database (CaldB), support of ground and in-flight calibration, and support of XRISM users in their scientific investigations of the energetic universe. Here, we summarize the roles and responsibilities of the SDC and its current status and future plans. The Resolve instrument poses particular challenges due to its unprecedented combination of high spectral resolution and throughput, broad spectral coverage, and relatively small field-of-view and large pixel-size. We highlight those challenges and how they are being met.

XRISM↗

NASA NTRS2017

Web Coverage Service Challenges for NASA's Earth Science Data

In an effort to ensure that data in NASA's Earth Observing System Data and Information System (EOSDIS) is available to a wide variety of users through the tools of their choice, NASA continues to focus on exposing data and services using standards based protocols. Specifically, this work has focused recently on the Web Coverage Service (WCS). Experience has been gained in data delivery via GetCoverage requests, starting out with WCS v1.1.1. The pros and cons of both the version itself and different implementation approaches will be shared during this session. Additionally, due to limitations with WCS v1.1.1 ability to work with NASA's Earth science data, this session will also discuss the benefit of migrating to WCS 2.0.1 with EO-x to enrich this capability to meet a wide range of anticipated user's needs This will enable subsetting and various types of data transformations to be performed on a variety of EOS data sets.

Web Coverage Services↗

NASA NTRS2003

ESML for Earth Science Data Sets and Analysis

The primary objective of this research project was to transition ESML from design to application. The resulting schema and prototype software will foster community acceptance for the Define once, use anywhere concept central to ESML. Supporting goals include: 1) Refinement of the ESML schema and software libraries in cooperation with the user community; 2) Application of the ESML schema and software to a variety of Earth science data sets and analysis tools; 3) Development of supporting prototype software for enhanced ease of use; 4) Cooperation with standards bodies in order to assure ESML is aligned with related metadata standards as appropriate; and 5) Widespread publication of the ESML approach, schema, and software.

Graves, Sara↗

NASA NTRS2013

GRAIL Science Data System Orbit Determination : Approach, Strategy, and Performance

This paper details orbit determination techniques and strategies employed within each stage of the larger iterative process of preprocessing raw GRAIL data into the gravity science measurements used within gravity field solutions. Each orbit determination pass used different data, corrections to them, and/or estimation parameters. We compare performance metrics among these passes. For example, for the primary mission, the magnitude of residuals using our orbits progressed from approximately or equal to19.4 to 0.077 approximately or equal to m/s for inter-satellite range rate data and from approximately or equal to 0.4 to approximately or equal to 0.1 mm/s for Doppler data.

Gravity Recovery and Interior Laboratory (GRAIL)↗

NASA NTRS2011

Making Earth Science Data Records for Use in Research Environments (MEaSUREs) Projects Data and Services at the GES DISC

NASA's Earth Science Program is dedicated to advancing Earth remote sensing and pioneering the scientific use of satellite measurements to improve human understanding of our home planet. Through the MEaSUREs Program, NASA is continuing its commitment to expand understanding of the Earth system using consistent data records. Emphasis is on linking together multiple data sources to form coherent time-series, and facilitating the use of extensive data in the development of comprehensive Earth system models. A primary focus of the MEaSUREs Program is the creation of Earth System Data Records (ESDRs). An ESDR is defined as a unified and coherent set of observations of a given parameter of the Earth system, which is optimized to meet specific requirements for addressing science questions. These records are critical for understanding Earth System processes; for the assessment of variability, long-term trends, and change in the Earth System; and for providing input and validation means to modeling efforts. Seven MEaSUREs projects will be archived and distributed through services at the Goddard Earth Sciences Data and Information Services Center (GES DISC).

Vollmer, Bruce E.↗

NASA NTRS2019

Evaluation of MODIS and VIIRS Cloud-Gap-Filled Snow-Cover Products for Production of an Earth Science Data Record

MODerate resolution Imaging Spectroradiometer (MODIS) cryosphere products have been available since 2000 – following the 1999 launch of the Terra MODIS and the 2002 launch of the Aqua MODIS – and include global snow-cover extent (SCE) (swath, daily, and 8 d composites) at 500 m and ∼5 km spatial resolutions. These products are used extensively in hydrological modeling and climate studies. Reprocessing of the complete snow-cover data record, from Collection 5 (C5) to Collection 6 (C6) and Collection 6.1 (C6.1), has provided improvements in the MODIS product suite. Suomi National Polar-orbiting Partnership (S-NPP) Visible Infrared Imaging Radiometer Suite (VIIRS) Collection 1 (C1) snow-cover products at a 375 m spatial resolution have been available since 2011 and are currently being reprocessed for Collection 2 (C2). Both the MODIS C6.1 and the VIIRS C2 products will be available for download from the National Snow and Ice Data Center beginning in early 2020 with the complete time series available in 2020. To address the need for a cloud-reduced or cloud-free daily SCE product for both MODIS and VIIRS, a daily cloud-gap-filled (CGF) snow-cover algorithm was developed for MODIS C6.1 and VIIRS C2 processing. MOD10A1F (Terra) and MYD10A1F (Aqua) are daily, 500 m resolution CGF SCE map products from MODIS. VNP10A1F is the daily, 375 m resolution CGF SCE map product from VIIRS. These CGF products include quality-assurance data such as cloud-persistence statistics showing the age of the observation in each pixel. The objective of this paper is to introduce the new MODIS and VIIRS standard CGF daily SCE products and to provide a preliminary evaluation of uncertainties in the gap-filling methodology so that the products can be used as the basis for a moderate-resolution Earth science data record (ESDR) of SCE. Time series of the MODIS and VIIRS CGF products have been developed and evaluated at selected study sites in the US and southern Canada. Observed differences, although small, are largely attributed to cloud masking and differences in the time of day of image acquisition. A nearly 3-month time-series comparison of Terra MODIS and S-NPP VIIRS CGF snow-cover maps for a large study area covering all or parts of 11 states in the western US and part of southwestern Canada reveals excellent correspondence between the Terra MODIS and S-NPP VIIRS products, with a mean difference of 11 070 sqkm, which is ∼0.45 % of the study area. According to our preliminary validation of the Terra and Aqua MODIS CGF SCE products in the western US study area, we found higher accuracy of the Terra product compared with the Aqua product. The MODIS CGF SCE data record beginning in 2000 has been extended into the VIIRS era, which should last at least through the early 2030s.

Hall, Dorothy K.↗

NASA NTRS1987

DSS 43 antenna gain analysis for Voyager Uranus encounter: 8.45-GHz radio science data correction

A malfunction of the Deep Space Network (DSN) 64-meter antenna in Australia forced the antenna to operate with a mispositioned subreflector during the Voyager Uranus encounter period (January 24, 1986). Because of changing main reflector shape and quadripod position as a function of elevation angle, the antenna gain and pointing were not as expected, and the 8.45 GHz received signal level changed during the pass. The study described here used the Geometrical Theory of Diffraction (GTD) analysis to determine actual antenna gain and pointing during that period in an attempt to reconstruct the radio science data. It is found that the 1.4 dB of signal variation can be accounted for by antenna geometry changes and pointing error. Suggested modifications to the values measured during the pass are presented. Additionally, an extremely useful tool for the analysis of gravity deformed reflectors was developed for use in future antenna design and analysis projects.

Slobin, S. D.↗

NASA NTRS1994

Use of a multimission system for cost effective support of planetary science data processing

JPL's Multimission Operations Systems Office (MOSO) provides a multimission facility at JPL for processing science instrument data from NASA's planetary missions. This facility, the Multimission Image Processing System (MIPS), is developed and maintained by MOSO to meet requirements that span the NASA family of planetary missions. Although the word 'image' appears in the title, MIPS is used to process instrument data from a variety of science instruments. This paper describes the design of a new system architecture now being implemented within the MIPS to support future planetary mission activities at significantly reduced operations and maintenance cost.

Green, William B.↗

NASA NTRS1995

Creating the Public Connection: Interactive Experiences with Real-Time Earth and Space Science Data

The Houston Museum of Natural Sciences is less than two miles from Rice University, a major hub on the Internet. This project links these two institutions so that NASA real-time data and imagery can flow via Rice to the Museum where it reaches the public in the form of planetarium programs, computer based interactive kiosks, and space and Earth science problem solving simulation. Through this program at least 200,000 visitors annually (including every 4th and 7th grader in the Houston Independent School District) will have direct exposure to the Earth and space research being conducted by NASA and available over the Internet. Each information conduit established between Rice University and the Houston Museum of Natural Science will become a model for public information dissemination that can be replicated nationally in museums, planetariums, Challenger Centers, and schools.

Reiff, Patricia H.↗

NASA NTRSDate not supplied

The NASA Open Science Data Repository: Biomedical Fair Data, Analysis Tools, User Communities, Publications, and Discoveries for Deep Space Missions

Increased biomedical risks and challenges associated with deep space missions require new knowledge discovery, new health countermeasures, and development of novel ecosystems, life support, crop production, and biomedical support capabilities. To meet NASA’s Moon to Mars strategic program goals for Human and Biological Sciences, findable, accessible, interoperable, reusable (FAIR), and maximally open-access data is going to be required to enable humanity to thrive in deep space. Indeed, this cornerstone perspective on FAIR and maximally open access data was also recommended in the recent 2023-2032 Decadal Survey from the National Academies of Sciences, Engineering, and Medicine. The NASA Open Science Data Repository (OSDR) is a maximally open access and FAIR database, and meets various scientific, technical, and operational spaceflight needs. It offers public users and submitters the ability to upload, download, search, share, analyze, and visualize data across ‘omics, physiological, phenotypic, behavioral, bioimaging, video, and environmental monitoring telemetry datasets. OSDR includes NASA GeneLab, NASA Ames Life Sciences Data Archive, and the NASA Biological Institutional Scientific Collection. OSDR has >455 studies with datasets from model organisms and non-NASA human astronauts. There are ~12 datasets from the Inspiration 4 (I4) mission, spanning metagenomics, comprehensive metabolic panels, clonal hematopoiesis, spatial transcriptomics, proteomics, and cytokine panels. In the interest of data privacy, two I4 datasets have raw FASTQ and FASTA files relating to the epitranscriptome, and a new request feature is live in OSDR (with a backend review process established) which was developed based on industry norms. OSDR also recently began a collaboration with the European Space Agency (ESA) to scientifically curate and make available >200 terabytes of human and model organism space-relevant data. The OSDR submission portal is designed to ingest and curate ~25 ‘omics assay data types, and ~50 physiological-phenotypic-imaging assay data types, spanning ultrasonography, micro-computed tomography, histology, morphometric photography, rebound tonometry, gait analysis, optical coherence tomography, novel object recognition, flow cytometry, and immunohistochemistry. A suite of analysis tools are available for OSDR users including: 1) an Environmental Data Application to compare radiation, CO2, relative humidity, temperature, and other telemetry across missions and subjects, 2) the RadLab database, a collaboration between NASA, ESA, the German and Italian Space Agencies, and the Bulgarian Academy of Sciences, which compiles radiation measurements relevant to human spaceflight and provides tools for accessing and manipulating the data, and 3) a Multi-study visualization tool which enables users to look across and combine GeneLab’s omics datasets across different experiments and missions. There are ~600 volunteer OSDR Analysis Working Group (AWG) members who: 1) provide feedback on scientific standards for reuse (subject and assay metadata; processing pipelines; dataset formats and uniformed structures for machine-readability), and 2) collaborate to mine-reuse OSDR data conducting scientific analysis. OSDR has enabled 60 publications as of September 2023, many directly from AWG collaborations most notably the Cell Press package in 2020. Lastly, there are at least 15 articles which mine OSDR data part of a package of ~50 articles across Nature Portfolio with research stemming from I4, the Japan Aerospace Exploration Agency, NASA Space Biology, and the NASA Human Research Program.

space biology↗

NASA NTRSDate not supplied

NASA Open Science Data Repository: Biomedical FAIR Data, Analysis Tools, User Communities, and Discoveries for Deep Space Missions

Increased biomedical risks and challenges associated with deep space missions require new knowledge discovery, new health countermeasures, and development of novel ecosystems, life support, crop production, and biomedical support capabilities. To meet NASA’s Moon to Mars strategic program goals for Human and Biological Sciences, findable, accessible, interoperable, reusable (FAIR), and maximally open-access data is going to be required to enable humanity to thrive in deep space. Indeed, this cornerstone perspective on FAIR and maximally open access data was also recommended in the recent 2023-2032 Decadal Survey from the National Academies of Sciences, Engineering, and Medicine. The NASA Open Science Data Repository (OSDR) is a maximally open access and FAIR database, and meets various scientific, technical, and operational spaceflight needs. It offers public users and submitters the ability to upload, download, search, share, analyze, and visualize data across ‘omics, physiological, phenotypic, behavioral, bioimaging, video, and environmental monitoring telemetry datasets. OSDR includes NASA GeneLab, NASA Ames Life Sciences Data Archive, and the NASA Biological Institutional Scientific Collection. OSDR has >455 studies with datasets from model organisms and non-NASA human astronauts. There are ~12 datasets from the Inspiration 4 (I4) mission, spanning metagenomics, comprehensive metabolic panels, clonal hematopoiesis, spatial transcriptomics, proteomics, and cytokine panels. In the interest of data privacy, two I4 datasets have raw FASTQ and FASTA files relating to the epitranscriptome, and a new request feature is live in OSDR (with a backend review process established) which was developed based on industry norms. OSDR also recently began a collaboration with the European Space Agency (ESA) to scientifically curate and make available >200 terabytes of human and model organism space-relevant data. The OSDR submission portal is designed to ingest and curate ~25 ‘omics assay data types, and ~50 physiological-phenotypic-imaging assay data types, spanning ultrasonography, micro-computed tomography, histology, morphometric photography, rebound tonometry, gait analysis, optical coherence tomography, novel object recognition, flow cytometry, and immunohistochemistry. A suite of analysis tools are available for OSDR users including: 1) an Environmental Data Application to compare radiation, CO2, relative humidity, temperature, and other telemetry across missions and subjects, 2) the RadLab database, a collaboration between NASA, ESA, the German and Italian Space Agencies, and the Bulgarian Academy of Sciences, which compiles radiation measurements relevant to human spaceflight and provides tools for accessing and manipulating the data, and 3) a Multi-study visualization tool which enables users to look across and combine GeneLab’s omics datasets across different experiments and missions. There are ~600 volunteer OSDR Analysis Working Group (AWG) members who: 1) provide feedback on scientific standards for reuse (subject and assay metadata; processing pipelines; dataset formats and uniformed structures for machine-readability), and 2) collaborate to mine-reuse OSDR data conducting scientific analysis. OSDR has enabled 60 publications as of September 2023, many directly from AWG collaborations most notably the Cell Press package in 2020. Lastly, there are at least 15 articles which mine OSDR data part of a package of ~50 articles across Nature Portfolio with research stemming from I4, the Japan Aerospace Exploration Agency, NASA Space Biology, and the NASA Human Research Program.

open access↗

DOE OSTI2024

A General Materials Data Science Framework for Quantitative 2D Analysis of Particle Growth from Image Sequences

Abstract Phase transformations are a challenging problem in materials science, which lead to changes in properties and may impact performance of material systems in various applications. We introduce a general framework for the analysis of particle growth kinetics by utilizing concepts from machine learning and graph theory. As a model system, we use image sequences of atomic force microscopy showing the crystallization of an amorphous fluoroelastomer film. To identify crystalline particles in an amorphous matrix and track the temporal evolution of the particle dispersion, we have developed quantitative methods of 2D analysis. 700 image sequences were analyzed using a neural network architecture, achieving 0.97 pixel-wise classification accuracy as a measure of the correctly classified pixels. The growth kinetics of isolated and impinged particles were tracked throughout time using these image sequences. The relationship between image sequences and spatiotemporal graph representations was explored to identify the proximity of crystallites from each other. The framework enables the analysis of all image sequences without the requirement of sampling for specific particles or timesteps for various materials systems.

36 MATERIALS SCIENCE↗

NASA NTRS2017

Transforming Science Data for GIS: How to Find and Use NASA Earth Observation Data Without Being a Rocket Scientist

NASAs Earth Observing System Data Information System (EOSDIS) manages Earth Observation satellites and the Distributed Active Archive Centers (DAACs), where the data is stored and processed. The challenge is that Earth Observation data is complicated. There is plenty of data available, however, the science teams have had a top-down approach: define what it is you are trying to study -select a set of satellite(s) and sensor(s), and drill down for the data.Our alternative is to take a bottom-up approach using eight environmental fields of interest as defined by the Group on Earth Observations (GEO) called Societal Benefit Areas (SBAs): Disaster Resilience (DR) Public Health Surveillance (PHS) Energy and Mineral Resource Management (EMRM) Water Resources Management (WRM) Infrastructure and Transport Management (ITM) Sustainable Urban Development (SUD) Food Security and Sustainable Agriculture (FSSA) Biodiversity and Ecosystems Sustainability (BES).

DAAC↗

NASA NTRS2017

An Innovative Infrastructure with a Universal Geo-Spatiotemporal Data Representation Supporting Cost-Effective Integration of Diverse Earth Science Data

The SpatioTemporal Adaptive Resolution Encoding (STARE) is a unifying scheme encoding geospatial and temporal information for organizing data on scalable computing/storage resources, minimizing expensive data transfers. STARE provides a compact representation that turns set-logic functions into integer operations, e.g. conditional sub-setting, taking into account representative spatiotemporal resolutions of the data in the datasets. STARE geo-spatiotemporally aligns data placements of diverse data on massive parallel resources to maximize performance. Automating important scientific functions (e.g. regridding) and computational functions (e.g. data placement) allows scientists to focus on domain-specific questions instead of expending their efforts and expertise on data processing. With STARE-enabled automation, SciDB (Scientific Database) plus STARE provides a database interface, reducing costly data preparation, increasing the volume and variety of interoperable data, and easing result sharing. Using SciDB plus STARE as part of an integrated analysis infrastructure dramatically eases combining diametrically different datasets.

Rilee, Michael Lee↗

NASA NTRS1988

Coping with all the earth science data

A report on the NASA-sponsored Earth Science and Applications Data Systems (ESADS) Workshop is presented. The ESADS report is reviewed and the task groups of the workshop are listed. The program set up to implement the recommendations of the workshop is discussed. The priorities of the ESADS committee recommendations include the development of standards and guidelines for data and metadata exchange, the creation of interoperable catalogs and directories, the development of guidelines for ancillary data archives, development of standard user interfaces, providing greater bandwidth in the user environment, collecting information about data storage technologies, and providing improved network connectivity.

Kahn, Ralph↗