Engineering PapersSearch

Engineering topics

Jenny Wood

Publications and source records attributed to Jenny Wood.

Automated Metadata Scoring Approaches for Earth Observation Data

The Common Metadata Repository (CMR) contains metadata records describing NASA’s Earth observation data products which are archived across 12 data centers also known as Distributed Active Archive Centers (DAACs). To ensure that NASA’s data is discoverable, accessible, and usable, the Analysis and Review of CMR (ARC) Team, located at Marshall Space Flight Center, assesses the quality of these metadata records. The ARC team currently uses a combination of automated and manual methods to check metadata records for quality dimensions such as completeness, correctness, and consistency. In addition to these quality assessments, the team is currently exploring various metadata scoring methods in order to provide normalized results across the twelve DAACs. This method is conducted by using automated methods to assess metadata fields and then provide a numeric score, or grade, based on the analysis. To implement this process, two different approaches have been theorized and are currently being explored by the ARC team. This presentation will describe ARC's two proposed methodologies in more detail, and the pros and cons to using these metadata scoring methods.

Jenny Wood

pyQuARC: Open Source Library for Earth Observation Metadata Quality Assessment

Metadata quality is essential to effective data discovery and has become increasingly vital as more Earth Science data sets become available. The Common Metadata Repository (CMR) hosts metadata describing NASA’s Earth Observation data products, which are archived across 12 Distributed Active Archive Centers (DAACs). The Analysis and Review of CMR (ARC) Team, located at Marshall Space Flight Center, conducts metadata quality assessments to ensure that these data products are discoverable, accessible, and usable. To achieve these goals, the ARC team has developed a metadata quality assessment framework to evaluate metadata completeness, correctness, and consistency. ARC uses a combination of manual and automated methods to assess these three components and identify areas of improvement; the team then collaborates with the DAACs to resolve any findings. To streamline this process, ARC is currently developing a host of scripts, known as pyQuARC, to automate metadata quality assessments as much as possible. pyQuARC is an open source library for Earth Observation Metadata Quality Assessment, and the tool utilizes ARC’s metadata quality assessment framework to make basic validation checks, pinpoint inconsistencies between dataset-level (i.e. collection) and file-level (i.e. granule) metadata, and identify opportunities for more descriptive and robust information. Since pyQuARC is also customizable, other users can make modifications as needed, and future metadata standards can also be implemented. Once pyQuARC is fully developed, it will support multiple schema types to serve the broader EOSDIS metadata community. This presentation will provide an overview of pyQuARC and its process of development while showcasing the tool’s valuable features and uses.

Jenny Wood

Promoting Collaborative Open Science through the Stakeholder Engagement Program

Since 2016, the Satellite Needs Working Group (SNWG), an initiative of the U.S. Group on Earth Observations (USGEO), has surveyed federal agencies biennially to identify their satellite Earth observation needs. Coordinating with the agencies, NASA-led assessment teams work to identify solutions for each expressed need. Solutions to a need can involve existing data products or even the formation of new data products and technologies, such as the Harmonized Landsat Sentinel-2 (HLS) product and the Catalog of Archived Sub-Orbital Earth Science Investigations (CASEI). To enhance community engagement with these new data products and technologies, the SNWG Management Office’s Stakeholder Engagement Program (SEP) was established. The SEP within NASA’s Interagency Implementation and Advanced Concepts Team (IMPACT) at Marshall Space Flight Center has three goals: to increase awareness of the SNWG survey and its outcomes, to ensure training coordination and outreach efforts supporting integration and use of SNWG solutions, and to enhance coordination among solution development teams, NASA’s Distributed Active Archive Centers (DAACs), SNWG stakeholders, and end user communities. These goals align with NASA Earth Science Data System’s (ESDS) Open Science initiative by establishing a collaborative community focused on enhancing scientific research at diverse levels of understanding. This presentation will highlight SEP’s facilitation of these open science goals through its support in SNWG’s past and current survey cycles as well as its plans for future involvement.

Jenny Wood

QuARC: Development of a Service to Enable FAIR-er Metadata

The ARC Project: The ARC Team located at NASA’s Marshall Space Flight Center conducts quality assessments of metadata records that catalog NASA’s collection of over 9,000 Earth observation data products, stored in a centralized database called the Common Metadata Repository (CMR). The ARC Team has developed a metadata quality assessment framework to evaluate metadata completeness, correctness, and consistency with the goal of making NASA’s data products more discoverable, accessible, and usable. ARC = Analysis and Review of the CMR

Earth Science Informatics

Addressing User Needs through the Stakeholder Engagement Program

Every two years, the Satellite Needs Working Group (SNWG), an initiative of the U.S. Group on Earth Observations (USGEO), surveys federal agencies to pinpoint their satellite Earth observation needs. For each expressed need, NASA-led assessment teams coordinate with the agencies to devise solutions. Solutions can include existing or modified data products as well as the construction of new data products and technologies, such as the Harmonized Landsat Sentinel-2 (HLS) product and the Catalog of Archived Sub-Orbital Earth Science Investigations (CASEI). To facilitate adoption of new data products and technologies, the SNWG Management Office’s Stakeholder Engagement Program (SEP) was established. The program’s primary goals are to respond to training and capacity building needs expressed by agencies and to encourage engagement from stakeholders as SNWG solutions are developed. To serve these needs, SEP has developed the following: an SNWG Solutions Earthdata webpage, an SEP Earthdata webpage, and an Earthdata Search Portal for SNWG products. These avenues provide assistance to users from all backgrounds and levels of expertise as well as publicize the ongoing efforts of SNWG solutions. In addition, the SEP is also collaborating with NASA’s Short-term Prediction Research and Transition (SPoRT) Center to develop user-driven applications for SNWG products leveraging stakeholder input. This presentation will provide an overview of the SEP, highlight the resources currently available to users, and describe ongoing efforts to address the needs of users, so SNWG products can be better implemented into scientific workflows.

Jenny Wood

pyQuARC: Preparing for Full Release

Metadata holds the contextual information about data and is the underlying structure for many data search portals. High quality metadata optimizes search results, allowing users to quickly retrieve the data they need. With the abundant volume and diversity of Earth observation datasets, data discovery and metadata quality are critical for end users. The Common Metadata Repository (CMR), for example, currently hosts metadata for over 9,000 Earth observation data products archived across 12 NASA Distributed Active Archive Centers (DAACs). The Analysis and Review of CMR (ARC) Team, located at Marshall Space Flight Center, assesses the completeness, correctness, and consistency of these metadata records to ensure they are accessible, usable, and discoverable. In 2021, ARC began developing pyQuARC, an open source library for Earth Observation Metadata Quality Assessment to automate this effort. The tool uses ARC’s existing metadata quality framework to provide prioritized recommendations for metadata improvement. During initial testing, pyQuARC automatically identified 58% of metadata findings when compared with a sample of manually reviewed records. Using the results from initial testing, this presentation will focus on recent advancements and improvements of the tool as the ARC team prepares for pyQuARC’s full release. It will also demonstrate pyQuARC's enrichment value, not only for the ARC team, but the broader EOSDIS metadata community as well.

Essence Raphael

Analyzing Federal Agency Earth Observation Needs: NASA’s 2022 Satellite Needs Working Group Assessment

Every two years, the National Aeronautics and Space Administration (NASA) leads an assessment of Federal civilian agency Earth observation needs submitted through the Satellite Needs Working Group (SNWG) survey. Nearly 30 agencies participated in the 2022 SNWG survey, submitting 115 high-priority satellite data needs that span Earth Science and represent a wide variety of potential applications for Earth observation data. Analysis of multiple SNWG survey cycles reveals trends in agency needs toward more frequent, higher resolution data that can inform agency decision-making. NASA and partners at the National Oceanic and Atmospheric Administration (NOAA) and U.S. Geological Survey (USGS) evaluated the agency surveys during an eight-month assessment period. Assessment teams comprised of subject matter experts, technology specialists, and agency managers conducted an in-depth interview with each submitting agency to fully understand the need and discuss relevant current and upcoming satellite missions. The teams then proposed over 100 potential solutions, or new activities that NASA, NOAA, and/or USGS could undertake to help meet agency needs. A few cross-cutting potential solutions that are projected to be most valuable to SNWG agencies are under consideration for implementation by NASA in the coming years.

Katrina Virts

Managing Current Earth Observation Needs through User-Driven Implementation of Upcoming Satellite Needs Working Group (SNWG) Solutions

Since 2016, the Satellite Needs Working Group (SNWG), an initiative of the U.S. Group on Earth Observations (USGEO), has surveyed federal agencies every two years to identify their satellite earth observation needs. For each expressed need, NASA-led assessment teams coordinate with responding agencies to devise remote sensing solutions that benefit multiple partners and span across a number of thematic areas including, but not limited to, Atmospheric Composition, Carbon Cycle and Ecosystems, Earth Surface and Interior, and Oceans and Cryosphere. Solutions can comprise existing or modified data products as well as the construction of new data products and technologies: since 2016, a multitude of SNWG activities have been theorized and developed, reaching a wide range of users in the science community. Due to an increase in survey responses in 2020 and to assure solution delivery to users within five years of budget appropriations, the SNWG Management Office was established to oversee the assessment of agency needs and the implementation and operations of solution development. The SNWG MO’s unique implementation strategy creates multiple touchpoints with agencies during solution development helping fulfill Earth Science to Action priorities (the 2024 NASA Earth Science Division strategic plan) and ensuring solutions are accessible, usable, and support decision-making for their intended audience. This presentation will outline the ways in which SNWG supports complementary goals of the Decadal Survey, with specific attention on the SNWG MO’s renewed user-centric implementation strategy for upcoming SNWG solutions.

Jenny Wood