Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data science”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,531 records · Page 85

PDS4: Developing the Next Generation Planetary Data System

The Planetary Data System (PDS) is in the midst of a major upgrade to its system. This upgrade is a critical modernization of the PDS as it prepares to support the future needs of both the mission and scientific community. It entails improvements to the software system and the data standards, capitalizing on newer, data system approaches. The upgrade is important not only for the purpose of capturing results from NASA planetary science missions, but also for improving standards and interoperability among international planetary science data archives. As the demands of the missions and science community increase, PDS is positioning itself to evolve and meet those demands.

Crichton, D.↗

Exploring Synergistic Tools from NASA Satellite Data for Air Quality

Space-borne earth observation has been important to monitor the earth condition and played a critical role in validating other instruments or modeling's outputs. However, the data from satellite earth observation are usually very complex in terms of science contents, formats, and spatiotemporal granularities, making them difficult to use from many aspects. NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), one of the 12 official NASA data centers, archives and distributes rich collections of data from multiple satellite missions and model results. The GES DISC is also the official archive center for data from the Ozone Monitoring Instrument (OMI) aboard NASA's Aura mission since 2004. Recently, the GES DISC has been evolving and improving its data management and services in order to promote NASA data to be easily discovered and accessed, as well as to facilitate interoperability. We'll show in this presentation how to explore and analyze NASA earth observation data for air quality through a suite of user-friendly tools - from Worldview to Giovanni, demonstrating in using this set of tools prepares us to serve the Sentinel 5P TROPOMI to the community.

air quality↗

Subsetting Satellite Level 2 Data at NASA GES DISC

Working with Level 2 satellite swath data can prove challenging for many users. The variety of metadata, high resolution, and orbit-based nature of such data makes it difficult to acquire and manage. The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) has developed a general-purpose Level 2 Subsetting service that facilitates access to Level 2 data products. The Level 2 Subsetter enables users to sub-sample swath and gridded data in a variety of ways: by location (in a lat/lon box, within a circle of given radius, or at a specific point), by time (via swath segments or collections of granules), by any nonspatial dimension, or by selecting specific variables. The Level 2 Subsetting service also allows users to specify output data configuration and file format. In this presentation, we will detail and demonstrate the capabilities of this new service.

Huwe, Paul↗

Explore Air Quality from NASA Satellite Data

Space-borne earth observation has been important to monitor the earth condition and played acritical role in validating other instruments or modeling's outputs. However, the data from satellite earth observation are usually very complex in terms of science contents, formats, and spatiotemporal granularities, making them difficult to use from many aspects. NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), one of the 12 official NASA data centers, archives and distributes rich collections of data from multiple satellite missions and model results. The GES DISC is also the official archive center for data from the Ozone Monitoring Instrument (OMI) aboard NASA's Aura mission since 2004. Recently, the GES DISChas been evolving and improving its data management and services in order to promote NASA data to be easily discovered and accessed, as well as to facilitate interoperability. We'll show in this presentation how to explore and analyze NASA earth observation data for air quality through a suite of user-friendly tools - from Giovanni to ArcGIS, demonstrating in using this set of tools prepares us to serve the Sentinel 5P TROPOMI to the community.

Wei, J.↗

Cloud Aerosol LIDAR Infrared Pathfinder Satellite Observations (CALIPSO) - Data Management - Data Products Catalog V4.94

The CALIPSO V2.00 Lidar Level 2 Polar Stratospheric Cloud data product is an updated version of an already order-able dat set. The changes were signed off by the CALIPSO Configuration Control Board, versioned, and the code uploaded to a code repository. There is no ITAR/SBU data or code associated with this product. Data will be publicly order-able at the NASA LaRC Atmospheric Sciences Data Center (ASDC). All documentation and web sites will be made public once the data product is released. The data is in HDF4 format and will be generated for majority of the mission (June 2006 - March 2021). The attached Data Products Catalog (v4.94) describes this new product in section 2.14, pp 115- 119.

Mark Vaughan↗

The Use of Atmospheric Composition Variable Standard Names in Airborne and Field Data Products

The number of variables measured during airborne field campaigns has increased more than tenfold over the last thirty years. With this increase in measurements, the complexity for distributed active archive centers (DAACs) to distribute the data and for data users to search for and find measurements of interest has also increased. Part of this complexity arises from the unique variable names in suborbital atmospheric composition field studies. With limited guidelines related to variable naming, variable names and structures can vary significantly, even for the same type of variable. It is common for instrument scientists to use their intended measurable quantity as the data variable name. This can make it difficult for users to locate and interact with a particular variable across multiple data sets. One effective solution to this problem, identified by the Earth Science Data System (ESDS) ICARTT Refresh Working Group [1], was to introduce variable standard names that can be used as tags for each data variable. This allows similar measurements (e.g., dew point) to be categorized and located across field campaigns, regardless of what variable name the instrument scientist has used. From this the atmospheric composition variable standard names were developed with the goal to use Findable, Accessible, Interoperable, and Reusable (FAIR) principles [2] and provide context for all users, while remaining connected to those in the subject area. These standard names have been successfully implemented in FIREX-AQ, CAMP 2EX, ACTIVATE, and DCOTSS field campaigns.

metadata↗

North American Land Data Assimilation (NLDAS) Data and Services at NASA GES DISC

The North American Land Data Assimilation System (NLDAS, https://ldas.gsfc.nasa.gov/nldas) integrates a large quantity of observation-based and model reanalysis data to drive offline (not coupled to the atmosphere) land surface models (LSMs) to produce fields of soil moisture, snow, and surface fluxes. The NLDAS-2 data sets currently archived at, and distributed by, the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC, https://disc.gsfc.nasa.gov) have been updated to NLDAS Version 2.0 (NLDAS-2.0). This presentation provides an overview of the updated NLDAS-2.0 data at NASA GES DISC and discusses the methods for the public to access the data as well as the data services available.

Ashley Heath↗

Cloud - Aerosol LIDAR Infrared Pathfinder Satellite Observations (CALIPSO) - Data Management System: Data Products Catalog V4.95

The CALIPSO V4.51 Lidar Level 1 and Level 2 data product is an updated version of an already order-able dataset. The changes were signed off by the CALIPSO Configuration Control Board, versioned, and the code uploaded to a code repository. There is no ITAR/SBU data or code associated with this product. Data will be publicly order-able at the NASA LaRC Atmospheric Sciences Data Center (ASDC). All documentation and web sites will be made public once the data product is released. The data is in HDF4 format and will be generated for majority of the mission (June 2006 - August 2023). The attached Data Products Catalog (v4.95) describes the content of these new data products.

Mark Vaughan↗

NASA's Commercial Smallsat Data Acquisition (CSDA) Program Enables Researchers to Take Advantage of This Rapidly Evolving Industry

The growth of commercial Earth Observation (EO) satellite industry is accelerating rapidly, bringing a diverse set of products to a wide range of EO research domains. NASA’s Commercial Smallsat Data Acquisition (CSDA) Program, established in 2017, identifies, evaluates, and acquires commercial data - products, including very high-resolution imagery spanning from visible to short-wave infrared wavelengths, synthetic aperture radar (SAR) imagery, as well as Global Navigation Satellite System (GNSS) data that support, augment, and complement NASA’s extensive catalog of Earth science data. The poster demonstrates how users can learn about the CSDA Program, access the data, and find results from publications and findings of NASA researchers. NASA-acquired commercial data are governed by an end user license agreement. This poster is intended as a practical guide to what the CSDA Program is, where to discover the data and types, and how to access and use the data for scientific purposes.

Stephan Klene↗

Use NASA Earthdata in the Cloud

With the impending arrival of new, high-data-volume Earth observation missions, NASA’s ability to effectively ingest, process, and archive large amounts of data requires the most cost-effective, flexible, and scalable data-management architectures and technologies. To meet these demands, NASA's Earth Science Data Systems (ESDS) Program is implementing a strategic vision to develop and operate multiple components of NASA's Earth Observing System Data and Information System (EOSDIS) in a commercial cloud environment. As more earth observing data is moved into the cloud, NASA EOSDIS wants to share our reasoning for moving data into the commercial cloud, as well as demonstrate how end-users can take advantage of both data in the cloud and cloud-deployed services. This presentation explains the enterprise reasons for moving data into the cloud, specifically the scalability of cloud systems, the flexibility to pivot to the most optimal language/system/architecture, and the reduced redundancy of a common architecture. Then we primarily focus on the user-driven reasons for moving to the cloud. Equal access to high performance computing helps all parties, especially users that don't have access to their own on-premise computing infrastructure. Rapid deployment allows users to spin up their own systems without needing the extensive platform previously required for large scale development. Cost effectiveness allows users a wide breadth of computing options, from super computer ability to small scale development, which can help underserved communities. Finally we link to internal resources that users can utilize to begin their cloud based development journey without having to be an expert in the field.

Nicholas Doty↗

Improving future travel demand projections: a pathway with an open science interdisciplinary approach

Transport accounts for 24% of global CO 2 emissions from fossil fuels. Governments face challenges in developing feasible and equitable mitigation strategies to reduce energy consumption and manage the transition to low-carbon transport systems. To meet the local and global transport emission reduction targets, policymakers need more realistic/sophisticated future projections of transport demand to better understand the speed and depth of the actions required to mitigate greenhouse gas emissions. In this paper, we argue that the lack of access to high-quality data on the current and historical travel demand and interdisciplinary research hinders transport planning and sustainable transitions toward low-carbon transport futures. We call for a greater interdisciplinary collaboration agenda across open data, data science, behaviour modelling, and policy analysis. These advancemets can reduce some of the major uncertainties and contribute to evidence-based solutions toward improving the sustainability performance of future transport systems. The paper also points to some needed efforts and directions to provide robust insights to policymakers. We provide examples of how these efforts could benefit from the International Transport Energy Modeling Open Data project and open science interdisciplinary collaborations.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Identifying requisite changes to support modern maintenance practices - 294

Modern data science and processing require the use of modern maintenance records. With traditional record-keeping practices, the isolated nature of the data, as well as the presence of handwritten maintenance work orders and incomplete service logs, severely limit the amount of progress that can be made towards advanced condition-based maintenance. These condition-based methods of diagnostics, prognostics, and maintenance planning are a primary goal of next-generation plant operations and maintenance strategies, and are all dependent on the availability of quality plant data including maintenance data. By implementing changes to maintenance record-keeping practices, such as the use of a computerized maintenance management system, key data will become available to allow for implementation of state-of-the-art data analysis methods. This paper covers the benefits of utilizing digital record systems to increase maintenance data availability in terms of condition-based maintenance and asset management. The ability of these methods to enable state-of-the-art practices within industrial organizations is discussed to offer insight into ways that these improvements to operating strategy will contribute to improvements in world-class maintenance excellence. A discussion of the future of asset management in terms of data analytics, maintenance decision support, and data integration is provided to illustrate the changing landscape of plant management. The result is an examination of innovative maintenance strategies and discussion of challenges related to the future of asset management and implementing modern maintenance practices. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Oracle-Preserving Latent Flows

A fundamental task in data science is the discovery, description, and identification of any symmetries present in the data. We developed a deep learning methodology for the simultaneous discovery of multiple non-trivial continuous symmetries across an entire labeled dataset. The symmetry transformations and the corresponding generators are modeled with fully connected neural networks trained with a specially constructed loss function, ensuring the desired symmetry properties. The two new elements in this work are the use of a reduced-dimensionality latent space and the generalization to invariant transformations with respect to high-dimensional oracles. The method is demonstrated with several examples on the MNIST digit dataset, where the oracle is provided by the 10-dimensional vector of logits of a trained classifier. We find classes of symmetries that transform each image from the dataset into new synthetic images while conserving the values of the logits. We illustrate these transformations as lines of equal probability (“flows”) in the reduced latent space. These results show that symmetries in the data can be successfully searched for and identified as interpretable non-trivial transformations in the equivalent latent space.

97 MATHEMATICS AND COMPUTING↗

An Update on the CDDIS

The Crustal Dynamics Data Inforn1ation System (CoorS) supports data archiving and distribution activities for the space geodesy and geodynamics community. The main objectives of the system are to store space geodesy and geodynamics related data products in a central data bank, to maintain infom1ation about the archival of these data, and to disseminate these data and information in a timely mam1er to a global scientific research community. The archive consists of GNSS, laser ranging, VLBI, and OORIS data sets and products derived from these data. The coors is one of NASA's Earth Observing System Oata and Infom1ation System (EOSorS) distributed data centers; EOSOIS data centers serve a diverse user community and are tasked to provide facilities to search and access science data and products. The coors data system and its archive have become increasingly important to many national and international science communities, in pal1icular several of the operational services within the International Association of Geodesy (lAG) and its project the Global Geodetic Observing System (GGOS), including the International OORIS Service (IDS), the International GNSS Service (IGS), the International Laser Ranging Service (ILRS), the International VLBI Service for Geodesy and Astrometry (IVS), and the International Earth Rotation Service (IERS). The coors has recently expanded its archive to supp011 the IGS Multi-GNSS Experiment (MGEX). The archive now contains daily and hourly 3D-second and subhourly I-second data from an additional 35+ stations in RINEX V3 fOm1at. The coors will soon install an Ntrip broadcast relay to support the activities of the IGS Real-Time Pilot Project (RTPP) and the future Real-Time IGS Service. The coors has also developed a new web-based application to aid users in data discovery, both within the current community and beyond. To enable this data discovery application, the CDDIS is currently implementing modifications to the metadata extracted from incoming data and product files pushed to its archive. This poster will include background information about the system and its user communities, archive contents and updates, enhancements for data discovery, new system architecture, and future plans.

Noll, Carey↗

Controlled Vocabularies Boost International Participation and Normalization of Searches

The Global Change Master Directory's (GCMD) science staff set out to document Earth science data and provide a mechanism for it's discovery in fulfillment of a commitment to NASA's Earth Science progam and to the Committee on Earth Observation Satellites' (CEOS) International Directory Network (IDN.) At the time, whether to offer a controlled vocabulary search or a free-text search was resolved with a decision to support both. The feedback from the user community indicated that being asked to independently determine the appropriate 'English" words through a free-text search would be very difficult. The preference was to be 'prompted' for relevant keywords through the use of a hierarchy of well-designed science keywords. The controlled keywords serve to 'normalize' the search through knowledgeable input by metadata providers. Earth science keyword taxonomies were developed, rules for additions, deletions, and modifications were created. Secondary sets of controlled vocabularies for related descriptors such as projects, data centers, instruments, platforms, related data set link types, and locations, along with free-text searches assist users in further refining their search results. Through this robust 'search and refine' capability in the GCMD users are directed to the data and services they seek. The next step in guiding users more directly to the resources they desire is to build a 'reasoning' capability for search through the use of ontologies. Incorporating twelve sets of Earth science keyword taxonomies has boosted the GCMD S ability to help users define and more directly retrieve data of choice.

Olsen, Lola M.↗

The ASDC Multi Mission Interactive Archive: on line analysis of the Swift/XRT data

We present the Swift/XRT Interactive Archive and the On-line Analysis tool developed at the ASI Science Data Center (ASDC) as part of the Multi Mission Interactive Archive. The On-line Analysis enables to run the Swift/XRT software task ''xrtpipeline'' on any desired XRT observation present in the Swift data archive maintained at ASDC, directly on the web. On-line imaging (with XIMAGE), spectral (with XSPEC) and timing data analysis (with LCURVE) can be performed. At the same time, spectra, light curves, effective area, exposure map and response matrix are promptly available for download to the user for any off-line analysis.

79 ASTRONOMY AND ASTROPHYSICS↗

Higher Energy Plasma Ions found near the Termination Shock: Analyses of Voyager 2 Data in the Heliosheath and in the Outer Heliosphere

We have found in the Voyager 2 (V2) plasma science data in the heliosheath (HS) near the termination shock (TS) high-energy ions (HEIs) in addition to the bulk plasma convective flow ions. The HEI detections temporally coincide with increased V2 plasma wave subsystem (PWS) activity in "event A"h of Gurnett and Kurth. Maxwellian fits to HEI detections indicate the HEIs are moving radially anti -Sunward with a proton speed of 600 km/s, a density of 10(exp -4) (exp -3), and a thermal speed of 10 km/s. The heliosheath bulk convective protons have a speed of 204 km/s, a density of 0.0029 cm(exp -3), and a thermal speed of 26.7 km/s. The HEI flux and ram pressure are approximately 10% and 30% of those of the bulk HS flow. Since the HEI speed is both close to twice the solar wind speed and independent of the heliosheath bulk plasma speed, the HEIs may be detections of pickup protons formed in the solar wind and convected through the TS. The HEIs also are reminiscent of the pickup protons upstream of the Mars bow shock where their energy also was independent of the bulk plasma speed and attributed to multiple reflections off the Mars bow shock. Gurnett and Kurth 's (2008) event A enhanced PWS activity may be generated by a two ]stream instability from the interaction of these HEIs with the heliosheath bulk plasma ions. We present our findings, discuss their implications, and also present alternative interpretations.

Intriligator, Devrie S.↗

Preservation of Provenance and Context to Ensure Future Understandability of Airborne Earth Observations and Derived Data Products

Open-source science goes beyond making data from scientific projects (e.g., on-orbit/satellite missions, airborne and field investigations, and other data producing activities) openly available after they are generated, but involves and open sharing of information throughout the project lifecycle. Preservation of the data and associated information required for understanding and reusing the data well after the scientific projects is a contributor to open-source science as well. Considering the high investment in the on-orbit/satellite missions, we had developed a document titled “NASA Earth Science Data Preservation Content Specification (PCS)” in 2011. This document has been used as a requirement for recent on-orbit/satellite missions by NASA. Recently it became clear that the specifications should be applied to other scientific projects as well. Therefore, the document was revised to cover other types of projects, and a Preservation Content Implementation Guidance (PCIG) document was also developed. The revised PCS, and the PCIG, were published in 2022. The purpose of this presentation is to highlight the contents of these documents as they apply to suborbital/airborne investigations. The PCS calls for content preservation in eight general categories - Measuring Instrument/Platform Description, Instrument and Science Data Products and Metadata, Science Raw Data, Product and Algorithm Documentation, Instrument Calibration, Science Algorithm Software, Science Data Product Algorithm Inputs, Science Data Product Validation, and Science Data Access and Analysis Tools. While all these categories apply to various types of projects, a few clarifying sentences have been added to the descriptions of contents in each of the categories to show which categories are especially important to airborne and field investigations and where some contents are not applicable (or difficult to obtain). The PCIG document provides some general guidance applicable to all types of projects and specific guidance in a separate section for airborne and field investigations. This section calls out typical artifacts produced during such investigations that can meet the spirit of the various PCS categories.

remote sensing↗