Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Science”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,495 records · Page 83
All sourcesNASA NTRSDOE OSTI
NASA NTRS2023

Cloud - Aerosol LIDAR Infrared Pathfinder Satellite Observations (CALIPSO) - Data Management System: Data Products Catalog V4.95

The CALIPSO V4.51 Lidar Level 1 and Level 2 data product is an updated version of an already order-able dataset. The changes were signed off by the CALIPSO Configuration Control Board, versioned, and the code uploaded to a code repository. There is no ITAR/SBU data or code associated with this product. Data will be publicly order-able at the NASA LaRC Atmospheric Sciences Data Center (ASDC). All documentation and web sites will be made public once the data product is released. The data is in HDF4 format and will be generated for majority of the mission (June 2006 - August 2023). The attached Data Products Catalog (v4.95) describes the content of these new data products.

Mark Vaughan↗
NASA NTRSDate not supplied

NASA's Commercial Smallsat Data Acquisition (CSDA) Program Enables Researchers to Take Advantage of This Rapidly Evolving Industry

The growth of commercial Earth Observation (EO) satellite industry is accelerating rapidly, bringing a diverse set of products to a wide range of EO research domains. NASA’s Commercial Smallsat Data Acquisition (CSDA) Program, established in 2017, identifies, evaluates, and acquires commercial data - products, including very high-resolution imagery spanning from visible to short-wave infrared wavelengths, synthetic aperture radar (SAR) imagery, as well as Global Navigation Satellite System (GNSS) data that support, augment, and complement NASA’s extensive catalog of Earth science data. The poster demonstrates how users can learn about the CSDA Program, access the data, and find results from publications and findings of NASA researchers. NASA-acquired commercial data are governed by an end user license agreement. This poster is intended as a practical guide to what the CSDA Program is, where to discover the data and types, and how to access and use the data for scientific purposes.

Stephan Klene↗
NASA NTRSDate not supplied

Use NASA Earthdata in the Cloud

With the impending arrival of new, high-data-volume Earth observation missions, NASA’s ability to effectively ingest, process, and archive large amounts of data requires the most cost-effective, flexible, and scalable data-management architectures and technologies. To meet these demands, NASA's Earth Science Data Systems (ESDS) Program is implementing a strategic vision to develop and operate multiple components of NASA's Earth Observing System Data and Information System (EOSDIS) in a commercial cloud environment. As more earth observing data is moved into the cloud, NASA EOSDIS wants to share our reasoning for moving data into the commercial cloud, as well as demonstrate how end-users can take advantage of both data in the cloud and cloud-deployed services. This presentation explains the enterprise reasons for moving data into the cloud, specifically the scalability of cloud systems, the flexibility to pivot to the most optimal language/system/architecture, and the reduced redundancy of a common architecture. Then we primarily focus on the user-driven reasons for moving to the cloud. Equal access to high performance computing helps all parties, especially users that don't have access to their own on-premise computing infrastructure. Rapid deployment allows users to spin up their own systems without needing the extensive platform previously required for large scale development. Cost effectiveness allows users a wide breadth of computing options, from super computer ability to small scale development, which can help underserved communities. Finally we link to internal resources that users can utilize to begin their cloud based development journey without having to be an expert in the field.

Nicholas Doty↗
DOE OSTI2022

Improving future travel demand projections: a pathway with an open science interdisciplinary approach

Transport accounts for 24% of global CO 2 emissions from fossil fuels. Governments face challenges in developing feasible and equitable mitigation strategies to reduce energy consumption and manage the transition to low-carbon transport systems. To meet the local and global transport emission reduction targets, policymakers need more realistic/sophisticated future projections of transport demand to better understand the speed and depth of the actions required to mitigate greenhouse gas emissions. In this paper, we argue that the lack of access to high-quality data on the current and historical travel demand and interdisciplinary research hinders transport planning and sustainable transitions toward low-carbon transport futures. We call for a greater interdisciplinary collaboration agenda across open data, data science, behaviour modelling, and policy analysis. These advancemets can reduce some of the major uncertainties and contribute to evidence-based solutions toward improving the sustainability performance of future transport systems. The paper also points to some needed efforts and directions to provide robust insights to policymakers. We provide examples of how these efforts could benefit from the International Transport Energy Modeling Open Data project and open science interdisciplinary collaborations.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2017

Identifying requisite changes to support modern maintenance practices - 294

Modern data science and processing require the use of modern maintenance records. With traditional record-keeping practices, the isolated nature of the data, as well as the presence of handwritten maintenance work orders and incomplete service logs, severely limit the amount of progress that can be made towards advanced condition-based maintenance. These condition-based methods of diagnostics, prognostics, and maintenance planning are a primary goal of next-generation plant operations and maintenance strategies, and are all dependent on the availability of quality plant data including maintenance data. By implementing changes to maintenance record-keeping practices, such as the use of a computerized maintenance management system, key data will become available to allow for implementation of state-of-the-art data analysis methods. This paper covers the benefits of utilizing digital record systems to increase maintenance data availability in terms of condition-based maintenance and asset management. The ability of these methods to enable state-of-the-art practices within industrial organizations is discussed to offer insight into ways that these improvements to operating strategy will contribute to improvements in world-class maintenance excellence. A discussion of the future of asset management in terms of data analytics, maintenance decision support, and data integration is provided to illustrate the changing landscape of plant management. The result is an examination of innovative maintenance strategies and discussion of challenges related to the future of asset management and implementing modern maintenance practices. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Oracle-Preserving Latent Flows

A fundamental task in data science is the discovery, description, and identification of any symmetries present in the data. We developed a deep learning methodology for the simultaneous discovery of multiple non-trivial continuous symmetries across an entire labeled dataset. The symmetry transformations and the corresponding generators are modeled with fully connected neural networks trained with a specially constructed loss function, ensuring the desired symmetry properties. The two new elements in this work are the use of a reduced-dimensionality latent space and the generalization to invariant transformations with respect to high-dimensional oracles. The method is demonstrated with several examples on the MNIST digit dataset, where the oracle is provided by the 10-dimensional vector of logits of a trained classifier. We find classes of symmetries that transform each image from the dataset into new synthetic images while conserving the values of the logits. We illustrate these transformations as lines of equal probability (“flows”) in the reduced latent space. These results show that symmetries in the data can be successfully searched for and identified as interpretable non-trivial transformations in the equivalent latent space.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2012

An Update on the CDDIS

The Crustal Dynamics Data Inforn1ation System (CoorS) supports data archiving and distribution activities for the space geodesy and geodynamics community. The main objectives of the system are to store space geodesy and geodynamics related data products in a central data bank, to maintain infom1ation about the archival of these data, and to disseminate these data and information in a timely mam1er to a global scientific research community. The archive consists of GNSS, laser ranging, VLBI, and OORIS data sets and products derived from these data. The coors is one of NASA's Earth Observing System Oata and Infom1ation System (EOSorS) distributed data centers; EOSOIS data centers serve a diverse user community and are tasked to provide facilities to search and access science data and products. The coors data system and its archive have become increasingly important to many national and international science communities, in pal1icular several of the operational services within the International Association of Geodesy (lAG) and its project the Global Geodetic Observing System (GGOS), including the International OORIS Service (IDS), the International GNSS Service (IGS), the International Laser Ranging Service (ILRS), the International VLBI Service for Geodesy and Astrometry (IVS), and the International Earth Rotation Service (IERS). The coors has recently expanded its archive to supp011 the IGS Multi-GNSS Experiment (MGEX). The archive now contains daily and hourly 3D-second and subhourly I-second data from an additional 35+ stations in RINEX V3 fOm1at. The coors will soon install an Ntrip broadcast relay to support the activities of the IGS Real-Time Pilot Project (RTPP) and the future Real-Time IGS Service. The coors has also developed a new web-based application to aid users in data discovery, both within the current community and beyond. To enable this data discovery application, the CDDIS is currently implementing modifications to the metadata extracted from incoming data and product files pushed to its archive. This poster will include background information about the system and its user communities, archive contents and updates, enhancements for data discovery, new system architecture, and future plans.

Noll, Carey↗
NASA NTRS2006

Controlled Vocabularies Boost International Participation and Normalization of Searches

The Global Change Master Directory's (GCMD) science staff set out to document Earth science data and provide a mechanism for it's discovery in fulfillment of a commitment to NASA's Earth Science progam and to the Committee on Earth Observation Satellites' (CEOS) International Directory Network (IDN.) At the time, whether to offer a controlled vocabulary search or a free-text search was resolved with a decision to support both. The feedback from the user community indicated that being asked to independently determine the appropriate 'English" words through a free-text search would be very difficult. The preference was to be 'prompted' for relevant keywords through the use of a hierarchy of well-designed science keywords. The controlled keywords serve to 'normalize' the search through knowledgeable input by metadata providers. Earth science keyword taxonomies were developed, rules for additions, deletions, and modifications were created. Secondary sets of controlled vocabularies for related descriptors such as projects, data centers, instruments, platforms, related data set link types, and locations, along with free-text searches assist users in further refining their search results. Through this robust 'search and refine' capability in the GCMD users are directed to the data and services they seek. The next step in guiding users more directly to the resources they desire is to build a 'reasoning' capability for search through the use of ontologies. Incorporating twelve sets of Earth science keyword taxonomies has boosted the GCMD S ability to help users define and more directly retrieve data of choice.

Olsen, Lola M.↗
NASA NTRS2010

Higher Energy Plasma Ions found near the Termination Shock: Analyses of Voyager 2 Data in the Heliosheath and in the Outer Heliosphere

We have found in the Voyager 2 (V2) plasma science data in the heliosheath (HS) near the termination shock (TS) high-energy ions (HEIs) in addition to the bulk plasma convective flow ions. The HEI detections temporally coincide with increased V2 plasma wave subsystem (PWS) activity in "event A"h of Gurnett and Kurth. Maxwellian fits to HEI detections indicate the HEIs are moving radially anti -Sunward with a proton speed of 600 km/s, a density of 10(exp -4) (exp -3), and a thermal speed of 10 km/s. The heliosheath bulk convective protons have a speed of 204 km/s, a density of 0.0029 cm(exp -3), and a thermal speed of 26.7 km/s. The HEI flux and ram pressure are approximately 10% and 30% of those of the bulk HS flow. Since the HEI speed is both close to twice the solar wind speed and independent of the heliosheath bulk plasma speed, the HEIs may be detections of pickup protons formed in the solar wind and convected through the TS. The HEIs also are reminiscent of the pickup protons upstream of the Mars bow shock where their energy also was independent of the bulk plasma speed and attributed to multiple reflections off the Mars bow shock. Gurnett and Kurth 's (2008) event A enhanced PWS activity may be generated by a two ]stream instability from the interaction of these HEIs with the heliosheath bulk plasma ions. We present our findings, discuss their implications, and also present alternative interpretations.

Intriligator, Devrie S.↗
NASA NTRSDate not supplied

Preservation of Provenance and Context to Ensure Future Understandability of Airborne Earth Observations and Derived Data Products

Open-source science goes beyond making data from scientific projects (e.g., on-orbit/satellite missions, airborne and field investigations, and other data producing activities) openly available after they are generated, but involves and open sharing of information throughout the project lifecycle. Preservation of the data and associated information required for understanding and reusing the data well after the scientific projects is a contributor to open-source science as well. Considering the high investment in the on-orbit/satellite missions, we had developed a document titled “NASA Earth Science Data Preservation Content Specification (PCS)” in 2011. This document has been used as a requirement for recent on-orbit/satellite missions by NASA. Recently it became clear that the specifications should be applied to other scientific projects as well. Therefore, the document was revised to cover other types of projects, and a Preservation Content Implementation Guidance (PCIG) document was also developed. The revised PCS, and the PCIG, were published in 2022. The purpose of this presentation is to highlight the contents of these documents as they apply to suborbital/airborne investigations. The PCS calls for content preservation in eight general categories - Measuring Instrument/Platform Description, Instrument and Science Data Products and Metadata, Science Raw Data, Product and Algorithm Documentation, Instrument Calibration, Science Algorithm Software, Science Data Product Algorithm Inputs, Science Data Product Validation, and Science Data Access and Analysis Tools. While all these categories apply to various types of projects, a few clarifying sentences have been added to the descriptions of contents in each of the categories to show which categories are especially important to airborne and field investigations and where some contents are not applicable (or difficult to obtain). The PCIG document provides some general guidance applicable to all types of projects and specific guidance in a separate section for airborne and field investigations. This section calls out typical artifacts produced during such investigations that can meet the spirit of the various PCS categories.

remote sensing↗
NASA NTRS2011

Science Enabling Roles and Services of SPDF

The current Heliophysics Science Data Management Policy defines the roles of the Space Physics Data Facility (SPDF) project as a heliophysics active Final Archive, a focus for critical data infrastructure services and a center of excellence for data and ancillary information services. This presentation will highlight some of our current activities and our understanding of why and how our services are useful to researchers, as well as SPDF's programmatic emphasis in the coming year. We will discuss how. in cooperation with the Heliophysics Virtual discipline Observatories (VxOs), we are working closely with the RBSP and MMS mission teams to support their decisions to use CDF as a primary format for their public data products, to leverage the ongoing data flows and capabilities of CDAWeb (directly and through external clients such as Autoplot) to serve their data in a multi-mission context and to use SSCWeb to assist community science planning and analysis. Among other current activities, we will also discuss and demonstrate our continuing effort to make the Virtual Space Physics Observatory (VSPO) service comprehensive in all significant and NASA relevant heliophysics data. The OMNI and OMNI High Resolution datasets remain current and heavily cited in publications. We are expanding our FTP file services to include online archived non-CDF data from all active missions, which is a re-hosting of this function from NSSDC's FTP site. We have extended the definitions of time in CDF to unambiguously and consistently handle leap seconds. We are improving SSCWeb for much faster per1ormance, more capabilities and a web services inter1ace to Query functionality. We will also review how CDAWeb data can be easily accessed within IDL and new features in CDAWeb.

McGuire, Robert E.↗
NASA NTRS2001

In Interactive, Web-Based Approach to Metadata Authoring

NASA's Global Change Master Directory (GCMD) serves a growing number of users by assisting the scientific community in the discovery of and linkage to Earth science data sets and related services. The GCMD holds over 8000 data set descriptions in Directory Interchange Format (DIF) and 200 data service descriptions in Service Entry Resource Format (SERF), encompassing the disciplines of geology, hydrology, oceanography, meteorology, and ecology. Data descriptions also contain geographic coverage information, thus allowing researchers to discover data pertaining to a particular geographic location, as well as subject of interest. The GCMD strives to be the preeminent data locator for world-wide directory level metadata. In this vein, scientists and data providers must have access to intuitive and efficient metadata authoring tools. Existing GCMD tools are not currently attracting. widespread usage. With usage being the prime indicator of utility, it has become apparent that current tools must be improved. As a result, the GCMD has released a new suite of web-based authoring tools that enable a user to create new data and service entries, as well as modify existing data entries. With these tools, a more interactive approach to metadata authoring is taken, as they feature a visual "checklist" of data/service fields that automatically update when a field is completed. In this way, the user can quickly gauge which of the required and optional fields have not been populated. With the release of these tools, the Earth science community will be further assisted in efficiently creating quality data and services metadata. Keywords: metadata, Earth science, metadata authoring tools

Pollack, Janine↗
NASA NTRS2008

An Overview of the EOS Data Dissemination Systems

The Earth Observing System Data and Information System (EOSDIS) is the primary data system serving the broad-scope of NASA s Earth Observing System (EOS) program and a significant portion of the "heritage" Earth science data. EOSDIS was designed to support the Earth sciences within NASA s Science Mission Directorate (previously the Earth Science Enterprise (ESE) and Mission to Planet Earth). The EOS Program was NASA s contribution to the United States Global Change Research Program (USGCRP) enacted by Congress in 1990 as part of the Global Change Act. ESE s objective was to launch a series of missions to help answer fundamental global change questions such as "How is Earth changing?" and "What are the consequences for life on Earth?" resulting support of this objective, EOSDIS distributes a wide variety of data to a diverse community.

Ramapriyan, H.K.↗
NASA NTRS2016

Soil Moisture Active Passive Mission L4_C Data Product Assessment (Version 2 Validated Release)

The SMAP satellite was successfully launched January 31st 2015, and began acquiring Earth observation data following in-orbit sensor calibration. Global data products derived from the SMAP L-band microwave measurements include Level 1 calibrated and geolocated radiometric brightness temperatures, Level 23 surface soil moisture and freezethaw geophysical retrievals mapped to a fixed Earth grid, and model enhanced Level 4 data products for surface to root zone soil moisture and terrestrial carbon (CO2) fluxes. The post-launch SMAP mission CalVal Phase had two primary objectives for each science product team: 1) calibrate, verify, and improve the performance of the science algorithms, and 2) validate accuracies of the science data products as specified in the L1 science requirements. This report provides analysis and assessment of the SMAP Level 4 Carbon (L4_C) product pertaining to the validated release. The L4_C validated product release effectively replaces an earlier L4_C beta-product release (Kimball et al. 2015). The validated release described in this report incorporates a longer data record and benefits from algorithm and CalVal refinements acquired during the SMAP post-launch CalVal intensive period. The SMAP L4_C algorithms utilize a terrestrial carbon flux model informed by SMAP soil moisture inputs along with optical remote sensing (e.g. MODIS) vegetation indices and other ancillary biophysical data to estimate global daily net ecosystem CO2 exchange (NEE) and component carbon fluxes for vegetation gross primary production (GPP) and ecosystem respiration (Reco). Other L4_C product elements include surface (10 cm depth) soil organic carbon (SOC) stocks and associated environmental constraints to these processes, including soil moisture and landscape freeze/thaw (FT) controls on GPP and respiration (Kimball et al. 2012). The L4_C product encapsulates SMAP carbon cycle science objectives by: 1) providing a direct link between terrestrial carbon fluxes and underlying FT and soil moisture constraints to these processes, 2) documenting primary connections between terrestrial water, energy and carbon cycles, and 3) improving understanding of terrestrial carbon sink activity in northern ecosystems. There are no L1 science requirements for the L4_C product; however self-imposed requirements have been established focusing on NEE as the primary product field for validation, and on demonstrating L4_C accuracy and success in meeting product science requirements (Jackson et al. 2012). The other L4_C product fields also have strong utility for carbon science applications; however, analysis of these other fields is considered secondary relative to primary validation activities focusing on NEE. The L4_C targeted accuracy requirements are to meet or exceed a mean unbiased accuracy (ubRMSE) for NEE of 1.6 g C/sq m/d or 30 g C/sq m/yr, emphasizing northern (45N) boreal and arctic ecosystems; this is similar to the estimated accuracy level of in situ tower eddy covariance measurement-based observations (Baldocchi 2008).

Cal/Val↗
DOE OSTI2022

CORAL: A framework for rigorous self-validated data modeling and integrative, reproducible data analysis

Abstract Background Many organizations face challenges in managing and analyzing data, especially when relevant datasets arise from multiple sources and methods. Analyzing heterogeneous datasets and additional derived data requires rigorous tracking of their interrelationships and provenance. This task has long been a Grand Challenge of data science and has more recently been formalized in the FAIR principles: that all data objects be Findable, Accessible, Interoperable, and Reusable, both for machines and for people. Adherence to these principles is necessary for proper stewardship of information, for testing regulatory compliance, for measuring the efficiency of processes, and for facilitating reuse of data-analytical frameworks. Findings We present the Contextual Ontology-based Repository Analysis Library (CORAL), a platform that greatly facilitates adherence to all 4 of the FAIR principles, including the especially difficult challenge of making heterogeneous datasets Interoperable and Reusable across all parts of a large, long-lasting organization. To achieve this, CORAL's data model requires that data generators extensively document the context for all data, and our tools maintain that context throughout the entire analysis pipeline. CORAL also features a web interface for data generators to upload and explore data, as well as a Jupyter notebook interface for data analysts, both backed by a common API. Conclusions CORAL enables organizations to build FAIR data types on the fly as they are needed, avoiding the expense of bespoke data modeling. CORAL provides a uniquely powerful platform to enable integrative cross-dataset analyses, generating deeper insights than are possible using traditional analysis tools.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

MetallData

MetallData is an HPC platform for interactive data science applications at HPC-scales. It provides an ecosystem for persistent distributed data structures, including algorithms, interactivity and storage.

Pearce, RogerA↗
DOE OSTI2017

Exploratory study on potential safeguards applications for shared ledger technology

The International Atomic Energy Agency (IAEA) is responsible for providing credible assurance that countries are meeting their obligations not to divert or misuse nuclear materials and facilities for non-peaceful purposes. To this end, the IAEA integrates information about States’ nuclear material inventories and transactions with other types of data to draw its safeguards conclusions. As the amount and variety of data and information has increased, the IAEA’s data acquisition, management, and analysis processes have greatly benefited from advancements in computer science, data management, and cybersecurity during the last 20 years. Despite these advancements, inconsistent use of advanced computer technologies as well as political concerns among certain IAEA Member States centered on trust, transparency, and IAEA authorities limit the overall effectiveness and efficiency of IAEA safeguards. As a result, there is an ongoing need to strengthen the effectiveness and efficiency of IAEA safeguards while improving Member State cooperation and trust in the safeguards system. These chronic safeguards needs could be met with some emerging technologies, specifically those associated with the digital currency bitcoin.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
NASA NTRS1978

The McDonald Observatory lunar laser ranging project

A summary of the activities of the McDonald lunar laser ranging station at Fort Davis for the FY 77-78 fiscal year is presented. The lunar laser experiment uses the observatory 2.7m reflecting telescope on a thrice-per-day, 21-day-per-lunation schedule. Data are recorded on magnetic tapes and sent to the University of Texas at Austin where the data is processed. After processing, the data is distributed to interested analysis centers and later to the National Space Science Data Center where it is available for routine distribution. Detailed reports are published on the McDonald operations after every fourth lunation or approximately once every 115 days. These reports contain a day-by-day documentation of the ranging activity, detailed discussions of the equipment development efforts, and an abundance of other information as is needed to document and archive this important data type.

Silverberg, E. C.↗