Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data formats”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
NASA NTRS2012

Bridging Informatics and Earth Science: a Look at Gregory Leptoukh's Contributions

With the tragic passing this year of Gregory Leptoukh, the Earth and Space Sciences community lost a tireless participant in--and advocate for--science informatics. Throughout his career at NASA, Dr. Leptoukh established a theme of bridging the gulf between the informatics and science communities. Nowhere is this more evident than his leadership in the development of Giovanni (GES DISC Interactive Online Visualization ANd aNalysis Infrastructure). Giovanni is an online tool that serves to hide the often-complex technical details of data format and structure, making science data easier to explore and use by Earth scientists. To date Giovanni has been acknowledged as a contributor in 500-odd scientific articles. In recent years, Leptoukh concentrated his efforts on multi-sensor data inter-comparison, merging and fusion. This work exposed several challenges at the intersection of data and science. One of these was the ease with which a naive user might generate spurious comparisons, a potential hazard that was the genesis of the Multi-sensor Data Synergy Advisor (MDSA). The MDSA uses semantic ontologies and inference rules to organize knowledge about dataset quality and other salient characteristics in order to advise users on potential caveats for comparing or merging two datasets. Recently, Leptoukh also led the development of AeroStat, an online Giovanni instance to investigate aerosols via statistics from station and satellite comparisons and merged maps of data from more than one instrument. Aerostat offers a neural net based bias adjustment to harmonize the data by removing systematic offsets between datasets before merging. These examples exhibit Leptoukh's talent for adopting advanced computer technologies in the service of making science data more accessible to researchers. In this, he set an example that is at once both vital and challenging for the ESSI community to emulate.

Source record↗
NASA NTRS2013

Data Quality Screening Service

A report describes the Data Quality Screening Service (DQSS), which is designed to help automate the filtering of remote sensing data on behalf of science users. Whereas this process often involves much research through quality documents followed by laborious coding, the DQSS is a Web Service that provides data users with data pre-filtered to their particular criteria, while at the same time guiding the user with filtering recommendations of the cognizant data experts. The DQSS design is based on a formal semantic Web ontology that describes data fields and the quality fields for applying quality control within a data product. The accompanying code base handles several remote sensing datasets and quality control schemes for data products stored in Hierarchical Data Format (HDF), a common format for NASA remote sensing data. Together, the ontology and code support a variety of quality control schemes through the implementation of the Boolean expression with simple, reusable conditional expressions as operands. Additional datasets are added to the DQSS simply by registering instances in the ontology if they follow a quality scheme that is already modeled in the ontology. New quality schemes are added by extending the ontology and adding code for each new scheme.

Strub, Richard↗
NASA NTRSDate not supplied

Surface Radiation Budget (SRB) Release 2.5 QC Longwave 3 hourly Data in Native Format (SRB_REL2.5_QCLW_3HRLY)

This data set contains average surface downward longwave flux, surface net longwave flux, and surface longwave cloud radiative forcing at three hourly intervals for each day for the entire glob between 07/01/1983 and 06/30/2005. These LW surface radiative parameters were derived with the Quality-Check LW (QCLW) algorithm of the NASA World Climate Research Programme/Global Energy and Water-Cycle Experiment (WCRP/GEWEX) Surface Radiation Budget (SRB) Project. [Location=GLOBAL] [Temporal_Coverage: Start_Date=1998-01-01; Stop_Date=2005-06-30] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Latitude_Resolution=1 degree; Longitude_Resolution=Ranges from 1 degree (tropics and subtropics) to 120 degrees (the poles).; Temporal_Resolution=3-hourly; Temporal_Resolution_Range=3-hourly].

SURFACE DOWNWARD LONGWAVE FLUX↗
NASA NTRSDate not supplied

Surface Radiation Budget (SRB) Release 2.5 QC Longwave Daily Data in Native Format (SRB_REL2.5_QCLW_DAILY)

The data set contains average surface downward longwave flux, surface net longwave flux, and surface longwave cloud radiative forcing measured at three hourly intervals for each day for the entire globe between 07/01/1983 and 6/30/2005. These LW surface radiative parameters were derived with the Quality-Check LW (QCLW) algorithm of the NASA World Climate Research Programme/Global Energy and Water-Cycle Experiment (WCRP/GEWEX) Surface Radiation Budget (SRB) Project. [Location=GLOBAL] [Temporal_Coverage: Start_Date=1998-01-01; Stop_Date=2005-06-30] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Latitude_Resolution=1 Degree; Longitude_Resolution=Ranges from 1 degree (tropics and subtropics) to 120 degrees (the poles).; Temporal_Resolution=daily; Temporal_Resolution_Range=daily].

CLOUD FORCING↗
NASA NTRSDate not supplied

Surface Radiation Budget (SRB) Release 2.5 QC Shortwave Daily Data in Native Format (SRB_REL2.5_QCSW_DAILY)

This data set contains average clear-sky surface insolation, all-sky surface insolation, surface absorbed SW flux, and all-sky surface albedo measured at daily intervals for each day for the entire globe between 07/01/1983 and 06/30/2005. These SW surface radiative parameters were derived with the Quality-Check SW (QCSW) algorithm of the NASA World Climate Research Programme/Global Energy and Water-Cycle Experiment (WCRP/GEWEX) Surface Radiation Budget (SRB) Project. [Location=GLOBAL] [Temporal_Coverage: Start_Date=1998-01-01; Stop_Date=2005-06-30] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Latitude_Resolution=1 degree; Longitude_Resolution=Ranges from 1 degree (tropics and subtropics) to 120 degrees (the poles).; Temporal_Resolution=daily; Temporal_Resolution_Range=daily].

SURFACE ABSORBED SW FLUX↗
DOE OSTI2024

Urban Parameters Maricopa County 100m Grid Spacing

132 urban parameters for Maricopa County are provided in WRF-readable binary form at 100m grid spacing with index. These parameters allow regional weather modelers to account for the contribution of built structures in modeling the urban heat island. This data is also provided in CSV format. Data are generated using 2023 Model America Version 1 data (https://www.osti.gov/biblio/1774134) and will be used to represent the urban morphology in Maricopa County to the WRF model for experiments conducted for the Southwest Urban Corridor Integrated Field Laboratory (SW-IFL). Three files associated with these parameters are included in this repository: index, binary file 00001-01549.00001-01796, Maricopa_Parameters_03072024.csv . To use the binary file with the Weather Research and Forecasting (WRF) model, the binary file and the index file must be placed in their own directory in WRF_GEOG and accessed in the same way the National Urban Database and Access Portal Tool data (NUDAPT44) would be accessed. The name of the binary file must be in the format: 00001-02715.00001-01803. If, upon download, the binary filename has additional or different characters, please change them to match this format.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRSDate not supplied

Interoperability and Other Aspects of Guiding Data Producers for the Benefit of End Users

The purpose of this paper is to discuss how the Climate and Forecast (CF) Metadata Conventions and netCDF standard have influenced the recommendations and guidance provided to producers of data products based on NASA’s Earth observations. It has been long-recognized that interoperable datasets and use of standards and conventions are beneficial to the users of these datasets, especially those who make use of multiple datasets for their research and applications. The Dataset Interoperability Working Group (DIWG), one of NASA’s Earth Science Data System Working Groups (ESDSWGs), was established in 2013, and has developed and published many recommendations. The Data Product Development Guide (DPDG) Working Group, established in 2018 as another of the ESDSWGs, has published a DPDG for Data Producers and a Quick Start Guide, incorporating guidance from many sources, including the recommendations from the DIWG. The DPDG includes recommendations regarding data formats (prominently netCDF-4) and metadata based primarily on the CF Metadata Conventions and the Attribute Convention for Data Discovery (ACDD). In early 2023, it was decided that the Resource Center for Data Producers (RCDP) Working Group be established as another ESDSWG, with the goals of providing all the information relevant and helpful for data producers via an easily accessible website, and of recommending how the DPDG and QSG could be maintained as living documents, given the rapidly changing technologies, and the need for incorporating the experience and feedback from the users of these documents.

Data product development↗
DOE OSTI2021

Modernization of ORIGEN Library Creation in the SCALE Computer Code

The modernization of SCALE features has been a target for recent SCALE releases. ORIGEN, the activation and depletion code in SCALE, is one such legacy code that has been targeted for modernization. A part of these modernization efforts has been to develop capabilities within ORIGEN to directly read ENDF-formatted data files. In addition, the input format for the COUPLE library creation utility was rewritten to a format more accessible to newer SCALE users. Finally, the ability of COUPLE to create ORIGEN libraries without sublibrary data has been added.KEYWORDS: ORIGEN, depletion, SCALE, API

Hart, Shane↗
DOE OSTI2015

The EPRDATA Format: A Dialogue

Recently the Los Alamos Nuclear Data Team has communicated certain issues of concern in relation to the new electron/photon/relaxation ACE data format as released in the eprdata12 library. In this document those issues are parsed, analyzed, and answered.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

About a method for compressing X-ray computed microtomography data

The management of scientific data is of high importance especially for experimental techniques that produce big data volumes. Such a technique is x-ray computed tomography (CT) and its community has introduced advanced data formats which allow for better management of experimental data. Rather than the organization of the data and the associated meta-data, the main topic on this work is data compression and its applicability to experimental data collected from a synchrotron-based CT beamline at the Elettra-Sincrotrone Trieste facility (Italy) and studies images acquired from various types of samples. This study covers parallel beam geometry, but it could be easily extended to a cone-beam one. The reconstruction workflow used is the one currently in operation at the beamline. Contrary to standard image compression studies, this manuscript proposes a systematic framework and workflow for the critical examination of different compression techniques and does so by applying it to experimental data. Beyond the methodology framework, this study presents and examines the use of JPEG-XR in combination with HDF5 and TIFF formats providing insights and strategies on data compression and image quality issues that can be used and implemented at other synchrotron facilities and laboratory systems. In conclusion, projection data compression using JPEG-XR appears as a promising, efficient method to reduce data file size and thus to facilitate data handling and image reconstruction

data compression↗
NASA NTRS2009

TRMM .25 deg x .25 deg Gridded Precipitation Text Product

Since the launch of the Tropical Rainfall Measuring Mission (TRMM), the Precipitation Measurement Missions science team has endeavored to provide TRMM precipitation retrievals in a variety of formats that are more easily usable by the broad science community than the standard Hierarchical Data Format (HDF) in which TRMM data is produced and archived. At the request of users, the Precipitation Processing System (PPS) has developed a .25 x .25 gridded product in an easily used ASCII text format. The entire TRMM mission data has been made available in this format. The paper provides the details of this new precipitation product that is designated with the TRMM designator 3G68.25. The format is packaged into daily files. It provides hourly precipitation information from the TRMM microwave imager (TMI), precipitation radar (PR), and TMI/PR combined rain retrievals. A major advantage of this approach is the inclusion only of rain data, compression when a particular grid has no rain from the PR or combined, and its direct ASCII text format. For those interested only in rain retrievals and whether rain is convection or stratiform, these products provide a huge reduction in the data volume inherent in the standard TRMM products. This paper provides examples of the 3G68 data products and their uses. It also provides information about C tools that can be used to aggregate daily files into larger time samples. In addition, it describes the possibilities inherent in the spatial sampling which allows resampling into coarser spatial sampling. The paper concludes with information about downloading the gridded text data products.

Stocker, Erich↗
DOE OSTI2016

FALDO: a semantic standard for describing the location of nucleotide and protein feature annotation

Nucleotide and protein sequence feature annotations are essential to understand biology on the genomic, transcriptomic, and proteomic level. Using Semantic Web technologies to query biological annotations, there was no standard that described this potentially complex location information as subject-predicate-object triples. In this paper, we have developed an ontology, the Feature Annotation Location Description Ontology (FALDO), to describe the positions of annotated features on linear and circular sequences. FALDO can be used to describe nucleotide features in sequence records, protein annotations, and glycan binding sites, among other features in coordinate systems of the aforementioned “omics” areas. Using the same data format to represent sequence positions that are independent of file formats allows us to integrate sequence data from multiple sources and data types. The genome browser JBrowse is used to demonstrate accessing multiple SPARQL endpoints to display genomic feature annotations, as well as protein annotations from UniProt mapped to genomic locations. Our ontology allows users to uniformly describe – and potentially merge – sequence annotations from multiple sources. Finally, data sources using FALDO can prospectively be retrieved using federalised SPARQL queries against public SPARQL endpoints and/or local private triple stores.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2014

Introduction to Reading and Visualizing ARM Data

Atmospheric Radiation Measurement (ARM) Program standard data format is NetCDF 3 (Network Common Data Form). The object of this tutorial is to provide a basic introduction to NetCDF with an emphasis on aspects of the ARM application of NetCDF. The goal is to provide basic instructions for reading and visualizing ARM NetCDF data with the expectation that these examples can then be applied to more complex applications.

Mather, James↗
DOE OSTI2025

Doppler Broadening and Other Temperature Effects

In this paper I attempt to document what I have learned and still remember about temperature effects, particularly Doppler broadening, on nuclear data, as it applies to ENDF formatted data. My focus is on the SIGMA1 method of Doppler broadening that I developed over 50 years ago. However, I do realize that there are currently many different methods used in computer codes, and I have tried to keep my discussion general as it applies to ALL of these methods. In particular, ALL of the MYTHS I describe below apply to all Doppler broadening methods: they all solve the parabolic diffusion equation in spherical geometry in (speed, reaction rate) versus temperature. These methods differ only in how the cross section is represented. So, at 85 years old here is what I still remember.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS1975

ERTS-1 data collection system: Status and performance

The Data Collection System flown on the first Earth Resources Technology Satellite (ERTS-1) relays earth resources data from remotely located in-situ sensors to Goddard Space Flight Center. Data is received at Goddard at least twice each day from every sensor installation and is distributed to users (who operate the sensors and transmitters) by mail and teletype. The system consists of a data formatting and transmitting unit, called the Data Collection Platform (DCP), a receiver and a retransmitter aboard ERTS-1; and receiving, demodulating and decoding equipment located at the Goldstone, California and Goddard data acquisition stations. Data is transmitted from the data acquisition stations to the ERTS Control Center at Goddard, then to the NASA (ERTS) Data Processing Facility (NDPF) where it is processed and distributed to users. Experience to date indicates that the design of the ERTS-1 Data Collection System is adequate for operational use for 50% of the users and, with minor modifications, could meet the requirements of 75%. Some users will have to augment the system by other data collection techniques to meet their operational requirements.

Painter, J. E.↗
NASA NTRS1983

Spatial inventory integrating raster databases and point sample data

A timber inventory of the Eldorado National Forest, located in east-central California, provides an example of the use of a Geographic Information System (GIS) to stratify large areas of land for sampling and the collection of statistical data. The raster-based GIS format of the VICAR/IBIS software system allows simple and rapid tabulation of areas, and facilitates the selection of random locations for ground sampling. Algorithms that simplify the complex spatial pattern of raster-based information, and convert raster format data to strings of coordinate vectors, provide a link to conventional vector-based geographic information systems.

Strahler, A. H.↗
NASA NTRS1989

MHOST version 4.2. Volume 1: Users' manual

This manual describes the user options available for running the MHOST finite element analysis package. MHOST is a solid and structural analysis program based on mixed finite element technology, and is specifically designed for three-dimensional inelastic analysis. A family of two- and three-dimensional continuum elements along with beam and shell structural elements can be utilized. Many options are available in the constitutive equation library, the solution algorithms and the analysis capabilities. An overview of the algorithms, a general description of the input data formats, and a discussion of input data for selecting solution algorithms are given.

Nakazawa, Shohei↗