Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data formats”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,495 records · Page 83

Comparison of H+ and He+ Plasmapause Locations Based on Resurrected and Reevaluated OGO-5 Ion Composition Data Base

Orbiting Geophysical Observatory 5 (OGO 5) magnetospheric ion-composition data (H+, He+ and O+) from an ion spectrometer (Sharp, 1969) have been retrieved from old magnetic tapes archived at the National Space Science Data Center (NSSDC). The highly compressed binary format was converted into a user-friendly ASCII format and these data have been made available online. We have inspected reliability and consistency of this data set in state of the art current knowledge. Comparing with the climatological model IRI-2012 and the mathematical model FLIP a shift of absolute and relative ion densities with time was revealed. We have suggested a correction procedure of individual H+, He+ and O+ ion densities. Using the corrected data set, we investigated plasmapause locations based on density gradient in H+, and He+. Correlation coefficient of both locations was determined as approx. 0.886 and the typical difference (Delta)L approx. 0.1. The electron density at the He+ plasmapause location for all cases is >100/cu cm.

Plasmasphere↗

Ionospheric Electron/Ion Densities Temperatures on CD-ROM and WWW

As part of this project a large volume of ionospheric satellite insitu data from the sixties, seventies and early eighties were made accessible online in ASCII format for public use. This includes 14 data sets from the BE-B, Alouette 2, DME-A, AE-B, ISIS-1, ISIS-2, OGO-6, DE-2, AEROS-A, AE-C, AE-D, AE-E, and Hinotori satellites. The original data existed in various machine-specific, highly compressed, binary encoding on 7-, or 9-track magnetic tapes. The data were decoded and converted to a common ASCII data format, solar and magnetic indices were added, and some quality control measures were taken. The original intent of producing CD-ROMs with these data was overtaken by the rapid development of the Internet. Most users now prefer to obtain the data directly online and greatly value WWW-interfaces to browse, plot and subset the data. Accordingly the data were made available online on the anonymous ftp site of NASA's National Space Science Data Center (NSSDC) at ftp://nssdcftp.gsfc.nasa.gov/spacecraft data/ and on NSSDC's ATMOWeb (http://nssdc.gsfc.nasa.gov/atmoweb/), a WWW-interface for plotting, subsetting, and downloading the data. Several new features were implemented into ATMOWeb as part of this project including a filtering and scatter plot capability. The availability of this new database and WWW system was announced through several electronic mailer (AGU, CEDAR, IRI, etc) and through talks and posters during scientific meetings.

Bilitza, Dieter↗

In Interactive, Web-Based Approach to Metadata Authoring

NASA's Global Change Master Directory (GCMD) serves a growing number of users by assisting the scientific community in the discovery of and linkage to Earth science data sets and related services. The GCMD holds over 8000 data set descriptions in Directory Interchange Format (DIF) and 200 data service descriptions in Service Entry Resource Format (SERF), encompassing the disciplines of geology, hydrology, oceanography, meteorology, and ecology. Data descriptions also contain geographic coverage information, thus allowing researchers to discover data pertaining to a particular geographic location, as well as subject of interest. The GCMD strives to be the preeminent data locator for world-wide directory level metadata. In this vein, scientists and data providers must have access to intuitive and efficient metadata authoring tools. Existing GCMD tools are not currently attracting. widespread usage. With usage being the prime indicator of utility, it has become apparent that current tools must be improved. As a result, the GCMD has released a new suite of web-based authoring tools that enable a user to create new data and service entries, as well as modify existing data entries. With these tools, a more interactive approach to metadata authoring is taken, as they feature a visual "checklist" of data/service fields that automatically update when a field is completed. In this way, the user can quickly gauge which of the required and optional fields have not been populated. With the release of these tools, the Earth science community will be further assisted in efficiently creating quality data and services metadata. Keywords: metadata, Earth science, metadata authoring tools

Pollack, Janine↗

Elucidating the formation mechanisms of zeolites using data-driven modelling and in-situ characterization

Zeolites are the main solid catalysts used by the chemical industry. The use of zeolites in separations and as shape selective catalysts requires control of the width and connectivity of their pores. 235 distinct zeolite frameworks have been synthesized to date, of over 2 million that have been proposed. Recent work indicates that the limitation is in large part kinetic: new synthetic pathways are required to access new zeolites. Organic cations are used to direct the synthesis towards specific zeolites. However, the molecular mechanisms by which cations direct the nucleation towards specific zeolites is not known. Elucidating these mechanisms is key to realize new zeolites for catalysis and separations, and is the focus of this project. This project developed and implemented a synergistic, data-driven computational and experimental approach to resolve the molecular pathways of nucleation, growth, and polymorph selection of zeolites and the role of organic cations in directing their formation. The project developed computationally efficient and accurate models for the study of the nucleation and growth of pure silica zeolites in molecular simulations, using machine learning with data from experiments. Simulations with these models were integrated with scanning tunneling electron microscopy, computer vision, and deep learning to unveil the molecular pathways of formation of a zeolite. Of particular interest in this project was to elucidate the role of amorphous precursors in the nucleation of the zeolite. Previous experiments indicate that zeolites are born within non-crystalline aggregates in which the silicates and organic cations have local and medium range order similar to that of the zeolite. The organic cations that direct the formation of zeolites and those that direct the formation of ordered mesoporous silicas are similar. We hypothesized that the frustrated attraction that for large organic cations leads to the formation of stable mesophases that direct the synthesis of mesoporous silicas, could promote the formation of metastable mesophases that can assist in the nucleation and polymorph selection of zeolites. The simulations resolved how structure directing agents build crystalline order and showed that mesoscopic pre-ordering occurs is not required to facilitate the nucleation of zeolites, because the synthesis occurs at high driving forces, where the barriers for nucleation are negligible. This project unveiled that polymorph selection in zeolite synthesis occurs after nucleation, opening a distinct area of control through the kinetics of growth and not through nucleation barriers.

36 MATERIALS SCIENCE↗

Developments of the EXFOR Database: Possible New Formats

The EXFOR database is a collection of experimental nuclear reaction data, maintained by the IAEA on behalf of the International Network of Nuclear Reaction Data Centres (NRDC). The format for the storage of such data was first described in 1969 and while there have been many incremental changes over the years so that the format is now capable of containing a very wide range of measurement results, there is a growing realisation that a major change is required. Consequently the IAEA Nuclear Data Section (NDS) organised a Consultant's Meeting on ‘Further Development of EXFOR’ in 2012. This was an opportunity for a range of international experts to discuss ways of improving EXFOR and while this focused on new formats there was also discussion on ways of storing new data, new output formats and software tools such as editors. This paper will discuss recent and proposed changes to enable new quantities to be stored (such as coincidence measurements and covariances), the range of output formats available (e.g. C4 and X4+) which make interaction with the data more user friendly and the possible use of XML to modernise the database.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Dataset for scientific paper "Simulated plant‑mediated oxygen input has strong impacts on fine‑scale porewater biogeochemistry and weak impacts on integrated methane fluxes in coastal wetlands", a modeling study based on field observation at the tidal salt marshes of the Parker River Estuary, Massachusetts, United States

This dataset is the raw and processed data for the paper "Simulated plant ‑ mediated oxygen input has strong impacts on fine ‑ scale porewater biogeochemistry and weak impacts on integrated methane fluxes in coastal wetlands". This study investigated how plant-mediated oxygen input affects subsurface biogeochemical reactions of organic carbon degradation and the resulting methane emissions of coastal wetlands by model simulation. We used the subsurface geochemical simulator PFLOTRAN for the modeling, which produced the simulated changes in porewater chemical substances and methane emissions over 10 days under different scenarios of plant-mediated oxygen input.Specifically, this dataset contains: 1) the input files for PFLOTRAN of all simulation runs conducted in this study. Those files are with an extension of ".in", containing information of the biogeochemical reaction network (stoichiometry, reaction rate, Monod constants, etc), fluid flow rate and oxygen concentration in the fluid which together simulated the plant-mediated oxygen input, the configuration of artificial reactions that simulated the methane fluxes, etc. The PFLOTRAN input files are text files, which can be opened by NotePad, but running these input files will require proper installation of PFLOTRAN (instruction: https://documentation.pflotran.org/user_guide/how_to/installation/installation.html). 2) the raw and processed model output from PFLOTRAN of all simulation runs, and 3) the python scripts used to process the raw model output, including random allocation of root cells, converting raw data into organized formats, calculating the methane fluxes based on the model output, data visualization, etc. The raw and processed model output from PFLOTRAN are in .spydata format, which can be viewed with Python. and 3) the python scripts for data processing and analysis are programming scripts, which can be opened with Python.This modeling work, in particular the model parameterization of root density and initial conditions of porewater concentrations of biogeochemical substances, was based on field measurements at the salt marsh of the Upper Parker River Estuary, Massachusetts, United States.

54 ENVIRONMENTAL SCIENCES↗

Microphone Phased Array NetCDF/HDF5 Archival Files: Application Program Interface Reference

An application program interface (API) has been developed for the creation and access of structured data files generated by microphone phased arrays utilized in aeroacoustics research. Two structured binary file formats are supported, namely NetCDF (Network Common Data Form) and HDF5 (Hierarchical Data Format) files. The API consists of a library of routines callable from C, Fortran or Matlab, with native versions of the API provided for each language. The libraries are divided into categories for file handling, file definition and initialization, data writing, data recovery, and error handling. The API is intended to provide a mechanism for generating self-describing binary files for long-term archiving of raw and processed data generated by phased array systems.

Humphreys, William M., Jr.↗

Flight, Wind-Tunnel, and Computational Fluid Dynamics Comparison for Cranked Arrow Wing (F-16XL-1) at Subsonic and Transonic Speeds

The data contained on this CD are a supplement to NASA/TP-2001-210629 published in February 2001. This CD replaces a web-site database search and retrieval system - noted as reference 36 in the NASA/TP - that was to supply the aeronautical community with access to the flight data. Unfortunately, this web-site was only available for a short time after the publication of NASA/TP-2001-21068 due to software and support issues. The contents of this CD are organized into five folders containing data from the flight test and reference 1. In particular, the following are provided: (1) tabular data of the Flight Conditions from Table 5; (2) boundary layer data from Table 12 for three flights in multiple formats; (3) skin-friction data - xmgr format (ref. 3) - used to generate Figure 26; (4) surface pressure data with a listing of the parameters; and (5) tuft-images from three cameras in two formats.

John E Lamar↗

Sparse triangular solves for ILU revisited: data layout crucial to better performance.; .

A key to good processor utilization for sparse matrix computations is storing the data in the format that is most conducive to fast access by the memory system. In particular, for sparse matrix triangular solves the traditional compressed sparse matrix format is poor, and minor adjustments to the data structure can increase the processor utilization dramatically. Such adjustments involve storing the L and U factors separately and storing the U rows 'backwards' so that they are accessed in a simple streaming fashion during the triangular solves. Changes to the PETSc libraries to use this modified storage format resulted in over twice the floating-point rate for some matrices. This improvement can be accounted for by a decrease in the cache misses and TLB (transaction lookaside buffer) misses in the modified code.

99 GENERAL AND MISCELLANEOUS↗

Data, Photographs, Videos, and Information for the Niwot Ridge Subalpine Forest (US-NR1) AmeriFlux site

This data package contains data and information about the operation of the Niwot Ridge Subalpine Forest AmeriFlux site (US-NR1) between Nov 1998 to the present (2020). This data archive supplements the primary 30-min data storage for the US-NR1 data (i.e., https://doi.org/10.17190/AMF/1246088) by providing the following: (i) five-minute statistics (means, variances, covariances) of all data measured by the data system between Nov 1998 and September 2020 in netCDF format, (ii) CSV data files saved within the memory of the CR23X data loggers (as well as an archive of the data logger programs), (iii) an archive of previous 30-min ASCII data versions of the US-NR1 AmeriFlux data and information related to each data release (a replica of what can be found at http://urquell.colorado.edu/data_ameriflux/), (iv) a web calendar (in HTML format) documenting activity at the site (a replica of http://urquell.colorado.edu/calendar/), (v) photos (over 15,000) and video taken at the site between years 2001 and present day (2020), and (vi) several auxiliary datasets, primary related to trees near the site, soil moisture and soil temperature, and subcanopy radiation data. The data package is setup so that the web calendar, photos, and electronic logbook can be easily accessed on a local computer using a web browser. The provided data files are in either netCDF, CSV, ASCII, or MATLAB format. To obtain a better understanding about the archive, please start by reading the PDF: README_ESS_DIVE_USNR1_readme_first.pdf.

54 ENVIRONMENTAL SCIENCES↗

BOREAS ECMWF 6-Hour Analysis and Forecast Data

In cooperation with BOREAS atmospheric research efforts, the ECMWF agreed to provide BOREAS with a customized subset of its 6-hourly forecast data. This data set contains parameters from three ECMWF data products in GRIB format: Surface and Diagnostic Fields, Supplemental Fields, and Extension Data. Sample software and information are provided to assist in reading the data files. Temporally, the atmospheric parameters are available for the four main synoptic hours of 00, 06, 12, and 18 UTC from 1994 to 1996. Spatially, the data are stored in a 0.5- by 0.5-degree latitude/longitude grid. To cover the entire BOREAS study area, the grid extends from 48 to 62 degrees latitude and -92 to -114 degrees longitude. The data are stored in binary data representation known as FM 92 GRIB. Due to the complexity of the content and format of this data set, users are advised to read Sections 6, 7, 8, and 14 before using data. Based on agreements between BOREAS and ECMWF, users may legally obtain and use these data only by having a set of the BOREAS CD-ROMs that contain the data. Possession or use of these data under any other circumstance is prohibited. See Sections 11.3 and 20.4 for details.

Viterbo, Pedro↗

COMPASS-FME Terrestrial Ecosystem Manipulation to Probe the Effects of Storm Treatments (TEMPEST) Experiment Level 2 Sensor Data v2-1

This is the version v2-1 Level 2 (L2) data release for COMPASS-FME environmental sensors located at our Terrestrial Ecosystem Manipulation to Probe the Effects of Storm Treatments (TEMPEST) experimental site. This manipulative, ecosystem-scale TEMPEST experiment addresses the potential for freshwater and estuarine-water disturbance events to alter tree function, species composition, and ecosystem processes in a deciduous coastal forest in MD, USA. The experiment uses a large-unit (2000 m2), un-replicated experimental design, with three 50 m × 40 m plots serving as control, freshwater, and estuarine-water treatments. Level 2 (L2) data consist of sensor observations from the COMPASS-FME synoptic sites, TEMPEST, and DELUGE. Compared to the L1 data, these are more consistent (always 15-minute timestamps for the entire year); better QA/QC’d (out of bounds, out of service, and extreme outlier values are removed); and more complete, with a gap-filled time series available alongside the main observations, and additional derived (calculated) variables. L2 data are intended to be rapidly and easily usable in analyses and simulations. However, algorithmic outlier identification always carries the risk of removing valid data, and Level 1 data may be more suitable for analyses that focus on variability or extreme events. This dataset includes: - An overall dataset README file that describes the current version, gives citation and contact information, etc. - Site- and year-specific folders, each holding variable-specific Parquet (a high performance, space efficient format; see https://parquet.apache.org) data files for each site and plot in that year. - Metadata files within each site-year folder provide full information on data units, expected ranges, contact information, detailed flood times, as well as a general description of the site. - Environmental sensor types that appear in the data files include weather (ClimaVUE50, CS, RM Young, and LI instruments in the graphs below); soil conditions (TEROS12); soil redox state (Redox); groundwater variables (AquaTROLL200 and AquaTROLL600); open water sondes (Exo); tree sap velocity (Sapflow); and system voltage and state (Datalogger). Data are reported every 15 minutes. Please see v2-1 TEMPEST L2 Sensor Package Quick Start.pdf for detailed information on data package structure, temporal coverage, and versioning. Data files are in Apache Parquet, a high performance, space efficient format for tabular data. These files can be read using R's `arrow` package (https://arrow.apache.org/docs/r/), with similar tools available in other languages. The TEMPEST flood events occurred on the following dates. They lasted for ~10 hours each day and delivered ~80,000 gallons to each plot; many data streams are available at 1 or 5 minute frequency during these periods. * Tests: Aug 25 (fresh plot) and Sep 9 (salt plot), 2021 * TEMPEST 1: June 22, 2022 * TEMPEST 2: June 6-7, 2023 * TEMPEST 3: June 11-13, 2024

EARTH SCIENCE > ATMOSPHERE > ATMOSPHERIC TEMPERATU↗

COMPASS-FME Synoptic Sites Level 2 Sensor Data v2-1

This is the version 2-1 Level 2 (L2) data release for COMPASS-FME environmental sensors located at our synoptic field sites. COMPASS-FME is studying sites in two distinct regions, the Chesapeake Bay and the Western Lake Erie Basin. We established the network at seven "synoptic" (observational) sites along the Chesapeake Bay and Lake Erie coastlines, collectively generating over three million observations per month, to track and comprehend environmental changes where land and water intersect. Additionally, the two regions provide an interesting contrast of saltwater and freshwater coasts that allow us to differentiate the impacts of inundation and coastal water chemistries in two nationally important coastal systems. Level 2 (L2) data consist of sensor observations from the COMPASS-FME synoptic sites, TEMPEST, and DELUGE. Compared to the L1 data, these are more consistent (always 15-minute timestamps for the entire year); better QA/QC’d (out of bounds, out of service, and extreme outlier values are removed); and more complete, with a gap-filled time series available alongside the main observations, and additional derived (calculated) variables. L2 data are intended to be rapidly and easily usable in analyses and simulations. However, algorithmic outlier identification always carries the risk of removing valid data, and Level 1 data may be more suitable for analyses that focus on variability or extreme events. This dataset includes: - An overall dataset README file that describes the current version, gives citation and contact information, etc. - Site- and year-specific folders, each holding variable-specific Parquet (a high performance, space efficient format; see https://parquet.apache.org) data files for each site and plot in that year. - Metadata files within each site-year folder provide full information on data units, expected ranges, contact information, detailed flood times, as well as a general description of the site. - Environmental sensor types that appear in the data files include weather (ClimaVUE50, CS, RM Young, and LI instruments in the graphs below); soil conditions (TEROS12); soil redox state (Redox); groundwater variables (AquaTROLL200 and AquaTROLL600); open water sondes (Exo); tree sap velocity (Sapflow); and system voltage and state (Datalogger). Data are reported every 15 minutes. Data files are in Apache Parquet, a high performance, space efficient format for tabular data. These files can be read using R's `arrow` package (https://arrow.apache.org/docs/r/), with similar tools available in other languages. Please see v2-1 L2 Sensor Package QStart.pdf for detailed information on data package structure, temporal coverage, and versioning.

EARTH SCIENCE > ATMOSPHERE > ATMOSPHERIC TEMPERATU↗

A Preconditioned Low-Rank Projection Method with a Rank-Reduction Scheme for Stochastic Partial Differential Equations

Herein, we consider the numerical solution of large systems of linear equations obtained from the stochastic Galerkin formulation of stochastic partial differential equations. We propose an iterative algorithm that exploits the Kronecker product structure of the linear systems. The proposed algorithm efficiently approximates the solutions in low-rank tensor format. Using standard Krylov subspace methods for the data in tensor format is computationally prohibitive due to the rapid growth of tensor ranks during the iterations. To keep tensor ranks low over the entire iteration process, we devise a rank-reduction scheme that can be combined with the iterative algorithm. The proposed rank-reduction scheme identifies an important subspace in the stochastic domain and compresses tensors of high rank on-the-fly during the iterations. The proposed reduction scheme is a coarse-grid method in that the important subspace can be identified inexpensively in a coarse spatial grid setting. The efficiency of the present method is displayed by numerical experiments on benchmark problems.

97 MATHEMATICS AND COMPUTING↗

Best practice data life cycle approaches for the life sciences

Throughout history, the life sciences have been revolutionised by technological advances; in our era this is manifested by advances in instrumentation for data generation, and consequently researchers now routinely handle large amounts of heterogeneous data in digital formats. The simultaneous transitions towards biology as a data science and towards a ‘life cycle’ view of research data pose new challenges. Researchers face a bewildering landscape of data management requirements, recommendations and regulations, without necessarily being able to access data management training or possessing a clear understanding of practical approaches that can assist in data management in their particular research domain. Here we provide an overview of best practice data life cycle approaches for researchers in the life sciences/bioinformatics space with a particular focus on ‘omics’ datasets and computer-based data processing and analysis. We discuss the different stages of the data life cycle and provide practical suggestions for useful tools and resources to improve data management practices.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

NWEI Azura December 2016 Data

Data files for the NWEI Azura grid-connected deployment at the 30-meter berth of the US Navys Wave Energy Test Site (WETS 30m Site) at the Kaneohe Marine Corps Base Hawaii (MCBH) on the windward (northeast) coast of the island of Oahu, HI. See general documentation describing specifics of the data files and formats in a separate submission. This month's data only covers the period Dec 1-6, 2016. On Dec 7, the Azura was shut down and disconnected in preparation for its Dec 8 removal from the WETS 30 m site. The Azura will be modified and re-deployed in 2017.

16 TIDAL AND WAVE POWER↗

Shipboard fisheries management terminals

The needs of the National Marine Fisheries Service (NMGS), National Weather Service, and the U.S. Coast Guard for locational, biological, and environmental data were assessed. The fisheries conservation zones and the yellowfin tuna jurisdiction of the NMFS operates observer programs on foreign and domestic fishing vessels. Data input terminal and data transfer and processing technology are reviewed to establish available capability. A matrix of implementation options is generated to identify the benefits of each option, and preliminary cost estimates are made. Recommendations are made for incremental application of available off the shelf hardware to obtain improved performance and benefits within a well bounded cost. Terminal recommendations are made for three interdependent shipboard units emphasizing: (1) the determination of location and fishing activity; (2) hand held data inputting and formatting in the fishing work areas; and (3) data manipulation, merging, and editing.

Nagler, R. G.↗

FGGE/SBUV tape specification and shipping letter description

The FGGE/SBUV Level 2C data set consists of 12 9-track data tapes, each of which contains total ozone and ozone profile data for one calendar month grouped in files containing the data in a 6 hour synoptic time block. The data flow and quality checks in the production of this data set are described as well as the format of the data tapes and the accompanying shipping documents.

Han, D.↗