Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data formats”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,225 records · Page 68
All sourcesNASA NTRSDOE OSTI
DOE OSTI2015

BRAINformat: A Data Standardization Framework for Neuroscience Data

Neuroscience is entering the era of `extreme data` with little experience and few plans for the associated volume, velocity, variety, and veracity challenges. This is a serious impediment for both the sharing of data across labs, as well as the utilization of modern and high-performance computing capabilities to enable data driven discovery. Here, we introduce BRAINformat, a novel file format and model for management and storage of neuroscience data. The BRAINformat library defines application-independent design concepts and modules that together create a general framework for standardization of scientific data. We describe the formal specification of scientific data standards, which facilitates sharing and verification of data and formats. We introduce the concept of Managed Objects, enabling semantic components of data formats to be specified as self-contained units, supporting modular and reusable design of data format components and file storage. The BRAINformat is built off of HDF5, enabling portable, scalable, and self-describing data storage. We introduce the novel concept of Relationship Attributes for modeling and use of semantic relationships between data objects, and discuss the annotation of data using dedicated data annotation modules provided by the BRAINformat library. Based on these concepts we implement dedicated, application-oriented modules and design a data standard for neuroscience data.The BRAINformat software library is open source, easy-to-use, and provides detailed user and developer documentation and is freely available at: https://bitbucket.org/oruebel/brainformat.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Data from: "Moisture rivals temperature in limiting photosynthesis by trees establishing beyond their cold-edge range limit under ambient and warmed conditions"

This archive contains data files that were used to draw conclusions in “Moisture rivals temperature in limiting photosynthesis by trees establishing beyond their cold-edge range limit under ambient and warmed conditions”, by Moyes et al., 2015. All field research was completed in common garden plots set up as part of the Alpine Treeline Warming Experiment (ATWE) on Niwot Ridge, Colorado, USA.There are two main data file formats in this archive: comma-separated values (.csv), and Microsoft Excel (.xls and .xlsx). .xlsx files can be read using Microsoft Excel and Google Sheets, and .csv files can be read using any simple text editor program, such as TextEdit (Mac) and Notepad (Windows). This .pdf data user’s guide can be read using Adobe Acrobat Reader, or any other compatible software. Seedling photographs and their corresponding leaf area-processed images are available in .jpg/.JPG image format, and can be opened using Preview (Mac) and Photos (Windows). To provide additional spatial context, two types of geospatial files are also published in this data package: ESRI shapefiles (.shp) and .kml files. Shapefiles are compatible with any GIS software able to read the file type (such as QGIS or ESRI’s ArcGIS suite), and .kml files can be opened with Google Earth or Google Maps. Figures 3 and 4 in the publication contain data from Moyes et al. 2013. This publication is cited in the References section in this archive, and data files can be accessed via the Alpine Treeline Warming Experiment project portal on ESS-DIVE. ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Climate change is altering plant species distributions globally, and warming is expected to promote uphill shifts in mountain trees. However, at many cold-edge range limits, such as alpine treelines in the western United States, tree establishment may be colimited by low temperature and low moisture, making recruitment patterns with warming difficult to predict.- We measured response functions linking carbon (C) assimilation and temperature- and moisture-related microclimatic factors for limber pine (Pinus flexilis) seedlings growing in a heating × watering experiment within and above the alpine treeline. We then extrapolated these response functions using observed microclimate conditions to estimate the net effects of warming and associated soil drying on C assimilation across an entire growing season.- Moisture and temperature limitations were each estimated to reduce potential growing season C gain from a theoretical upper limit by 15–30% (c. 50% combined). Warming above current treeline conditions provided relatively little benefit to modeled net assimilation, whereas assimilation was sensitive to either wetter or drier conditions.- Summer precipitation may be at least as important as temperature in constraining C gain by establishing subalpine trees at and above current alpine treelines as seasonally dry subalpine and alpine ecosystems continue to warm.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2016

Architecture and Implementation of OpenPET Firmware and Embedded Software

OpenPET is an open source, modular, extendible, and high-performance platform suitable for multi-channel data acquisition and analysis. Due to the versatility of the hardware, firmware, and software architectures, the platform is capable of interfacing with a wide variety of detector modules not only in medical imaging but also in homeland security applications. Analog signals from radiation detectors share similar characteristics-a pulse whose area is proportional to the deposited energy and whose leading edge is used to extract a timing signal. As a result, a generic design method of the platform is adopted for the hardware, firmware, and software architectures and implementations. The analog front-end is hosted on a module called a Detector Board, where each board can filter, combine, timestamp, and process multiple channels independently. The processed data is formatted and sent through a backplane bus to a module called Support Board, where 1 Support Board can host up to eight Detector Board modules. The data in the Support Board, coming from 8 Detector Board modules, can be aggregated or correlated (if needed) depending on the algorithm implemented or runtime mode selected. It is then sent out to a computer workstation for further processing. The number of channels (detector modules), to be processed, mandates the overall OpenPET System Configuration, which is designed to handle up to 1,024 channels using 16-channel Detector Boards in the Standard System Configuration and 16,384 channels using 32-channel Detector Boards in the Large System Configuration.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS1982

Recommendations concerning satellite-acquired earth resource data: 1982 report of the Data Management Subcommittee of the GEOSAT Committee, Incorporated

End user concerns about the content and accessibility of libraries of remote sensing data in general are addressed. Recommendations pertaining to the United States' satellite remote sensing programs urge: (1) the continuation of the NASA/EROS Data Center program to convert pre-1979 scenes to computer readable tapes and create a historical archive of this valuable data; (2) improving the EROS archive by adding geologically interesting scenes, data from other agencies (including previously classified data), and by adopting a policy to retire data from the archive; (3) establishing a computer data base inquiry system that includes remote sensing data from all publically available sources; (4) capability for prepurchase review and evaluation; (5) a flexible price structure; and (6) adoption of standard digital data products format. Information about LANDSAT 4, the status of worldwide LANDSAT receiving stations, future non-U.S. remote sensing satellites, a list of sources for LANDSAT data, and the results of a survey of GEOSAT members' remote sensing data processing systems are also considered.

Source record↗
DOE OSTI2012

Generalized Nuclear Data: A New Structure (with Supporting Infrastructure) for Handling Nuclear Data

The Evaluated Nuclear Data File (ENDF) format was designed in the 1960s to accommodate neutron reaction data to support nuclear engineering applications in power, national security and criticality safety. Over the years, the scope of the format has been extended to handle many other kinds of data including charged particle, decay, atomic, photo-nuclear and thermal neutron scattering. Although ENDF has wide acceptance and support for many data types, its limited support for correlated particle emission, limited numeric precision, and general lack of extensibility mean that the nuclear data community cannot take advantage of many emerging opportunities. More generally, the ENDF format provides an unfriendly environment that makes it difficult for new data evaluators and users to create and access nuclear data. The Cross Section Evaluation Working Group (CSEWG) has begun the design of a new Generalized Nuclear Data (or 'GND') structure, meant to replace older formats with a hierarchy that mirrors the underlying physics, and is aligned with modern coding and database practices. In support of this new structure, Lawrence Livermore National Laboratory (LLNL) has updated its nuclear data/reactions management package Fudge to handle GND structured nuclear data. Fudge provides tools for converting both the latest ENDF format (ENDF-6) and the LLNL Evaluated Nuclear Data Library (ENDL) format to and from GND, as well as for visualizing, modifying and processing (i.e., converting evaluated nuclear data into a form more suitable to transport codes) GND structured nuclear data. GND defines the structure needed for storing nuclear data evaluations and the type of data that needs to be stored. But unlike ENDF and ENDL, GND does not define how the data are to be stored in a file. Currently, Fudge writes the structured GND data to a file using the eXtensible Markup Language (XML), as it is ASCII based and can be viewed with any text editor. XML is a meta-language, meaning that it has a primitive set of definitions for representing hierarchical data/text in a file. Other meta-languages, like HDF5 which stores the data in binary form, can also be used to store GND in a file. In this paper, we will present an overview of the new GND data structures along with associated tools in Fudge.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

ESS-DIVE reporting format for field measurements of soil respiration

This is a new data and metadata reporting format for soil respiration data, based on engagement with a wide range of researchers in the earth and ecological sciences as well as expert advisory panels. Reporting formats are intended to be ‘bottom-up’, community-developed documents and templates that can enable consistent, findable, accessible, interoperable, and reproducible (FAIR) data; our goal was a reporting format that would be relevant and useful for synthesis activities, optimizing data discoverability and usability while not placing an undue burden on data contributors. The format is split into two levels of information—metadata about chambers (used to measure soil respiration in the field), and the measured data themselves. The file data_reportingformat_template.xlsx contains information on how the data table should be structured, including field names, field descriptions, and units; the chammetadata_reportingformat_template.xlsx file contains similar information for the chamber-level metadata. Fundamentally, this format aims to enable FAIR data through an easy-to-use guide for data providers interested in formatting their data in a common way, and provide ‘future-proofing’ capabilities to support reanalyses of soil respiration data, a globally-important component of the carbon cycle.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1975

Automated storage and retrieval of data obtained in the Interkosmos project

The formation of a data bank and information retrieval system for scientific data is described. The stored data can be digital or documentation data. Data classification methods are discussed along with definition and compilation of the dictionary utilized, definition of the indexing scheme, and definition of the principles used in constructing a file for documents, data blocks, and tapes. Operating principles are also presented.

Ziolkovski, K.↗
DOE OSTI2015

EBR-II and TREAT Digitization Project

Digitizing the technical drawings for EBR-II and TREAT provides multiple benefits. Moving the scanned or hard copy drawings to modern 3-D CAD (Computer Aided Drawing) format saves data that could be lost over time. The 3-D drawings produce models that can interface with other drawings to make complex assemblies. The 3-D CAD format can also include detailed material properties and parametric coding that can tie critical dimensions together allowing easier modification. Creating the new files from the old drawings has found multiple inconsistencies that are being flagged or corrected improving understanding of the reactor(s).

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2023

Demographic data of Sedum lanceolatum from 2013 to 2014 under a climate manipulation experiment

Demographic data of Sedum lanceolatum under a climate manipulation experiment (heating and watering). Dataset includes one .csv with demographic data for 232 individuals monitored over 2013-2014 which was used, in part, to draw conclusions in "Elevation effects on vital rate sensitivities generate variation in neighbor effects on population growth rate in Sedum lanceolatum" by Herzog et al. (in review). All data was collected under a watering and warming experiment as part of the Alpine Treeline Warming Experiment at Niwot Ridge, Colorado, USA. There are two main data file formats in this archive: comma-separated values (.csv) which can be read using any simple text editor program, such as TextEdit (Mac) and Notepad (Windows). The .pdf data user’s guide can be read using Adobe Acrobat Reader, or any other compatible software.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1977

Infrared studies of star formation

Infrared observations at wavelengths of a few microns to 1 mm are reviewed which pertain to the problem of star formation. The data considered include observations of large gas and dust clouds within which stars may be forming and detailed studies of individual objects within these clouds. Stages of star formation are outlined, the IR luminosity of forming stars is examined, and criteria for selecting interstellar regions for IR studies are discussed along with the importance of dust in the IR energy distributions of star-formation regions. Detailed results, including IR maps, are evaluated for the Orion Molecular Cloud 1 (OMC-1), W3, OMC-2, Mon R2, RCW 57, M17, CRL 2591, and NGC 7538. Some general properties of star-formation regions are summarized, and observational techniques for IR astronomy are described. It is noted that the discovery of possible pre-main-sequence (PMS) objects in the densest central portions of larger clouds supports the generally accepted premise of gravitational collapse as the driving mechanism for the star-formation process and that the observed properties of possible PMS objects agree qualitatively with the predictions of detailed models based on gravitational collapse.

Werner, M. W.↗
NASA NTRS2004

Future Concepts for Realtime Data Interfaces for Control Centers

Existing methods of exchanging realtime data between the major control centers in the International Space Station program have resulted in a patchwork of local formats being imposed on each Mission Control Center. This puts the burden on a data customer to comply with the proprietary data formats of each data supplier. This has increased the cost and complexity for each participant, limited access to mission data and hampered the development of efficient and flexible operations concepts. Ideally, a universal format should be promoted in the industry to prevent the unnecessary burden of each center processing a different data format standard for every external interface with another center. With the broad acceptance of XML and other conventions used in other industries, it is now time for the Aerospace industry to fully engage and establish such a standard. This paper will briefly consider the components that would be required by such a standard (XML schema, data dictionaries, etc.) in order to accomplish the goal of a universal low-cost interface, and acquire broad industry acceptance. We will then examine current approaches being developed by standards bodies and other groups. The current state of CCSDS panel work will be reviewed, with a survey of the degree of industry acceptance. Other widely accepted commercial approaches will be considered, sometimes complimentary to the standards work, but sometimes not. The question is whether de facto industry standards are in concert with, or in conflict with the direction of the standards bodies. And given that state of affairs, the author will consider whether a new program establishing its Mission Control Center should implement a data interface based on those standards. The author proposes that broad industry support to unify the various efforts will enable collaboration between control centers and space programs to a wider degree than is currently available. This will reduce the cost for programs to provide realtime access to their data, hence reducing the cost of access to space, and benefiting the industry as a whole.

Kearney, Mike W., III↗
NASA NTRS2004

Gullies on Mars and Constraints Imposed by Mars Global Surveyor Data

The discovery of geologically recent gully features on Mars has spawned a wide variety of proposed theories of their origin including water versus carbon dioxide based erosion and shallow versus deep fluid sources. To test the validity of such gully formation mechanisms, data from the Mars Global Surveyor spacecraft has been analyzed to uncover trends in the dimensional and physical properties of the gullies and their surrounding terrain. Over 100 Mars Orbiter Camera (MOC) images containing clear evidence of gully landforms, distributed in the southern mid and high latitudes, have been analyzed in combination with Mars Orbiter Laser Altimeter (MOLA) and Thermal Emission Spectrometer (TES) data to provide quantitative measurements of numerous gully characteristics. Parameters measured include apparent source depth and distribution, vertical and horizontal dimensions, slopes, compass orientations, and factors controlling present-day climatic conditions.

Heldmann, J. L.↗
DOE OSTI2023

Practical Guide to Chemometric Analysis of Optical Spectroscopic Data

The methodology and mathematical treatment of several classic multivariate methods for the analysis of spectroscopic data is demonstrated in a straightforward way that can be used as a basis for teaching an undergraduate introductory course on chemometric analysis. The multivariate techniques of classical least squares (CLS), principal component regression (PCR), and partial least squares (PLS), as well as the univariate Beer’s law method have been described and compared, building students’ understanding by starting with the univariate method and progressing step by step into the multivariate methods. Equations for the production of regression vectors from training set spectral data is described and their use demonstrated for the prediction of constituent concentrations on a separate validation set of spectra. Extreme care is taken to ensure consistency in variable formatting of data matrices. This provides a key foundation to understanding how spectral data are manipulated using these different mathematical approaches for building quantitative regression models. Each method is applied to a real-world data set, and the results are discussed to show students the types of information that can be gleaned from each method. A training set comprised of 20 infrared absorbance spectra containing 3 constituents (benzene, polystyrene, and gasoline) of known composition are used to demonstrate the matrix operations for each regression method. A separate set of 12 real-world napalm samples (containing benzene, polystyrene and gasoline) are used as a validation set to demonstrate the ability to utilize the regression models on an unknown dataset. A toolbox (PNNL Chemometric Toolbox) written in MATLAB language is supplied in the Supplemental Information file and can be used as a companion for understanding the development and deployment of the chemometric algorithms described in this paper. The datasets of the infrared spectra are also supplied, allowing users to build and inspect the chemometric models on their own. Finally, the Toolbox includes scripts to assist users in loading their own datasets into MATLAB and performing CLS, PCR, and PLS on their data.

Upper-Division Undergraduate, Analytical Chemistry↗
NASA NTRS2019

Comparison of Electrical Output Format Options for the Analysis of Strain-Gage Balance Calibration Data

Fundamental characteristics of three gage output formats are discussed that may be used to both interpret and analyze wind tunnel strain-gage balance data. The first output format uses raw outputs, i.e., absolute voltage measurements, for the analysis. This choice requires an intercept term in the regression model of the outputs if the Iterative Method is chosen for the load prediction. Raw outputs can be used for the analysis of all known output characteristics as long as the Iterative Method is applied. However, raw outputs cannot be used to analyze data of a balance with bi-directional outputs if the Non-Iterative Method is chosen for the analysis. The second output format, i.e., difference type 1, uses the difference between raw outputs and the natural zeros of the balance gages for the analysis. In this case, the use of the intercept term becomes optional. Analysis results for difference type 1 will exactly match analysis results obtained by using raw outputs as long as identical math models are used for the regression analysis. In addition, difference type 1 may be used to analyze data of a balance with bi directional outputs if an analyst prefers to process data using the Non-Iterative Method. The third output format, i.e., difference type 2, uses the difference between raw outputs and the outputs of the zero load point of a load series for the data analysis. The application of this format is only recommended if the maximum magnitude of all tare loads of a given balance calibration data set is less than two percent of capacity. Data from the calibration of a force balance is used to illustrate the application of the three gage output formats.

Wind Tunnel Strain-Gage Balance↗
DOE OSTI2025

CROCUS Low Cost All-in-One Weather Station AMB-001 Data Argonne National Laboratory Prairie Site

The Ambient Weather WS-2902D (AMB) is a low cost weather station that has become very useful for filling data gaps in harder to deploy locations. These low cost weather stations collect 13 second data, which is averaged to a five minute data output available to users through an API key. The data files contain measurements for precipitation, temperature, wind chill/heat index, relative humidity, dew point, UV index, solar radiation, wind speed, wind direction, wind gust, and with an external particulate matter 2.5 (PM 2.5) sensor. Having all of these measurements in one condense system allows for fast deploying and dense network capabilities. Three of the AMB weather stations were deployed at the Argonne Testbed for Multiscale Observational Science (ATMOS), a 20-acre prairie site at Argonne National Laboratory in Lemont, Illinois. The instruments are denoted by their three digit identifier (CMS-AMB-xxx) format. The data is presented as daily NetCDF (.nc) files, each containing approximately 24 hours of observations. Files follow the naming convention of: the project (CROCUS), location (atmos), instrument name (CMS-AMB-001), data level (raw, a1), and date (year, month, day). The NetCDF format can be accessed using common scientific software such as Python using xarray, netCDF4 or ACT-DOE.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

CROCUS Low Cost All-in-One Weather Station AMB-002 Data Argonne National Laboratory Prairie Site

The Ambient Weather WS-2902D (AMB) is a low cost weather station that has become very useful for filling data gaps in harder to deploy locations. These low cost weather stations collect 13 second data, which is averaged to a five minute data output available to users through an API key. The data files contain measurements for precipitation, temperature, wind chill/heat index, relative humidity, dew point, UV index, solar radiation, wind speed, wind direction, wind gust, and with an external particulate matter 2.5 (PM 2.5) sensor. Having all of these measurements in one condense system allows for fast deploying and dense network capabilities. Three of the AMB weather stations were deployed at the Argonne Testbed for Multiscale Observational Science (ATMOS), a 20-acre prairie site at Argonne National Laboratory in Lemont, Illinois. The instruments are denoted by their three digit identifier (CMS-AMB-xxx) format. The data is presented as daily NetCDF (.nc) files, each containing approximately 24 hours of observations. Files follow the naming convention of: the project (CROCUS), location (atmos), instrument name (CMS-AMB-002), data level (raw, a1), and date (year, month, day). The NetCDF format can be accessed using common scientific software such as Python using xarray, netCDF4 or ACT-DOE.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

CROCUS Low Cost All-in-One Weather Station AMB-004 Data Argonne National Laboratory Prairie Site

The Ambient Weather WS-2902D (AMB) is a low cost weather station that has become very useful for filling data gaps in harder to deploy locations. These low cost weather stations collect 13 second data, which is averaged to a five minute data output available to users through an Application Programming Interface (API) key. The data files contain measurements for precipitation, temperature, wind chill/heat index, relative humidity, dew point, UV index, solar radiation, wind speed, wind direction, wind gust, and with an external particulate matter 2.5 (PM 2.5) sensor. Having all of these measurements in one condense system allows for fast deploying and dense network capabilities. Three of the AMB weather stations were deployed at the Argonne Testbed for Multiscale Observational Science (ATMOS), a 20-acre prairie site at Argonne National Laboratory in Lemont, Illinois. The instruments are denoted by their three digit identifier (CMS-AMB-xxx) format. The data is presented as daily NetCDF (.nc) files, each containing approximately 24 hours of observations. Files follow the naming convention of: the project (CROCUS), location (atmos), instrument name (CMS-AMB-004), data level (raw, a1), and date (year, month, day). The NetCDF format can be accessed using common scientific software such as Python using xarray, netCDF4 or ACT-DOE.

EARTH SCIENCE > ATMOSPHERE > AEROSOLS > PARTICULAT↗
DOE OSTI2022

Leaf spectra, Feb2016-April2016, PA-SLZ, PA-PNM, PA-BCI: Panama

This data package contains leaf spectra data measured on a monthly basis from February to April, 2016. Measurements were taken at the Bosque Protector San Lorenzo (SLZ), Barro Colorado Island (BCI) and Parque Natural Metropolitano (PNM) NGEE Tropics sites in Panama. Data from the BCI site are only available for March, 2016. Within the attached zip file are PDF manuals for instruments used, a guide to data collection protocol, and metadata files, including a PDF containing metadata for the 2016 ENSO gas exchange campaign. Also included is an additional zip file "2016_ENSO_BNL_Leaf_Spectra_Archive.zip" with data in .csv format organized by site. This data was collected as part of the 2016 ENSO campaign. See related datasets (existing and future) for further sample details, leaf water potential data, LMA, and gas exchange and leaf chemistry data. VERSION 2 update. The identification of a species from the PNM site has been corrected as follows: the identification of the tree initially identified as Pseudosamanea guachapele (ALBIED) has been revised to Albizia adinocephala (ALBIAD). The updated data package includes revised data, metadata and protocol documents updated to reflect this change.

54 ENVIRONMENTAL SCIENCES↗