Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data formats”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49
All sourcesNASA NTRSDOE OSTI
NASA NTRS2024

Tracking Community Building in Open Science

Open Science is enabled by a vibrant community of researchers who regularly engage with the data, from its production to its organization, curation, archiving, dissemination, analysis, and publication. This presentation will examine community building in open science. The NASA Open Science Data Repository (OSDR) makes data available to the public following the FAIR (Findability, Accessibility, Interoperability, and Reusability) principles. OSDR takes open science further with the OS Analysis Working Groups (AWGs) that facilitate community development and promotion. The primary activity of each AWG is to establish and validate analytical processes to generate higher-order data from data housed in OSDR. There are a number of these groups on various topics, including the Animal AWG, Plant AWG, Microbial AWG, Multi-Omics AWG, AI/ML AWG, and the Ames Life Sciences Data Archive (ALSDA) AWG. The international volunteers participating in these AWGs come from academia, citizen science initiatives, industry, and government. They include researchers, principal investigators, professors, trained hobbyists, and students from various domains and disciplines. Anyone may request to join the AWGs, and membership requests are vetted monthly by the group organizers before granting admission. Core to membership is demonstrated expertise through records of training, integrity, work in the professed domain(s), and good community standing. Regular virtual meetings are held for each AWG, with a varying cadence depending on the group's needs and goals. AWG communities share their expertise in research including cutting edge tools, software, frameworks, data formats, and libraries accelerating research collectively. This collaborative approach helps community members cross technology gaps and identify emerging challenges. These diverse communities encompass a wide range of individuals hailing from various sectors within the Science Mission Directorate and beyond. They serve as a means to promote and enhance transparency, accessibility, and inclusion. An annual AWG Symposium brings contributors together in person. Participation in AWGs can be synchronous or asynchronous, with some groups performing most of their work in off hours. Participants gain valuable skills and connections that allow them to add value to their communities and new organizations that they join, resulting in an expanded return on investment for the space life science community. Open science is increasingly a federal mandate and initiatives like NASA's Transform to Open Science and instruments like the Decadal Survey of Biological and Physical Sciences in Space demonstrate the need to carefully consider best practices in this domain. Here, we present greater detail about the makeup and participation metrics of the various AWGs affiliated with OSDR and details of successful peer-reviewed publication campaigns.

Christina M Johnson↗
NASA NTRS2024

High-Rate Delay Tolerant Networking (HDTN) User Guide Version 1.3.0

Delay Tolerant Networking (DTN) has been identified as a key technology to enable and facilitate the development and growth of future space networks. Classically, space communications networks are collections of disparate links that are manually managed either point-to-point or use space relays. The accelerating accessibility of space enables a new scaling of space nodes, yet both the manual management of configurations and scheduling and the lack of structure connecting links precisely prohibit scaling. This challenge gives rise to newer and larger classes of communications needs that are met by DTN, which must overcome the disconnection, disruption, latency, and mobility featured in space communications systems. DTN joins the underlying links as an overlay, and can be made to communicate over any protocol stack. The core actions of DTN are store, carry, and forward, where data are stored instead of dropped if there is no immediately available outduct. It does this by taking the DTN unit of data, bundles, and providing necessary layers to adapt these bundles to the underlying transport protocols of choice; these are called convergence layers. DTN's Bundle Protocol (BP) can then be used on top of terrestrial protocol stacks, such as TCP/IP, as well as protocols for space, such as LTP/AOS, all in the same network. For emphasis it is noted that bundles can be of essentially any size, and hence this convergence to lower layers of choice is necessary. Existing DTN implementations have operated in constrained environments with limited resources, resulting in low data speeds. However, as various technologies have advanced, data transfer rates and efficiency have advanced, which has pushed the need for a DTN implementation for ground systems and for spacecraft that is performance-oriented in order to not impose an unnecessary bottleneck. High-rate Delay Tolerant Networking (HDTN) takes advantage of modern hardware platforms to substantially reduce latency and improve throughput compared to today’s DTN operations. The HDTN implementation maintains interoperability with existing deployments of DTN that conform to IETF RFCs 4838, 5050, and 9171. At the same time, HDTN defines a new data format better suited to higher-rate operation. It defines and adopts a massively parallel pipelined and message-oriented architecture, allowing the system to scale gracefully as its resources increase. HDTN’s architecture also supports hooks to replace various processing pipeline elements with specialized hardware accelerators. This offers improved Size, Weight, and Power (SWaP) characteristics while reducing development complexity and cost.

Delay Tolerant Networking↗
NASA NTRSDate not supplied

Tracking Community Building in Open Science

Open Science is enabled by a vibrant community of researchers who regularly engage with the data, from its production to its organization, curation, archiving, dissemination, analysis, and publication. This presentation will examine community building in open science. The NASA Open Science Data Repository (OSDR) makes data available to the public following the FAIR (Findability, Accessibility, Interoperability, and Reusability) principles. OSDR takes open science further with the OS Analysis Working Groups (AWGs) that facilitate community development and promotion. The primary activity of each AWG is to establish and validate analytical processes to generate higher-order data from data housed in OSDR. There are a number of these groups on various topics, including the Animal AWG, Plant AWG, Microbial AWG, Multi-Omics AWG, AI/ML AWG, and the Ames Life Sciences Data Archive (ALSDA) AWG. The international volunteers participating in these AWGs come from academia, citizen science initiatives, industry, and government. They include researchers, principal investigators, professors, trained hobbyists, and students from various domains and disciplines. Anyone may request to join the AWGs, and membership requests are vetted monthly by the group organizers before granting admission. Core to membership is demonstrated expertise through records of training, integrity, work in the professed domain(s), and good community standing. Regular virtual meetings are held for each AWG, with a varying cadence depending on the group's needs and goals. AWG communities share their expertise in research including cutting edge tools, software, frameworks, data formats, and libraries accelerating research collectively. This collaborative approach helps community members cross technology gaps and identify emerging challenges. These diverse communities encompass a wide range of individuals hailing from various sectors within the Science Mission Directorate and beyond. They serve as a means to promote and enhance transparency, accessibility, and inclusion. An annual AWG Symposium brings contributors together in person. Participation in AWGs can be synchronous or asynchronous, with some groups performing most of their work in off hours. Participants gain valuable skills and connections that allow them to add value to their communities and new organizations that they join, resulting in an expanded return on investment for the space life science community. Open science is increasingly a federal mandate and initiatives like NASA's Transform to Open Science and instruments like the Decadal Survey of Biological and Physical Sciences in Space demonstrate the need to carefully consider best practices in this domain. Here, we present greater detail about the makeup and participation metrics of the various AWGs affiliated with OSDR and details of successful peer-reviewed publication campaigns.

Christina M Johnson↗
DOE OSTI2016

On-Orbit Ephemeris Determination with Radio Doppler Validation

Multiple CubeSats are often released from the same host spacecraft into virtually the same orbit at nearly the same time. A satellite team needs the ability to identify and track its own satellites as soon as possible. However, this can be a difficult and confusing task with a large number of satellites. Los Alamos National Laboratory encountered this issue during a launch of LANL-designed CubeSats that were released with more than 20 other objects. A simple radio Doppler method used shortly after launch by the Los Alamos team to select its satellites of interest from the list of available tracked ephemerides is described. This method can also be used for automated real time ephemeris validation. For future efforts, each LANL-designed CubeSat will automatically perform orbit determination from the position, velocity, and covariance estimates provided by an added on-board GPS receiver. This self-determined ephemeris will be automatically downlinked by ground stations for mission planning, antenna tracking, Doppler-pre-correction, etc. A simple algorithm based on established theory and well suited for embedded on-board processing is presented. The trades examined in selecting the algorithm components and data formats are briefly discussed, as is the expected performance.

Dallmann, Nicholas↗
DOE OSTI2015

Basic Matrix Library (bml), Version 0.x

The basic matrix library (bml) is a collection of various matrix data formats (in dense and sparse) and their associated algorithms for basic matrix operations.

Source record↗
DOE OSTI2016

MESHMAKER (MM) V1.5

MeshMaker v1.5 is a code that describes the system geometry and discretizes the domain in problems of flow and transport through porous and fractured media that are simulated using the TOUGH+ [Moridis and Pruess, 2014] or TOUGH2 [Pruess et al., 1999; 2012] families of codes. It is a significantly modified and drastically enhanced version of an earlier simpler facility that was embedded in the TOUGH2 codes [Pruess et al., 1999; 2012], from which it could not be separated. The code (MeshMaker.f90) is a stand-alone product written in FORTRAN 95/2003, is written according to the tenets of Object-Oriented Programming, has a modular structure and can perform a number of mesh generation and processing operations. It can generate two-dimensional radially symmetric (r,z) meshes, and one-, two-, and three-dimensional rectilinear (Cartesian) grids in (x,y,z). The code generates the file MESH, which includes all the elements and connections that describe the discretized simulation domain and conforming to the requirements of the TOUGH+ and TOUGH2 codes. Multiple-porosity processing for simulation of flow in naturally fractured reservoirs can be invoked by means of a keyword MINC, which stands for Multiple INteracting Continua. The MINC process operates on the data of the primary (porous medium) mesh as provided on disk file MESH, and generates a secondary mesh containing fracture and matrix elements with identical data formats on file MINC.

MORIDIS, GEORGE↗
DOE OSTI2016

FASTQ quality control dashboard

FQCDB builds up existing open source software, FastQC, implementing a modern web interface for across parsed output of FastQC. In addition, FQCDB is extensible as a web service to include additional plots of type line, boxplot, or heatmap, across data formatted according to guidelines. The interface is also configurable via more readable JSON format, enabling customization by non-web programmers.

Source record↗
NASA NTRS1994

An Experimental Evaluation of Data Link Textual Formats

Problems resulting from the use of verbal communications in the National Airspace System have lead to an increasing necessity for digitized air-ground communications or data link. This report describes an investigation of digitized communications through the evaluation of message length and different textual formats of clearance data. Current line pilots flew in a part-task simulation where the message length (one message with four commands vs. two messages with two commands each) and the textual format of ATC clearances were varied. Pilots also monitored a secondary task while flying. Secondary task measures and data link response times revealed no significant differences between the two formats under investigation. Message length did impact communication timing with only the first of a pair of two short messages resulting in significantly faster response times than either the second short or long message types.

McGann, Alison↗
NASA NTRS2003

Compressing Aviation Data in XML Format

Design, operations and maintenance activities in aviation involve analysis of variety of aviation data. This data is typically in disparate formats making it difficult to use with different software packages. Use of a self-describing and extensible standard called XML provides a solution to this interoperability problem. XML provides a standardized language for describing the contents of an information stream, performing the same kind of definitional role for Web content as a database schema performs for relational databases. XML data can be easily customized for display using Extensible Style Sheets (XSL). While self-describing nature of XML makes it easy to reuse, it also increases the size of data significantly. Therefore, transfemng a dataset in XML form can decrease throughput and increase data transfer time significantly. It also increases storage requirements significantly. A natural solution to the problem is to compress the data using suitable algorithm and transfer it in the compressed form. We found that XML-specific compressors such as Xmill and XMLPPM generally outperform traditional compressors. However, optimal use of Xmill requires of discovery of optimal options to use while running Xmill. This, in turn, depends on the nature of data used. Manual disc0ver.y of optimal setting can require an engineer to experiment for weeks. We have devised an XML compression advisory tool that can analyze sample data files and recommend what compression tool would work the best for this data and what are the optimal settings to be used with a XML compression tool.

Patel, Hemil↗
DOE OSTI2018

Fallon FORGE: Well 21-31 Wireline Logs

Included are the following wireline logs from the Fallon FORGE Well 21-31: Ormat_Forge 21-31_8.5 inch section: FMI data in PDF and DLIS formats; MSCT data in PDF format; Pressure and Temperature data in PDF, LAS, and DLIS formats; Sonic Scanner data in PDF, DLIS, and LAS formats (LAS format contains Stoneley Slowness, Shear Slowness, and Compressional Slowness logs); Triple Combo in PDF, DLIS, and LAS formats; and USIT data in DLIS and PDF formats. Ormat_Forge_21-31_12.25 inch section: Resistivity data in PDF and LAS formats; Sonic Scanner data in PDF, DLIS, and LAS formats (LAS format contains Stoneley Slowness, Shear Slowness, and Compressional Slowness logs); Triple Combo in PDF and LAS formats; and Caliper data in PDF format (DLIS format for caliper data is included in the Sonic Scanner DLIS).

15 GEOTHERMAL ENERGY↗
NASA NTRS2010

Development of an e-VLBI Data Transport Software Suite with VDIF

We have developed a software library (KVTP-lib) for VLBI data transmission over the network with the VDIF (VLBI Data Interchange Format), which is the newly proposed standard VLBI data format designed for electronic data transfer over the network. The software package keeps the application layer (VDIF frame) and the transmission layer separate, so that each layer can be developed efficiently. The real-time VLBI data transmission tool sudp-send is an application tool based on the KVTP-lib library. sudp-send captures the VLBI data stream from the VSI-H interface with the K5/VSI PC-board and writes the data to file in standard Linux file format or transmits it to the network using the simple- UDP (SUDP) protocol. Another tool, sudp-recv , receives the data stream from the network and writes the data to file in a specific VLBI format (K5/VSSP, VDIF, or Mark 5B). This software system has been implemented on the Wettzell Tsukuba baseline; evaluation before operational employment is under way.

Sekido, Mamoru↗
DOE OSTI2014

Performance Refactoring of Instrumentation, Measurement, and Analysis Technologies for Petascale Computing. The PRIMA Project

The growing number of cores provided by today’s high-­end computing systems present substantial challenges to application developers in their pursuit of parallel efficiency. To find the most effective optimization strategy, application developers need insight into the runtime behavior of their code. The University of Oregon (UO) and the Juelich Supercomputing Centre of Forschungszentrum Juelich (FZJ) develop the performance analysis tools TAU and Scalasca, respectively, which allow high-­performance computing (HPC) users to collect and analyze relevant performance data – even at very large scales. TAU and Scalasca are considered among the most advanced parallel performance systems available, and are used extensively across HPC centers in the U.S., Germany, and around the world. The TAU and Scalasca groups share a heritage of parallel performance tool research and partnership throughout the past fifteen years. Indeed, the close interactions of the two groups resulted in a cross-­fertilization of tool ideas and technologies that pushed TAU and Scalasca to what they are today. It also produced two performance systems with an increasing degree of functional overlap. While each tool has its specific analysis focus, the tools were implementing measurement infrastructures that were substantially similar. Because each tool provides complementary performance analysis, sharing of measurement results is valuable to provide the user with more facets to understand performance behavior. However, each measurement system was producing performance data in different formats, requiring data interoperability tools to be created. A common measurement and instrumentation system was needed to more closely integrate TAU and Scalasca and to avoid the duplication of development and maintenance effort. The PRIMA (Performance Refactoring of Instrumentation, Measurement, and Analysis) project was proposed over three years ago as a joint international effort between UO and FZJ to accomplish these objectives: (1) refactor TAU and Scalasca performance system components for core code sharing and (2) integrate TAU and Scalasca functionality through data interfaces, formats, and utilities. As presented in this report, the project has completed these goals. In addition to shared technical advances, the groups have worked to engage with users through application performance engineering and tools training. In this regard, the project benefits from the close interactions the teams have with national laboratories in the United States and Germany. We have also sought to enhance our interactions through joint tutorials and outreach. UO has become a member of the Virtual Institute of High-­Productivity Supercomputing (VI-­HPS) established by the Helmholtz Association of German Research Centres as a center of excellence, focusing on HPC tools for diagnosing programming errors and optimizing performance. UO and FZJ have conducted several VI-­HPS training activities together within the past three years.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2000

Ocean Data from MODIS at the NASA Goddard DAAC

Terra satellite carrying the Moderate Resolution Imaging Spectroradiometer (MODIS) was successfully launched on December 18, 1999. Some of the 36 different wavelengths that MODIS samples have never before been measured from space. New ocean data products, which have not been derived on a global scale before, are made available for research to the scientific community. For example, MODIS uses a new split window in the four-micron region for the better measurement of Sea Surface Temperature (SST), and provides the unprecedented ability (683 nm band) to measure chlorophyll fluorescence. At full ocean production, more than a thousand different ocean products in three major categories (ocean color, sea surface temperature, and ocean primary production) are archived at the NASA Goddard Earth Sciences (GES) Distributed Active Archive Center (DAAC) at the rate of approx. 230GB/day. The challenge is to distribute such large volumes of data to the ocean community. It is achieved through a combination of public and restricted EOS Data Gateways, the GES DAAC Search and Order WWW interface, and an FTP site that contains samples of MODIS data. A new Search and Order WWW interface at http://acdisx.gsfc.nasa.gov/data/ developed at the GES DAAC is based on a hierarchical organization of data, will always return non-zero results. It has a very convenient geographical representation of five-minute data granule coverage for each day MODIS Data Support Team (MDST) continues the tradition of quality support at the GES DAAC for the ocean color data from the Coastal Zone Color Scanner (CZCS) and the Sea Viewing Wide Field-of-View Sensor (SeaWiFS) by providing expert assistance to users in accessing data products, information on visualization tools, documentation for data products and formats (Hierarchical Data Format-Earth Observing System (HDF-EOS)), information on the scientific content of products and metadata. Visit the MDST website at http://daac.gsfc.nasa.gov/CAMPAIGN DOCS/MODIS/index.html

Leptoukh, Gregory G.↗
DOE OSTI2021

Columnar data analysis with ATLAS analysis formats

Future analysis of ATLAS data will involve new small-sized analysis formats to cope with the increased storage needs. The smallest of these, named DAOD_PHYSLITE, has calibrations already applied to allow fast downstream analysis and avoid the need for further analysis-specific intermediate formats. This allows for application of the "columnar analysis" paradigm where operations are applied on a per-array instead of a per-event basis. We will present methods to read the data into memory, using Uproot, and also discuss I/O aspects of columnar data and alternatives to the ROOT data format. Furthermore, we will show a representation of the event data model using the Awkward Array package and present proof of concept for a simple analysis application.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2002

Software for Processing Flight and Simulated Data of the ATIC Experiment

ATIC (Advanced Thin Ionization Calorimeter) is a balloon borne experiment designed to measure the cosmic ray composition for elements from hydrogen to iron and their energy spectra from approx.50 GeV to near 100 TeV. It consists of a Si-matrix detector to determine the charge of a CR particle, a scintillator hodoscope for tracking, carbon interaction targets and a fully active BGO calorimeter. ATIC had its first flight from McMurdo, Antarctica from 28/12/2000 to 13/01/2001. The ATIC flight collected approximately 25 million events. A C++-class library for building different programs for processing flight and simulated data of the ATIC balloon experiment is described. This library is compatible with the ROOT-system and includes classes and methods for solving a number of problems as the following: Reading data files in different formats (raw-data format, ROOT-format, ASCII-format, different formats for simulated data); Transferring all these formats to the only inner format of the library; Reconstruction of trajectories of primary particles with BGO calorimeter only. The Monte-Carlo simulations with GEANT code were used to obtain the basic tables for computing error corridors and chi(sup 2)-values for the trajectories. Obtaining error corridors for searching for signal of primary particle in the Si-matrix; Searching for hit of primary particle in the Si-matrix with using of error corridor and other criteria (chi(sup 2)-values, agreement between signals in Si-matrix and in the upper layer of scintillator and others); Determination of charge of primary particle; Determination of energy deposit in BGO calorimeter.

Panov, A. D.↗
DOE OSTI2022

Simulated CO 2 storage efficiency factors for saline formations of various lithologies and depositional environments using new experimental relative permeability data

Saline formations are attractive geologic reservoirs for permanent carbon dioxide (CO 2 ) storage. Here, the U.S. Department of Energy's National Energy Technology Laboratory (DOE-NETL) has worked to develop and refine methods and tools for the calculation of CO 2 storage potential in subsurface reservoirs. DOE-NETL's CO 2 -SCREEN provides an online tool for executing these storage methods. CO 2 storage efficiency terms are input parameters in DOE-NETL's methods and equations embedded in the CO 2 -SCREEN, which assesses pore space available for CO 2 storage. In this work, a modeling workflow was initiated to refine two CO 2 storage efficiency terms - volumetric displacement (E V ) and microscopic displacement (E d ). The models are based on new experimental relative permeability data that are specific to homogenous lithology and depositional environments of key subsurface saline formations targeted for CO 2 storage. In future work, heterogenous features will be added to this initial modeling effort to update efficiency factors as described in DOE-NETL's methods and CO 2 -SCREEN tool. E V accounts for the volume utilized in the reservoir under the areal plume, while E d accounts for saturation values in the plume to assess efficiency of CO 2 storage at the pore scale. The results of this work are significant in that prior values were based on a limited geologically non-specific relative permeability data set that were collected prior to 2009. Specifically, we applied numerical simulations using TOUGH3 models to update CO 2 storage efficiency values for supercritical CO 2 injection into brine-saturated reservoirs for three lithologies (clastics, limestone, dolomite) and six depositional environments (Marginal Marine, Strand Plain, Deltaic Complex Fluvial, Aeolian, Shallow Marine, and Reef) that have a high potential for geologic CO 2 storage. Experimental relative permeability data in cores from these environments were utilized in the models with corresponding rock type/sedimentary environment. Results of this study showed that dolomite followed by limestone generated higher ranges of storage efficiency compared to clastics. The updated values provided a tighter efficiency range for clastics, lower P 10 but higher P 90 range for limestone, and higher P 10 and P 90 for dolomite. In general, tighter reservoirs with relatively low permeability and porosity were associated with higher E V and E d , showing efficient reservoir and pore utilization in these scenarios. High reservoir pressure and temperature associated with increasing depth increased the E V , and high CO 2 injection rates resulted in increases in E V and E d , while the impact of permeability anisotropy was minimal after the 30-year injection period.

03 NATURAL GAS↗