Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data sharing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2014

Multilateral Biomedical Data Sharing in the One-year Joint US-Russian Mission on the International Space Station

The One Year Mission (1YM) by two astronauts on the International Space Station (ISS), starting in March 2015, offers a unique opportunity to expand multilateral collaboration by sharing data and resources among the partner agencies in preparation for planned space exploration missions beyond low Earth orbit. Agreements and protocols will be established for the collection, distribution, analysis and reporting of both research and clinical data. Data will be shared between the agencies sponsoring the investigators, and between the research and clinical medicine communities where common interests are identified. The assignment of only two astronauts, one Russian and the other American, to the 1YM necessitated creativity in bilateral efforts to maximize the biomedical return from the opportunity. Addition of Canadian, European and Japanese investigations make the effort even more integrative. There will be three types of investigations: joint, cross‐participation and data‐exchange. The joint investigations have US and Russian coprincipal investigators, and the data acquired will be their common responsibility. The other two types must develop data sharing agreements and processes specific to their needs. A multilateral panel of ISS partner space agencies will develop policies for international exchange of scientific information to meet their science objectives and priorities. They will promote archiving of space flight data and will inform each other and the scientific community at large about the results obtained from space life sciences studies. Integration tasks for the 1YM are based on current experience from the ISS and previous efforts on the Russian space station Mir. Closer coordination between international partners requires more common approaches to remove barriers to multilateral resource utilization on the ISS. Greater integration in implementation should increase utilization efficiency to benefit all participants in spaceflight human research. This presentation will describe the overarching principles for multilateral data collection, analysis and sharing and for data security for medical and research data shared between ISS partners prior to release in public forums.

Charles, John B.↗
NASA NTRS1981

Panel D report: Standards needed to interconnect ADS pilots for data sharing in data formats and descriptions

Data exchange specifications and standards needed to facilitate the interchange of information between three pilot modes in an Applications Data Service program are addressed. In designing standards, the following considerations were considered important: (1) accessible, understandable Data Base Management Systems (DBMS) catalogs, (2) formatting conventions, (3) archival data records and data descriptions formats, (4) standardized terminology, and (5) optimization of data formats by individual DBMS.

Source record↗
DOE OSTI2021

Efforts and Innovations to Promote Data Sharing and Data Accessibility in the EGS Collab Experiments

Large-scale scientific research programs such as the EGS Collab experiments and the FORGE program play extremely important roles in advancing geothermal technologies. Such efforts involve a large number of researchers from multiple institutions, last multiple years, and generate large, complex datasets. The value of the research efforts is only realized when the datasets are used by a large community of researchers in the decades to come. A challenge is that due to the complexity of the data, it could require a user to devote a serious effort into understanding the data before the data can be effectively utilized. In the EGS Collab experiments, the team has devoted remarkable efforts and developed many innovative solutions to make the data more accessible to broader team members and future users. This paper documents the experience gained and lessons learned by the EGS Collab team in disseminating the data in the most informative and inspiring forms to maximize the value of this precious dataset. "Accessibility"in the title does not only mean making the raw data available for download. Particularly, we want to emphasize the importance of organizing, annotating, and presenting the data in ways to make it easy to digest by prospective consumers of the data.

circulation↗
DOE OSTI2021

Deliverable D11 – Data Sharing, Storage, Security Protocols, and a Specification of a Potential Data Sharing Portal

Pacific Northwest National Laboratory (PNNL) and Technical University of Denmark (DTU) completed this deliverable as part of Work Package 2: Data Information Catalog for Distributed Wind Research for the International Energy Agency (IEA) Wind Technology Collaboration Programme Task 41: Enabling Wind to Contribute to a Distributed Energy Future. As part of the work plan, Deliverable D11 requires the development of data sharing, storage, and security protocols for metadata to be stored on the platform, if needed. The specification of a potential data sharing portal that expands on the catalog is also required.

17 WIND ENERGY↗
DOE OSTI2016

Parallel checksumming of data chunks of a shared data object using a log-structured file system

Checksum values are generated and used to verify the data integrity. A client executing in a parallel computing system stores a data chunk to a shared data object on a storage node in the parallel computing system. The client determines a checksum value for the data chunk; and provides the checksum value with the data chunk to the storage node that stores the shared object. The data chunk can be stored on the storage node with the corresponding checksum value as part of the shared object. The storage node may be part of a Parallel Log-Structured File System (PLFS), and the client may comprise, for example, a Log-Structured File System client on a compute node or burst buffer. The checksum value can be evaluated when the data chunk is read from the storage node to verify the integrity of the data that is read.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1994

The Dash Data Sharing System

The Data Sharing system (DASH) project was recently undertaken at NASA Johnson Space Center to introduce distributed data sharing into the Mission Control Center (MCC). Although the project focused on MCC communications, the solution is a general one. This paper describes that project. DASH allows applications to share data. It provides callable interfaces for applications wishing to export or import data. The system consists of several processes: publishers make exported data available to subscribers, which provide it to interested importing applications. A network registration service provides network location transparency, allowing the other processes to reside at arbitrary network locations. These processes act as intermediaries between external producing and consuming applications. DASH has been demonstrated in the MCC where it transmits Shuttle electrical bus data from the Bus Loss Smart System to the Configurable Realtime Analysis System. In addition, the Failure Impact and Procedure Analysis system used DASH to transmit Shuttle remote manipulator data from an expert system to a version of CRANS. DASH is currently being used to integrate a knowledge acquisition application and the CLIPS expert system shell.

Hasan, David A.↗
DOE OSTI2020

Livewire Data Platform - A Solution for Energy Efficient Mobility Systems (EEMS) Data Sharing

The Livewire Data Platform is a data storage and exchange platform. It provides: a platform, allowing data sharing and discovery by linking disparate data sources to a single website via application programming interfaces (APIs); a community, building partnerships and collaboration rather than competition; a system, allowing shared data to increase in size and complexity as EEMS evolves.

47 OTHER INSTRUMENTATION↗
DOE OSTI2016

Parallel compression of data chunks of a shared data object using a log-structured file system

Techniques are provided for parallel compression of data chunks being written to a shared object. A client executing on a compute node or a burst buffer node in a parallel computing system stores a data chunk generated by the parallel computing system to a shared data object on a storage node by compressing the data chunk; and providing the data compressed data chunk to the storage node that stores the shared object. The client and storage node may employ Log-Structured File techniques. The compressed data chunk can be de-compressed by the client when the data chunk is read. A storage node stores a data chunk as part of a shared object by receiving a compressed version of the data chunk from a compute node; and storing the compressed version of the data chunk to the shared data object on the storage node.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2011

Data Standards for Omics Data: the Basis of Data Sharing and Reuse.

To facilitate sharing of Omics data, many groups of scientists have been working to establish the relevant data standards. The main components of data sharing standards are experiment description standards, data exchange standards, terminology standards, and experiment execution standards. Here we provide a survey of existing and emerging standards that are intended to assist the free and open exchange of large-format data.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2018

Light-weight cache coherence for data processors with limited data sharing

A data processing system includes a plurality of processors, local memories associated with a corresponding processor, and at least one inter-processor link. In response to a first processor performing a load or store operation on an address of a corresponding local memory that is not currently in the local cache, a local cache allocates a first cache line and encodes a local state with the first cache line. In response to a load operation from an address of a remote memory that is not currently in the local cache, the local cache allocates a second cache line and encodes a remote state with the second cache line. The first processor performs subsequent loads and stores on the first cache line in the local cache in response to the local state, and subsequent loads from the second cache line in the local cache in response to the remote state.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

NARUC grid data sharing playbook

In 2022, the National Association of Regulatory Utility Commissioners (NARUC) launched an initiative to support its members in addressing issues related to grid data sharing. The Grid Data Sharing Collaborative was funded by the DOE’s Office of Electricity and Office of Cybersecurity, Energy Security, and Emergency Response (CESER). NARUC invited programmatic, policy, technical, and cybersecurity subject matter experts from public utility commissions, utilities, non-governmental organizations, energy service companies, and DOE to join the two-year Grid Data Sharing Collaborative to help develop a flexible framework for states to use as a starting point when navigating complex decision-making inherent in grid data sharing. The framework took shape through a series of intensive workshops during which Collaborative participants explored illustrative use cases to identify data needs, articulate the benefits and risks of sharing such data, and assess the trade-offs. Along the way, participants offered suggestions for how the framework could be used in practice. The purpose of this playbook is to describe the elements of the Grid Data Sharing Framework and to begin supporting its implementation.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2018

Data Sharing and Scientific Impact in Eddy Covariance Research

Do the benefits of data sharing outweigh its perceived costs? This is a critical question, and one with the potential to change culture and behavior. Dai et al. (2018) examine how data sharing is related to scientific impact in the field of eddy covariance (EC), and find that data sharers are disproportionately high-impact researchers, and vice versa; they also note strong regional differences in EC data sharing norms. The current policies and restrictions of EC journals and repositories are highly uneven. Incentivizing data sharing and enhancing computational reproducibility are critical next steps for EC, ecology, and science more broadly.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2019

Livewire Data Platform - A Solution for EEMS Data Sharing

To bring about fundamental changes in our transportation system, data sharing must be endemic. The Livewire Data Platform is a user-friendly, searchable platform allowing easy and secure data sharing and discovery for DOE's Energy Efficient Mobility Systems (EEMS) researchers. The platform was funded by the DOE Vehicle Technologies Office (VTO) to enable a research community that builds partnerships and collaboration around data in order to find answers to today's biggest mobility challenges.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2023

The Importance of Sharing Data in Systems Biology

Systems biology research spans a range of biological scales and science domains, and often requires a collaborative effort to collect and share data so that integration is possible. However, sharing data effectively is a challenging task that requires effort and alignment between collaborative partners, as well as coordination between organizations, repositories, and journals. As a community of systems biology researchers, we must get better at efficiently sharing data, and ensuring that shared data comes with the recognition and citations it deserves.

Wood-Charlson, Elisha M. (ORCID:0000000195577715)↗
DOE OSTI2017

AMRZone: A Runtime AMR Data Sharing Framework For Scientific Applications

Frameworks that facilitate runtime data sharing across multiple applications are of great importance for scientific data analytics. Although existing frameworks work well over uniform mesh data, they can not effectively handle adaptive mesh refinement (AMR) data. Among the challenges to construct an AMR-capable framework include: (1) designing an architecture that facilitates online AMR data management; (2) achieving a load-balanced AMR data distribution for the data staging space at runtime; and (3) building an effective online index to support the unique spatial data retrieval requirements for AMR data. Towards addressing these challenges to support runtime AMR data sharing across scientific applications, we present the AMRZone framework. Experiments over real-world AMR datasets demonstrate AMRZone's effectiveness at achieving a balanced workload distribution, reading/writing large-scale datasets with thousands of parallel processes, and satisfying queries with spatial constraints. Moreover, AMRZone's performance and scalability are even comparable with existing state-of-the-art work when tested over uniform mesh data with up to 16384 cores; in the best case, our framework achieves a 46% performance improvement.

Zhang, Wenzhao↗
NASA NTRSDate not supplied

Data Sharing in Radiobiology; Towards FAIR

The value of scientific data depends on their findability, accessibility, integrability and reusability according to the FAIR principles. Together with the sustainability of data preservation and access, these principles underpin the long term benefits of scientific research. Within the domain of radiobiology we have a huge array of data types, themes and complexities which make standardisation of metadata, data structure and data integration very challenging. Moreover, it is clear that, for example, in the area of disaster preparedness, the ready discovery and availability of multiple types of data, for example on biological effects of exposure, climatology, ecology, human behavioural and attitudinal studies, is important for an integrated scientific approach. Because these data are spread over many databases, journal supplementary information resources and even the computers of the investigators, their discovery and reuse can be challenging. Despite exhortations from funding agencies and scientific institutions over the past two decades there is still a serious deficit in the willingness and in some cases the ability of investigators to share data, and although much may not be formally „Public domain“, information about the existence of the data, their metadata, and how to obtain them should always be available. We report the progress of work on three databases, the STORE and the NASA GeneLab and LSDA repositories to leverage the Radiation Biology Ontology (RBO), a structured terminology for metadata that can be used by all radiation biology-relevant databases to unite federated and automated data searches across multiple databases, for example using web services, and through semantic web technologies supporting data discovery. The initial primary use-cases for RBO were archiving data in the STORE database (https://www.storedb.org/), the repository used for the RadoNorm and Pianoforte Projects among others, and in the NASA Open Science Data Repository (https://osdr.nasa.gov/bio). The scope of radiobiology research ranges from basic physics to radiation oncology to sociolegal studies; no existing ontology had the necessary breadth or depth to fulfill this need. In addition, a formal ontology has the advantage of being usable for machine learning and, importantly, for tasks like data integration, knowledge extraction from the scientific literature and for query extension and data classification. Standardisation of metadata is one of the primary objectives of the FAIR principles for open data; RBO is an important landmark for FAIR-compliant radiation biology data sharing. The RBO is developed using the open-source tools of GitHub and the OBO Foundry-led Ontology Development Kit, and published through GitHub and the NIH/NCBI BioPortal website. This initial phase of concept modeling has yielded an ontology that has more than 300 declared concepts, with more than 3500 additional concepts imported from other OBO Foundry ontologies with relevance to radiation biology (for example, concepts from the ISO standard Basic Formal Ontology, the Environment Ontology and the Gene Ontology). We welcome input into the development of RBO and encourage its adoption.

ontologies↗