Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data sharing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

Interlinked tuples in coordination namespace

A system and method for supporting tuple record interlinking in one or more tuple space/coordinated namespace (CNS) extended memory storage systems. A system-wide CNS provides for efficient storing and communicating of data generated by local processes running at the nodes, and coordinated to generate a union/intersection of multiple CNS where tuple records are interlinked in multiple CNS hashtables, and/or share tuple data between two sets of processes that are part of different CNSs. Local node processes further generate multi-key tuples where two or more tuple records are interlinked within the same CNS hash table, thereby permitting a look up of the tuple data by either tuple name/keys. A CNS controller further provides a tuple iterator for a key-value storage in a CNS system that adds more links between tuples enables creation of iterator structures such as linked list or trees etc. of “different” tuples in a tuple database.

Jacob, Philip↗

Thread Migration in the Presence of Pointers

Dynamic migration of lightweight threads supports both data locality and load balancing. However, migrating threads that contain pointers referencing data in both the stack and heap remains an open problem. In this paper we describe a technique by which threads with pointers referencing both stack and non-shared heap data can be migrated such that the pointers remain valid after migration. As a result, threads containing pointers can now be migrated between processors in a homogeneous distributed memory environment.

Cronk, David↗

NASA’s Simulation Activities for Evaluating UAM Concept of Operations

NASA’s vision for Advanced Air Mobility (AAM) is to help emerging aviation markets to safely develop an air transportation system that moves people and cargo between places previously not served or underserved by aviation using revolutionary new aircraft types. Urban Air Mobility (UAM), the concept of expanding transportation networks by serving short flights to transport people and goods around metropolitan areas, is part of a larger paradigm shift toward AAM, in which new technologies and business models are enabling transformational applications of aviation. In NASA’s Concept of Operations for UAM, Providers of Services for UAM (PSU) play a key role to enable safe and efficient UAM operations by sharing operational data among UAM operators. PSUs provide a pre-departure strategic conflict management service that establishes operational plans for new flights and coordinates them with all relevant operations in shared airspace. The strategic conflict management aims to minimize the need for tactical separation provision, while considering anticipated traffic demand, vertiport capacity and availability, forecasted weather, and airspace restrictions. NASA is currently preparing a new lab evaluation activity with aviation industry partners, called the X4 simulation, to demonstrate their airspace services and capabilities and test new information exchange requirements for UAM operations. This simulation activity will support NASA’s National Campaign (NC) flight tests which are planned over the next several years to guide the collective community and stakeholders through a series of scenario-based test activities that involve vehicles and airspace management services operating in a live test environment. This presentation will provide an overview of the X4 simulation, including objectives, scenarios, assumptions, system architecture, and test schedule. The X4 simulation will evaluate the interconnectivity and operational intent sharing between PSUs for multiple operators, as well as the performance of strategic conflict management.

Urban Air Mobility, Simulation, Advanced Air Mobil↗

Next generation experimental data access at NSLS-II

The NSLS-II network and computing infrastructure has been significantly updated recently. The re-IP process in 2020-2021 enabled the NSLS-II network to be routable to the rest of the BNL campus. Then, standardization of the operating systems and deployment procedures helped to deliver a consistent environment to workstations and servers used by all NSLS-II beamlines. In particular, the RedHat Enterprise Linux 8 was deployed to 700+ machines using the RedHat Satellite infrastructure management product, and all critical services (IOCs, databases, etc.) were migrated to the new OS. NFS users’ home directories are consistent across all of the machines, which eliminates the need for the individual configuration of the user environment on each host. The standard suite of software packages is available to the beamline staff and users, which includes the system packages (deployed via RPM) as well as the conda environments for data acquisition and analysis. Security measures were implemented to comply with the industry standards, which include multi-factor authentication (using Duo), secure screen lock for the beamline machines, and advanced access control to the experimental data that is stored in shared central storage available on all hosts. These major enhancements facilitated sharing the experimental data (currently for a number of selected beamlines, with a plan to extend it to the whole facility in the nearest future) with the users via an externally facing JupyterHub instance. The beamlines keep using the Bluesky data acquisition framework to orchestrate their experiments, and the new infrastructure enabled them to use a next-generation data access library called tiled.

36 MATERIALS SCIENCE↗

FAIR AI models in high energy physics

Abstract The findable, accessible, interoperable, and reusable (FAIR) data principles provide a framework for examining, evaluating, and improving how data is shared to facilitate scientific discovery. Generalizing these principles to research software and other digital products is an active area of research. Machine learning models—algorithms that have been trained on data without being explicitly programmed—and more generally, artificial intelligence (AI) models, are an important target for this because of the ever-increasing pace with which AI is transforming scientific domains, such as experimental high energy physics (HEP). In this paper, we propose a practical definition of FAIR principles for AI models in HEP and describe a template for the application of these principles. We demonstrate the template’s use with an example AI model applied to HEP, in which a graph neural network is used to identify Higgs bosons decaying to two bottom quarks. We report on the robustness of this FAIR AI model, its portability across hardware architectures and software frameworks, and its interpretability.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

SharP: Towards Programming Extreme-Scale Systems with Hierarchical Heterogeneous Memory

The pre-exascale systems are expected to have a significant amount of hierarchical and heterogeneous on-node memory, and this trend of system architecture in extreme-scale systems is expected to continue into the exascale era. Along with hierarchical-heterogeneous memory, the system typically has a high-performing network and a compute accelerator. This system architecture is not only effective for running traditional High Performance Computing (HPC) applications (Big-Compute), but also running data-intensive HPC applications and Big-Data applications. As a consequence, there is a growing desire to have a single system serve the needs of both Big-Compute and Big-Data applications. Though the system architecture supports the convergence of the Big-Compute and Big-Data, the programming models have yet to evolve to support either hierarchical-heterogeneous memory systems or the convergence. In this work, we propose and develop the programming abstraction called SHARed data-structure centric Programming abstraction (SharP) to address both of these goals, i.e., provide (1) a simple, usable, and portable abstraction for hierarchical-heterogeneous memory and (2) a unified programming abstraction for Big-Compute and Big-Data applications. To evaluate SharP, we implement a Stencil benchmark using SharP, port QMCPack, a petascale-capable application, and adapt Memcached ecosystem, a popular Big-Data framework, to use SharP, and quantify the performance and productivity advantages. Additionally, we demonstrate the simplicity of using SharP on different memories including DRAM, High-bandwidth Memory (HBM), and non-volatile random access memory (NVRAM).

97 MATHEMATICS AND COMPUTING↗

Extending the Blockchain: Ensuring Transactional Integrity in Relational Data via Blockchain Technology

The idea of combining a relational database with concepts associated with blockchain technology is being examined. The use case outlined herein concurrently utilizes relational and blockchain data structures to facilitate the sharing of complex data among untrusted users without the participation of a trusted third party. By capturing the transactions that result in data being stored in a relational database and placing those transactions in a blockchain structure, users can be assured that the information has not been created, altered, or destroyed without the knowledge of all users of the data. Capturing relational database transactions via a blockchain structure presents several challenges. Among them are increased storage capacity requirements, transaction ordering prior to placement on the blockchain within a multiuser database, use of existing or creation of new consensus mechanisms, and timely data verification. Addressing these challenges, although not unsurmountable, will introduce trade-offs (e.g., increased system sizing, slower transaction execution) that might or might not be acceptable based upon the envisioned use. If these trade-offs are acceptable, then this concept of extending the blockchain is a powerful method to provide both applications and their users immutable, trusted, well-defined, and consistent data.

Ray, Brian↗

Using Open Data to Characterize Building Stock Trends for Energy and Equity Evaluation

This project provides a methodology for retrieving data from both existing public data and municipal open data sets to characterize changes in the building stock, socioeconomic, demographic, and climate indicators at a neighborhood scale. This methodology forms the basis for a geospatial dashboard to analyze and share the data. The developed methodology may be used to collect data for further energy equity analyses. Additional data sets, such as from other municipalities, may be incorporated in the future to expand the extents of the possible analysis.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

An Apparatus for Monitoring the Health of Electrical Cables

As with most elements of infrastructure, electrical wiring is innocuous; usually hidden away and unnoticed until it fails. Failure of infrastructure, however, sometimes leads to serious health and safety hazards. Electrical wiring fails when the polymeric (usually rubber) insulation material that sheathes the conductor gets embrittled with age from exposure to pressure, temperature or radiation cycling or when the insulation gets removed by the chafing of wires against each other. Miles of such wiring can be found in typical aircraft, with significant lengths of the wiring immersed in aviation fuel - a recipe for an explosion if a spark were to occur. Diagnosing the health of wiring is thus an important aspect of monitoring the health of aging aircraft. Stress wave propagation through wiring affords a quick and non-invasive method for health monitoring. The extent to which a stress wave propagating through the cable core gets attenuated depends on the condition of the surrounding insulation. When the insulation is in good condition - supple and pliable, there is more damping or attenuation of the waveform. As the insulation gets embrittled and cracked, the attenuation is likely to reduce and the waveform of the propagating stress wave is likely to change. The monitoring of these changes provides a potential tool to evaluate wiring or cabling in service that is not accessible for visual inspection. This experiment has been designed for use in an introductory mechanical or materials engineering instrumentation lab. Initial setup (after procuring all the materials) should take the lab instructor about 4 hours. A single measurement can be initiated and saved to disk in less than 3 minutes, allowing for all the students in a typical lab section to take their own data rather than share a single set of data for the entire class.

Pai, Devdas M.↗

Defining the Core Archive Data Standards of the International Planetary Data Alliance (IPDA)

A goal of the International Planetary Data Alliance (lPDA) is to develop a set of archive data standards that enable the sharing of scientific data across international agencies and missions. To help achieve this goal, the IPDA steering committee initiated a six month proj ect to write requirements for and draft an information model based on the Planetary Data System (PDS) archive data standards. The project had a special emphasis on data formats. A set of use case scenarios were first developed from which a set of requirements were derived for the IPDA archive data standards. The special emphasis on data formats was addressed by identifying data formats that have been used by PDS nodes and other agencies in the creation of successful data sets for the Planetary Data System (PDS). The dependency of the IPDA information model on the PDS archive standards required the compilation of a formal specification of the archive standards currently in use by the PDS. An ontology modelling tool was chosen to capture the information model from various sources including the Planetary Science Data Dictionary [I] and the PDS Standards Reference [2]. Exports of the modelling information from the tool database were used to produce the information model document using an object-oriented notation for presenting the model. The tool exports can also be used for software development and are directly accessible by semantic web applications.

ontology↗

Evolution of International Space Station Program Safety Review Processes and Tools

The International Space Station Program at NASA is constantly seeking to improve the processes and systems that support safe space operations. To that end, the ISS Program decided to upgrade their Safety and Hazard data systems with 3 goals: make safety and hazard data more accessible; better support the interconnection of different types of safety data; and increase the efficiency (and compliance) of safety-related processes. These goals are accomplished by moving data into a web-based structured data system that includes strong process support and supports integration with other information systems. Along with the data systems, ISS is evolving its submission requirements and safety process requirements to support the improved model. In contrast to existing operations (where paper processes and electronic file repositories are used for safety data management) the web-based solution provides the program with dramatically faster access to records, the ability to search for and reference specific data within records, reduced workload for hazard updates and approval, and process support including digital signatures and controlled record workflow. In addition, integration with other key data systems provides assistance with assessments of flight readiness, more efficient review and approval of operational controls and better tracking of international safety certifications. This approach will also provide new opportunities to streamline the sharing of data with ISS international partners while maintaining compliance with applicable laws and respecting restrictions on proprietary data. One goal of this paper is to outline the approach taken by the ISS Progrm to determine requirements for the new system and to devise a practical and efficient implementation strategy. From conception through implementation, ISS and NASA partners utilized a user-centered software development approach focused on user research and iterative design methods. The user-centered approach used on the new ISS hazard system utilized focused user research and iterative design methods employed by the Human Computer Interaction Group at NASA Ames Research Center. Particularly, the approach emphasized the reduction of workload associated with document and data management activities so more resources can be allocated to the operational use of data in problem solving, safety analysis, and recurrence control. The methods and techniques used to understand existing processes and systems, to recognize opportunities for improvement, and to design and review improvements are described with the intent that similar techniques can be employed elsewhere in safety operations. A second goal of this paper is to provide and overview of the web-based data system implemented by ISS. The software selected for the ISS hazard systemMission Assurance System (MAS)is a NASA-customized vairant of the open source software project Bugzilla. The origin and history of MAS as a NASA software project and the rationale for (and advantages of) using open-source software are documented elsewhere (Green, et al., 2009).

Ratterman, Christian D.↗

SharP Unified Memory Allocator: An Intent-Based Memory Allocator for Extreme-Scale Systems

The pre-exascale systems will soon be deployed with a deep, complex memory hierarchy composed of many heterogeneous memories. This presents multiple challenges for users including: how to allocate data objects with locality between memories and devices for the various memories in these systems, which includes DRAM, High-bandwidth Memory (HBM), and non-volatile random access memory (NVRAM), and how to perform these allocations while providing portability for their application. Currently, the user can make use of multiple, disjoint libraries to allocate data objects on these memories. However, it is difficult to obtain locality between memories and devices when using libraries that are unaware of each other. This paper presents the Unified Memory Allocator (UMA) of the SHARed data-structure centric Programming abstraction (SharP) library, which provides a unified interface for memory allocations across DRAM, HBM, and NVRAM and is extensible to support future memory types. In addition, the SharP UMA allows for portability between systems by supporting both explicit and implicit, intent-based memory allocations. To demonstrate the ease of use of the SharP UMA, we have extended both Open MPIand OpenSHMEM-Xto support SharP. We validate this work by evaluating the performance implications and intent-based approach with synthetic benchmarks as well as adaptations of the Graph500 benchmark.

Aderholdt, William↗

2.3.3.404 - National Lab and University Collaboration for MHK Instrumentation and Data Processing Tools

Field and laboratory validation, testing, demonstration, and operation are critical steps for increasing the technology readiness level of marine energy (ME) converters because they provide high-quality testing and performance data that are critical information used to feed all aspects of technology development. This project, in partnership with industry, enables the marine and hydrokinetic energy (MHK) community to reliably and efficiently collect, process, manage, and share quality data by facilitating access to and development of instrumentation, guidelines and data processing/QA tools. Under this project, open-source data processing code (MHKiT) and tools (ME Data Pipeline, MRE Code Hub, PRIMRE Code Catalog), instrumentation (loads measurements), data acquisition systems (miniDAQ), and measurement guidance tools (Telesto, high EMI guidance) were developed to facilitate the collection and processing of quality laboratory and field data. Overall, this project is intended to improve the quality of the data collected during laboratory and field demonstration projects by standardizing the collection and processing techniques, as well as by improving access to instrumentation, code, and measurement guidance. Quality data will, in turn, lead to improved knowledge capture following ME device testing.

data processing↗

Growing Beyond Earth: Student Citizen Science Contributing to Space Crop Production

Fairchild Tropical Botanic Garden and NASA have been partnering since 2015 to conduct a citizen science education program for middle and high school students called Growing Beyond Earth (GBE). Growing Beyond Earth is a multi-classroom science project designed to advance NASA’s research on growing plants in space. GBE was implemented locally and scaled nationally under two NASA Grants. Now serving more than 250 schools and over 10,000 middle and high school students nationwide, GBE successfully improved STEM education. It also contributed student-generated data to NASA, improving NASA research on the ground and on ISS, with two student-selected crops grown in space. GBE is unique in its focus on real scientific research, enabling student “citizen scientists” to contribute data toward NASA mission planning. Each classroom receives a Fairchild-designed plant habitat analogous to the plant growing equipment aboard the International Space Station (ISS). Fairchild and NASA scientists train teachers to conduct in-classroom GBE experiments, and students then share experimental data online with NASA. As NASA looks toward a long-term human presence beyond Earth’s orbit, there are specific science, technology, engineering, and math challenges related to food production in space. During this presentation, learn how GBE is addressing those challenges by expanding the diversity and quality of edible plants that can be grown aboard spacecraft. We will share the significant scientific and educational results that have come out of this partnership and explain how we quickly pivoted to allow students to continue to contribute during the COVID-era. Finally, we will explain how on Earth, GBE is also advancing technologies for growing plants in urban, indoor, and other resource-limited settings through the GBE Maker challenge for High School, University, and Professional communities of Makers across the country to develop the next generation of space crop production technologies. These programs are supported by NASA.

Growing Beyond Earth↗

COHERENT Collaboration data release from the measurements of CsI[Na] response to nuclear recoils

The data release from the measurements of the CsI[Na] response to low energy nuclear recoils by the COHERENT collaboration. The release corresponds to the results published in 'D. Akimov et al 2022 JINST 17 P10034.' We share the data in the form of raw ADC waveforms, provide benchmark subselections and event reconstruction scripts to enhance the transparency and reproducibility of our results.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Expanding NASA and Roscosmos Scientific Collaboration on the International Space Station

The International Space Station (ISS) is a world-class laboratory orbiting in space. NASA and Roscosmos have developed a strong relationship through the ISS Program Partnership, working together and with the other ISS Partners for more than twenty years. Since 2013, based on a framework agreement between the Program Managers, NASA and Roscosmos are building a joint program of collaborative research on ISS. This international collaboration is developed and implemented in phases. Initially, members of the ISS Program Science Forum from NASA and TsNIIMash (representing Roscosmos) identified the first set of NASA experiments that could be implemented in the "near term". The experiments represented the research categories of Technology Demonstration, Microbiology, and Education. Through these experiments, the teams from the "program" and "operations" communities learned to work together to identify collaboration opportunities, establish agreements, and jointly plan and execute the experiments. The first joint scientific activity on ISS occurred in January 2014, and implementation of these joint experiments continues through present ISS operations. NASA and TsNIIMash have proceeded to develop "medium term" collaborations, where scientists join together to improve already-proposed experiments. A major success is the joint One-Year Mission on ISS, with astronaut Scott Kelly and cosmonaut Mikhail Kornienko, who returned from ISS in March, 2016. The teams from the NASA Human Research Program and the RAS Institute for Biomedical Problems built on their considerable experience to design joint experiments, learn to work with each other's protocols and processes, and share medical and research data. New collaborations are being developed between American and Russian scientists in complex fluids, robotics, rodent research and space biology, and additional human research. Collaborations are also being developed in Earth Remote Sensing, where scientists will share data from imaging systems mounted on ISS as well as other orbiting spacecraft to improve our understanding of the Earth and its climate. NASA and Roscosmos continue to encourage international scientific cooperation and expanded use of the ISS Laboratory. "Long-term", larger collaborations will achieve scientific objectives that no single national science team or agency can achieve on its own. The joint accomplishments achieved so far have paved the way for a stronger international scientific community and improved results and benefits from ISS.

Hasbrook, Pete↗

OPEN leaf : an open‐source cloud‐based phenotyping system for tracking dynamic changes at leaf‐specific resolution in Arabidopsis

SUMMARY The first draft of the Arabidopsis genome was released more than 20 years ago and despite intensive molecular research, more than 30% of Arabidopsis genes remained uncharacterized or without an assigned function. This is in part due to gene redundancy within gene families or the essential nature of genes, where their deletion results in lethality (i.e., thedark genome). High‐throughput plant phenotyping (HTPP) offers an automated and unbiased approach to characterize subtle or transient phenotypes resulting from gene redundancy or inducible gene silencing; however, access to commercial HTPP platforms remains limited. Here we describe the design and implementation ofOPEN leaf, an open‐source phenotyping system with cloud connectivity and remote bilateral communication to facilitate data collection, sharing and processing.OPEN leaf, coupled with our SMART imaging processing pipeline was able to consistently document and quantify dynamic changes at the whole rosette level and leaf‐specific resolution when plants experienced changes in nutrient availability. Our data also demonstrate that VIS sensors remain underutilized and can be used in high‐throughput screens to identify and characterize previously unidentified phenotypes in a leaf‐specific time‐dependent manner. Moreover, the modular and open‐source design ofOPEN leafallows seamless integration of additional sensors based on users and experimental needs.

Plant Sciences↗