Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Sharing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

Privacy policy robustness to reverse engineering

Differential privacy policies allow one to preserve data privacy while sharing and analyzing data. However, these policies are susceptible to an array of attacks. In particular, often a portion of the data desired to be privacy protected is exposed online. Access to these pre-privacy protected data samples can then be used to reverse engineer the privacy policy. With knowledge of the generating privacy policy, an attacker can use machine learning to approximate the full set of originating data. Bayesian inference is one method for reverse engineering both model and model parameters. We present a methodology for evaluating and ranking privacy policy robustness to Bayesian inference-based reverse engineering, and demonstrated this method across data with a variety of temporal trends.

Kusne, Aaron Gilad↗

Rhizosphere Soil Biogeochemical Data and Photosynthetic Data of Vicia Faba in a Rhizobox

Here we share the data in column format via csv files for pH, redox, and dissolved oxygen collected at hourly resolution from microelectrodes. Dissolved organic carbon concentrations collected from TOC are also provided in a similar format but are composited samples from hourly microdialysis collection. This provided resolution of diel rhizosphere dynamics belowground. Plant physiological data was also collected at every 5 min for 24 hr cycles in order to capture diel dynamics aboveground. This data was used to parameterize the reaction transport model eSTOMP-ROOTS, which examines the rhizosphere biogeochemistry of a growing Vicia faba plant. The aim was to investigate plant activity and belowground biogeochemical processes, particularly their impact on mineral-organic associations in the rhizosphere. We combined in-situ rhizosphere microsensor and plant physiological measurements with a 3-D plant-soil reactive transport model to explore the behavior of dissolved organic carbon (DOC) in the rhizosphere. Over several days, microdialysis probes placed at the root-soil interface in live soil showed distinct daily patterns of DOC concentration in the pore water. Spikes in DOC concentrations during the day aligned with peaks in leaf-level photosynthesis, accompanied by decreasing redox potential and dissolved oxygen levels, and increasing pH in the rhizosphere. This new mechanistic modeling framework, which integrates aboveground plant physiological data with non-destructive, high-resolution monitoring of rhizosphere processes, offers significant potential for studying the factors that control carbon storage in soils.

54 ENVIRONMENTAL SCIENCES↗

Design and Performance of Kokkos Staging Space toward Scalable Resilient Application Couplings

With the growing number of applications designed for heterogeneous HPC devices, application programmers and users are finding it challenging to compose scalable workflows as ensembles of these applications, that are portable, performant and resilient. The Kokkos C++ library has been designed to simplify this cumbersome procedure by providing an intra-application uniform programming model and portable performance. However, assembling multiple Kokkos-enabled applications into a complex workflow is still a challenge. Although Kokkos enables a uniform programming model, the inter-application data exchange still remains a challenge from both performance and software development cost perspectives. In order to address this issue, we propose Kokkos data staging memory space, an extension of Kokkos' data abstraction (memory space) for heterogeneous computing systems. This new abstraction allows to express data on a virtual shared-space for multiple Kokkos applications, thus extending Kokkos to support inter-application data exchange to build an efficient application workflow. Additionally, we study the effectiveness of asynchronous data layout conversions for applications requiring different memory access patterns for the shared data. Our preliminary evaluation with a synthetic benchmark indicate the effectiveness of this conversion adapted to three different scenarios representing access frequency and use patterns of the shared data.

97 MATHEMATICS AND COMPUTING↗

Network Configuration of Oracle and Database Programming Using SQL

A database can be defined as a collection of information organized in such a way that it can be retrieved and used. A database management system (DBMS) can further be defined as the tool that enables us to manage and interact with the database. The Oracle 8 Server is a state-of-the-art information management environment. It is a repository for very large amounts of data, and gives users rapid access to that data. The Oracle 8 Server allows for sharing of data between applications; the information is stored in one place and used by many systems. My research will focus primarily on SQL (Structured Query Language) programming. SQL is the way you define and manipulate data in Oracle's relational database. SQL is the industry standard adopted by all database vendors. When programming with SQL, you work on sets of data (i.e., information is not processed one record at a time).

Davis, Melton↗

Cross-Cutting Interoperability in an Earth Science Collaboratory

An Earth Science Collaboratory is: A rich data analysis environment with: (1) Access to a wide spectrum of Earth Science data, (3) A diverse set of science analysis services and tools, (4) A means to collaborate on data, tools and analysis, and (5)Supports sharing of data, tools, results and knowledge

Lynnes, Christopher↗

MSD CoP Webinar: "Advances in MSD-LIVE to Support the MSD Community of Practice"

Context: This webinar was hosted by the MultiSector Dynamics Community of Practice (MSD CoP; https://multisectordynamics.org). Advances in MSD-LIVE to Support the MSD Community of Practice Presenters: Casey Burleyson and Zoe Guillen (Pacific Northwest National Laboratory) Abstract: The MultiSector Dynamics Living, Intuitive, Value-adding, Environment (MSD-LIVE; msdlive.org) is a cloud-based data management system and advanced computing platform that enables MSD researchers to document and archive their data, run their models and analysis tools, and share their data, software, and workflows within the MSD Community of Practice. Recently, several high-profile datasets have attracted many new users to MSD-LIVE. This webinar has two goals: 1) To refamiliarize the MSD community and new users with the components of the platform (e.g., the data repository, model training notebooks, and data dashboards) and to highlight examples of how these components are advancing MSD science and 2) To demonstrate new features in v3 of the platform, released in late 2025. The main new feature in v3 is the ability to interactively explore data in MSD-LIVE without downloading it. MSD-LIVE users can now click a button in our data repository and launch a blank Jupyter notebook with access to the underlying data on AWS. Users can use the notebook to write analysis, visualization, or subsetting routines that process the data directly on the AWS cloud. We also added a GitHub integration feature that allows users to share analysis or visualization code they develop with the community of MSD-LIVE users. The webinar will wrap up with a look at what's coming next for MSD-LIVE in 2026. Moderator: Patrick M. Reed (MSD CoP Facilitation Team) This webinar was held on: May 12th, 2026 from 1-2 PM EST.

Open Science↗

Holistic and Pragmatic Standards Processes Enable Interdisciplinary Science

Open, interdisciplinary science inevitably relies heavily on standards. Standards are those often unseen agreements that we take for granted when systems and processes are working fine. Yet standards work is perpetual, laborious, and sometimes contentious, especially for standards to work across diverse disciplines. Standards development, maintenance, and implementation is a complex, ongoing socio-technical process. NASA has developed a progressively open science policy and strategy that calls for the establishment of a data standards process reaching across the five diverse divisions of the Science Mission Directorate. This is a delicate exercise. We, therefore, seek to apply a holistic yet pragmatic approach to developing and maintaining a standards process. We adopt an ecological philosophy that focuses on the interactions within the data ecosystem and how standards facilitate those interactions. We couple high-level analysis with on the ground experimentation. We began by 1) mapping information ecosystem components (e.g. data centers, missions, services, protocols, users), 2)establishing how the components interact (e.g. sharing (meta)data, funding, personnel exchange), and 3) modelling system dynamics (e.g. creation of products from multiple data centers, redundant processes, shared services). The goal is to apply understanding of the ecosystem to real world applications (e.g. planning a new mission, implementing new policy requirements, improving process efficiency, etc.). We have also conducted studies of historical standardization efforts, documenting lessons learned and cautionary tales. We then contrast this more abstract work with real examples. We reviewed and assessed multiple existing standards development processes both within and external to NASA. We now work to implement an initial test process which can be further optimized. We seek to define a consistent approach for assigning persistent identifiers for research objects, especially for the purposes of citation. The experience from this relatively ‘simple’ test case adds a pragmatic perspective on how researchers and engineers actually work. This presentation will review the details of this methodology, our initial findings, and how they might apply to other interdisciplinary standardization efforts.

Mark A Parsons↗

Anonymization of Network Traces Data through Condensation-based Differential Privacy

Network traces are considered a primary source of information to researchers, who use them to investigate research problems such as identifying user behavior, analyzing network hierarchy, maintaining network security, classifying packet flows, and much more. However, most organizations are reluctant to share their data with a third party or the public due to privacy concerns. Therefore, data anonymization prior to sharing becomes a convenient solution to both organizations and researchers. Although several anonymization algorithms are available, few of them allow sufficient privacy (organization need), acceptable data utility (researcher need), and efficient data analysis at the same time. This article introduces a condensation-based differential privacy anonymization approach that achieves an improved tradeoff between privacy and utility compared to existing techniques and produces anonymized network trace data that can be shared publicly without lowering its utility value. Our solution also does not incur extra computation overhead for the data analyzer. A prototype system has been implemented, and experiments have shown that the proposed approach preserves privacy and allows data analysis without revealing the original data even when injection attacks are launched against it. When anonymized datasets are given as input to graph-based intrusion detection techniques, they yield almost identical intrusion detection rates as the original datasets with only a negligible impact.

97 MATHEMATICS AND COMPUTING↗

MOSIQS: Persistent Memory Object Storage With Metadata Indexing and Querying for Scientific Computing

Scientific applications often require high-bandwidth shared storage to perform joint simulations and collaborative data analytics. Shared memory pools provide a chance to satisfy such needs. Recently, a high-speed network such as Gen-Z utilizing persistent memory (PM) offers an opportunity to create a shared memory pool connected to compute nodes. However, there are several challenges to use scientific applications on the shared memory pool directly such as scalability, failure-atomicity, and lack of scientific metadata-based search and query. In this paper, we propose MOSIQS, a persistent memory object storage framework with metadata indexing and querying for scientific computing. We design MOSIQS based on the key idea that memory objects on PM pool can live beyond the application lifetime and can become the sharing currency for applications and scientists. MOSIQS provides an aggregate memory pool atop an array of persistent memory devices to store and access memory objects to accelerate scientific computing. MOSIQS uses a lightweight persistent memory key-value store to manage the metadata of memory objects, which enables memory object sharing. To facilitate metadata search and query over millions of memory objects resident on memory pool, we introduce Group Split and Merge (GSM), a novel persistent index data structure designed primarily for scientific datasets. GSM splits and merges dynamically to minimize the query search space and maintains low query processing time while overcoming the index storage overhead. MOSIQS is implemented on top of PMDK. We evaluate the proposed approach on many-core server with an array of real PM devices. Experimental results show that MOSIQS gains a 100% write performance improvement and executes multi-attribute queries efficiently with 2.7× less index storage overhead offering significant potential to speed up scientific computing applications.

97 MATHEMATICS AND COMPUTING↗

Improving Discovery, Sharing, and Use of Water Data: Initial Findings and Suggested Future Work

Collaborative management of water resources requires a broad suite of “water data” that extends beyond basic information about water quantity and quality to other related topics such as water infrastructure, aquatic ecosystem health, socioeconomic factors, and power generation. Water data are disparate in nature because they are collected and provided by many entities, and in some cases, remain challenging to access and use. The U.S. Department of Energy’s Water Power Technologies Office initiated a project to characterize relevant categories of water data; describe the current state of accessing, using, and visualizing water data; and outline investigatory pathways for future efforts aimed at improving the discovery, sharing, and use of water data. Input on these topics was solicited from a small but diverse cross section of members of the water resources community. Fourteen broad categories of water data were identified: dams; ecology; flood control; hydroclimatology; hydrography; hydrology; hydropower; management landscape; migratory barriers; recreation and aesthetic importance; socioeconomic; water quality; water availability and use; and weather. Stakeholder perspectives on the accessibility and usability of water data indicate these aspects are affected by a complex set of technical and social factors. However, stakeholders generally agreed that better access to water data can provide a range of benefits to water management, and they stressed the need to generate broad support from water data users and producers. Two investigatory pathways were outlined that, taken together, provide a logical progression toward the goals of the project. The first pathway emphasizes further investigation to better define target audiences and data needs, identify opportunities for collaboration between related efforts, and conduct value demonstration activities to generate further support for improving discovery and access of water data. The second pathway focuses on creating a comprehensive vision for potential solutions that improve the discovery of water data. Several activities that align with the first pathway are suggested for the next phase of the project.

13 HYDRO ENERGY↗

msdlive-cli-distro

MSD-LIVE, the MultiSector Dynamics – Living, Intuitive, Value-adding, Environment, is a flexible and scalable data and code management system combined with a distributed computational platform that will enable MSD researchers to document and archive their data, run their models and analysis tools, and share their data, software, and multi-model workflows within a robust Community of Practice. MSD-LIVE will facilitate a new open, collaborative, resource-rich, technology-facilitated, community-driven way of doing MSD research.

Lansing, Carina↗

A Review of Existing Test Methods for Occupancy Sensors

One of the key new features of connected lighting systems (CLS) is their ability to collect data from various types of integral sensors and share that data with other lighting or building systems. Occupancy and vacancy sensors have been widely adopted as an energy-saving strategy in buildings, yet published test methods for reproducibly characterizing their performance remain few and limited in their sophistication. As a result, it has been difficult to predict their performance in a specific application, and in practice, they frequently do not meet energy-savings expectations. Occupants at times remove or otherwise bypass occupancy sensors that hinder their work or otherwise do not perform as expected, thereby compromising the sensors’ potential to reduce energy consumption. Poor performance can result from multiple causes – ranging from fundamental limitations of the sensor technology, to misconfiguration, to poor placement in the room or space. Innovative occupancy sensors, some of them combining multiple sensing technologies, have come on the market over the years, with claims of improved performance compared to their predecessors; yet in practice, their performance has led to neither high deployment nor high user satisfaction in any significant application, nor has it differed enough from the performance of previous products to necessitate a test method that facilitated comparison between them. While the performance of both common and novel occupancy sensors has been the subject of many published research articles, the test methods that have been employed for them have typically been loosely described and incorporated custom equipment or techniques that render them difficult to reproduce, or have been limited in their ability to fairly characterize devices that utilize varying sensor technology. The lack of a well-described, technology-agnostic test method that yields reproducible results across different implementations has been a barrier to the commercial success of new occupancy sensor products, as users and specifiers who have been disappointed with previous products are often unwilling to take a chance with new ones. Motivated by a desire to fairly characterize new technologies that continue to enter the market and claim not only improved occupancy detection but, in some cases, also additional capabilities (e.g., the ability to measure traffic or discern between different object types), this report presents the results of a literature review of recent published, well-described test methods for characterizing occupancy sensor performance, as well as research articles containing ad-hoc test methods. The review also identifies and consolidates the best techniques for characterizing sensor performance in indoor spaces and identifies test method gaps that need to be filled in order to evaluate emerging technologies and products.

47 OTHER INSTRUMENTATION↗

A Review of Existing Test Methods for Occupancy Sensors

One of the key new features of connected lighting systems (CLS) is their ability to collect data from various types of integral sensors and share that data with other lighting or building systems. Occupancy and vacancy sensors have been widely adopted as an energy-saving strategy in buildings, yet published test methods for reproducibly characterizing their performance remain few and limited in their sophistication. As a result, it has been difficult to predict the performance of such sensors in a specific application, and in practice, they frequently do not meet energy-savings expectations. Occupants at times remove or otherwise bypass occupancy sensors that hinder their work or otherwise do not perform as expected, thereby compromising the sensors’ potential to reduce energy consumption. Poor performance can result from multiple causes – ranging from fundamental limitations of the sensor technology, to misconfiguration, to poor placement in the room or space. Innovative occupancy sensors, some of them combining multiple sensing technologies (i.e., multimodal), have come on the market over the years, with claims of improved performance compared to their predecessors. However, in practice, their performance has neither differed enough from the performance of previous products to necessitate a test method that facilitated comparison between them, nor has it led to high deployment or high user satisfaction in human-occupied spaces with persistent presence. While the performance of both common and novel occupancy sensors has been the subject of many published research articles, the test methods that have been employed for them typically have been loosely described and have incorporated custom equipment or techniques that render them difficult to reproduce, or have been limited in their ability to fairly characterize devices that utilize varying sensor technology. The lack of a fully described, technology-agnostic test method that yields reproducible results across different implementations has been a barrier to the commercial success of new occupancy-sensor products, as users and specifiers who have been disappointed with previous products are often unwilling to take a chance with new ones. Motivated by a desire to fairly characterize new technologies that continue to enter the market and claim not only improved occupancy detection but, in some cases, additional capabilities (e.g., the ability to measure traffic or discern between different object types), this report presents the results of a literature review of recently published fully described test methods for characterizing occupancy-sensor performance, as well as research articles containing ad-hoc test methods. The review also identifies and consolidates test conditions for characterizing sensor performance in indoor spaces and identifies apparent test method gaps that need to be filled in order to evaluate emerging technologies and products. The identified test-method conditions are intended to enable the development of a future technology-agnostic test method that facilitates occupancy-sensor performance characterization more-accurately representing performance in buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

ADS pilot program Plan

The Applications Data Service (ADS) is a system based on an electronic data communications network which will permit scientists to share the data stored in data bases at universities and at government and private installations. It is designed to allow users to readily locate and access high quality, timely data from multiple sources. The ADS Pilot program objectives and the current plans for accomplishing those objectives are described.

Clauson, J.↗

Software Facilitates Sharing of Water Quality Data Worldwide

John Freighery was an environmental engineer at Johnson Space Center when a new, simplified version of the coliform bacteria test was developed for astronaut use on the International Space Station. Through his New York City-based mWater Foundation, Freighery is using the test to help rural communities monitor their water supplies for contamination. The organization has also developed a mobile phone app to make the information publicly available.

Source record↗

A path to intelligent watersheds: coordinating the data to decision pipeline

Operations of multi-reservoir systems are challenged in-part by the interplay of complex physical processes functioning within the watershed. The employment of intelligent systems can be of aid by linking environmental sensing, information technology, data analytics, simulation and decision support to achieve a data-to-decision flow of information. A further challenge is that watershed resources are managed for multiple purposes requiring some level of coordination among numerous resource managers, asset operators and users. System intelligence in this context relies on shared community platforms (data portals, community models), and coordinated communication between decision makers. Opportunities to enrich watershed intelligence has been the subject of a roadmapping exercise for the Department of Energy’s Water Power Technologies Office which has relied on broad stakeholder engagement. Initial phases of engagement involved personal interviews and a series of virtual group meetings, which focused on identifying opportunities to improve the intelligence of the physical infrastructure within our watersheds—examples of feedback include improved sensing of snowpack and runoff, data standards for facilitated data sharing, and better forecasting tools. The latter phase of engagement involved the conduct of a case study in the Upper Colorado River basin where key stakeholders were interviewed to map how their decisions are informed by intelligence from other basin stakeholders. Our presentation will highlight the interdisciplinary flow of information in complex watershed systems and identify physical and institutional opportunities toward the strategic operation of water infrastructure.

Colorado River↗