SEARCH · Engineering Papers

Results for “Data Sharing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

All sources NASA NTRS DOE OSTI

DOE OSTI2025

BULKI-Store v0.3.2

BULKI-Store is a distributed object storage system optimized for high-performance computing environments. Built with a Rust core and Python bindings, it efficiently manages scientific and machine learning datasets across HPC clusters. The system employs a client-server architecture with MPI integration, enabling seamless scaling on supercomputers like Perlmutter. BULKI-Store's object-oriented approach provides intuitive data organization with rich metadata support, contrasting with traditional file-based solutions. Key optimizations include selective checkpoint loading, unified checkpoint files, and object chunking for large data transfers. For machine learning workloads, BULKI-Store offers advantages through fine-grained access patterns, dynamic data sharing between training instances, and reduced memory pressure. Memory management features include strategic Python GC calls, minimized data copies, and batch processing capabilities. The system leverages Rayon's thread pool for asynchronous data prefetching and supports multiple CPU architectures (ARM64, x86, AMD, RISC-V). By combining performance optimizations with developer-friendly APIs, BULKI-Store addresses the complex data management challenges of modern HPC applications while maintaining compatibility across heterogeneous computing environments.

Zhang, Wei [Lawrence Berkeley National Laboratory ↗

NASA NTRS1991

The NASA Ocean Data System at the Jet Propulsion Laboratory

Global change studies require satellite oceanographic observations archived in an active data center. This paper describes the activities of an experimental active oceanographic data archive center specializing in distribution of high-level oceanographic data products produced by research oceanographers from satellite altimeter, scatterometer, and microwave and infrared radiometer measurements. Methods to encourage data sharing practices were developed. Services initiated to help oceanographers conduct research more effectively included rapid delivery of data, reprocessing data sets, subsetting of large data sets, and distribution of multiple data sets on a single medium.

Halpern, David↗

NASA NTRS2020

Predicting Gate Conflicts using NASA ATD-2 Fused Data Sources

The modern day National Airspace System (NAS) is powered by System Wide Information Management (SWIM) which is a real-time digital data sharing infrastructure that provides a high fidelity view of the lifecycle of a flight. The newly available data within the SWIM feeds can be leveraged to help drive efficiencies in the NAS. In this talk, we investigate the gate conflict prediction problem as a concrete use case which could help drive efficiencies. We begin with a high level description of NASA's Airspace Technology Demonstration 2 which is built upon the real-time SWIM feeds and produces the data used in our investigation. We model gate conflicts as a regression problem and describe the iterative process of model building, model validation, and evaluation used to assess the efficacy of our approach.

Coupe, William J.↗

NASA NTRS2020

Enabled International Collaborations in EDL: Lessons Learned and Recommendations

William J. Coupe↗

NASA NTRS1993

Flow Analysis Software Toolkit

Flow Analysis Software Toolkit (FAST) computer program provides software environment facilitating visualization of data. Collection of separate programs (modules) running simultaneously and helps user to examine results of numerical and experimental simulations. Intended for graphical depiction of computed flows, also assists in analysis of other types of data. Combines capabilities of such programs as PLOT3D, RIP, SURF, and GAS into one software environment with modules sharing data. All modules have consistent, highly interactive graphical user interface. Modular construction makes it flexible and extensible. Environment custom-configured, and new modules developed and added as needed. Written in ANSI compliant FORTRAN 77 and C language.

Watson, Velvin↗

NASA NTRS1990

Concurrent Image Processing Executive (CIPE). Volume 1: Design overview

The design and implementation of a Concurrent Image Processing Executive (CIPE), which is intended to become the support system software for a prototype high performance science analysis workstation are described. The target machine for this software is a JPL/Caltech Mark 3fp Hypercube hosted by either a MASSCOMP 5600 or a Sun-3, Sun-4 workstation; however, the design will accommodate other concurrent machines of similar architecture, i.e., local memory, multiple-instruction-multiple-data (MIMD) machines. The CIPE system provides both a multimode user interface and an applications programmer interface, and has been designed around four loosely coupled modules: user interface, host-resident executive, hypercube-resident executive, and application functions. The loose coupling between modules allows modification of a particular module without significantly affecting the other modules in the system. In order to enhance hypercube memory utilization and to allow expansion of image processing capabilities, a specialized program management method, incremental loading, was devised. To minimize data transfer between host and hypercube, a data management method which distributes, redistributes, and tracks data set information was implemented. The data management also allows data sharing among application programs. The CIPE software architecture provides a flexible environment for scientific analysis of complex remote sensing image data, such as planetary data and imaging spectrometry, utilizing state-of-the-art concurrent computation capabilities.

Lee, Meemong↗

NASA NTRS1992

MODIS algorithm development and data visualization using ACTS

The study of the Earth as a system will require the merger of scientific and data resources on a much larger scale than has been done in the past. New methods of scientific research, particularly in the development of geographically dispersed, interdisciplinary teams, are necessary if we are to understand the complexity of the Earth system. Even the planned satellite missions themselves, such as the Earth Observing System, will require much more interaction between researchers and engineers if they are to produce scientifically useful data products. A key component in these activities is the development of flexible, high bandwidth data networks that can be used to move large amounts of data as well as allow researchers to communicate in new ways, such as through video. The capabilities of the Advanced Communications Technology Satellite (ACTS) will allow the development of such networks. The Pathfinder global AVHRR data set and the upcoming SeaWiFS Earthprobe mission would serve as a testbed in which to develop the tools to share data and information among geographically distributed researchers. Our goal is to develop a 'Distributed Research Environment' that can be used as a model for scientific collaboration in the EOS era. The challenge is to unite the advances in telecommunications with the parallel advances in computing and networking.

Abbott, Mark R.↗

NASA NTRS2008

The Citizens and Remote Sensing Observational Network (CARSON) Guide: Merging NASA Remote Sensing Data with Local Environmental Awareness

"Citizen science" generally refers to observatoinal research and data collection conducted by non-professionals, commonly as volunteers. In the environmental science field, citizen scientists may be involved with local nad regional issues such as bird and wildlife populations, weather, urban sprawl, natural hazards, wetlands, lakes and rivers, estuaries, and a spectrum of public health concerns. Some citizen scientists may be primarily motivated by the intellectual challenge of scientific observations. Citizen scientists may now examine and utilize remote-sensing data related to their particular topics of interest with the easy-to-use NASA Web-based tools Giovanni and NEO, which allow exploration and investigation of a wide variety of Earth remote sensing data sets. The CARSON (Citizens and Remote Sensing Observational Network) Guide will be an online resource consisting of chapters each demonstrating how to utilize Giovanni and NEO to access and analyze specific remote-sensing data. Integrated in each chapter will be descriptions of methods that citizen scientists can employ to collect, monitor, analyze, and share data related to the chapter topic which pertain to environmental and ecological conditions in their local region. A workshop held in August 2008 initiated the development of prototype chapters on water quality, air quality, and precipitation. These will be the initial chapters in the first release of the CARSON Guide, which will be used in a pilot project at the Maryland Science Center in spring 2009. The goal of the CARSON Guide is to augment and enhance citizen scientist environmental research with NASA satellite data by creating a participatory network consisting of motivated individuals, environmental groups and organizations, and science-focused institutions such as museuma and nature centers. Members of the network could potentially interact with government programs, academic research projects, and not-for-profit organizations focused on environmental issues.

Acker, James↗

DOE OSTI2026

Challenges and Vision for Standardization of Biopolymer Data Sets for Machine Learning

Machine learning (ML) is transforming materials research, yet potential for biopolymer discovery remains constrained by fragmented data and nonstandardized reporting. Biopolymers differ significantly from synthetic polymers, requiring specialized approaches to represent their biosynthetic origins, hierarchical structures, and application-specific metrics. In this Perspective, we identify three core challenges limiting biopolymer representation: information encoding, data quality, and data sharing. We describe the most pressing issues and propose commensurate approaches to address each key challenge. Recommendations include the design and adoption of biopolymer-specific fingerprinting and representation frameworks, development of hybrid human-large language model (LLM) data extraction strategies, and expanding Findable, Accessible, Interoperable, Reusable (FAIR)-compliant repositories. We propose a robust foundation to define interoperable, high-quality data sets that capture the full context of biopolymer materials. Standardized metadata, shared ontologies, and community-driven infrastructure would enable scalable, reproducible workflows and accelerate the ML-driven development of biopolymers.

36 MATERIALS SCIENCE↗

DOE OSTI2025

MPEX AI Digital Twins

All magnetically confined plasma fusion power plant concepts (Tokamak, Spherical Tokamak, Stellarator, Mirror, ...) must exhaust the heat and plasma from the core confinement region to the material walls. The primary channel for this exhaust is through a plasma divertor which directs plasma along open magnetic field lines to a material target. The Material Plasma Exposure eXperiment (MPEX) illustrated in Figure 1, is a high-power, steady-state linear plasma device designed to produce the plasma material interaction (PMI) conditions of the divertor of future magnetic confinement fusion power plants: energy flux 20MW/m 2 , ion fluence 1031/m 2 , pulse duration 106 sec. These goals of plasma exposure in MPEX are well beyond those achieved in magnetic fusion experimental devices. Successfully achieving these high power steady state conditions for long pulses requires operational control of the heating and particle sources and the plasma flux to the walls and target. The MPEX AI Hot Spot Controller, proposed in this project, will help achieve the operational milestones of MPEX. The MPEX device will begin commissioning at the end of FY26. A smaller proto-MPEX was operated for 14,666 plasma discharges and will resume operation in September of 2025 as proto-MPEX-lite, with reduced capability, to test a new window for the Helicon plasma source. The proto-MPEX data has undergone surrogate modeling with machine learning methods (R. Archibald, 2022 IEEE International Conference on Big Data). This proto-MPEX data will be used to begin development of the AI digital twins described in this white paper. The scientific mission of MPEX is to qualify materials of different composition for use in the high energy and plasma flux conditions of a fusion power plant. The materials exposed in MPEX will in some cases be exposed to high neutron fluxes at other ORNL facilities to measure the changes to their PMI properties. The targets exposed in MPEX will be transported under vacuum to a Surface Analysis Station (SAS). The SAS will be equipped with the following diagnostics: Focused Ion Beam (FIB) for trench milling, 100-400 angstrom resolution scanning electron microscope (SEM), surface mapping x-ray spectrometer, high resolution camera, and a future upgrade to a laser induced breakdown spectroscopy quadruple mass spectrometer (LIBS-QMS). The MPEX experiments will generate diverse pre- and post-exposure measurement data of detailed material properties down to the crystal grain level in 3D for post-exposure assessment of PMI damage (e.g. cracking, melting, erosion and redeposition of the material). Physics models for the PMI, and how the material composition and manufacturing impact its performance under high energy plasma exposure, need to be validated with MPEX data to guide the selection of new candidate materials. Our vision for the MPEX AI Digital Twins project is to supply experimental and physics model simulation data to train Artificial Intelligence (AI) models for data processing, analysis, operational control, PMI and materials simulation to maximize the scientific output of the MPEX device. Ultimately, an AI digital twin of MPEX material assessment metrics for tested and synthetic material types with simulated PMI will be trained by the AI Modeling Teams on the experimental and physics simulation data submitted to the American Science Cloud by this project. A purely empirical search for the best material is inefficient given the finite number of samples that can be tested on MPEX. In order to expand the material properties database for training the MPEX Material Assessment AI Digital Twin, and to gain physics understanding of the PMI processes, physics models of the material properties and PMI processes are required. The physics simulations provide detailed simulation data, like impact angles for plasma ions, sputtering yields, transport of the ionized sputtered target material in the plasma, and redeposition locations. This simulation data expands the measurement data for deeper physics understanding. The experimental data is essential to validate the PMI and material structure simulation models. The validated models can then be used to generate new simulation data of MPEX material assessments for synthetic material compositions that have not been exposed in MPEX. These predictive simulations, plus the whole experimental dataset, will be used to train the MPEX Material Assessment AI Digital Twin allowing a rapid generative AI search for new materials with reduced PMI damage by interpolating the domain of the training set. These new optimum materials can be simulated with the physics codes and/or tested in MPEX. The ability of AI neural networks to interpolate multi-dimensional parameter spaces and generate virtual data is exploited for a more efficient search for optimum materials. The advent of the Transformational AI Models Consortium (TAIMC) is an opportunity to engage with state of the art private and public AI developers to achieve the goals of the AI digital twins and AI accelerated physics models proposed in this project. Our partners at ORNL from the Advance Scientific Computing Research (ASCR) organization will collaborate in accelerating the integrated plasma material interaction simulation framework. This simulation framework will provide a platform for generating simulation data across a range of physical fidelities, including hybrid methods that produce multi-fidelity results. This data will be leveraged for AI model development, both for generation of surrogates and the automation of simulation campaigns. A part of the research below will include collaborative efforts with the TAIMC to (i) adapt data storage approaches to ensure AI-readiness, (ii) provide a protypical exemplar to inform and exercise constructed workflows, and (iii) generate and share data, using the TAIMC unified AI data standard, for foundational models that will be trained from multiple sources across the DOE complex. We will also collaborate with the TAIMC, as well as the planned AI modeling teams, to develop approaches for reducing the cost of data generation. These include tailored multi-fidelity approaches as well as fine-tuning strategies to augment general, large-scale foundational models.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

NASA NTRS2012

Evaluation ofthe Middle East and North Africa Land Data Assimilation System

The Middle East and North Africa (MENA) region is dominated by dry, warm deserts, areas of dense population, and inefficient use of fresh water resources. Due to the scarcity, high intensity, and short duration of rainfall in the MENA, the region is prone to hydro climatic extremes that are realized by devastating floods and times of drought. However, given its widespread water stress and the considerable demand for water, the MENA remains relatively poorly monitored. This is due in part to the shortage of meteorological observations and the lack of data sharing between nations. As a result, the accurate monitoring of the dynamics of the water cycle in the MENA is difficult. The Land Data Assimilation System for the MENA region (MENA LDAS) has been developed to provide regional, gridded fields of hydrological states and fluxes relevant for water resources assessments. As an extension of the Global Land Data Assimilation System (GLDAS), the MENA LDAS was designed to aid in the identification and evaluation of regional hydrological anomalies by synergistically combining the physically-based Catchment Land Surface Model (CLSM) with observations from several independent data products including soil-water storage variations from the Gravity Recovery and Climate Experiment (GRACE) and irrigation intensity derived from the Moderate Resolution Imaging Spectroradiometer (MODIS). In this fashion, we estimate the mean and seasonal cycle of the water budget components across the MENA.

Bolten, John D.↗

NASA NTRS2019

Bringing Analysis Closer to Data: Developing a Visualization Tool for L2 Earth Science Satellite Data

Earth Science satellite missions provide a unique opportunity for scientists to visualize complex and multifaceted observations projected geospatially across maps of the Earth. While visualization tools can help scientists comprehend, analyze, and share data, visualizing Level-2 Earth Sciences data poses its own specific set of challenges. Since the geospatial information in Level-2 data files is stored as independent variables, the plotting process involves matching dimensional information from latitude and longitude with a desired variable. Variables are stored in different ways across various Earth Science data file formats, which complicates the process of extracting data and plotting variables from a given file without requiring extensive user input and prerequisite familiarity with the file type variable structure. In coordination with NASA’s Goddard Earth Sciences Data Information Services Center (GES DISC), the team developed a Level-2 Earth Science data visualization tool that aims to address some of the complexities associated with plotting Level-2 data. This tool offers command-line and user interface support for file and variable selection to accommodate varying use cases and degrees of user familiarity with the structure of a given file. The visualization tool is written in Python 3 and utilizes a modular approach to facilitate continued expansion and reuse. In addressing some common complications involved in plotting Level-2 Earth Sciences data, the tool aims to help to link the process of analysis more directly with data acquisition and visualization, bringing analysis closer to data across levels of processing.

Li, Angela W.↗

NASA NTRS1997

Sustainable Biosphere Initiative Project

The goal of the Advanced Technology in Ecological Sciences project is to gain broad participation within the environmental scientific community in developing a research agenda addressing the development and refinement of technologies instrumental to research that responds to these challenges (e.g. global climate change, unsustainable resource use, and threats to biological diversity). The following activities have been completed: (1) A listserve 'eco-tech was set up to serve as a clearinghouse of information about activities and events relating to advanced technologies; (2) A series of conference calls were organized on specific topics including data visualization and spatial analysis, and remote sensing; and (3) Two meetings were organized at the 19% ESA Annual Meeting in Providence, Rhode Island. Topics covered included concerns about tool and data sharing; interest in expanded development of ground-based remote sensing technologies for monitoring; issues involved in training for using new technologies and increasing data streams, and- associated implications of data processing capabilities; questions about how to develop appropriate standards (i.e. surface morphology classification standards) that facilitate the exchange and comparison of analytical results; and some thoughts about remote sensing platforms and vehicles.

Source record↗

NASA NTRS2018

Observaciones de la Tierra desde la Estación Espacial Internacional

The International Space Station is a "global observation and diagnosis station." It promotes international Earth observations aimed at understanding and resolving the environmental issues of our home planet. A wide variety of Earth observation payloads can be attached to the exposed facilities on the station's exterior as well as within the Destiny module. The presence of a human crew also provides a unique capability for real-time observation of the Earth, and "on the fly" data collection using hand-held digital cameras, and the astronauts may also provide input to ground personnel programming the station's automated Earth observation systems. Several instruments are currently collecting data from the International Space Station; in addition, some instruments have completed their data collection missions, with other remote sensing systems in development or proposed by researchers from the partner countries, NASA, academic institutions, and corporations. The existing international partnerships, fundamental to the International Space Station, facilitate data sharing that can benefit people around the world and promote international collaboration on other Earth observation activities. The station contributes to humanity by collecting data on global climate, environmental change, and natural hazards using its unique complement of crew-operated and automated Earth observation payloads.

Sotomayor, Jorge L.↗

NASA NTRS2023

NASA’s Digital Information Platform to Accelerate the Transformation of the National Airspace System

In order to accelerate the digital transformation of airspace operations, a foundational framework and infrastructure for providing sustainable, data-driven, and cohesive decision-making digital services for both traditional and emergent air vehicles is being developed. The reference implementation of Digital Information Platform builds an ecosystem for the aviation community by providing access to a secure and trusted source of aviation data and services. Several key features and services have been implemented to enable secure data sharing, communication, and service registration on the Platform. The technical approach used to implement these features is presented here. NASA-developed integrated aviation data and machine learning based prediction services to optimize airspace operations are available on the Platform. These services are being evaluated in an operational environment by flight operators and the real-world benefits are being captured. The Platform fosters collaboration among industry and researchers to develop complex aviation services and the aim is to make it publicly accessible for consumption by the aviation community.

Digital Transformation↗

NASA NTRSDate not supplied

NASA’s Digital Information Platform to Accelerate the Transformation of the National Airspace System

Digital Transformation↗

DOE OSTI2024

Best practices: Organizational execution

This article, the fourth and final installment in the DOE–IDEA series, focuses on organizational execution and how strong management practices, teamwork, and preparedness contribute to successful district energy systems. It highlights case studies from Ashley Energy and Cornell University to illustrate effective operational strategies. Ashley Energy demonstrates the importance of emergency preparedness and rapid response. After a major flood disrupted its plant, the organization restored service in under 72 hours by relying on pre-established plans, vendor relationships, and trained staff. The case emphasizes proactive contingency planning, understanding insurance processes, and empowering skilled personnel to improvise during crises. Cornell University’s example highlights the role of collaboration and transparency in long-term success. Its district energy system benefits from strong data sharing, real-time energy monitoring, and active involvement of faculty and students in system planning and innovation. This culture of teamwork and data-driven decision-making supports sustainability goals and continuous system improvement. Overall, the article shows that effective organizational execution—through preparedness, collaboration, and data transparency—is essential for maintaining reliable, efficient, and sustainable district energy systems.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

DOE OSTI2025

Floating Offshore Wind US Manufacturing and Commercialization: Cooperative Research and Development (Final Report)

NREL assessed the supply chain and workforce considerations for the OCG-Wind floater technology, a floating semi-submersible offshore wind substructure, as well sharing vessel needs to inform their installation strategy. This technical assistance was in support of the FLoating Offshore Wind ReadINess (FLOWIN) Prize Phase 2 submission. NREL provided an assessment of domestic supplier capabilities for the main components of their floating offshore wind platform design and analyzed US regional and national supply chain constraints and gaps. Thirteen interviews with companies including steel distributors, forges, foundries, ports, large component fabricators, subcomponent fabricators, and secondary suppliers provided key insights such as 1) assembly ports are the key infrastructure barrier standing in the way of unlocking the domestic assembly and component fabrication for steel-based FOW platforms, 2) domestic steel producers can supply the types and quantities of steel necessary for FOW platforms, and 3) coordination between stakeholders will be a vital part of successfully developing the supply chain and infrastructure needed to domestically produce FOW platforms. In the workforce assessment, NREL documented a step-by-step approach to conduct a place-based assessment of the foundational workforce consideration for recruiting, upskilling, and retaining a workforce, such as supportive local and state policy, nearby education and training programs, and existing relevant industry. This approach was applied to Tacoma, Washington. Tacoma was indicated to have the potential be a successful location for fabrication and assembly of floating offshore wind energy in terms of workforce development. To share data on vessel requirements to install the OCG-Wind floater, NREL compiled resources that help answer the questions related to anchor handling tug vessels, shared a database of cable laying vessels, and answered questions on complying with the Jones Act.

17 WIND ENERGY↗