SEARCH · Engineering Papers

Results for “distributed storage”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

All sources NASA NTRS DOE OSTI

DOE OSTI2022

U.S. national water and energy land dataset for integrated multisector dynamics research

Abstract Understanding resource demands and tradeoffs among energy, water, and land socioeconomic sectors requires an explicit consideration of spatial scale. However, incorporation of land dynamics within the energy-water nexus has been limited due inconsistent spatial units of observation from disparate data sources. Herein we describe the development of a National Water and Energy Land Dataset (NWELD) for the conterminous United States. NWELD is a 30-m, 86-layer rasterized dataset depicting the land use of mappable components of the United States energy sector life cycles (and related water used for energy), specifically the extraction, development, production, storage, distribution, and operation of eight renewable and non-renewable technologies. Through geospatial processing and programming, the final products were assembled using four different methodologies, each depending upon the nature and availability of raw data sources. For validation, NWELD provided a relatively accurate portrayal of the spatial extent of energy life cycles yet displayed low measures of association with mainstream land cover and land use datasets, indicating the provision of new land use information for the energy-water nexus.

58 GEOSCIENCES↗

DOE OSTI2025

dCache project status and update

The dCache project delivers an open-source, massively scalable, distributed storage system deployed internationally to satisfy today’s scientists’ ever-demanding storage requirements. Its multifaceted approach supports different use cases with the same storage, from high throughput data ingest, data sharing over wide area networks, efficient access from HPC clusters, and longterm data persistence on tertiary storage. Even though dCache was initially developed for HEP experiments, today, it is used by various scientific communities, including astrophysics, biomed, and life science, each with their specific requirements. To match the needs of these new communities and keep up with the scaling demands of existing experiments, dCache is permanently evolving. With this contribution, we would like to highlight the recent developments in dCache regarding integration with CERN Tape Archive (CTA), advanced metadata handling, token-based authorization support, bulk API for QoS transitions, REST API to control interaction with the tape system, and future development directions.

Mkrtchyan, Tigran [DESY]↗

DOE OSTI2024

To Derive or Not to Derive: I/O Libraries Take Charge of Derived Quantities Computation

The ever-increasing volume of data produced by HPC simulations necessitates scalable methods for data exploration and knowledge extraction. Scientific data analysis often involves complex queries across distributed datasets, requiring manipulation of multiple primary variables and generating derived data that needs to be handled efficiently, creating challenges for applications that need to parse many large datasets. Relying on individual applications to handle all intermediate data generally leads to redundant computations across studies and unnecessary data transfers. In this paper, we investigate the performance of different approaches where applications define derived variables as quantities of interest (QoIs) and offload the computation and transfer of these QoIs to the I/O library. This significantly reduces redundancy and optimizes data movement across the distributed storage and processing infrastructure by allowing control over when and where derived variables are computed. We present a detailed analysis of the performance-storage trade-offs associated with different solutions and showcase results for our study on two large-scale datasets created from climate and combustion simulations.

Gainaru, Ana↗

DOE OSTI2020

Streaming Data Reorganization at Scale with DeltaFS Indexed Massive Directories

We report complex storage stacks providing data compression, indexing, and analytics help leverage the massive amounts of data generated today to derive insights. It is challenging to perform this computation, however, while fully utilizing the underlying storage media. This is because, while storage servers with large core counts are widely available, single-core performance and memory bandwidth per core grow slower than the core count per die. Computational storage offers a promising solution to this problem by utilizing dedicated compute resources along the storage processing path. We present DeltaFS Indexed Massive Directories (IMDs), a new approach to computational storage. DeltaFS IMDs harvest available (i.e., not dedicated) compute, memory, and network resources on the compute nodes of an application to perform computation on data. We demonstrate the efficiency of DeltaFS IMDs by using them to dynamically reorganize the output of a real-world simulation application across 131,072 CPU cores. DeltaFS IMDs speed up reads by 1,740x while only slightly slowing down the writing of data during simulation I/O for in situ data processing.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Recent Developments in Sensor Technologies for Enabling the Hydrogen Economy

Efforts to create a sustainable hydrogen economy are gaining momentum as governments all over the world are investing in hydrogen production, storage, distribution, and delivery technologies to develop a hydrogen infrastructure. This involves transporting hydrogen in gaseous or liquid form or using carrier gases such as methane, ammonia, or mixtures of methane and hydrogen. Hydrogen is a colorless, odorless gas and can easily leak into the atmosphere leading to economic loss and safety concerns. Therefore, deployment of robust low-cost sensors for various scenarios involving hydrogen is of paramount importance. Here, we review some recent developments in hydrogen sensors for applications such as leak detection, safety, process monitoring in production, transport and use scenarios. The status of methane and ammonia sensors is covered due to their important role in hydrogen production and transportation using existing natural gas and ammonia infrastructure. This review further provides an overview of existing commercial hydrogen sensors and also addresses the potential for hydrogen as an interferent gas for currently used sensors. This review can help developers and users make informed decisions about how to drive hydrogen sensor technology forward and to incorporate hydrogen sensors into the various hydrogen deployment projects in the coming decade.

08 HYDROGEN↗

DOE OSTI2023

Orchestration of materials science workflows for heterogeneous resources at large scale

In the era of big data, materials science workflows need to handle large-scale data distribution, storage, and computation. Any of these areas can become a performance bottleneck. We present a framework for analyzing internal material structures (e.g., cracks) to mitigate these bottlenecks. We demonstrate the effectiveness of our framework for a workflow performing synchrotron X-ray computed tomography reconstruction and segmentation of a silica-based structure. Our framework provides a cloud-based, cutting-edge solution to challenges such as growing intermediate and output data and heavy resource demands during image reconstruction and segmentation. Specifically, our framework efficiently manages data storage, scaling up compute resources on the cloud. The multi-layer software structure of our framework includes three layers. A top layer uses Jupyter notebooks and serves as the user interface. A middle layer uses Ansible for resource deployment and managing the execution environment. A low layer is dedicated to resource management and provides resource management and job scheduling on heterogeneous nodes (i.e., GPU and CPU). At the core of this layer, Kubernetes supports resource management, and Dask enables large-scale job scheduling for heterogeneous resources. The broader impact of our work is four-fold: through our framework, we hide the complexity of the cloud’s software stack to the user who otherwise is required to have expertise in cloud technologies; we manage job scheduling efficiently and in a scalable manner; we enable resource elasticity and workflow orchestration at a large scale; and we facilitate moving the study of nonporous structures, which has wide applications in engineering and scientific fields, to the cloud. While we demonstrate the capability of our framework for a specific materials science application, it can be adapted for other applications and domains because of its modular, multi-layer architecture.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

A New Capability of E4D For 3D Parallel Joint Inversion of DC Resistivity And Traveltime Data on Unstructured Mesh

A major challenge in interpreting geophysical data is how to derive consistent three-dimensional (3D) earth models of different physical properties from spatially and temporally limited measurements. Joint inversion with cross-gradient constraints is an approach to find such models by imposing structural similarities between different physical parameters. We have developed a parallel distributed-memory joint inversion code for direct-current (DC) resistivity and traveltime data using the cross-gradient constraint on unstructured mesh. The code utilizes existing E4D framework for parallel forward simulation, distributed storage and computation of the Jacobian matrix of forward operator, and parallel execution of matrix-vector multiplication during inversion. Besides, the joint inversion is solved by nonlinear conjugate gradient algorithm parallelized for DC resistivity and traveltime data. The joint inversion capability of E4D was tested using synthetic data from cross-borehole DC resistivity and traveltime data. The results indicate that the shape and size of the anomalies from the joint inversion are more reliable than those from separate inversions.

58 GEOSCIENCES↗

DOE OSTI2023

Recent Developments in Sensor Technologies for Enabling the Hydrogen Economy

08 HYDROGEN↗

DOE OSTI2025

An Nginx-based Content Distribution Network for HEP

With the move to HTTP/WebDAV and JSON Web Tokens as a standard protocol for transfers within the WLCG distributed storage network, a large amount of off-the-shelf technologies become viable for meeting the requirements of a Storage Element (SE). In this work, we explore the capabilities and performance of the OpenResty framework, which extends the nginx server with the LuaJIT scripting language, to recreate the feature set of a SE. We demonstrate token-authenticated HTTP read, write, and WebDAV third-party copy features, as well as a storage federation with HTTP redirect, proxy, and caching capabilities. We further explore the performance scaling in terms of throughput and requests per second.

Aarora, Aashay [UC, San Diego]↗

DOE OSTI2026

Measuring labor productivity dynamics in U.S. industrial and electric power sectors: a case study (2014–2023)

This study proposes a subsystem methodology for measuring labor productivity in the U.S. industrial and electric power sectors by leveraging public data available between 2014 and 2023. Building on Pasinetti’s framework and subsequent developments, the approach employs Vertically Integrated Sectors (VIS) to account for both direct and indirect productivity effects. The novelty of this work is twofold. First, it enables the estimation of productivity trends over time, providing a robust foundation for empirical analysis. Second, it applies the methodology to a case study of the electric generation sector, highlighting its practical relevance. Using data from the Bureau of Economic Analysis, the Bureau of Labor Statistics, and the Impact Analysis for Planning (IMPLAN) tool, the study reveals significant discrepancies between conventional productivity measures and those derived from the VIS approach. Furthermore, the proposed method aligns with the principles of Integrated Energy Systems by capturing the interrelations among generation, distribution, storage, and consumption. This alignment underscores its utility and applications for energy-related policy and planning. Overall, the findings contribute to more precise labor productivity assessments, supporting informed decision-making and future research. Additionally, the method highlights the importance of considering the whole supply chain, providing interrelated metrics for labor productivity which includes both, direct and indirect effects on the final labor productivity metric. By incorporating intersectoral dependencies, this method offers a more comprehensive and accurate measure of labor productivity compared to traditional metrics.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

NASA NTRS1974

Hydrogen energy: A bibliography with abstracts. Cumulative volume, 1953 - 1973

A bibliography on hydrogen as an energy source is presented. Approximately 8,000 documents are abstracted covering the period 1953 through 1973. Topics covered include: production, utilization, transmission, distribution, storage, and safety.

Cox, K. E.↗

NASA NTRS1977

Alternate aircraft fuels: Prospects and operational implications

The potential use of coal-derived aviation fuels was assessed. The studies addressed the prices and thermal efficiencies associated with the production of coal-derived aviation kerosene, liquid methane and liquid hydrogen and the air terminal requirements and subsonic transport performance when utilizing liquid hydrogen. The fuel production studies indicated that liquid methane can be produced at a lower price and with a higher thermal efficiency than aviation kerosene or liquid hydrogen. Ground facilities of liquefaction, storage, distribution and refueling of liquid hydrogen fueled aircraft at airports appear technically feasibile. The aircraft studies indicate modest onboard energy savings for hydrogen compared to conventional fuels. Liquid hydrogen was found to be superior to both aviation kerosene and liquid methane from the standpoint of aircraft engine emissions.

Witcofski, R. D.↗

NASA NTRS1981

Residential solar-heating system uses pyramidal optics

Report describes reflective panels which optimize annual solar energy collection in attic installation. Subunits include collection, storage, distribution, and 4-mode control systems. Pyramid optical system heats single-family and multi-family dwellings.

Source record↗

NASA NTRS1980

Asynchronous interactive control systems

A class of interactive control systems is derived by generalizing interactive manipulator control systems. The general structural properties of such systems are discussed and an appropriate general software implementation is proposed. This is based on the fact that tasks of interactive control systems can be represented as a network of a finite set of actions which have specific operational characteristics and specific resource requirements, and which are of limited duration. This has enabled the decomposition of the overall control algorithm into a set of subalgorithms, called subcontrollers, which can operate simultaneously and asynchronously. Coordinate transformations of sensor feedback data and actuator set-points have enabled the further simplification of the subcontrollers and have reduced their conflicting resource requirements. The modules of the decomposed control system are implemented as parallel processes with disjoint memory space communicating only by I/O. The synchronization mechanisms for dynamic resource allocation among subcontrollers and other synchronization mechanisms are also discussed in this paper. Such a software organization is suitable for the general form of multiprocessing using computer networks with distributed storage.

Vuskovic, M. I.↗

NASA NTRS1996

Site Partitioning for Redundant Arrays of Distributed Disks

Redundant arrays of distributed disks (RADD) can be used in a distributed computing system or database system to provide recovery in the presence of disk crashes and temporary and permanent failures of single sites. In this paper, we look at the problem of partitioning the sites of a distributed storage system into redundant arrays in such a way that the communication costs for maintaining the parity information are minimized. We show that the partitioning problem is NP-hard. We then propose and evaluate several heuristic algorithms for finding approximate solutions. Simulation results show that significant reduction in remote parity update costs can be achieved by optimizing the site partitioning scheme.

Mourad, Antoine N.↗

NASA NTRS1998

Insights Into the Fractional Order Initial Value Problem via Semi-Infinite Systems

This paper considers various aspects of the initial value problem for fractional order differential equations. The main contribution of this paper is to use the solutions to known spatially distributed systems to demonstrate that fractional differintegral operators require an initial condition term that is time-varying due to past distributed storage of information.

Hartley, Tom T.↗

NASA NTRS2008

Cryogenic Fluid Technologies for Long Duration In-Space Operations

Reliable knowledge of low-gravity cryogenic fluid management behavior is lacking and yet is critical in the areas of storage, distribution, and low-gravity propellant management. The Vision for Space Exploration mission objectives will require the use of high performance cryogenic propellants (hydrogen, oxygen, and methane). Additionally, lunar missions will require success in storing and transferring liquid and gas commodities on the surface. The fundamental challenges associated with the in-space use of cryogens are their susceptibility to environmental heat, their complex thermodynamic and fluid dynamic behavior in low gravity and the uncertainty of the position of the liquid-vapor interface if the propellants are not settled. The Cryogenic Fluid Management (CFM) project is addressing these issues through ground testing and analytical model development, and has crosscutting applications and benefits to virtually all missions requiring in-space operations with cryogens. Such knowledge can significantly reduce or even eliminate tank fluid boil-off losses for long term missions, reduce propellant launch mass and on-orbit margins, and simplify vehicle operations. The Cryogenic Fluid Management (CFM) Project is conducting testing and performing analytical evaluation of several areas to enable NASA s Exploration Vision. This paper discusses the content and progress of the technology focus areas within CFM.

Motil, Susan M.↗

NASA NTRS2010

Ceramic Integration Technologies for Advanced Energy Systems: Critical Needs, Technical Challenges, and Opportunities

Advanced ceramic integration technologies dramatically impact the energy landscape due to wide scale application of ceramics in all aspects of alternative energy production, storage, distribution, conservation, and efficiency. Examples include fuel cells, thermoelectrics, photovoltaics, gas turbine propulsion systems, distribution and transmission systems based on superconductors, nuclear power generation and waste disposal. Ceramic integration technologies play a key role in fabrication and manufacturing of large and complex shaped parts with multifunctional properties. However, the development of robust and reliable integrated systems with optimum performance requires the understanding of many thermochemical and thermomechanical factors, particularly for high temperature applications. In this presentation, various needs, challenges, and opportunities in design, fabrication, and testing of integrated similar (ceramic ceramic) and dissimilar (ceramic metal) material www.nasa.gov 45 ceramic-ceramic-systems have been discussed. Experimental results for bonding and integration of SiC based Micro-Electro-Mechanical-Systems (MEMS) LDI fuel injector and advanced ceramics and composites for gas turbine applications are presented.

Singh, Mrityunjay↗