SEARCH · Engineering Papers

Results for “Distributed File Systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

All sources NASA NTRS DOE OSTI

NASA NTRS1988

The Clouds distributed operating system - Functional description, implementation details and related work

Clouds is an operating system in a novel class of distributed operating systems providing the integration, reliability, and structure that makes a distributed system usable. Clouds is designed to run on a set of general purpose computers that are connected via a medium-of-high speed local area network. The system structuring paradigm chosen for the Clouds operating system, after substantial research, is an object/thread model. All instances of services, programs and data in Clouds are encapsulated in objects. The concept of persistent objects does away with the need for file systems, and replaces it with a more powerful concept, namely the object system. The facilities in Clouds include integration of resources through location transparency; support for various types of atomic operations, including conventional transactions; advanced support for achieving fault tolerance; and provisions for dynamic reconfiguration.

Dasgupta, Partha↗

NASA NTRS1994

Analysis of the request patterns to the NSSDC on-line archive

NASA missions, both for earth science and for space science, collect huge amounts of data, and the rate at which data is being gathered is increasing. For example, the EOSDIS project is expected to collect petabytes per year. In addition, these archives are being made available to remote users over the Internet. The ability to manage the growth of the size and request activity of scientific archives depends on an understanding of the access patterns of scientific users. The National Space Science Data Center (NSSDC) of NASA Goddard Space Flight Center has run their on-line mass storage archive of space data, the National Data Archive and Distribution Service (NDADS), since November 1991. A large world-wide space research community makes use of NSSDC, requesting more than 20,000 files per month. Since the initiation of their service, they have maintained log files which record all accesses the archive. In this report, we present an analysis of the NDADS log files. We analyze the log files, and discuss several issues, including caching, reference patterns, clustering, and system loading.

Johnson, Theodore↗

NASA NTRS2010

Implementation of a Relay Coordination System for the Mars Network

Mars network relay operations involve the coordination of lander and orbiter teams through long-term and short-term planning, tactical changes and post-pass analysis. Much of this coordination is managed through email traffic and point-to-point file data exchanges. It is often difficult to construct a complete and accurate picture of the relay situation at any given moment, as there is no centralized store of correlated relay data. The Mars Relay Operations Service (MaROS) is being implemented to address the problem of relay coordination for current and next-generation relay missions. The service is provided for the purpose of coordinating communications sessions between landed spacecraft assets and orbiting spacecraft assets at Mars. The service centralizes a set of functions previously distributed across multiple spacecraft operations teams, and as such greatly improves visibility into the end-to-end strategic coordination process. Most of the process revolves around the scheduling of communications sessions between the spacecraft during periods of time when a landed asset on Mars is geometrically visible by an orbiting spacecraft. These "relay" sessions are used to transfer data both to and from the landed asset via the orbiting asset on behalf of Earth-based spacecraft operators. This paper will discuss the relay coordination problem space, overview the architecture and design selected to meet system requirements, and describe the first phase of system implementation

Allard, Daniel A.↗

NASA NTRS1991

Mars high-resolution mapping

A series of photomosaics of high-resolution Viking Orbiter images of Mars is being prepared and published to support the Mars 1:500,000 scale geologic mapping program. More than 100 of these photomosaics were made manually, but for the last several years they have all been made digitally. The digital mosaics are published on the Mars Transverse Mercator (MTM) system, and they are also available to the appropriate principal investigators as digital files in the mosaicked digital image model (MDIM) format. The mosaics contain Viking Orbiter images with the highest available resolution: in some areas as high as 10 m/pixel. This resolution, where it exists, will support a 1:100,000 map scale. The full resolution of a mosaic is preserved in a digital file, but conventional lithographic publication of such large-scale inset maps will be done only if required by the geologic map author. When high-resolution images do not full the neatlines of an MTM quadrangle, the medium-resolution (1/256 degrees/pixel, or 231 m/pixel) MDIM is used. The mosaics are tied by image-matching to the planetwide MDIM, in which random errors as large as 5 km (10 mm at 1:500,000 scale) are common; a few much larger, worst-case errors also occur. Because of the distribution of the errors, many large discrepancies appear along the cutlines between frames with very different resolutions. Furthermore, each block of quadrangles is compiled on its own local control system, and adjacent blocks, compiled later, are unlikely to match. Selection of areas to be mapped is based on geologic mapping proposals reviewed and recommended by the Mars 1:500,000 scale geologic mapping review panel. There is no intention to map the entire planet at this scale.

Batson, R. M.↗

NASA NTRS2000

BOREAS TE-5 Leaf Gas Exchange Data

The BOREAS TE-5 team collected measurements in the NSA and SSA on gas exchange, gas composition, and tree growth. The leaf photosynthetic gas exchange data were collected in the BOREAS NSA and the SSA from 06-Jun- 1994 to 13-Sep- 1994 using a LI-COR 6200 portable photosynthesis system. The data were collected to compare the photosynthetic capacity, stomata] conductance, and leaf intercellular CO, concentrations among the major tree species at the BOREAS sites. The data are average values from diurnal measurements on the upper canopy foliage (sun leaves). The data are available in tabular ASCII files. The data files are available on a CD-ROM (see document number 20010000884), or from the Oak Ridge National Laboratory (ORNL) Distributed Activity Archive Center (DAAC).

Hall, Forrest G.↗

NASA NTRS1989

Second catalog of interferometric measurements of binary stars (McAlister and Hartkopf 1988): Documentation for the machine-readable version

The machine-readable version of the catalog, as it is currently being distributed from the Astronomical Data Center, is described. The catalog is a compilation of measurements of binary- and multiple-star systems obtained by speckle interferometric techniques; this version supersedes a previous edition of the catalog published in 1985. Stars that have been examined for multiplicity with negative results are included, in which case upper limits for the separation are given. The second version is expanded from the first in that a file of newly resolved systems and six cross-index files of alternate designations are included. The data file contains alternate identifications for the observed systems, epochs of observation, reported errors in position angles and separation, and bibliographical references.

Warren, Wayne H., Jr.↗

NASA NTRS1992

Recent enhancements to the GRIDGEN structured grid generation system

Significant enhancements are being implemented into the GRIDGEN3D, multiple block, structured grid generation software. Automatic, point-to-point, interblock connectivity will be possible through the addition of the domain entity to GRIDBLOCK's block construction process. Also, the unification of GRIDGEN2D and GRIDBLOCK has begun with the addition of edge grid point distribution capability to GRIDBLOCK. The geometric accuracy of surface grids and the ease with which databases may be obtained is being improved by adding support for standard computer-aided design formats (e.g., PATRAN Neutral and IGES files). Finally, volume grid quality was improved through addition of new SOR algorithm features and the new hybrid control function type to GRIDGEN3D.

Steinbrenner, John P.↗

NASA NTRS2005

NASA GES DISC DAAC Satellite Data for GIS

NASA's Goddard Earth Science (GES) Data and Information Services Center (DISC) Distributed Active Archive Center (DAAC) makes available a large and continually growing collection of spatially continuous global satellite observations of environmental parameters. These products include those from the MODIS (Moderate Resolution Imaging Spectroradiometer) on both Terra and Aqua platforms, and the Tropical Rainfall Measuring Mission (TRMM). These data products are well suited for use within Geographic Information Systems (GIS), as both backdrops to cartographic products as well as spatial analysis. However, data format, file size, and other issues have limited their widespread use by traditional GIS users. To address these data usability issues, the GES DISC DAAC recently updated tools and improved documentation of conversion procedures. In addition, the GES DISC DAAC has also been working with a major GIS software vendor to incorporate the ability to read the native Hierarchial Data Format (HDF), the format in which most of the NASA data is stored. The result is the enabling of GIS users to realize the benefit of GES DISC DAAC data without a substantial expenditure in resources to incorporate these data into their GIS. Several documents regarding the potential uses of GES DISC DAAC satellite data in GIS have recently been created. These show the combinations of concurrent data from different satellite products with traditional GIS vector products for given geographic areas. These map products include satellite imagery of Hurricane Isabel and the California wildfires, and can be viewed at http://daac.gsfc.nasa.gov/MODIS/GIS/.

Nickless, Darryl↗

DOE OSTI2020

WHONDRS Summer 2019 Sampling Campaign: Global River Corridor Sediment FTICR-MS, Dissolved Organic Carbon, Aerobic Respiration, Elemental Composition, Grain Size, Total Nitrogen and Organic Carbon Content, Bacterial Abundance, and Stable Isotopes (v10)

The WHONDRS Summer 2019 Sampling (S19S) Campaign collected samples in 97 globally distributed river corridor systems between July and September 2019. Surficial streambed sediments were collected at three locations within each site (upstream, midstream, and downstream). Surface water was collected at the downstream site. This dataset includes a portion of the data types produced from the sediment samples and does not include any results from the surface water. Surface water data can be found at https://data.ess-dive.lbl.gov/view/doi:10.15485/1603775. The S19S campaign was designed with the science community to ask questions associated with links among core/transient metabolomes, microbial metabolism, biogeochemical function, and physical properties of watershed and river corridor systems. This data package was originally published in December 2020. It was updated in April 2021 (v2; modified files), May 2022 (v3; new and modified files), November 2022 (v4; new and modified files), January 2023 (v5 and v6; new and modified files), February 2023 (v7; new and modified files), August 2023 (v8; new and modified files), July 2025 (v9; new and modified files), and June 2026 (v10; new and modified files). Version 10 includes major restructuring of the files and their formats. See the change history in the readme for details. In addition to a readme, this data package also includes a file-level metadata (FLMD) file that describes each file and a data dictionary (DD) that describes all column/row headers and variable definitions. This dataset contains (1) readme, (2) data dictionary, (3) file level metadata, (4) sampling protocol, (5) a data checks report, (6) field metadata, (7) international generic sample number (IGSN) mapping file, (8) joint genome institute (JGI) mapping file, (9) a folder of site photos, and (10) a folder of sample data. The sample data folder contains (1) dissolved organic carbon (DOC, measured as non-purgeable organic carbon, NPOC) and FTICR methods; (2) respiration rates and normalized respiration rates calculated from laboratory sediment incubations, (3) X-ray fluorescence (XRF) elemental composition, (4) grain size distribution from the < 2 millimeter fraction of sediment, (5) total organic carbon and total nitrogen content, (6) bacterial abundance flow cytometry data, (7) sediment stable isotopes (C and N), (8) laboratory methods, (9) water and sediment mass and volume used in incubations, (10) a folder with code, inputs, and plots for the respiration rates, (11) a folder containing XRF data, (12) a folder containing unaligned, peak-picked high resolution characterization of dissolved organic matter from sediment via 12 Tesla Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS) through the Environmental Molecular Sciences Laboratory (EMSL; https://www.pnnl.gov/environmental-molecular-sciences-laboratory), (12) and a folder containing processed FTICR-MS data. All files are .msa, .txt, .spx, .xml, .csv, .pdf, .txt, .jpg, or .jpeg.

13C↗

NASA NTRSDate not supplied

What (and How) MERRA-2 Reanalysis Data are Used in Applied Sciences

The Modern Era Retrospective-analysis for Research and Applications, Version 2 (MERRA-2) is the global atmospheric data reanalysis for the satellite era produced by NASA’s Global Modeling and Assimilation Office (GMAO), using the Goddard Earth Observing System Model (GEOS)version 5.12.4. The data are officially distributed by the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC). MERRA-2 data have been widely used by the Earth sciences and application community. Since MERRA-2 data were released in early 2016, the number of registered data users has grown steadily from 1,252 in 2016 to 6477 in 2020. By the end of October 2021, ~16 petabytes (over 360 million files) of data have been distributed to more than 18,900 users. Searching in Google Scholar (https://scholar.google.com/), we have found over 7,000 articles, published between January 2017 and May 2021, involving the use ofMERRA-2 data. The figure shows the numbers for various application areas in which theMERRA-2 data have been used, covering almost all of the application areas defined in NASA Applied Sciences (http://appliedsciences.nasa.gov). The largest number of articles are found in disaster research, with the subcategories ordered in flood, wildfires, hurricanes and cyclones, and other forms of severe weather. In this presentation, we will discuss the preliminary findings from a review of the selected literature that uses MERRA-2 data in applied sciences. The current analytic and interoperable data services at GES DISC are listed, such as the on-the-fly subset and analysis service, NASA Giovanni; THREDDS Data Server(TDS); and Python Jupyter notebooks. In addition, we will introduce two new services for supporting the open sciences: My Dashboard and Related Publications.

data management↗

NASA NTRS1990

The ISIS project: Fault-tolerance in large distributed systems

The semi-annual status report covers activities of the ISIS project during the second half of 1989. The project had several independent objectives: (1) At the level of the ISIS Toolkit, ISIS release V2.0 was completed, containing bypass communication protocols. Performance of the system is greatly enhanced by this change, but the initial software release is limited in some respects. (2) The Meta project focused on the definition of the Lomita programming language for specifying rules that monitor sensors for conditions of interest and triggering appropriate reactions. This design was completed, and implementation of Lomita is underway on the Meta 2.0 platform. (3) The Deceit file system effort completed a prototype. It is planned to make Deceit available for use in two hospital information systems. (4) A long-haul communication subsystem project was completed and can be used as part of ISIS. This effort resulted in tools for linking ISIS systems on different LANs together over long-haul communications lines. (5) Magic Lantern, a graphical tool for building application monitoring and control interfaces, is included as part of the general ISIS releases.

Birman, Kenneth P.↗

DOE OSTI2026

Fracture Intersections under Stress: Laboratory Data and Code [Data set]

The connectivity of natural and induced fractures governs the injection and withdrawal of fluids from subsurface reservoirs. Connectivity depends on intersections that control how fluids mix and move through the entire system. Here, we present data sets from 3D X-ray microscopy measurements of simple fracture networks under stress. 3D printing was used to create prismatic blocks that formed fracture networks composed of 2 orthogonal fractures. The network orientation was either "x" or "+" relative to an applied vertical stress. 3D data sets were collected for normal loads of 25, 100 and 200 Newtons for samples with fracture surfaces with either correlated or uncorrelated asperity distributions. The file contains data from the 12 samples analyzed along with an example code used to extract the intersection geometry. Additional experimental details can be found in the manuscript "Geologic Stress Modulates Fluid Mixing at Fracture Intersections" (10.1038/s43247-026-03525-9)and supplemental information to appear in Communications Earth & Environment in 2026.

02 PETROLEUM↗

NASA NTRS1999

Hyperspectral Imagery Data for Remote Sensing

In order for remotely sensed data to be useful in a practical application for agriculture, an information product must be made available to the land management decision maker within 24 to 48 hours of data acquisition. Hyperspectral imagery data is proving useful in differentiation of plant species potentially allowing identification of non-healthy areas and pest infestations within crop fields that may require the farm managers attention. Currently however, extracting the needed site-specific feature information from the vast spectral content of large hyperspectral image files is a labor intensive and time consuming task prohibiting the necessary fast turnaround from raw data to final product. We illustrate the methods, techniques and technologies necessary to produce field-level information products from imagery and other related spatial data that are useful to the farm manager for specific decisions that must be made throughout the growing season. We also propose to demonstrate the cost effectiveness of an integrated system, from acquisition to final product distribution, to utilize imagery for decisions on a working farm in conjunction with a commercial agricultural services company and their crop scouts. The demonstration farm is Chesapeake Farms, a 3000 acre research farm in Chestertown, Maryland on the Eastern Shore and is owned by the DuPont Corporation.

Garegnani, Jerry↗

DOE OSTI2020

Hydrologic Model Files (PRMS) for Historical Conditions in the East River Watershed, Colorado between 1987-2019

The data package contains model input and output file for the East River watershed (85 km2) located in the headwaters of the Colorado River. The model is the U.S. Geological Survey (USGS) Precipitation-Modeling Runoff System (PRMS) for the historical, or baseline, condition (1987-2019) to assess the efficiency of summer monsoon rains to generate streamflow. The finite difference grid resolution is 100 m with elevations resampled from the USGS National Elevation Dataset. LANDFIRE raster data is used to derive parameters of dominant cover type, summer and winter cover density, canopy interception characteristics for snow and rain and transmission coefficient for shortwave radiation. Climate forcing uses minimum and maximum daily temperature lapse rates defined by the two Snow Telemetry (SNOTEL) stations located in the vicinity of the East River adjusted for aspect. Schofield SNOTEL snowfall is spatially distributed using LiDAR derived snow depth observations from the Airborne Snow Observatory (ASO) flown 4 April 2016. Snow depths are converted to snow water equivalent based on ground surveys and density modeling. Rainfall is spatially distributed using the monthly Parameter-elevation Relationships on Independent Slopes Model 30-year monthly averages. Simulated solar radiation is calibrated to match weather station observations. Model verification of snow water equivalent (SWE) accumulation and ablation relies on the 2018 and 2019 ASO maps and weather station snow depth. The data package contains model input files in text format, model documentation in pfd and a readme.txt file to help users understand the file structure to run the program.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Sample Identifiers and Metadata Reporting Format for Environmental Systems Science

The ESS-DIVE sample identifiers and metadata reporting format primarily follows the System for Earth Sample Registration (SESAR) Global Sample Number (IGSN) guide and template, with modifications to address Environmental Systems Science (ESS) sample needs and practicalities (IGSN-ESS). IGSNs are associated with standardized metadata to characterize a variety of different sample types (e.g. object type, material) and describe sample collection details (e.g. latitude, longitude, environmental context, date, collection method). Globally unique sample identifiers, particularly IGSNs, facilitate sample discovery, tracking, and reuse; they are especially useful when sample data is shared with collaborators, sent to different laboratories or user facilities for analyses, or distributed in different data files, datasets, and/or publications. To develop recommendations for multidisciplinary ecosystem and environmental sciences, we first conducted research on related sample standards and templates. We provide a comparison of existing sample reporting conventions, which includes mapping metadata elements across existing standards and Environment Ontology (ENVO) terms for sample object types and environmental materials. We worked with eight U.S. Department of Energy (DOE) funded projects, including those from Terrestrial Ecosystem Science and Subsurface Biogeochemical Research Scientific Focus Areas. Project scientists tested the process of registering samples for IGSNs and associated metadata in workflows for multidisciplinary ecosystem sciences. We provide modified IGSN metadata guidelines to account for needs of a variety of related biological and environmental samples. While generally following the IGSN core descriptive metadata schema, we provide recommendations for extending sample type terms, and connecting to related templates geared towards biodiversity (Darwin Core) and genomic (Minimum Information about any Sequence, MIxS) samples and specimens. ESS-DIVE recommends registering samples for IGSNs through SESAR, and we include instructions for registration using the IGSN-ESS guidelines. Our resulting sample reporting guidelines, template (IGSN-ESS), and identifier approach can be used by any researcher with sample data for ecosystem sciences.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS1996

First Two Years of Observations NASA ACTS Propagation Experiment Central Oklahoma Site

Continuous observations from December 1, 1993 through November 30, 1995 were made at the ACTS Propagation Terminal on the roof of the Sarkeys Energy Center at the University of Oklahoma in Norman, Oklahoma. Beacon and radiometer observations were combined to calibrate the beacon system for the estimation of total attenuation (attenuation relative to free space) and attenuation relative to clear sky (gaseous absorption component removed). Empirical cumulative distributions (edf's) were compiled for each month of observation and for each year. The annual edf's are displayed in the figures, the monthly and annual edf's are listed in the tables. The tables are organized by blocks and pages within a block. The blocks correspond to the headings in the edf files generated by the ACTS Preprocessing (actspp) software and contained in the fourth disk in the set of ACTS Propagation Experiment CD-ROMs generated by the University of Texas.

Crane, Robert K.↗

DOE OSTI2025

Leveraging Pre-Built Catalogs and Object-Level Scheduling to Eliminate I/O Bottlenecks in HPC Environments

Modern High-Performance Computing (HPC) environments face mounting challenges due to the shift from large to small file datasets, along with an increasing number of users and parallelized applications. As HPC systems rely on Parallel File Systems (PFS), such as Lustre for data processing, performance bottlenecks stemming from Object Storage Target (OST) contention have become a significant concern. Existing solutions, such as LADS with its object-level scheduling approach, fall short in large-scale HPC environments due to their inability to effectively address metadata I/O bottlenecks and the growing number of I/O processes. This study highlights the pressing need for a comprehensive solution that tackles both OST contention and metadata I/O challenges in diverse HPC workloads. To address these challenges, we propose SwiftLoad, an object-level I/O scheduling framework that leverages a metadata catalog to enhance the performance and efficiency of parallel HPC utilities. The adoption of the metadata catalog mitigates the metadata I/O bottlenecks that commonly occur in HPC utilities, a challenge that is particularly pronounced in object-level I/O scheduling. SwiftLoad addresses OST contention and the uneven distribution of I/O processes across different OSTs through mathematical modeling and incorporates a Loader Configuration Module to regulate the number of I/O processes. Evaluated with two representative utilities—data deduplication profiling and data augmentation—SwiftLoad achieved performance improvements of up to 5.63x and 11.0x, respectively, on a production supercomputer.

HPC↗

DOE OSTI2025

How initial conditions-, structural-, and parameter-based model uncertainty interact and influence predictions in permafrost ecosystems: Modeling Archive

This dataset contains model output and input data, as well as source code examples for the Terrestrial Ecosystem Model with the Dynamic Vegetation Model and Dynamic Organic Soil (DVM-DOS-TEM) for the field sites Imnavait creek and the Bonanza creek Long Term Ecological Research Network (LTER). The data covers simulations from the last glacial maximum (LGM) until 2100 for a selection of paleo scenarios, setting the mean temperature of the LGM up to 10°C lower than pre-industrial conditions. The model structure was modulated to represent various model versions, and this dataset contains the relevant changes in the source code. The raw output data, the processed statistical data, the setup and processing scripts as well as parameter value distribution files from a parameter sensitivity analysis are included as well. Model outputs include active layer depth, organic soil carbon, soil layer depths, gross primary productivity (GPP) with and without nitrogen limitation, net primary productivity (NPP), soil liquid water content, heterotrophic, maintenance, and growth respiration, soil temperature, and vegetation carbon (*.nc files). The Next-Generation Ecosystem Experiments in the Arctic (NGEE Arctic) project is a research effort to reduce uncertainty in the Department of Energy’s Energy Exascale Earth System Model (E3SM) by developing a predictive understanding of Arctic tundra ecosystems underlain by permafrost and to quantify feedbacks from the Arctic tundra to the Earth system. NGEE Arctic is supported by the Department of Energy's Office of Biological and Environmental Research.Over Phases 1–3, observations made by the NGEE Arctic team across a gradient of permafrost landscapes in Arctic Alaska improved the representation of tundra processes in the land surface component of E3SM (the E3SM Land Model, ELM). Model improvements emphasized unique aspects of permafrost environments and explored reductions in model complexity while retaining predictive power. The Arctic-informed ELM developed by NGEE Arctic has been used to make novel predictions on processes ranging from permafrost thaw to soil biogeochemical cycling to Earth system feedbacks associated with the unique characteristics of tundra plants. In Phase 4, the NGEE Arctic team is evaluating our new predictive understanding under novel conditions across the Arctic domain. In collaboration with partners at long-term pan-Arctic research sites we are examining whether an Arctic-informed ELM can faithfully simulate interactions among surface and subsurface processes at site, regional, and pan-Arctic scales. In turn, we are using variety of tools to dynamically extend and evaluate ELM inference, with an emphasis on data synthesis and pan-Arctic model evaluation, reintegration of code with an evolving E3SM, scaling across heterogeneous Arctic landscapes, and the appropriate representation of the impacts of increasingly frequent Arctic disturbances.

54 ENVIRONMENTAL SCIENCES↗