Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Distributed File Systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Queued Up: 2025 Edition – Characteristics of Power Plants Seeking Transmission Interconnection As of the End of 2024 [Slides]

Electric transmission system operators (ISOs, RTOs, or utilities) require proposed power plants seeking to connect to the transmission grid to undergo a series of impact studies before they can be built. This process establishes what new transmission equipment or upgrades may be needed before a project can connect to the system and assigns the costs of that equipment. The lists of projects in this process are known as “interconnection queues”. In collaboration with interconnection.fyi, Berkeley Lab compiled, aggregated, and cleaned interconnection queue data from >50 transmission grid operators (7 ISO/RTOs and 49 non-ISO balancing areas), which collectively represent ~97% of currently installed U.S. electric generating capacity. The dataset includes requests submitted to queues through the end of 2024, and only includes requests seeking to connect to the transmission grid (not distribution-connected or behind-the-meter projects). The files below include both a PDF report and an Excel data file. The PDF report analyzes interconnection data and metrics through the end of 2024. The Excel data file includes (a) the full project-level interconnection queue dataset through 2024, (b) a codebook (data dictionary) describing each data field, and (c) 35 additional tabs featuring tables summarizing a range of interconnection metrics. Key highlights from the Queued Up: 2025 Edition (featuring data through 2024) include: • As of the end of 2024, there were ~10,300 projects actively seeking grid interconnection in the U.S., representing 1,400 GW of generation and approximately 890 GW of storage. • Historic withdrawal rates alongside relatively fewer new requests resulted in a 12% decrease in total active queue volume compared to the prior year. • Active natural gas capacity (136 GW, +72% year-over-year) increased in 2024, while solar (956 GW, -12%), storage (890 GW, -13%), and wind (271 GW, -26%) capacity decreased. • 408 GW of capacity already has a draft or executed interconnection agreement (IA) but has not yet reached commercial operations. • The time projects spend in queues before reaching COD is increasing. For the regions with available data, the median duration from IR to COD has doubled from <2 years for projects built in 2000-2007 to over 4 years for those built in 2018-2024. • Ultimately, most of this proposed capacity will not be built. Only 13% of capacity that submitted interconnection requests from 2000-2019 had reached commercial operations by the end of 2024; 77% of that capacity had been withdrawn and 10% was still active. • FERC Order 2023 and various other reforms are being implemented. These are important measures to reduce interconnection bottlenecks and enhance grid system reliability, but it is too early to measure and assess their full impact. • New additions for the 2025 edition include: (a) additional detail on data processing and gaps; (b) updates on interconnection reforms; (c) new analysis on interconnection agreements, and more.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

The git based ATLAS data acquisition configuration service in LHC Run 3

The ATLAS experiment at the LHC at CERN uses a large, distributed trigger and data acquisition system composed of many computing nodes, networks, and hardware modules. Its configuration service is used to provide descriptions of control, monitoring, diagnostic, recovery, dataflow and data quality configurations, interconnections, and parameters for modules, chips, and channels of various online systems, detectors, and the whole ATLAS experiment. Those descriptions have historically been stored in more than one thousand interconnected XML files, which are updated by various experts many times per day. Maintaining error-free and consistent sets of such files and providing reliable and fast access to current and historical configurations is a major challenge. This paper gives details of the configuration service upgrade on the modern Git version control system backend for LHC Run 3 and its exploitation experience. It may be interesting for developers using human-readable file formats, where consistency of the files, performance, access control, traceability of modifications, and effective archiving are key requirements.

Soloviev, Igor [Univ. of California, Irvine, CA (U↗
NASA NTRS1976

LACIE performance predictor final operational capability program description, volume 3

The requirements and processing logic for the LACIE Error Model program (LEM) are described. This program is an integral part of the Large Area Crop Inventory Experiment (LACIE) system. LEM is that portion of the LPP (LACIE Performance Predictor) which simulates the sample segment classification, strata yield estimation, and production aggregation. LEM controls repetitive Monte Carlo trials based on input error distributions to obtain statistical estimates of the wheat area, yield, and production at different levels of aggregation. LEM interfaces with the rest of the LPP through a set of data files.

Source record↗
NASA NTRS1996

BIOME: A browser-aware search and order system

The Oak Ridge National Laboratory (ORNL) Distributed Active Archive Center (DAAC), which is associated with NASA's Earth Observing System Data and Information System (EOSDIS), provides access to a large number of tabular and imagery datasets used in ecological and environmental research. Because of its large and diverse data holdings, the challenge for the ORNL DAAC is to help users find data of interest from the hundreds of thousands of files available at the DAAC without overwhelming them. Therefore, the ORNL DAAC developed the Biogeochemical Information Ordering Management Environment (BIOME), a search and order system for the World Wide Web (WWW). The WWW provides a new vehicle that allows a wide range of users access to the data. This paper describes the specialized attributes incorporated into BIOME that allow researchers easy access to an otherwise bewildering array of data products.

Grubb, Jon W.↗
DOE OSTI2024

Continuous soil temperature measurements from 2019-10-4 to 2020-10-4, Teller road Mile 27, Seward Peninsula, Alaska

The dataset contains depth-resolved soil temperature measured at 45 discrete locations in a watershed located along the Nome-Teller road at Mile 27 in Seward Peninsula, Alaska. The dataset was generated to understand the local heterogeneity of soil thermal dynamics and their controls in a discontinuous permafrost region. At each location, temperatures were measured by a distributed temperature profiling probe designed based on Dafflon et al (2022). The dataset includes a description of the probe locations in the "Probe_locations.csv" file and the 45 data files (Soil_temperatures_*.csv). Metadata files include data descriptions (_dd.csv) for tabular data. All included files are listed and described in NGA513_flmd.csv.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Maps of plant functional type (PFT), PFT fractional cover, and uncertainty derived from AVIRIS-NG data, 2019, Seward Peninsula

Remote sensing maps of plant functional type (PFT), PFT fractional cover (fCover), and fCover uncertainty maps derived from NASA’s Airborne Visible / Infrared Imaging Spectrometer – Next Generation (AVIRIS-NG). The AVIRIS-NG imaging spectroscopy data (380 ~ 2510 nm) was collected as a part of the collaboration between NASA’s Arctic-Boreal Vulnerability Experiment (ABoVE; Miller et al., 2019) and DOE’s Next Generation Ecosystem Experiment in the Arctic (NGEE-Arctic). This package includes maps for flights over Teller, Kougarok, and Council watersheds created using eight AVIRIS-NG imagery collected in July, 2019. The map data and metadata are provided as image (ENVI, *.png) and text (*.txt, *hdr) formats. Additional supporting map quicklooks are provided as GIS *.kml files. Detailed description of the methods for each map are provided in Yang et al., (2023). These datasets are provided in support of Yang et al., (In revision) “Topography and Functional Traits Control the Distribution of Key Shrub Plant Functional Types in Low-Arctic Tundra”.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

ARDP Natrium Neutronic Methodology: Argonne Neutronic Assessment of ABR-1000

The Natrium Sodium-cooled Fast Reactor (SFR) concept developed by TerraPower, LLC was selected as one of the advanced reactor designs for demonstration under the Advanced Reactor Demonstration Program Natrium Demo project. In collaboration with TerraPower, the Argonne National Laboratory (ANL) team provide independent reviews of the neutronic methodology being used for the Natrium design. As part of this activity, both the TerraPower and ANL teams agreed to perform independent neutronics analyses of the ABR-1000 reactor problem as a demonstration on the usage of the neutronics methodologies. Comparison of the results from TerraPower and ANL would expose any methodological differences in the modeling approaches. This report describes and presents the Argonne analysis work on the ABR-1000, and will be provided to TerraPower, along with data files, to complete the comparison study. The comparison will cover the methodology to evaluate the reactivity coefficients for a safety analysis, the shutdown margin, and the reconstructed pin power distribution. The methods and models used to calculate the kinetic parameters and the reactivity coefficients (density, Doppler, axial/radial expansion, etc.) are described in detail with recommendations of specific method options and modelling techniques. The control system reactivity worth and the excess reactivity due to temperature defect are calculated for the shutdown margin analysis. The method to evaluate the excess reactivity is discussed in detail. The pin power reconstruction methodology used in SE2ANL, SE2RCT, and DASSH are discussed in this report. The pin power distribution evaluated by different methods are compared and discussed in the report.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS1978

The IMSL environment for software development

The international mathematical and statistical library (IMSL) developed a set of macros and a file naming convention that automates the subroutine development and testing process over ten computer types. The IMSL software development system is implemented on a Data General Eclipse C330 computer with 256K bytes of central memory and 192M bytes of disk storage using the AOS Operating System. RJE activity is handled by a Data 100 communications computer. The system allows the programmer to work with basis decks. Distribution decks are generated, by the IMSL FORTRAN converter, as they are needed for testing and whenever the basis deck has been modified.

Aird, T. J.↗
DOE OSTI2024

Updates to the Hanford Soil Inventory Model (SIM Version 2) for FY 2023

The purpose of this environmental calculation file (ECF) is to document the updates made to the Soil Inventory Model version 2.1 (SIM-v2.1) (ECF-HANFORD-21-0073, Updates to the Hanford Soil Inventory Model (SIM Version 2) for FY 2021) in FY 2023. These updates to SIM-v2.1 are referred to as the SIM-v2.2 version. The following updates have been made: • Include inventory estimate for a new analyte • hexavalent chromium (Cr(VI)), separate from total chromium inventory • Revise the inventory discharged to the 216-U-10 and 216-T-4 Pond systems based on partitioning of waste streams discharges over time and space among influent ditches and ponds • Enhance the preprocessing and postprocessing of the input and output files Note that the methodology for estimating Cr(VI) inventories is based on ECF-200W-23-0040, Recommendations for Updating Liquid Discharged Inventory and Transport Modeling Parameters for Cumulative Impacts Evaluation of Hexavalent Chromium in the 200 West Area while the revision of inventory discharged to the 216-U-10 and 216-T-4 Pond systems is based on ECF-HANFORD-19-0032, Distribution of Infiltration in the 216-U-10, 216-B-3 Pond, and 216-T-4 Pond Systems 1944-1997.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2005

Space Physics Data Facility Web Services

The Space Physics Data Facility (SPDF) Web services provides a distributed programming interface to a portion of the SPDF software. (A general description of Web services is available at http://www.w3.org/ and in many current software-engineering texts and articles focused on distributed programming.) The SPDF Web services distributed programming interface enables additional collaboration and integration of the SPDF software system with other software systems, in furtherance of the SPDF mission to lead collaborative efforts in the collection and utilization of space physics data and mathematical models. This programming interface conforms to all applicable Web services specifications of the World Wide Web Consortium. The interface is specified by a Web Services Description Language (WSDL) file. The SPDF Web services software consists of the following components: 1) A server program for implementation of the Web services; and 2) A software developer s kit that consists of a WSDL file, a less formal description of the interface, a Java class library (which further eases development of Java-based client software), and Java source code for an example client program that illustrates the use of the interface.

Candey, Robert M.↗
NASA NTRS1972

Map the distribution of glaciofluvial deposits and associated glacial landforms

The author has identified the following significant results. Relatively little good usable ERTS-1 imagery has been received to date for data extraction. Of three U-2 aircraft support missions flown in Maine, only photography from the 20 September flight is cloud free and of excellent quality. Controlled local contract photography flown in August and September is of generally excellent quality. Low altitude ground truth photography is useful. The system of image and photo filing is discussed, and the limited work involving image and photo comparison is described.

Woodman, R. G.↗
DOE OSTI2024

SCALE Input and Result Files Supporting SCALE Inventory and Reactivity Analysis as Part of the Hermes 2021 PSAR Review

This dataset contains input and result files of computational simulations with the SCALE code system. The simulations cover radionuclide inventory and reactivity analyses of a fluoride salt-cooled high temperature pebble-bed reactor (PB-FHR), specifically the Hermes low-power PB-FHR demonstration reactor. Users wanting to reproduce results from this dataset are required to obtain a license to the SCALE code system for which details on the distribution can be found here: https://www.ornl.gov/scale/releases

equilibrium core↗
DOE OSTI2025

Disentangling the Impacts of Microtopography and Shrub Distribution on Snow Depth in a Subarctic Watershed: Toward a Predictive Understanding of Snow Spatial Variability: Supporting Data and Code

This repository contains R code and associated datasets for reproducing the analysis described in the manuscript titled “Disentangling the Impacts of Microtopography and Shrub Distribution on Snow Depth in a Subarctic Watershed: Toward a Predictive Understanding of Snow Spatial Variability” (DOI: 10.1029/2024JG008604). The provided scripts facilitate a comprehensive analysis of snow depth variability influenced by microtopography and vegetation distribution in a subarctic watershed. Included datasets are high-resolution spatial maps of snow depth, terrain elevation, vegetation height, and distance from shrubs taller than 1 meter, all formatted as text files (.txt). These data are fully describe in doi:10.15485/2316038. Users can adapt the provided R scripts to accommodate different data formats or larger spatial domains, noting that some output files may require modification due to their size.The code includes implementations for boosted regression tree analysis adapted from methods outlined in Elith et al. (2008). Users interested in understanding or modeling landscape-scale snow distribution patterns, particularly in Arctic or subarctic ecosystems, will find this package useful. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1994

A distributed analysis and visualization system for model and observational data

Software was developed with NASA support to aid in the analysis and display of the massive amounts of data generated from satellites, observational field programs, and from model simulations. This software was developed in the context of the PATHFINDER (Probing ATmospHeric Flows in an Interactive and Distributed EnviRonment) Project. The overall aim of this project is to create a flexible, modular, and distributed environment for data handling, modeling simulations, data analysis, and visualization of atmospheric and fluid flows. Software completed with NASA support includes GEMPAK analysis, data handling, and display modules for which collaborators at NASA had primary responsibility, and prototype software modules for three-dimensional interactive and distributed control and display as well as data handling, for which NSCA was responsible. Overall process control was handled through a scientific and visualization application builder from Silicon Graphics known as the Iris Explorer. In addition, the GEMPAK related work (GEMVIS) was also ported to the Advanced Visualization System (AVS) application builder. Many modules were developed to enhance those already available in Iris Explorer including HDF file support, improved visualization and display, simple lattice math, and the handling of metadata through development of a new grid datatype. Complete source and runtime binaries along with on-line documentation is available via the World Wide Web at: http://redrock.ncsa.uiuc.edu/ PATHFINDER/pathre12/top/top.html.

Wilhelmson, Robert B.↗
NASA NTRS2001

The Standard Autonomous File Server, a Customized, Off-the-Shelf Success Story

The Standard Autonomous File Server (SAFS), which includes both off-the-shelf hardware and software, uses an improved automated file transfer process to provide a quicker, more reliable, prioritized file distribution for customers of near real-time data without interfering with the assets involved in the acquisition and processing of the data. It operates as a stand-alone solution, monitoring itself, and providing an automated fail-over process to enhance reliability. This paper will describe the unique problems and lessons learned both during the COTS selection and integration into SAFS, and the system's first year of operation in support of NASA's satellite ground network. COTS was the key factor in allowing the two-person development team to deploy systems in less than a year, meeting the required launch schedule. The SAFS system his been so successful, it is becoming a NASA standard resource, leading to its nomination for NASA's Software or the Year Award in 1999.

Semancik, Susan K.↗
DOE OSTI2021

Distribution of Infiltration in the 216-U-10, 216-B-3 Pond, and 216-T-4 Pond Systems 1944-1997

A modeling system to simulate fate and transport of contaminant plumes in groundwater beneath the Central Plateau to support the Cumulative Impact Evaluation (CIE) and Composite Analysis (CA) is being developed. The CIE will evaluate the cumulative effect of multiple Central Plateau radiological and chemical sources on groundwater quality. This will enable cleanup decisions to be evaluated in the context of all Central Plateau waste sites and existing groundwater conditions. The purpose of this Environmental Calculation File (ECF) is to partition the infiltration of wastewater and contaminant inventory between the main pond and each expansion lobe of the 216-B-3 Pond system, and to partition the infiltration of wastewater and contaminant inventory between the ditches and ponds of the 216-U-10 Pond and 216-T-4 Pond systems.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

BULKI-Store v0.3.2

BULKI-Store is a distributed object storage system optimized for high-performance computing environments. Built with a Rust core and Python bindings, it efficiently manages scientific and machine learning datasets across HPC clusters. The system employs a client-server architecture with MPI integration, enabling seamless scaling on supercomputers like Perlmutter. BULKI-Store's object-oriented approach provides intuitive data organization with rich metadata support, contrasting with traditional file-based solutions. Key optimizations include selective checkpoint loading, unified checkpoint files, and object chunking for large data transfers. For machine learning workloads, BULKI-Store offers advantages through fine-grained access patterns, dynamic data sharing between training instances, and reduced memory pressure. Memory management features include strategic Python GC calls, minimized data copies, and batch processing capabilities. The system leverages Rayon's thread pool for asynchronous data prefetching and supports multiple CPU architectures (ARM64, x86, AMD, RISC-V). By combining performance optimizations with developer-friendly APIs, BULKI-Store addresses the complex data management challenges of modern HPC applications while maintaining compatibility across heterogeneous computing environments.

Zhang, Wei [Lawrence Berkeley National Laboratory ↗
NASA NTRS1988

The Clouds distributed operating system - Functional description, implementation details and related work

Clouds is an operating system in a novel class of distributed operating systems providing the integration, reliability, and structure that makes a distributed system usable. Clouds is designed to run on a set of general purpose computers that are connected via a medium-of-high speed local area network. The system structuring paradigm chosen for the Clouds operating system, after substantial research, is an object/thread model. All instances of services, programs and data in Clouds are encapsulated in objects. The concept of persistent objects does away with the need for file systems, and replaces it with a more powerful concept, namely the object system. The facilities in Clouds include integration of resources through location transparency; support for various types of atomic operations, including conventional transactions; advanced support for achieving fault tolerance; and provisions for dynamic reconfiguration.

Dasgupta, Partha↗