Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data storage data management”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

ENRESA's Spent Nuclear Fuel and Special Waste Database - 18115

Empresa Nacional de Residuos Radiactivos S.A. (ENRESA, by its initials in Spanish) Spent Nuclear Fuel (SNF) and Special Waste (SW) database development was initiated in a common effort between ENRESA and UNESA (the Spanish Association of the Electricity Industry) as a consequence of new regulatory requirements in the frame of radioactive waste management plans. Although these requirements were only mandatory for operators of nuclear power plants, ENRESA deemed necessary to have a centralized database which collected the data from the plant operators. The most relevant features of this database are: - The information collected covers not only the general characteristics of the SNF and SW but also the operation details needed for their characterization. - An application, named Gestion de Elementos Combustibles y Residuos Especiales (GECYRE, by its initials in Spanish) has been implemented for easing the queries and the generation of predefined reports. - An agile data transfer scheme, based on XML files, is used for an effective communication between ENRESA and the operators. The database is currently in production phase since 2014. During this phase it has demonstrated its effectiveness as an information repository to address the SNF and SW interim storage projects in Spain foreseen in the near future. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Cloud-Based Orchestration of a Model-Based Power and Data Analysis Toolchain

The proposed Europa Mission concept contains many engineering and scientific instruments that consume varying amounts of power and produce varying amounts of data throughout the mission. System-level power and data usage must be well understood and analyzed to verify design requirements. Numerous cross-disciplinary tools and analysis models are used to simulate the system-level spacecraft power and data behavior. This paper addresses the problem of orchestrating a consistent set of models, tools, and data in a unified analysis toolchain when ownership is distributed among numerous domain experts. An analysis and simulation environment was developed as a way to manage the complexity of the power and data analysis toolchain and to reduce the simulation turnaround time. A system model data repository is used as the trusted store of high-level inputs and results while other remote servers are used for archival of larger data sets and for analysis tool execution. Simulation data passes through numerous domain-specific analysis tools and end-to-end simulation execution is enabled through a web-based tool. The use of a cloud-based service facilitates coordination among distributed developers and enables scalable computation and storage needs, and ensures a consistent execution environment. Configuration management is emphasized to maintain traceability between current and historical simulation runs and their corresponding versions of models, tools and data.

Post, Ethan↗

I/O in Machine Learning Applications on HPC Systems: A 360-degree Survey

Growing interest in Artificial Intelligence (AI) has resulted in a surge in demand for faster methods of Machine Learning (ML) model training and inference. This demand for speed has prompted the use of high performance computing (HPC) systems that excel in managing distributed workloads. Because data is the main fuel for AI applications, the performance of the storage and I/O subsystem of HPC systems is critical. In the past, HPC applications accessed large portions of data written by simulations or experiments or ingested data for visualizations or analysis tasks. ML workloads perform small reads spread across a large number of random files. This shift of I/O access patterns poses several challenges to modern parallel storage systems. In this paper, we survey I/O in ML applications on HPC systems, and target literature within a 6-year time window from 2019 to 2024. We define the scope of the survey, provide an overview of the common phases of ML, review available profilers and benchmarks, examine the I/O patterns encountered during offline data preparation, training, and inference, and explore I/O optimizations utilized in modern ML frameworks and proposed in recent literature. Lastly, we seek to expose research gaps that could spawn further R&D.

97 MATHEMATICS AND COMPUTING↗

Sandia Machine Learning Laboratory

Samlab provides a workflow and data storage for machine learning experiment inputs and outputs using mongodb, and a web service to manage, search, visualize, and analyze the results.

Shead, Timothy↗

Real-time data reduction at 100 Tbps: Challenge and opportunity for AI-based data reduction for next-generation large-scale nuclear physics collider experiment

The modern large-scale nuclear physics (NP) experiments in high-energy particle colliders utilize streaming-readout electronics to digitize detector response at O(100) Tbps bandwidth. Prominent examples at Brookhaven National Lab (BNL) include the sPHENIX experiment at Relativistic Heavy Ion Collider (RHIC), which is under construction, and the experiments proposed for the Electron-Ion Collider (EIC), planned for the 2030s . One of the main challenges for these streaming readout systems is to manage the data rate with sufficient data reduction in real time so the end-data fit persistent storage for offline analysis, which is typically at O(1000) times smaller and O(100) Gbps. Such data reduction traditionally is achieved via real-time high level triggers, which select and save a small subset of collisions of interest. Although triggering is applicable to high energy collider experiments such as those at the Large Hardron Collider at CERN, it is insufficient for these nuclear physics experiments which study diverse collision topologies. And traditional triggering approach is inefficient to preserve the max information harvested from the operation of colliders that costs O(100)M per year to DOE. Meanwhile, in recent years, ML-based high-throughput data reduction has emerged as a promising approach to efficiently preserve max information for a given space of persistent storage, e.g. via AI data compression, feature extraction, and noise filtering.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Command and control of unmanned scientific spacecraft

Recent developments in command and control technology for use with the Voyager and the planned Galileo are discussed. These spacecraft each carry more than 10 scientific instruments, many of which are very complex, and these instruments must be able to function with a considerable degree of autonomy because the round-trip light time to the spacecraft in the vicinity of Jupiter and Saturn is too great to permit prompt ground-based management of onboard anomalies or control of some observation programs. Command and control procedures, including data storage procedures, for systems of the two spacecraft are examined.

Gates, C. R.↗

Advanced data management design for autonomous telerobotic systems in space using spaceborne symbolic processors

The use of computers in autonomous telerobots is reaching the point where advanced distributed processing concepts and techniques are needed to support the functioning of Space Station era telerobotic systems. Three major issues that have impact on the design of data management functions in a telerobot are covered. It also presents a design concept that incorporates an intelligent systems manager (ISM) running on a spaceborne symbolic processor (SSP), to address these issues. The first issue is the support of a system-wide control architecture or control philosophy. Salient features of two candidates are presented that impose constraints on data management design. The second issue is the role of data management in terms of system integration. This referes to providing shared or coordinated data processing and storage resources to a variety of telerobotic components such as vision, mechanical sensing, real-time coordinated multiple limb and end effector control, and planning and reasoning. The third issue is hardware that supports symbolic processing in conjunction with standard data I/O and numeric processing. A SSP that currently is seen to be technologically feasible and is being developed is described and used as a baseline in the design concept.

Goforth, Andre↗

Communications and information research: Improved space link performance via concatenated forward error correction coding

With the development of new advanced instruments for remote sensing applications, sensor data will be generated at a rate that not only requires increased onboard processing and storage capability, but imposes demands on the space to ground communication link and ground data management-communication system. Data compression and error control codes provide viable means to alleviate these demands. Two types of data compression have been studied by many researchers in the area of information theory: a lossless technique that guarantees full reconstruction of the data, and a lossy technique which generally gives higher data compaction ratio but incurs some distortion in the reconstructed data. To satisfy the many science disciplines which NASA supports, lossless data compression becomes a primary focus for the technology development. While transmitting the data obtained by any lossless data compression, it is very important to use some error-control code. For a long time, convolutional codes have been widely used in satellite telecommunications. To more efficiently transform the data obtained by the Rice algorithm, it is required to meet the a posteriori probability (APP) for each decoded bit. A relevant algorithm for this purpose has been proposed which minimizes the bit error probability in the decoding linear block and convolutional codes and meets the APP for each decoded bit. However, recent results on iterative decoding of 'Turbo codes', turn conventional wisdom on its head and suggest fundamentally new techniques. During the past several months of this research, the following approaches have been developed: (1) a new lossless data compression algorithm, which is much better than the extended Rice algorithm for various types of sensor data, (2) a new approach to determine the generalized Hamming weights of the algebraic-geometric codes defined by a large class of curves in high-dimensional spaces, (3) some efficient improved geometric Goppa codes for disk memory systems and high-speed mass memory systems, and (4) a tree based approach for data compression using dynamic programming.

Rao, T. R. N.↗

Criticality Safety Analysis of Spent Nuclear Fuel Canisters Using As-Loaded Configurations

Dual purpose canisters (DPCs) used for storage and transportation of spent nuclear fuel (SNF) are typically designed and evaluated using bounding (enveloping) fuel characteristics such as fuel type, fuel dimensions, initial enrichment, discharge burnup, and cooling time. This is a design basis, bounding licensing approach for SNF storage and transportation systems, as licensing and supporting safety analysis reviews are performed prior to the actual fuel loading. The bounding fuel characteristics for a system are developed by fully utilizing the regulatory and regulators recommended safety limits such as neutron multiplication factor (keff) approaching 0.95 to maximize the system utilizations. In reality, there are wide variations in SNF assembly burnups, initial enrichments, and cooling times. Therefore, dry storage systems are typically loaded with assemblies that satisfy the bounding fuel characteristics defined in the certificate of compliance (CoC), with some amount of unquantified and uncredited margin. This paper presents an as-loaded canister-specific criticality analysis approach for quantifying inherent uncredited margins in already loaded DPCs. The as-loaded analysis approach has been implemented in a new SNF management and analysis tool - The Used Nuclear Fuel-Storage, Transportation, and Disposal Analysis Resource and Data System (UNF ST&DARDS). The paper presents as-loaded criticality analysis of 616 canisters at 28 US reactor sites. Additionally, the paper discusses as-loaded analysis methodology validation approach using detailed reactor operational and fuel design data.

Banerjee, Kaushik↗

VISTA

SAND2025-14753O VISTA Image Management is a tool that serves as a thin wrapper around S3 storage, enabling teams to create projects, upload images, and add labels to data. It uses standard open-source libraries, employs conventional authentication and authorization methods, and is expected to run behind a reverse proxy that handles authentication. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Garland, Anthony [Sandia National Lab. (SNL-CA), L↗

A Study of the Trade-off Between Reducing Precision and Reducing Resolution for Data Analysis and Visualization

There presently exist two dominant strategies to reduce data sizes in analysis and visualization: reducing the precision of the data, e.g., through quantization, or reducing its resolution, e.g., by subsampling. Both have advantages and disadvantages and both face fundamental limits at which the reduced information ceases to be useful. The paper explores the additional gains that could be achieved by combining both strategies. In particular, we present a common framework that allows us to study the trade-off in reducing precision and/or resolution in a principled manner. We represent data reduction schemes as progressive streams of bits and study how various bit orderings such as by resolution, by precision, etc., impact the resulting approximation error across a variety of data sets as well as analysis tasks. Additionally, we compute streams that are optimized for different tasks to serve as lower bounds on the achievable error. Scientific data management systems can use the results proposed in this paper as guidance on how to store and stream data to make efficient use of the limited storage and bandwidth in practice.

97 MATHEMATICS AND COMPUTING↗

PIMS-Universal Payload Information Management

As the overall manager and integrator of International Space Station (ISS) science payloads and experiments, the Payload Operations Integration Center (POIC) at Marshall Space Flight Center had a critical need to provide an information management system for exchange and management of ISS payload files as well as to coordinate ISS payload related operational changes. The POIC's information management system has a fundamental requirement to provide secure operational access not only to users physically located at the POIC, but also to provide collaborative access to remote experimenters and International Partners. The Payload Information Management System (PIMS) is a ground based electronic document configuration management and workflow system that was built to service that need. Functionally, PIMS provides the following document management related capabilities: 1. File access control, storage and retrieval from a central repository vault. 2. Collect supplemental data about files in the vault. 3. File exchange with a PMS GUI client, or any FTP connection. 4. Files placement into an FTP accessible dropbox for pickup by interfacing facilities, included files transmitted for spacecraft uplink. 5. Transmission of email messages to users notifying them of new version availability. 6. Polling of intermediate facility dropboxes for files that will automatically be processed by PIMS. 7. Provide an API that allows other POIC applications to access PIMS information. Functionally, PIMS provides the following Change Request processing capabilities: 1. Ability to create, view, manipulate, and query information about Operations Change Requests (OCRs). 2. Provides an adaptable workflow approval of OCRs with routing through developers, facility leads, POIC leads, reviewers, and implementers. Email messages can be sent to users either involving them in the workflow process or simply notifying them of OCR approval progress. All PIMS document management and OCR workflow controls are coordinated through and routed to individual user's "to do" list tasks. A user is given a task when it is their turn to perform some action relating to the approval of the Document or OCR. The user's available actions are restricted to only functions available for the assigned task. Certain actions, such as review or action implementation by non-PIMS users, can also be coordinated through automated emails.

Elmore, Ralph↗

Overview of System Integration Analysis Activities for Integrated Waste Management

Spent nuclear fuel (SNF) generated by the current fleet of commercial nuclear reactors is being stored at the reactor sites in spent fuel pools (SFPs) and in dry independent spent fuel storage installations (ISFSIs). The US Department of Energy Office of Nuclear Energy (DOE-NE) is developing an Integrated Waste Management Program (IWMP) comprising a suite of options and supporting analyses to enable future informed choices. The IWMP is organized into the following five major areas: 1) Consent-Based Siting, 2) IWM Facilities and Equipment Concepts and Development, 3) Transportation Capability Analysis and Support, 4) Information Technology Solutions and Support, and 5) System Integration Analysis and Support. This paper discusses the activities ongoing in the IWMP System Integration Analysis and Support area. Two main areas of research in system integration are data and tools development, as well as system analysis assessments. One of the tools being developed in the system integration area is the Used Nuclear Fuel-Storage, Transportation & Disposal Analysis Resource and Data System (UNF-ST&DARDS) tool. It is being developed as a foundational resource for DOE-NE to manage SNF data, along with several compatible analysis tools for time-dependent characterization of SNF and related systems. UNF-ST&DARDS has the unparalleled ability to track SNF through the entire back end of the fuel cycle—from the time the fuel is discharged from a reactor through its disposal in a geological repository. UNF ST&DARDS interfaces with the SCALE code system for nuclear analysis and COBRA-SFS for thermal analysis. Another main tool being developed is the Next Generation System Analysis Model (NGSAM). NGSAM is an agent-based simulation software tool expressly designed to be capable of modeling the waste management system. NGSAM has been developed to enable informed decision-making by providing the capability of analyzing various potential system options for the management of SNF and HLW. Using NGSAM, system architecture analyses are being conducted to support the future deployment of a comprehensive nuclear waste management system that considers all major back-end aspects of the nuclear fuel cycle (i.e., transportation, storage, and disposal). System analysis assessments may investigate the implications of various strategies such as different acceptance rates, acceptance queues, facility capacities and options, standardized canisters, and different assumed system operation start dates. Recently, some system analysis effort has begun to look at how the waste management system might operate for advanced reactor fuel cycles.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Open Data Integration (ODIN): A Concurrent, Distributed Message-Based Architecture and Framework for Disaster Response

The Runtime for Airspace Concept Evaluation (RACE) is an open-source software architecture and framework to build configurable, highly concurrent and distributed message-based systems that offer scalable, low-latency performance on commodity hardware. RACE was used in commercial aviation applications to rapidly build systems that span several machines (including synchronized displays), interface existing hardware simulators and other live data feeds, and incorporate sophisticated visualization components such as NASA WorldWind. These RACE applications validated elements of the FAA’s System Wide Information Management (SWIM) Program, handling up to 1000 messages/sec from diverse sources (SFDPS, TFM-DATA, TAIS, ASDE-X, ITWS and local ADS) for 4,500 simultaneous flights tracked in the next-generation air transportation system’s digital backbone. We have since generalized RACE to support Open Data Integration (ODIN) applications outside aviation. Systems built with RACE/ODIN can be deployed in the field, on commodity hardware, and operate with limited or intermittent connectivity to the outside world. Our primary use case is a web-server with local/persistent data storage that runs within and only serves the stakeholder network (e.g. an incident command post). We are tailoring the RACE/ODIN system to support wildland fire management for the upcoming NASA Wildland Fire Safety Demonstration Series. RACE-ODIN is under consideration for application in the Scalable Traffic Management for Emergency Response Operations project, or STEReO, which aims to create a system that can be deployed during emergencies, to coordinate multiple elements of disaster response. Such data sources predominantly come from existing services on the internet (e.g. weather and satellite data, imported from so called "edge servers") but can also include dynamic (real-time) data from computer simulations and within the stakeholder network (such as aircraft and personnel tracking information). We will present the architecture and ODIN system demonstration incorporating local data from instrumented power-line towers, interpolated weather data and geospatial data from space-based platforms.

Joseph C Coughlan↗

Open Data Integration (ODIN): A Concurrent, Distributed Message-Based Architecture and Framework for Disaster Response

The Runtime for Airspace Concept Evaluation (RACE) is an open-source software architecture and framework to build configurable, highly concurrent and distributed message-based systems that offer scalable, low-latency performance on commodity hardware. RACE was used in commercial aviation applications to rapidly build systems that span several machines (including synchronized displays), interface existing hardware simulators and other live data feeds, and incorporate sophisticated visualization components such as NASA WorldWind. These RACE applications validated elements of the FAA’s System Wide Information Management (SWIM) Program, handling up to 1000 messages/sec from diverse sources (SFDPS, TFM-DATA, TAIS, ASDE-X, ITWS and local ADS) for 4,500 simultaneous flights tracked in the next-generation air transportation system’s digital backbone. We have since generalized RACE to support Open Data Integration (ODIN) applications outside aviation. Systems built with RACE/ODIN can be deployed in the field, on commodity hardware, and operate with limited or intermittent connectivity to the outside world. Our primary use case is a web-server with local/persistent data storage that runs within and only serves the stakeholder network (e.g. an incident command post). We are tailoring the RACE/ODIN system to support wildland fire management for the upcoming NASA Wildland Fire Safety Demonstration Series. RACE-ODIN is under consideration for application in the Scalable Traffic Management for Emergency Response Operations project, or STEReO, which aims to create a system that can be deployed during emergencies, to coordinate multiple elements of disaster response. Such data sources predominantly come from existing services on the internet (e.g. weather and satellite data, imported from so called "edge servers") but can also include dynamic (real-time) data from computer simulations and within the stakeholder network (such as aircraft and personnel tracking information). We will present the architecture and ODIN system demonstration incorporating local data from instrumented power-line towers, interpolated weather data and geospatial data from space-based platforms.

Guillaume P Brat↗

Data management at Biosphere 2 center

Throughout the history of Biosphere 2, the collecting and recording of biological data has been sporadic. Currently no active effort to administer and record regular biological surveys is being made. Also, there is no central location, such as an on-site data library, where all records from various studies have been archived. As a research institute, good, complete data records are at the core of all Biosphere 2's scientific endeavors. It is therefore imperative that an effective data management system be implemented within the management and research departments as soon as possible. Establishing this system would require three general phases: (1) Design/implement a new archiving/management program (including storage, cataloging and retrieval systems); (2) Organize and input baseline and intermediate data from existing archives; and (3) Maintain records by inputting new data.

McCreary, Leone F.↗

Data-driven key performance indicators and datasets for building energy flexibility: A review and perspectives

Energy flexibility, through short-term demand-side management (DSM) and energy storage technologies, is now seen as a major key to balancing the fluctuating supply in different energy grids with the energy demand of buildings. This is especially important when considering the intermittent nature of ever-growing renewable energy production, as well as the increasing dynamics of electricity demand in buildings. This paper provides a holistic review of (1) data-driven energy flexibility key performance indicators (KPIs) for buildings in the operational phase and (2) open datasets that can be used for testing energy flexibility KPIs. The review identifies a total of 48 data-driven energy flexibility KPIs from 87 recent and relevant publications. These KPIs were categorized and analyzed according to their type, complexity, scope, key stakeholders, data requirement, baseline requirement, resolution, and popularity. Moreover, 330 building datasets were collected and evaluated. Of those, 16 were deemed adequate to feature building performing demand response or building-to-grid (B2G) services. The DSM strategy, building scope, grid type, control strategy, needed data features, and usability of these selected 16 datasets were analyzed. This review reveals future opportunities to address limitations in the existing literature: (1) developing new data-driven methodologies to specifically evaluate different energy flexibility strategies and B2G services of existing buildings; (2) developing baseline-free KPIs that could be calculated from easily accessible building sensors and meter data; (3) devoting non-engineering efforts to promote building energy flexibility, standardizing data-driven energy flexibility quantification and verification processes; and (4) curating and analyzing datasets with proper description for energy flexibility assessm.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Experience and Challenges in Implementing Stratospheric Aerosol Gas Experiment on Meteor-3M Platform

Implementation of Stratospheric Aerosol Gas Experiment (SAGE) is a joint science mission between the Rosavioskosmos, also called Russian Aviation and Space Agency (RASA) and the National Aeronautics and Space Administration (NASA). Under the global collaboration agreement established by President Clinton and Yeltsin in 1995 between the United States and Russia, space was one of the major areas identified for joint scientific collaboration. There were several collaborative projects identified under space, earth, human exploration of space and aeronautics. SAGE was one of the key Earth Science instruments selected common to both countries' interests in ozone research. SAGE has a long space heritage, and four earlier versions of this instrument have flown in space for the last 15-year period. It has provided a vital ozone and aerosol data in the mid latitudes and has contributed in the overall ozone depletion research. SAGE II, the fourth instrument has been flying in space on NASA's Earth Radiation Budget Satellite (ERBS) for the last 14 years. Ball Aerospace built the instrument under Langley Research Center's (LaRC) management. SAGE III for Russian Meteor-3M mission is a third generation design with more spectral bands, elaborate data gathering and storage and intelligent terrestrial software. The Russian collaboration required a complete integration of SAGE III on the Russian Meteor-3M satellite and a launch on a Zenit-2 launch vehicle manufactured in Ukraine. The whole complex is scheduled to be launched from Baikonur cosmodrome in early 2001. This cooperative mission has presented a number of management, technical and logistical challenges on both sides. This paper makes an attempt to review and document such experiences.

Habib, Shahid↗