Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data storage data management”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

Biospecimen Culling: Temporal RNA Integrity Analysis Across Spaceflight Missions Dating from 1985 to 2011

The Ames Life Science Data Archive (ALSDA) at NASA Ames Research Center is managed by the Space Biosciences Division and has been operational since 1993. The ALSDA is responsible for archiving information and biospecimens collected from life science spaceflight experiments and matching ground control experiments. They are stored in the Ames biobank, which is located in the Biospecimen Storage Facility (BSF). The ALSDA also manages a Biospecimen Sharing Program, performs curation and long-term storage operations, and makes biospecimens available to the scientific community for research purposes via the Life Science Data Archive public website (https:lsda.jsc.nasa.gov). The BSF maintains both fixed and frozen spaceflight and ground tissues, collected from recent and past spaceflight missions. Due to the ever increasing demand for space to preserve current and future flight biospecimens, the ALSDA has initiated the development of a culling plan for biospecimens currently stored in the BSF. Culling enables the ALSDA to assess the quality of archived samples, and supports the development of standardized culling procedures that improve the operational efficiency of the BSF. The culling plan focuses on generating disposition recommendations for samples in the BSF, and currently is based on measuring ribonucleic acid (RNA) integrity number (RIN). The culling process includes (1) sorting and identification of candidate samples for RIN analysis, (2) completion of RIN analysis on select samples, and (3) development of disposition recommendations for specimens based on the RIN values. Furthermore, our approach allows for unique scientific opportunities, including development of a RIN-based methodology for culling, and temporal assessment of the quality of the tissues that have been stored in BSF since the 1980s. Results of this work will also support NASA open science initiatives.

biospecimen↗

A Workflow-based Intelligent Network Data Movement Advisor with End-to-end Performance Optimization

Next-generation eScience applications often generate large amounts of simulation, experimental, or observational data that must be shared and managed by collaborative organizations. Advanced networking technologies and services have been rapidly developed and deployed to facilitate such massive data transfer. However, these technologies and services have not been fully utilized mainly because their use typically requires significant domain knowledge and in many cases application users are even not aware of their existence. By leveraging the functionalities of an existing Network-Aware Data Movement Advisor (NADMA) utility, we propose a new Workflow-based Intelligent Network Data Movement Advisor (WINDMA) with end-to-end performance optimization for this DOE funded project. This WINDMA system integrates three major components: resource discovery, data movement, and status monitoring, and supports the sharing of common data movement workflows through account and database management. This system provides a web interface and interacts with existing data/space management and discovery services such as Storage Resource Management, transport methods such as GridFTP and GlobusOnline, and network resource provisioning brokers such as ION and OSCARS. We demonstrate the efficacy of the proposed transport-support workflow system in several use cases based on its implementation and deployment in DOE wide-area networks.

97 MATHEMATICS AND COMPUTING↗

Enhanced Performance Assessment System (EPAS) for carbon sequestration.

Carbon capture and sequestration (CCS) is an option to mitigate impacts of atmospheric carbon emission. Numerous factors are important in determining the overall effectiveness of long-term geologic storage of carbon, including leakage rates, volume of storage available, and system costs. Recent efforts have been made to apply an existing probabilistic performance assessment (PA) methodology developed for deep nuclear waste geologic repositories to evaluate the effectiveness of subsurface carbon storage (Viswanathan et al., 2008; Stauffer et al., 2009). However, to address the most pressing management, regulatory, and scientific concerns with subsurface carbon storage (CS), the existing PA methodology and tools must be enhanced and upgraded. For example, in the evaluation of a nuclear waste repository, a PA model is essentially a forward model that samples input parameters and runs multiple realizations to estimate future consequences and determine important parameters driving the system performance. In the CS evaluation, however, a PA model must be able to run both forward and inverse calculations to support optimization of CO{sub 2} injection and real-time site monitoring as an integral part of the system design and operation. The monitoring data must be continually fused into the PA model through model inversion and parameter estimation. Model calculations will in turn guide the design of optimal monitoring and carbon-injection strategies (e.g., in terms of monitoring techniques, locations, and time intervals). Under the support of Laboratory-Directed Research & Development (LDRD), a late-start LDRD project was initiated in June of Fiscal Year 2010 to explore the concept of an enhanced performance assessment system (EPAS) for carbon sequestration and storage. In spite of the tight time constraints, significant progress has been made on the project: (1) Following the general PA methodology, a preliminary Feature, Event, and Process (FEP) analysis was performed for a hypothetical CS system. Through this FEP analysis, relevant scenarios for CO{sub 2} release were defined. (2) A prototype of EPAS was developed by wrapping an existing multi-phase, multi-component reservoir simulator (TOUGH2) with an uncertainty quantification and optimization code (DAKOTA). (3) For demonstration, a probabilistic PA analysis was successfully performed for a hypothetical CS system based on an existing project in a brine-bearing sandstone. The work lays the foundation for the development of a new generation of PA tools for effective management of CS activities. At a top-level, the work supports energy security and climate change/adaptation by furthering the capability to effectively manage proposed carbon capture and sequestration activities (both research and development as well as operational), and it greatly enhances the technical capability to address this national problem. The next phase of the work will include (1) full capability demonstration of the EPAS, especially for data fusion, carbon storage system optimization, and process optimization of CO{sub 2} injection, and (2) application of the EPAS to actual carbon storage systems.

54 ENVIRONMENTAL SCIENCES↗

dCache - Keeping up With the Evolution of Science

The dCache project provides open-source software deployed internationally to satisfy ever more demanding storage requirements of various scientific communities. Its multifaceted approach provides an integrated way of supporting different use-cases with the same storage, from high throughput data ingest, through wide access and easy integration with existing systems, including event driven workflow management. With this presentation, we will show some of the recent developments that optimize data management and access to maximise the gain from stored data.

Mkrtchyan, Tigran↗

DoCeph: DPU-Offloaded Messaging in Ceph for Reduced Host CPU Utilization

Ceph is a widely used distributed object store, but its messenger layer imposes substantial CPU overhead on the host. To address this limitation, we propose DoCeph, a DPU-offloaded storage architecture for Ceph that disaggregates the system by offloading the communication-intensive messaging component to the DPU while retaining the storage backend on the host. The DPU efficiently manages communication, using lightweight RPC for metadata operations and DMA for data transfer. Moreover, DoCeph introduces a pipelining technique that overlaps data transmission with buffer preparation, mitigating hardware-imposed transfer size limitations. We implemented DoCeph on a Ceph cluster with NVIDIA BlueField-3 DPUs. Evaluation results indicate that DoCeph cuts host CPU usage by up to 92% while sustaining stable throughput and providing larger performance benefits for object writes over 1 MB.

Park, Kuri [Sogang University]↗

Two new SciDAC institutes promote mathematical tools and software technology for high-performance computing

Bigger is often said to be better, and the newest extreme-scale computers certainly are bigger, with millions of processing units. Moreover, the breadth of science performed on the U.S. Department of Energy (DOE) computing facilities is expanding, with new technology such as artificial intelligence emerging. These advances are exciting, creating new opportunities for scientific discovery; however, they also raise new questions for scientists who want to exploit these advances for tackling more complex problems. Will my simulation code be able to utilize the accelerators in extreme-scale computing systems? Can I take advantage of the deepening memory hierarchy in heterogeneous processors? Is there a way around bottlenecks caused by the widening ratio of peak floating-point operations per second to I/0 bandwidth? How can I manage my huge amounts of data effectively? Can I analyze data in situ, or must I transfer it to offline storage for later analysis? To address such questions, DOE announced that it is providing $57.5 million over the next five years for two multidisciplinary teams — FASTMath and RAPIDS2 — to develop new tools and techniques to harness supercomputers for scientific discovery. The teams, called SciDAC Institutes, are part of the Scientific Discovery through Advanced Computing program.

97 MATHEMATICS AND COMPUTING↗

Efficient Dimension Reduction of Complex Three-dimensional CO2 Saturation using Deep Learning Models

In the domain of deep learning (DL), dimension reduction is crucial for enhancing training efficiency and mitigating overfitting, particularly when managing complex data such as three-dimensional (3D) saturation data. The 3D saturation data in the context of geological carbon storage (GCS) presents unique challenges due to its inherent sparsity and the abrupt transitions at plume boundaries, known as shock fronts. To address the challenges, we proposed a novel DL framework that integrates dimension reduction with advanced 3D reconstruction techniques. Our model leveraged latent variables derived from 2D average saturation data, offering a robust and efficient solution tailored to the intricate dynamics of 3D saturation fields. The proposed framework can extract the critical features of the high-dimensional data while reducing the variable numbers, which is more tractable for DL models and enhances the model robustness and accuracy. Therefore, it provides a novel approach for modeling and analyses in complex geological scenarios, which finds great potential applications in environmental monitoring and energy storage.

Wang, Hongsheng↗

Electrical power technology for robotic planetary rovers

Power technologies which will enable a range of robotic rover vehicle missions by the end of the 1990s and beyond are discussed. The electrical power system is the most critical system for reliability and life, since all other on board functions (mobility, navigation, command and data, communications, and the scientific payload instruments) require electrical power. The following are discussed: power generation, energy storage, power management and distribution, and thermal management.

Bankston, C. P.↗

A Case for Bundle Protocol in Space

NASA, through the Advanced Exploration Systems (AES) project, is investing in the development and infusion of delay tolerant networking (DTN) protocols for use on future space flight missions. The cornerstone of the DTN suite is the Bundle Protocol which provides network layer addressing and routing of data blocks. In 2017, the Plankton, Aerosol, Cloud, and Ocean Ecosystem (PACE) mission was selected as the first in-house robotic science mission to implement the Bundle Protocol for downlink of housekeeping telemetry. One year into the design and incorporation of the Bundle Protocol on PACE, this presentation makes a case for using the Bundle Protocol for communication with future space assets. Specifically, the use of the Bundle Protocol (1) simplifies relaying data through store and forward routing and custody transfer; (2) simplifies downlink management through delivery guarantees; and (3) simplifies storage services through block level interactions with memory devices.

Swinski, J. P.↗

United States Nuclear Power Reactor Used Nuclear Fuel Database and Applications

The Unified Database (UDB) within STANDARDS serves as the foundational data infrastructure for managing the United States' spent nuclear fuel inventory of 315,111 discharged assemblies totaling 91,036 metric tons of heavy metal. The database organizes this complex inventory through over 200 interconnected tables structured into eight primary attribute categories, supporting integrated analyses across storage, transportation, and disposal domains. Data enters the UDB through the GC-859 Nuclear Fuel Data Survey, which transitioned to web-based collection in 2023, improving data quality through real-time validation. The UDB enables automated generation of input files for nuclear safety analyses, reducing preparation time from weeks to hours while maintaining traceability. Applications include national inventory reporting, Certificate of Compliance assessments, and facility optimization. The three-tier distribution model balances accessibility with security requirements for federal agencies, national laboratories, and research organizations. The UDB provides essential data infrastructure as spent fuel management transitions from site-specific to integrated national campaigns.

Stefanovic, Peter↗

Bulk Data Mover

Bulk Data Mover (BDM) is a high-level data transfer management tool. BDM handles the issue of large variance in file sizes and a big portion of small files by managing the file transfers with optimized transfer queue and concurrency management algorithms. For example, climate simulation data sets are characterized by large volume of files with extreme variance in file sizes. The BDN achieves high performance using a variety of techniques, including multi-threaded concurrent transfer connections, data channel caching, load balancing over multiple transfer servers, and storage i/o pre-fetching. Logging information from the BDM is collected and analyzed to study the effectiveness of the transfer management algorithms. The BDM can accept a request composed of multiple files or an entire directory. The request also contains the target site and directory where the replicated files will reside. If a directory is provided at the source, then the BDM will replicate the structure of the source directory at the target site. The BDM is capable of transferring multiple files concurrently as well as using parallel TCP streams. The optimal level of concurrency or parallel streams depends on the bandwidth capacity of the storage systems at both ends of the transfer as well as achievable bandwidth of the wide-area network. Hardware req.-PC, MAC, Multi-platform & Workstation; Software req.: Compile/version-Java 1.50_x or above; Type of files: source code, executable modules, installation instructions other, user guide; URL: http://sdm.lbl.gov/bdm/

Natarajan, Vijaya↗

Long-Term Information Management (LTIM) of Safeguards Data at Repositories: Phase II

One of the challenges of implementing safeguards for geological repositories will be the long-term preservation of safeguards-related data for 100 years or more. While most countries considering the construction and operation of such facilities agree that safeguards information should be preserved, there are gaps with respect to standardized requirements, guidelines, timescales, and approaches. This study analyzes those gaps and explores research to clarify stakeholder needs, identify current policies, approaches, best practices and international standards, and explores existing safeguards information management infrastructure. The study also attempts to clarify what a safeguards data classification system might look like, how long data should be retained, and how information should be exchanged between stakeholders at different phases of a repository’s life cycle. The analysis produced a variety of recommendations on what information to preserve, how to preserve it, where to store it, retention options and how to exchange information in the long term. Key findings include the use of the globally recognized international records management standard, ISO15489, for guidance on the development of information management systems, and the development of a Key Information File (KIF). The KIF could be used to identify only the most relevant, high-level safeguards information and the history of decision making about the repository. The study also suggests implementing on-site and off-site records storage in digital and physical form; developing a safeguards data classification system; long-term records retention with periodic reviews every 5 to 10 years during each phase of the repository life cycle; and establishing transition procedures well in advance so that data shepherds and records officers can transfer information with incoming facility managers effectively and efficiently. These and other recommendations are further analyzed in this study.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

A Conceptual World Information Library (WIL) and Land Use Information System (LUIS) - 16181

The Organization for Economic Co-operation and Development Nuclear Energy Agency initiative on the Preservation of Records, Knowledge and Memory is addressing the topic of communicating with future generations on the location, specific contents, and potential risks associated with deep geologic nuclear waste repositories. At the Waste Isolation Pilot Plant (WIPP) in the United States, the U.S. Department of Energy (DOE) has committed, prior to the facility closure, to develop a Passive Institutional Controls (PICs) program designed to last as long as practicable. A portion of this PICs program includes development of records packages, selection of data storage materials and methods, and a determination of records retention/storage locations. The approved plan for record retention at WIPP includes the storage of information including hard copies of data, figures and maps in multiple libraries and archive record centers. With this in mind, it is easy to envision reams of various paper documents in a robust physical archive record center similar to one of the museums in Washington D.C., or DOE's Legacy Management facility in Morgantown, West Virginia. While some portion of records for nuclear waste burial sites should be maintained in this fashion for near-term retrieval purposes, it is widely accepted that this is not an efficient way to communicate with future generations even 1,000 years from now. Transmitting large detailed volumes of information to the future should be captured in an electronic format; maintained on computers, translated by computers, and perhaps updated by artificial intelligence as machine and human languages change over the centuries. In addition to a physical records development and storage process for transmittal to future generations, a web-based electronic database system should be developed. A World Electronic Library (WEL) database could be funded from various nations and perhaps sanctioned by the United Nations and/or the IAEA. This WEL could contain information regarding several different subjects with the intent of being a one-stop-information-shop for future generations. This database would require updates and maintenance for as long as there is a recipient. One subset of the WEL would be a spatial database containing all the information available to any set of GPS coordinates, anywhere within the world. This Land Use Information System (LUIS) database would contain information on past and present land use, natural resources, known geology, hydrology and atmospheric conditions, potential warnings, and other pertinent information. The LUIS database is where specific electronic information, a subset of all the records data gathered for a nuclear waste repository, could reside. For not only would LUIS provide the information on a nuclear waste repository when specific GPS coordinates were entered; but a search from the LUIS on 'Nuclear Waste Repositories' could bring up information, including data on location of repositories, radionuclides, operations, D and D, maps, and regulations, plus many other details for locations throughout the world. This tool could be used by future generations for a number of land use or resource exploration decisions. So what can we do now? We can agree to the types of information that should be captured into an electronic database for nuclear waste repositories. We can agree to the levels of detail, the file names and the formats, for ease of combining information sets in the future. Perhaps we can agree to a central electronic data storage site, or sites, where this information will reside for import into a centralized electronic record system, if one is ever developed. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Improving Operational Efficiency, Compliance and Community Perception with Real-time Data - 19260

The nuclear and medical radiation industry has always faced a significant burden in effectively balancing exposure and productivity. Maintenance operations and development of new techniques require significant staffing resources to monitor and review personnel exposures and changes in operational radiation levels. Currently utilised monitoring technology and review techniques remain unchanged since the 1950's, relying upon mostly analogue instrumentation and paper reporting. After utilising isolated-area monitoring during a reactor decommissioning project it became apparent that current systems created false assurance as the units continually failed without warning due to 'dirty' power. These instrument failures could have easily led to an unnecessary exposure while operators continued to assume they were being safely monitored. This paper is a philosophical discussion on how current shortcomings could be addressed, security increased, and exposure risks minimised, by utilising real-time monitoring and automated reporting. The community and media expectations of reported data and nuclear monitoring systems continue to be coloured by sensational technology seen in movies and emerging technology available through smart homes and smart cities initiatives. For the general public to be more engaged with real radiation levels and effects, the nuclear industry needs to more effectively communicate safe levels. Organisations can have regain control of exposure levels discussions through the controlled release of background and expected exposure level data. An increase in real world monitoring data communicated in a controlled and more effective way will aid in the general public accepting, and being educated about, the minimal increase above natural background levels of the nuclear industry and other radiation facilities. This is particularly as Australia is in the process of implementing its Nuclear Waste Facility, with community acceptance the number one inhibitor of being able to move forward. Storage, mobile assets, and processing all present unique management, security, exposure, and telemetry challenges for a facility operations manager. Active monitoring and automated review of the monitoring data can alert operators to any unexpected events before any resultant increases in radiation levels cause an unplanned exposure to operators or the environment. Integration of radiation monitoring data with global positioning telemetry enables better organisational awareness of mobile asset location and early detection of any potential shifting and reduction in shielding integrity of sources and encapsulated waste during transport. Additionally, the real-time monitoring can be set-up to enhance an organisations' or nation's security capabilities. For instance, the real time monitor will send an automated alert in the case of an unexpected movement of a source through a monitored facility or for an unscheduled movement of a monitored vehicle. There are further benefits to be gained in control, ALARA principles and effluent management by increasing real-time monitoring capabilities through the stages of the waste cycle. Increasing operational effectiveness while delivering operational cost savings sounds like an attractive proposition. With increased access to operational area radiation data comes drastically improved real-time management of exposures for new, and experimental practices. Increased live data can be utilised to identify optimum practices for reducing operational and environmental exposures or releases. This increased operational data effectively comes with the added benefit of a reduction in the required health physics personnel resources for general operations. By reducing exposure and the detachment of required health physics resources from routine operations, there is greater availability for these resources to support maintenance operations and project-based work. The review of this increased data will create internal capability to identify low-- and high-risk activities, resulting in the ability to reduce the number of highly skilled workers in an industry where the availability of this talent is declining. During my time as the Radiation Safety and Nuclear Security Manager at a research facility, I implemented a real-time monitoring system. The system identified a secondary risk that had previously been unidentified and posed a higher exposure and security risk than the radiation practice being monitored. What stops industry from implementing technology that encourages agile work practices, while minimising security risks and personnel exposure? (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Sealion Database: Tracking and Characterization of Legacy Wastes

The Radioactive Scrap and Waste Facility Liner-by-Liner Characterization Project was initiated to support waste management planning and disposition activities at the Materials and Fuels Complex located at the Idaho National Laboratory. The project scope consisted of a detailed examination of available historical records to consolidate information and eliminate discrepancies between sources. This information was captured in a new comprehensive searchable online database dubbed Sealion (Searchable Liner Online). For each storage liner and associated waste container, Sealion tracks the physical configuration, radiological data (e.g., source term, transuranic content, fissile content, and direct gamma radiation reading), Resource Conservation and Recovery Act characterization data, contents descriptions, and a variety of other waste management data. Historical hard-copy records were scanned and are stored in the database for easy access. In addition to storing the consolidated data in a library for easy retrieval or linking, Sealion serves as a tool in the development of batching plans for retrieving, transporting, processing, and, ultimately, dispositioning the waste. An integral search function allows the user to query for a variety of parameters in order to plan custom batches and account for facility or regulatory limitations (e.g., U.S. Department of Transportation limits, hazard category determinations, and fissile gram equivalent limitations). Liners can be combined or batched together and the combined results displayed in real-time graphs and tables showing the cumulative characteristics. The basic database architecture has proven to be adaptable to a variety of other similar applications. Sealion is capable of tracking segmented inventories (i.e., the liners can be replaced with storage drums, racks in a warehouse, or grids overlaid on a landfill). Additionally, the batching functions allow for the ability to combine inventory sub-locations into real-time graphs that summarize the characteristics of the contents for ease in comparison of characteristics to established thresholds or decision-making modeling needed to support waste-management operations.

99 GENERAL AND MISCELLANEOUS↗

I/O through High Performance Data Services

The conclusions of this paper are that: (1) moving output data processing to a separate processing area has performance advantages; (2) management of data movement results in large performance gains; (3) the Data Service abstraction enables the development of data staging operations; and (4) using the data service model, we can create adaptive resource aware storage backends.

97 MATHEMATICS AND COMPUTING↗

Capillary Flow Experiments Began on the International Space Station

The Capillary Flow Experiments (CFEs) are a suite of fluid physics flight experiments designed to investigate capillary flows and phenomena in low gravity. Data obtained from the CFEs will be crucial to NASA s Space Exploration Initiative, particularly pertaining to fluids management systems such as fuels and cryogen storage systems, thermal control systems (e.g., water recycling), and materials processing in the liquid state. NASA s current plans for exploration missions assume the use of larger liquid propellant masses than have ever flown on interplanetary missions. Under low-gravity conditions, capillary forces can be exploited to control fluid orientation so that such large mission-critical systems perform predictably. The first of the CFE experiments has been conducted on the International Space Station, and the data are being analyzed. The experiment suite is described briefly.

J. Mark Hickman↗

Supporting Building Portfolio Investment and Policy Decision Making through an Integrated Building Utility Data Platform

The American Recovery and Reinvestment Act stimulus funding of 2009 for smart grid projects resulted in the tripling of smart meters deployment. In 2012, the Green Button initiative provided utility customers with access to their real-time1 energy usage. The availability of finely granular data provides an enormous potential for energy data analytics and energy benchmarking. The sheer volume of time-series utility data from a large number of buildings also poses challenges in data collection, quality control, and database management for rigorous and meaningful analyses. In this paper, we will describe a building portfolio-level data analytics tool for operational optimization, business investment and policy assessment using 15-minute to monthly intervals utility data. The analytics tool is developed on top of the U.S. Department of Energy’s Standard Energy Efficiency Data (SEED) platform, an open source software application that manages energy performance data of large groups of buildings. To support the significantly large volume of granular interval data, we integrated a parallel time-series database to the existing relational database. The time-series database improves on the current utility data input, focusing on real-time data collection, storage, analytics and data quality control. The fully integrated data platform supports APIs for utility apps development by third party software developers. These apps will provide actionable intelligence for building owners and facilities managers. Unlike a commercial system, this platform is an open source platform funded by the U.S. Government, accessible to the public, researchers and other developers, to support initiatives in reducing building energy consumption.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗