SEARCH · Engineering Papers

Results for “DATA STORAGE”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,783 records · Page 99

All sources NASA NTRS DOE OSTI

DOE OSTI2018

Testing of ENDF/B-VIII.0 in the GNDS format with LLNL transport codes - 25606

ENDF/B-VIII.0 was released in the Evaluated Nuclear Data Format and the Generalized Nuclear Data Structure format (GNDS), a new international standard for storing nuclear data developed under the auspices of the Nuclear Energy Agency Working Party on Evaluation Cooperation Subgroup 38. GNDS relies on modern coding practices, and offers a structured, flexible and physics-based standard for storing and exchanging nuclear data to address limitations in legacy nuclear data formats such as ENDF-6. GNDS supports the storage of evaluated nuclear data as well as processed data suitable for both deterministic (i.e., multi-group) and Monte Carlo transport codes. Lawrence Livermore National Laboratory has implemented a complete suite of codes to test GNDS data. Simulations for the ENDF/B-VIII.0 cross-section library in GNDS format are presented. Deterministic and Monte Carlo radiation transport simulations with the Ardra and Mercury codes respectively, are validated against reactivities in fast criticality safety benchmark assemblies. Finally, Mercury simulations of {sup 238}U(n,f), {sup 237}Np(n,f) and {sup 239}Pu(n,f) reaction rates in Godiva, Jezebel and Flattop are compared to MCNP results and measured data. (authors)

61 RADIATION PROTECTION AND DOSIMETRY↗

DOE OSTI2022

Machine Learning-Assisted High-Temperature Reservoir Thermal Energy Storage Optimization: Numerical Modeling and Machine Learning Input and Output Files

This data set includes the numerical modeling input files and output files used to synthesize data, and the reduced-order machine learning models trained from the synthesized data for reservoir thermal energy storage site identification. In this study, a machine-learning-assisted computational framework is presented to identify High-Temperature Reservoir Thermal Energy Storage (HT-RTES) site with optimal performance metrics by combining physics-based simulation with stochastic hydrogeologic formation and thermal energy storage operation parameters, artificial neural network regression of the simulation data, and genetic algorithm-enabled multi-objective optimization. A doublet well configuration with a layered (aquitard-aquifer-aquitard) generic reservoir is simulated for cases of continuous operation and seasonal-cycle operation scenarios. Neural network-based surrogate models are developed for the two scenarios and applied to generate the Pareto fronts of the HT-RTES performance for four potential HT-RTES sites. The developed Pareto optimal solutions indicate the performance of HT-RTES is operation-scenario (i.e., fluid cycle) and reservoir-site dependent, and the performance metrics have competing effects for a given site and a given fluid cycle. The developed neural network models can be applied to identify suitable sites for HT-RTES, and the proposed framework sheds light on the design of resilient HT-RTES systems. All the simulations and the neural network model were done by Idaho National Laboratory. A detailed description of the work was reported in publication linked below.

15 GEOTHERMAL ENERGY↗

DOE OSTI2016

Bit Grooming: statistically accurate precision-preserving quantization with compression, evaluated in the netCDF Operators (NCO, v4.4.8+)

Abstract. Geoscientific models and measurements generate false precision (scientifically meaningless data bits) that wastes storage space. False precision can mislead (by implying noise is signal) and be scientifically pointless, especially for measurements. By contrast, lossy compression can be both economical (save space) and heuristic (clarify data limitations) without compromising the scientific integrity of data. Data quantization can thus be appropriate regardless of whether space limitations are a concern. We introduce, implement, and characterize a new lossy compression scheme suitable for IEEE floating-point data. Our new Bit Grooming algorithm alternately shaves (to zero) and sets (to one) the least significant bits of consecutive values to preserve a desired precision. This is a symmetric, two-sided variant of an algorithm sometimes called Bit Shaving that quantizes values solely by zeroing bits. Our variation eliminates the artificial low bias produced by always zeroing bits, and makes Bit Grooming more suitable for arrays and multi-dimensional fields whose mean statistics are important. Bit Grooming relies on standard lossless compression to achieve the actual reduction in storage space, so we tested Bit Grooming by applying the DEFLATE compression algorithm to bit-groomed and full-precision climate data stored in netCDF3, netCDF4, HDF4, and HDF5 formats. Bit Grooming reduces the storage space required by initially uncompressed and compressed climate data by 25–80 and 5–65 %, respectively, for single-precision values (the most common case for climate data) quantized to retain 1–5 decimal digits of precision. The potential reduction is greater for double-precision datasets. When used aggressively (i.e., preserving only 1–2 digits), Bit Grooming produces storage reductions comparable to other quantization techniques such as Linear Packing. Unlike Linear Packing, whose guaranteed precision rapidly degrades within the relatively narrow dynamic range of values that it can compress, Bit Grooming guarantees the specified precision throughout the full floating-point range. Data quantization by Bit Grooming is irreversible (i.e., lossy) yet transparent, meaning that no extra processing is required by data users/readers. Hence Bit Grooming can easily reduce data storage volume without sacrificing scientific precision or imposing extra burdens on users.

58 GEOSCIENCES↗

DOE OSTI2012

Status and Path Forward for the Department of Energy Used Fuel Disposition Storage and Transportation Program - 12571

The U.S. Department of Energy, Office of Nuclear Energy (DOE/NE) has sponsored a program since Fiscal Year (FY) 09 to develop the technical basis for extended dry storage of used fuel. This program is also working to develop the transportation technical basis for the transport of used fuel after the extended storage period. As this program has progressed, data gaps associated with dry storage systems (e.g., fuel, cask internals, canister, closure, overpack, and pad) have been identified that need to be addressed to develop the technical bases for extended storage and transportation. There has also been an initiation of experimental testing and analyses based on the identified data gaps. The technical aspects of the NE program are being conducted by a multi-lab team made up of the DOE laboratories. As part of this program, a mission objective is to also collaborate closely with industry and the international sector to ensure that all the technical issues are addressed and those programs outside the DOE program can be leveraged, where possible, to maximize the global effort in storage and transportation research. The DOE/NE program is actively pursuing the development of the technical basis to demonstrate the feasibility of storing UNF for extended periods of time with subsequent transportation of the UNF to its final disposition. This program is fully integrated with industry, the U.S. regulator, and the international community to assure that programmatic goals and objectives are consistent with a broad perspective of technical and regulatory opinion. As the work evolves, assessments will be made to ensure that the work continues to focus on the overall goals and objectives of the program. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2022

Southeast Regional CO 2 Utilization and Storage Acceleration Partnership (SECARB-USA): Needs Assessment Framework for Storage Complexes Contributed to EDX (Work Product 2.1.c)

On September 30, 2021, a Needs Assessment Framework for Storage Complexes was completed for the SECARB-USA region by the Southern States Energy Board (SSEB) and The University of Texas at Austin Bureau of Economic Geology (UT-BEG). The Needs Assessment Framework for Storage Complexes documented a region-wide assessment to identify data needed to advance storage projects at sites of relevance to industrial, academic, and government stakeholders. The region-wide assessment addresses the needs of CO2 source, storage, and utilization stakeholders, finance and insurance institutions, state and local government agencies, local stakeholders at prospective storage complexes, environmental non-governmental organizations (NGOs), and others as identified by the Partners. This assessment was tested against various potential storage sites and modified to include site-specific issues, such as surface or pore space rights. The framework was provided to stakeholders for review and then used in other tasks, such as the ML initiative (Subtask 3.4) and storage complex readiness evaluation (Subtask 4.2). In accordance with the SOPO, this assessment satisfied completion of Work Product 2.1.b. The OSTI ID is 3015803, and the DOI link is https://doi.org/10.2172/3015803. On February 28, 2022, SSEB uploaded Work Product 2.1.b to NETL’s Energy Data eXchange (EDX). As such, Work Product 2.1.c is completed as documented below.

42 ENGINEERING↗

DOE OSTI2018

A Conditions Data Management System for HEP Experiments

Conditions data infrastructure for both ATLAS and CMS have to deal with the management of several Terabytes of data. Distributed computing access to this data requires particular care and attention to manage request-rates of up to several tens of kHz. Thanks to the large overlap in use cases and requirements, ATLAS and CMS have worked towards a common solution for conditions data management with the aim of using this design for data-taking in Run 3. In the meantime other experiments, including NA62, have expressed an interest in this cross- experiment initiative. For experiments with a smaller payload volume and complexity, there is particular interest in simplifying the payload storage. The conditions data management model is implemented in a small set of relational database tables. A prototype access toolkit consisting of an intermediate web server has been implemented, using standard technologies available in the Java community. Access is provided through a set of REST services for which the API has been described in a generic way using standard Open API specications, implemented in Swagger. Such a solution allows the automatic generation of client code and server stubs and further allows changes in the backend technology transparently. An important advantage of using a REST API for conditions access is the possibility of caching identical URLs, addressing one of the biggest challenges that large distributed computing solutions impose on conditions data access, avoiding direct DB access by means of standard web proxy solutions.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

DOE OSTI2018

Fibre Channel Development Final Report CRADA No. TC-0340-92-D

The Fibre Channel (FC) Development project was designed to enhance U.S. industrial competitiveness by accelerating the standardization and subsequent industrial acceptance of the American National Standards Institute’s (AIW) Fibre Channel Standard (now X3T1 1). It was also intended to give the principal U.S. participants a one- to two-year lead in developing heterogeneous high-speed computer networks, dktibuted computing through clustering, scientific visualization techniques, and high speed channels. The project was proposed to benefit U.S. industry as these high performance computing methods became generally available. In 1992-93, during the initial project phases, Fibre Channel PC) was emerging as a new ANSI standard. It was envisioned as becoming the mechanism for data transfer between the next generation of computers, and between these computers and their peripherals. Using this channel standard, U.S. computer vendors were expecting to be able to provide high-speed interoperability between heterogeneous computers and their storage devices, with data transfer rates greater than a GBit/sec. Our project was composed of key principal players in the FC standardization effort from both U.S. industry and the Department of Energy’s (DOES) Lawrence Liverrnore National Laboratory (LLNL). The industial participants were developing individual FC interfaces to operate with their platform products. LLNL’s role was to be a neutral testing site and a facilitator for helping to resolve conflicting interpretations of the embryonic Fibre Channel specification. LLNL anticipated that conflicts in the interpretation of such a standard would arise and require neutral resolution and that such resolutions would best be achieved in cooperation with the ANSI FC Working Group. Project plans included transferring to U.S. industry any resilient FC testing capabilities at the project conclusion.

42 ENGINEERING↗

DOE OSTI2018

Fibre Channel Development Final Report CRADA No. TC-0340-92-C

The Fibre Channel (FC) Development project was designed to enhance U.S. industrial competitiveness by accelerating the standardization and subsequent industrial acceptance of the American National Standards Institute’s (ANSI) Fibre Channel Standard (now X3T1 1). It was also intended to give the principal U.S. participants a one-to two-year lead in developing heterogeneous high-speed computer networks, distributed computing through clustering, scientific visualization techniques, and high speed channels. The project was proposed to benefit U.S. industry as these high performance computing methods became generally available. In 1992-93, during the initial project phases, Fibre Channel (FC) was emerging as a new ANSI standard. It was envisioned as becoming the mechanism for data transfer between the next generation of computers, and between these computers and their peripherals. Using this channel standard, U.S. computer vendors were expecting to be able to provide high-speed interoperatillity between heterogeneous computers and their storage devices, with data transfer rates greater than a GBit/sec. Our project was composed of key principal players in the FC standardization effort from both U.S. industry and the Department of Energy’s@OEs) Lawrence Liverrnore National Laboratory (LLNL). The industrial participants were developing individual FC interfaces to operate with their platform products. LLNL’s.role was to be a neutral testing site and a facilitator for helping to resolve conflicting interpretations of the embryonic Fibre Channel specification. LLNL anticipated that conflicts in the interpretation of such a standard would arise and require neutral resolution and that such resolutions would best be achieved in cooperation with the ANSI FC Working Group. Project plans included transferring to U.S. industry any resilient FC testing capabilities at the project conclusion.

42 ENGINEERING↗

DOE OSTI2017

FIPD: EBR-II Fuels Irradiation & Physics Database

The DOE Advanced Reactor Technology program has supported efforts to recover and preserve metallic fuel data generated throughout the US sodium cooled fast reactor program (SFR). Those efforts have been focused on establishing databases of the experimental data that were mainly generated during the Integral Fast Reactor program including data generated at EBR-II, FFTF, and TREAT reactors, as well as out of pile data. The data is essential for future-licensing activities of metallic fuel based advanced fast reactors. This report describes the EBR-II Fuels Irradiation & Physics Database (FIPD). It covers the scientific knowledge available in the database, the logical storage of the data in the database, and the web interface used to access the data. The report also covers the QA plan (SQAPP) developed to cover all aspects of the FIPD system. Summaries of activities from previous years, the current fiscal year (FY17), and future plans are also provided.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

NASA NTRS2022

Information Fusion and Data Analytics for Human Lunar Exploration (CIF REPORT: Detailed PI Write-up)

The Information Fusion & Data Analytics (IFDA) project commenced in FY20, continued through FY21, and its final platform development phase continues in FY22. The objective remains the fusion and rapid accessibility of large quantities of disparate sourced human spaceflight data. IFDA is a platform tailored for NA (S&MA) to develop highly advanced operational data integration and analysis techniques. IFDA leverages the JSC ER7 modeling, simulation,and data fusion capabilities to collect, warehouse, and augment data human exploration data integration and analysis techniques. The IFDA project’s integrated data visualizations have been demonstrated in two validation scenarios in FY21, and provided the architecture and platform basis for development of a full-scale data analysis suite and storage solution useful to all JSC organizations engaged in real time operations and safety tasks. Scenarioand prototypical development including the construction of a full scale data analysis suite and storage solution, useful to all JSC organizations engaged in real time operations and safety tasks, is central to IFDA Phase 3 and provides a demonstrable pathway for the Digital Transformation Program. IFDA Phase 3 is focused on data provider, data utilizer, and SME hands-on workshops that will conclude the Dem / Valphase and deliver a program-ready data integration tool as a product.

information fusion↗

NASA NTRS2022

Information Fusion & Analytics for Human Lunar Exploration

information fusion↗

DOE OSTI2017

Dry Storage Cask Inventory Assessment

The report, Commercial Spent Nuclear Fuel and High-Level Radioactive Waste Inventory Report [FCRDNFST-2013-000263, Vinson/Metzger/Carter 2017], provides information on the inventory of commercial spent nuclear fuel (SNF) as well as Government-owned SNF and High Level Waste (HLW) in the U.S. Department of Energy (DOE) complex. Inventory forecasts for commercial SNF were made for a few selected scenarios of future commercial nuclear power generation involving the existing reactor fleet including one scenario involving reactors under construction. This Dry Storage Cask Inventory Assessment report uses the data contained in FCRD-NFST-2013- 000263 to define the existing inventory of SNF in dry storage. This information is integrated with data on dry storage canisters and casks from the report, Storage and Transport Cask Data for Used Commercial Nuclear Fuel, 2013 U. S. Edition [ATI-TR-13047 2013] in a Microsoft Access database (hereinafter referred to as the Dry Storage Cask/Inventory Database). The Dry Storage Cask/Inventory Database is used to produce queries for assessing the various systems used for the existing inventory of dry storage casks. The database and this report will be revised in the future as the inventory of fuel in dry storage changes and as additional information becomes available. Both bare fuel and canistered dry storage casks are currently used to dry store SNF. Only 4 utilities currently use bare fuel storage systems for dry storage at 5 reactor sites. Seven unique bare fuel storage cask systems are used to store a total of 9,694 spent fuel assemblies in 212 total casks.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2022

Behind-the-Meter Storage Policy Stack

A variety of studies and disparate data sets track state energy storage policies, but these datasets do not cover all BTM-related storage policy. Moreover, these databases do not align policies with the policy stacking framework. Thus, it is unclear which BTM storage policies are adopted across the country, what should comprise a complete storage policy framework or stack, or how states policies compare with that stack. This first-of-its-kind BTM storage policy stack includes 11 parent policy categories and 31 policies across the market preparation, creation, and expansion policy components.

25 ENERGY STORAGE↗

NASA NTRS1979

The LACIE data bases: Design considerations

The implementation of direct access storage devices for LACIE is discussed with emphasis on the storage and retrieval of image data. Topics covered include the definition of the problem, the solution methodology (design decisions), the initial operational structure, and the modifications which were incorporated. Some conclusions and projections of future problems to be solved are also presented.

Westberry, L. E.↗

NASA NTRS1987

Advanced data management design for autonomous telerobotic systems in space using spaceborne symbolic processors

The use of computers in autonomous telerobots is reaching the point where advanced distributed processing concepts and techniques are needed to support the functioning of Space Station era telerobotic systems. Three major issues that have impact on the design of data management functions in a telerobot are covered. It also presents a design concept that incorporates an intelligent systems manager (ISM) running on a spaceborne symbolic processor (SSP), to address these issues. The first issue is the support of a system-wide control architecture or control philosophy. Salient features of two candidates are presented that impose constraints on data management design. The second issue is the role of data management in terms of system integration. This referes to providing shared or coordinated data processing and storage resources to a variety of telerobotic components such as vision, mechanical sensing, real-time coordinated multiple limb and end effector control, and planning and reasoning. The third issue is hardware that supports symbolic processing in conjunction with standard data I/O and numeric processing. A SSP that currently is seen to be technologically feasible and is being developed is described and used as a baseline in the design concept.

Goforth, Andre↗

DOE OSTI2014

A Report on Simulation-Driven Reliability and Failure Analysis of Large-Scale Storage Systems

High-performance computing (HPC) storage systems provide data availability and reliability using various hardware and software fault tolerance techniques. Usually, reliability and availability are calculated at the subsystem or component level using limited metrics such as, mean time to failure (MTTF) or mean time to data loss (MTTDL). This often means settling on simple and disconnected failure models (such as exponential failure rate) to achieve tractable and close-formed solutions. However, such models have been shown to be insufficient in assessing end-to-end storage system reliability and availability. We propose a generic simulation framework aimed at analyzing the reliability and availability of storage systems at scale, and investigating what-if scenarios. The framework is designed for an end-to-end storage system, accommodating the various components and subsystems, their interconnections, failure patterns and propagation, and performs dependency analysis to capture a wide-range of failure cases. We evaluate the framework against a large-scale storage system that is in production and analyze its failure projections toward and beyond the end of lifecycle. We also examine the potential operational impact by studying how different types of components affect the overall system reliability and availability, and present the preliminary results

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2016

Optimization of tomographic reconstruction workflows on geographically distributed resources

New technological advancements in synchrotron light sources enable data acquisitions at unprecedented levels. This emergent trend affects not only the size of the generated data but also the need for larger computational resources. Although beamline scientists and users have access to local computational resources, these are typically limited and can result in extended execution times. Applications that are based on iterative processing as in tomographic reconstruction methods require high-performance compute clusters for timely analysis of data. Here, time-sensitive analysis and processing of Advanced Photon Source data on geographically distributed resources are focused on. Two main challenges are considered: (i) modeling of the performance of tomographic reconstruction workflows and (ii) transparent execution of these workflows on distributed resources. For the former, three main stages are considered: (i) data transfer between storage and computational resources, (i) wait/queue time of reconstruction jobs at compute resources, and (iii) computation of reconstruction tasks. These performance models allow evaluation and estimation of the execution time of any given iterative tomographic reconstruction workflow that runs on geographically distributed resources. For the latter challenge, a workflow management system is built, which can automate the execution of workflows and minimize the user interaction with the underlying infrastructure. The system utilizes Globus to perform secure and efficient data transfer operations. The proposed models and the workflow management system are evaluated by using three high-performance computing and two storage resources, all of which are geographically distributed. Workflows were created with different computational requirements using two compute-intensive tomographic reconstruction algorithms. Experimental evaluation shows that the proposed models and system can be used for selecting the optimum resources, which in turn can provide up to 3.13× speedup (on experimented resources). Furthermore, the error rates of the models range between 2.1 and 23.3% (considering workflow execution times), where the accuracy of the model estimations increases with higher computational demands in reconstruction tasks.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2025

A Performance Model of In-Situ Techniques

The computational capacity of High-Performance Computing (HPC) systems increases continuously with the rapid development of central processing units (CPUs) and graphic processing units (GPUs), while the in-/output (IO) subsystem develops relatively slowly and storage capacity is also limited. Data-intensive applications, which are designed to leverage the high computational capacity of HPC resources, typically generate a considerable amount of data for post-processing visualizations and data analytics. The limited IO speed and storage space could lead to constraints in the actual performance of these applications and, therefore, scientific discovery. In-situ techniques, where data is visualized/analysed while still in memory rather than through disk, can contribute to alleviating these problems as they can reduce or even fully avoid data writing/reading through the IO subsystem to/from storage. However, the overall efficiency of insitu techniques crucially depends on the characteristics of both the in-situ tasks and the applications, and the resource distribution among them. Therefore, choosing the right in-situ approach (synchronous, asynchronous, or hybrid) and resource allocation is essential to minimize overhead and maximize the benefits of concurrent execution. In this paper, we present a performance model of in-situ techniques to find the most beneficial in-situ approach and the preferred resource configuration. We verify the high accuracy of our approach with over 6800 measurements and provide use cases with different applications.

Ju, Yi [Max Planck Computing and Data Facility, Ga↗