DOE OSTI · 2228295
A Ceph S3 Object Data Store for HEP
Abstract
We present a novel data format design that obviates the need for data tiers by storing individual event data products in column objects. The objects are stored and retrieved through Ceph S3 technology, with a layout designed to minimize metadata volume and maximize data processing parallelism. Performance benchmarks of data storage and retrieval are presented.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Smith, Nick, Jayatilaka, Bo, Mason, David, Gutsche, Oliver, Peisker, Alison, Illingworth, Robert, Jones, Chris. 2023-11-27. A Ceph S3 Object Data Store for HEP. https://www.osti.gov/biblio/2228295
Cite the original work for its findings. Save a collection to share your selection of sources.