Engineering topics

Seidl, EdwardT

Publications and source records attributed to Seidl, EdwardT.

2 records

DOE OSTI2024

Implement the size statistics Parquet standard in the Rust implementation of Arrow and Parquet.

This patch will implement the new size statistics standard in the Rust implementation of Apache Arrow and Parquet (https://github.com/apache/arrow-rs/). This allows an uncompressed and unencoded size to be known prior to uncompressing and unencoding data stored in parquet files.

Seidl, EdwardT↗

DOE OSTI2022

nvidia dataframe library patch to support parquet indexing

On behalf of our WFO sponsors/collaborators, we are working closely with NVIDIA to improve their public, open-source GPU dataframes library. We are improving the library's support for reading and writing Parquet (an open source file format) for general-purpose cloud storage and processing. This patch better supports the indexing found in the more recent Parquet specifications. Is there

Seidl, EdwardT↗