December 2024

Hyparquet

TIL

I came across a nice dependency-free library today, hyparquet, for parsing Parquet files in JavaScript.

It supports many compression formats including Snappy and Zstd, and reads Parquet files in chunks using range requests rather than loading the entire file. You can read just the metadata, or particular rows and columns.

It’s a good companion to Jeff Heer’s flechette, a lightweight library for reading and writing Arrow files. (API reference)

See also: fzstd, a small library for decompressing zstd files.

Back to top