Technology
Apache Parquet
Apache Parquet is an open-source, column-oriented data file format optimized for efficient data storage and high-performance analytical query processing.
Parquet is the definitive columnar storage format for big data analytics: it drastically improves performance and reduces storage costs. Unlike row-based formats (CSV), Parquet organizes data by column, enabling systems to read only the necessary fields (predicate pushdown) and compress similar data types together (e.g., Snappy, Gzip). This design delivers massive efficiency gains; for example, one study showed Parquet queries running 34x faster with 99.7% cost savings compared to CSV on a 1TB dataset. The format is language-agnostic and features a self-describing schema via a file footer (metadata), making it the standard interchange format across major ecosystems like Apache Spark, Hive, Presto, and cloud services (AWS Athena, Google BigQuery).
What builders pair with Apache Parquet
Projects using both technologies. Select a pairing to see a project.
2 more pairings
Pairing: Apache Arrow
How We Put a Data Warehouse in the Browser and Let AI Agents Explore It
Pairing: DuckDB
LLM Datasets in the Browser with Parquet
Pairing: DuckDB-WASM
How We Put a Data Warehouse in the Browser and Let AI Agents Explore It
Pairing: Hugging Face
LLM Datasets in the Browser with Parquet
Pairing: Hyparquet
LLM Datasets in the Browser with Parquet
Pairing: JavaScript
LLM Datasets in the Browser with Parquet
Recent Talks & Demos
Showing 1-2 of 2