datafusion
DataFusion is a Rust-based query engine integrated with Apache Arrow. It provides libraries for building database and analytics systems tailored to specific workloads. Supporting SQL and DataFrame APIs, DataFusion offers performance with native support for formats like CSV, Parquet, JSON, and Avro. Its design allows customization, including new data sources and functions, and supports Python and distributed integrations for diverse use cases.