dataprof

AndreaBozzo/dataprof

Data profiling and quality gates for CSV, JSON, Parquet and Arrow, with Python bindings

rust
data-quality
python
data-engineering
csv
json
apache-arrow
data-profiling

On crates.io

More in Data processing

pathwayby pathwaycom

Performant open-source Python ETL framework with Rust runtime, supporting 300+ data sources.

v0.32.1Pythonupdated 1d ago

62.1k

polarsby pola-rs

Fast feature complete DataFrame library

polars0.55.22.8m/90d updated today

40.1k

datafusionby apache

DataFusion is a very fast, extensible query engine for building high-quality data-centric systems in Rust, using the Apache Arrow in-memory format.

datafusion55.2.06.6m/90d updated today

9.5k

pg_analyticsby paradedb

PostgreSQL extension that accelerates analytical query processing inside Postgres to a performance level comparable to dedicated OLAP databases.

v0.26.2updated today

9.4k

pg_lakehouseby paradedb

PostgreSQL extension that transforms Postgres into an analytical query engine over object stores like AWS S3/GCS and table formats like Delta Lake/Iceberg.

v0.26.2updated today

9.4k

ndarrayby bluss

N-dimensional array with array views, multidimensional slicing, and efficient operations

ndarray0.17.231.3m/90d updated 2d ago

4.3k

IronCalc

A new, modern, work-in-progress spreadsheet engine.

ironcalc0.9.051.3k/90d updated today

4.2k

sailby lakehq

Sail is a drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

v0.7.2updated today

3.5k

All 19 in Data processing