Data processing

yataby amv-dev

High performance technical analysis library

yata0.7.015.4k/90d updated 2y ago

dataprofby AndreaBozzo

Data profiling and quality gates for CSV, JSON, Parquet and Arrow, with Python bindings

dataprof0.12.0148/90d updated today

ndarrayby bluss

N-dimensional array with array views, multidimensional slicing, and efficient operations

ndarray0.17.231.3m/90d updated 2d ago

elusionby DataBora

An end-to-end data engineering DataFrame library built on DataFusion, with connectors for Microsoft Fabric, Azure, SharePoint, FTP, Postgres, MySQL, and REST APIs

elusion8.3.0304/90d updated 6mo ago

datafusionby apache

DataFusion is a very fast, extensible query engine for building high-quality data-centric systems in Rust, using the Apache Arrow in-memory format.

datafusion55.2.06.6m/90d updated today

faucet-streamby faucet-hq

ETL that governs your data while it moves: a config-driven data-movement platform with pluggable source and sink connectors, CDC, in-flight masking and quality checks, run from YAML by a single binary or embedded as a library

faucet-core1.14.05.1k/90d updated today

datalogic-rsby GoPlasmatic

High-performance, type-safe JSONLogic evaluation engine for business rules and dynamic filtering, with official bindings for Node, WASM, Python, Go, Java,.NET and PHP

datalogic-rs5.8.284.3k/90d updated 2d ago

IronCalc

A new, modern, work-in-progress spreadsheet engine.

ironcalc0.9.051.3k/90d updated today

utahby kernelmachine

Dataframe structure and operations

updated 8y ago

sailby lakehq

Sail is a drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

v0.7.2updated today

LogiSheetsby logisky

A new, modern spreadsheet engine that drives real products.

logisheets-rs1.16.1730/90d TypeScriptupdated 1d ago

mq-bridgeby marcomq

Async ETL and messaging library: config-driven routes move data between brokers (Kafka, NATS, AMQP, MQTT), databases incl. Postgres/MongoDB CDC, Parquet on S3/GCS/Azure, files and HTTP/gRPC, with retry, DLQ and deduplication middleware

mq-bridge1.0.35.8k/90d updated today

betterofficeby openooxml

Native OOXML engines for DOCX, XLSX and PPTX: editing, layout, rendering, CRDT collaboration and agent editing, compiled to WebAssembly.

updated today

pathwayby pathwaycom

Performant open-source Python ETL framework with Rust runtime, supporting 300+ data sources.

v0.32.1Pythonupdated today

pg_analyticsby paradedb

PostgreSQL extension that accelerates analytical query processing inside Postgres to a performance level comparable to dedicated OLAP databases.

v0.26.2updated today

pg_lakehouseby paradedb

PostgreSQL extension that transforms Postgres into an analytical query engine over object stores like AWS S3/GCS and table formats like Delta Lake/Iceberg.

v0.26.2updated today

polarsby pola-rs

Fast feature complete DataFrame library

polars0.55.22.8m/90d updated today

formualizerby PSU3D0

Embeddable spreadsheet engine that parses, evaluates and mutates Excel workbooks: 400+ functions, Arrow-backed storage, incremental recalculation, Python and WASM bindings

formualizer0.12.03k/90d updated 1d ago

weldby weld-project

High-performance runtime for data analytics applications

weld0.4.0102/90d updated 6mo ago