luminal

luminal-ai/luminal

High-performance general-purpose inference compiler with RISC-style architecture, search-based optimization, and native CUDA/Metal backends. Supports transformers, convnets, and autograd.

On crates.io

More in Machine learning

candleby huggingface

A minimalist ML framework with a focus on easiness of use and on performance (including GPU support)

candle-core0.11.03.9m/90d updated 6d ago

21.2k

burnby tracel-ai

A Flexible and Comprehensive Deep Learning Framework.

burn0.22.1724.3k/90d updated today

16.1k

tokenizersby huggingface

Hugging Face's tokenizers for modern NLP pipelines (original implementation) with bindings for Python.

tokenizers0.23.217.1m/90d updated 1d ago

11.2k

mistral.rsby EricLBuehler

Fast, flexible LLM inference engine supporting multimodal models, quantization (GGUF/GPTQ/ISQ), and OpenAI-compatible API

mistralrs0.8.1136.9k/90d updated today

7.8k

planoby katanemo

The AI-native proxy server and data plane for agentic apps.

0.4.37updated 13d ago

7.1k

shimmyby Michael-A-Kuykendall

Pure-Rust WebGPU inference engine with an OpenAI-compatible API and native GGUF support.

shimmy2.6.51k/90d updated 2d ago

leafby autumnai

Open Machine Intelligence framework.. Abandoned project. The most updated fork is juice.

leaf0.2.1231/90d updated 2y ago

5.5k

tch-rsby LaurentMazare

Bindings for PyTorch.

tch0.26.02.6m/90d updated 1mo ago

5.5k

All 30 in Machine learning