ort
Library Featured
A safe Rust wrapper for ONNX Runtime 1.31 - Optimize and accelerate machine learning inference & training
- Downloads
- 3,902,768
- Dependents
- 694
- Stars
- 2,611
- Forks
- 279
- Contributors
- 78
- Commits
- 1,104
- Latest release
- 2.0.0-rc.15 ·
About
ort is a Rust interface for performing hardware-accelerated inference & training on machine learning models in the Open Neural Network Exchange (ONNX) format.
Based on the now-inactive onnxruntime-rs crate, ort is primarily a wrapper for Microsoft's ONNX Runtime library, but offers support for other pure-Rust runtimes.
ort with ONNX Runtime is super quick - and it supports almost any hardware accelerator you can think of. Even still, it's light enough to run on your users' devices.
When you need to deploy a PyTorch/TensorFlow/Keras/scikit-learn/PaddlePaddle model either on-device or in the datacenter, ort has you covered.
📖 Documentation
🤔 Support
🌠 Backers
💖 FOSS projects using ort
Open a PR to add your project here 🌟
Read the full README
- Text Embeddings Inference (TEI) uses
ortto deliver high-performance ONNX Runtime inference for text embedding models. - Magika uses
ortfor neural network-based file type detection. - retto uses
ortfor reliable, fast ONNX inference of PaddleOCR models on Desktop and WASM platforms. - edge-transformers uses
ortfor accelerated transformer model inference at the edge. sbv2-apiis a fast implementation of Style-BERT-VITS2 text-to-speech usingort.- BoquilaHUB uses
ortfor local AI deployment in biodiversity conservation efforts. - CamTrap Detector uses
ortto detect animals, humans and vehicles in trail camera imagery. - Ortex uses
ortfor safe ONNX Runtime bindings in Elixir. - oar-ocr A comprehensive OCR library, built in Rust with
ortfor efficient inference. FastEmbed-rsusesortfor generating vector embeddings, reranking locally.- Ahnlich uses
ortto power their AI proxy for semantic search applications. - nicegal is a desktop image gallery app that uses
ortfor OCR & semantic image search. - Murmure uses
ortas its core engine, leveraging NVIDIA Parakeet to deliver fully local, free, private and cross‑platform Speech‑to‑Text enhanced with LLM post‑processing. - Valentinus uses
ortto provide embedding model inference inside LMDB. - SilentKeys uses
ortfor fast, on-device real-time dictation with NVIDIA Parakeet and Silero VAD. - Xybrid uses
ortto run LLMs, ASR, and TTS natively on-device across iOS, Android, Flutter, and Unity apps and games. - Ultralytics YOLO Rust Inference is a high-performance, pure Rust library and CLI providing a fast and efficient interface for running YOLO models using
ort. - Air Paint uses
ortto run a YOLO hand pose model for real-time air drawing.
Compatibility
- Runs on
- CUDA, WebGPU, ROCm
What shows it
- CUDA: ort feature cuda, ort-sys feature cuda
- WebGPU: ort feature webgpu, ort-sys feature webgpu
- ROCm: ort feature rocm, ort-sys feature rocm
- Native code
- Required
- Binds native code: onnxruntime, ort-sys
- Build uses a native toolchain: pkg-config (feature pkg-config)
- Python bindings
- No Python binding crate found
- License
- Apache-2.0 OR MIT
Compare with similar projects
Order: strongest tier first, then most downloads, then name, with unmeasured values last. A library counts downloads over 30 days. An app counts binary downloads per release. An app with none counts its crate downloads over 30 days. ML Rust runs this catalogue, so its closest project always gets a row.
| Project | Downloads | Dependents | Stars | Latest release | Runs on (GPU) | Native code | License |
|---|---|---|---|---|---|---|---|
|
A safe Rust wrapper for ONNX Runtime 1.31 - Optimize and accelerate machine learning inference & training |
3,902,768 downloads over 30 days | 694 | 2,611 | 2.0.0-rc.15 | CUDA, WebGPU, ROCm | Binds native code: onnxruntime, ort-sys. Build uses a native toolchain: pkg-config (feature pkg-config) | Apache-2.0 OR MIT |
|
rten Featured
Tensor library for the RTen machine learning runtime |
496,924 downloads over 30 days | 29 | 360 | 0.27.0 | GPU support unknown | No native code found | Apache-2.0 OR MIT |
|
lele Listed
Bare-metal machine learning inference library in Rust |
132 downloads over 30 days | 1 | 183 | 0.2.0 | GPU support unknown | No native code found | MIT |
|
A rust mlx server, ui, and model router for fast, dependency free inference on apple architecture |
23 binary downloads per release | Not applicable | 34 | Not measured | Not measured | MIT | |
|
Inference server for LLMs, speech and embeddings: OpenAI-compatible routes with streaming, plus speech synthesis (TTS) and transcription (ASR). Serves Llama, Mistral, Qwen, Mamba2, MLA+MoE and hybrid models from SafeTensors, AWQ, GPTQ and GGUF. |
8 binary downloads per release | Not applicable | 7 | 0.7.1 | CUDA, WebGPU | Binds native code: ring (feature distributed) | Apache-2.0 |
|
Machine Learning Inference Framework and Server Runtime Python bindings |
0 downloads over 30 days | 0 | 153 | 0.2.3 | GPU support unknown | No native code found | MIT |
|
furnace New
Fast, unified, Rust-native, Axum-compatible inference endpoints and nervous system for tensor models and LLMs: KServe / Triton and OpenAI APIs from one pure-Rust server |
241 downloads over 30 days | 0 | 66 | 0.16.2 | CUDA, WebGPU, Metal | No native code found | MIT |
Why FeaturedIt passes every Featured gate.
What it meets
- It has 409 active dependents and 385 new dependents in 365 days. Featured needs 11 active dependents or 9 new dependents in 365 days.
- Active dependents are at 100% of their peak. Featured needs at least 50%.
- Docs are present. The release commit or a manifest ties the crate to the repository.
- No vulnerability advisory stays unpatched past the grace window. At least one version is outside 0.0.x.
- The last activity is on 1 Nov 2026, 8 days ago. The rules expect an update within 800 days. Dormancy rule
What else the check found
- Every version is a prerelease.
Exact rules: Featured library. The check on applied thresholds version 9.
Every rule outcome, as the check records it
expected-interval: version 2.0.0-rc.15 base 200, doubled for 3902768 downloads per month, doubled for 408.5 active users: E = 800 daysdormancy: last activity 2026-11-01, 8 days ago, E = 800: activefeatured: featured: active_users 408.5, new_adopters 384.5, former_glory 1, every version is a prerelease
Crates5 crates
- ort Primary
- ort-candle
- ort-sys
- ort-tract
- ort-web
Measurements and sources
Each signal row shows the raw value, its source and the fetch date. The Sources list gathers every distinct source on this page. Movement needs more history.
Sources6 sources
- Description: the crates.io description
- crates.io database dump, fetched
- RustSec advisory database, fetched
- GitHub repository, fetched
- crates.io package, fetched
- GitHub contributors, fetched
Adoption409 active dependents, 385 new dependents in 365 days1 not measured
| Signal | Value | Source | Fetched | Counts |
|---|---|---|---|---|
| Active dependents | 408.5 | crates.io database dump | Yes | |
| New dependents (365 days) | 384.5 | crates.io database dump | Yes | |
| Peak active dependents | 404.5 | crates.io database dump | Yes | |
| Active dependents as a share of the peak | 1 | crates.io database dump | Yes | |
| Binary downloads per release | Not measured | Yes |
MaintenanceLatest human commit: 8 days ago3 not measured
| Signal | Value | Source | Fetched | Counts |
|---|---|---|---|---|
| Latest human commit | 2026-11-01 | GitHub repository | Yes | |
| Latest release | 2026-10-23 | crates.io database dump | Yes | |
| First release | 2023-11-22 | crates.io database dump | Yes | |
| Latest version | 2.0.0-rc.15 | crates.io database dump | Yes | |
| Days the oldest outside issue waits for a reply | 22 | GitHub repository | Yes | |
| Maintainer replies over 365 days | 82 | GitHub repository | Yes | |
| Repository archived | false | GitHub repository | Yes | |
| Repository gone | false | GitHub repository | Yes | |
| Release commit or manifest in the repo | true | crates.io package | Yes | |
| Published docs | true | crates.io database dump | Yes | |
| Latest release fails cargo check | Not measured | Yes | ||
| Build check date | Not measured | Yes | ||
| Build check toolchain | Not measured | Yes |
SecurityUnpatched vulnerabilities: none
| Signal | Value | Source | Fetched | Counts |
|---|---|---|---|---|
| Unpatched vulnerabilities past the grace window | none | RustSec advisory database | Yes | |
| RustSec unmaintained advisory | none | RustSec advisory database | Yes | |
| Deprecation notice | none | crates.io database dump | Yes | |
| Deprecated requirement | none | crates.io database dump | Yes |
Distribution16 releases, 3,902,768 downloads over 30 days5 not measured
| Signal | Value | Source | Fetched | Counts |
|---|---|---|---|---|
| Releases | 16 | crates.io database dump | Yes | |
| Downloads over 30 days | 3902768 | crates.io database dump | Yes | |
| Binary downloads over the last 3 releases | Not measured | Yes | ||
| Homebrew installs on request over 365 days | Not measured | Yes | ||
| Repology repository families | Not measured | Yes | ||
| Docker pull growth over 90 days | Not measured | Yes | ||
| Docker pulls at the growth baseline | Not measured | Yes | ||
| Every version a prerelease | true | crates.io database dump | Yes | |
| Every version 0.0.x | false | crates.io database dump | Yes | |
| Every version yanked | false | crates.io database dump | Yes | |
| Crate deleted from crates.io | false | crates.io database dump | Yes |
Repository2,611 stars, 279 forks, 78 contributors, 1,104 commits. Stars alone never qualify a project.
| Signal | Value | Source | Fetched | Counts |
|---|---|---|---|---|
| GitHub stars | 2611 | GitHub repository | Yes — one part of the repository route | |
| GitHub forks | 279 | GitHub repository | Yes — one part of the repository route | |
| Contributors with a GitHub account | 78 | GitHub contributors | Yes — one part of the repository route | |
| Commits on the default branch | 1104 | GitHub repository | No | |
| Repository's main crate left out of the entry | none | crates.io database dump | Yes |
Facts that never count
| Signal | Value | Source | Fetched | Counts |
|---|---|---|---|---|
| License | Apache-2.0 OR MIT | crates.io database dump | No | |
| Runs on, from listed crates and their direct dependencies | CUDA, WebGPU, ROCm | crates.io database dump | No | |
| What shows each backend | CUDA: ort feature cuda, ort-sys feature cuda; WebGPU: ort feature webgpu, ort-sys feature webgpu; ROCm: ort feature rocm, ort-sys feature rocm | crates.io database dump | No | |
| Native code, from listed crates and their dependencies | Binds native code: onnxruntime, ort-sys. Build uses a native toolchain: pkg-config (feature pkg-config) | crates.io database dump | No | |
| Python bindings, from direct dependencies of listed crates | No Python binding crate found | crates.io database dump | No | |
| Crates that depend on a listed crate directly | 694 | crates.io database dump | No |
Corrections and review history
No correction applies to this entry.
Judgments
A judgment enters only through an approved issue and a merged pull request.
No judgment applies to this entry.