ML Rust catalogue
Menu

All categories

LLM clients

Client libraries for the APIs of LLM providers.

40 projects. Checked .

Start here

The Featured projects with the most downloads.

All projects

Order: strongest tier first, then most downloads, then name, with unmeasured values last. A library counts downloads over 30 days. An app counts binary downloads per release. An app with none counts its crate downloads over 30 days.

What do the tiers mean?
Featured
Shown first. It passes every Featured gate.
Listed
Shown in the normal listing. No other tier applies.
New
A project whose first release is recent.
Archived
No longer maintained, or ended by its author.

Tiers come from published rules over raw signals. Stars alone never qualify a project.

Active dependents: crates from other owners that depend on this project in a current release. One owner counts at most once.

Movement needs more history.

ProjectDownloadsDependentsStarsLatest releaseRuns on (GPU)Native codeLicense
async-openai Featured

Rust library for OpenAI

 275 2,031 0.43.0 MIT
rust-genai Featured

Multi-AI Providers Library for Rust. (OpenAI, Gemini, Anthropic, DeepSeek, Ollama, OMLX, AWS Bedrock, Vertex, Xai, Groq, Kimi, GLM and many more)

 81 938 0.7.3 Apache-2.0 OR MIT
ollama-rs Featured

A Rust library for interacting with the Ollama API

 68 1,061 0.3.6 MIT
aichat App Featured

All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.

 Not applicable 10,556 0.30.0 Apache-2.0 OR MIT
llm Featured

A Rust library unifying multiple LLM backends.

 34 365 1.3.8 MIT
Listed 32 projects
ChatGPT App Listed Dormant

❄️ ChatGPT Desktop Application (Mac, Windows and Linux)

 Not applicable 54,663 Not measured Not measured None stated
harmony Listed

OpenAI's response format for its open-weight model series gpt-oss

Python bindings

 9 4,539 0.0.8 Apache-2.0
openai-api-rs Listed

OpenAI API client library for Rust (unofficial)

 33 485 10.0.2 MIT
aisdk Listed

An open-source Rust library for building AI-powered applications, inspired by the Vercel AI SDK. It provides a robust, type-safe, and easy-to-use interface for interacting with various Large Language Models (LLMs).

 4 263 0.6.1 MIT
liter-llm Listed

Universal LLM API client — 174 providers, streaming, tool calling. Rust-powered, type-safe, compiled.

 8 264 2.7.0 MIT
openai Listed

An unofficial Rust library for the OpenAI API.

 13 128 1.1.1 MIT
chat-ai-desktop App Listed Dormant

Unofficial ChatGPT desktop app for Mac & Windows menubar using Tauri & Rust

 Not applicable 1,997 Not measured Not measured MIT
openrouter-rs Listed

A type-safe OpenRouter Rust SDK

 3 98 0.24.0 MIT
gemini-rust Listed

Rust client for Google Gemini API

 5 79 2.1.0 MIT
oatmeal App Listed Dormant

Terminal UI to chat with large language models (LLM) using different model backends, and integrations with your favourite editors!

 Not applicable 772 0.13.0 MIT
edgequake-llm Listed

Multi-provider LLM abstraction library with caching, rate limiting, and cost tracking

 15 44 0.10.10 Apache-2.0
gemini-client Listed

A Rust SDK for the Google Gemini API

 2 13 0.10.0 MIT
anthropic-sdk-rs Listed

An unofficial Rust SDK for Anthropic's Claude AI API

 4 18 0.2.27 MIT
antrhopic-rs Listed Dormant

Anthropic Rust SDK.

 6 Not measured 0.0.8 MIT
rstructor Listed

Get structured, validated data out of LLMs as native Rust structs and enums. Derive a type and rstructor generates the JSON Schema, prompts the model, parses the reply, and retries on validation errors — across OpenAI, Anthropic Claude, Google Gemini, and xAI Grok.

 3 34 0.6.0 MIT
anthropic-sdk Listed Dormant

Anthropic Rust SDK.

 3 38 0.1.5 MIT
llm_providers Listed

A unified source of truth for LLM providers, models, pricing, and capabilities.

 4 2 0.14.4 MIT
tenere App Listed

TUI interface for LLMs written in Rust

 Not applicable 686 0.11.3 GPL-3.0-or-later
mistralai-client-rs Listed Dormant

Mistral AI API client library for Rust (unofficial).

 4 48 0.14.0 Apache-2.0
smartcat App Listed Dormant

Putting a brain behind `cat`🐈‍⬛ Integrating language models in the Unix commands ecosystem through text streams.

 Not applicable 580 2.2.0 Apache-2.0 OR MIT
plano App Listed

Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.

 Not applicable 7,111 Not measured Not measured Apache-2.0
allms Listed

One Library to rule them aLLMs

 0 110 0.45.0 MIT
bitrouter App Listed

elastic inference for your agentic workloads, on your terms

 Not applicable 239 0.33.0 Apache-2.0
smg App Listed

High-performance model-routing gateway for large-scale LLM deployments

 Not applicable 703 1.14.0 Apache-2.0
llmvm Listed Dormant

A protocol and modular application suite for language models.

 0 105 0.1.1 MPL-2.0
rllm Listed

Unifies multiple LLM backends in Rust.

 0 137 1.1.9 MIT
vtcode App Listed

A Rust-based terminal coding agent with modular architecture supporting multiple LLM providers

 Not applicable 903 0.181.5 Apache-2.0 OR MIT
llm_client Listed Dormant

llm_client: The easiest Rust interface for local LLMs

 1 254 0.0.7 Metal MIT
litellm-rs App Listed

A high-performance AI Gateway written in Rust, providing OpenAI-compatible APIs with intelligent routing, load balancing, and enterprise features

 Not applicable 123 0.10.1 MIT
aipack App Listed

Run, Build, Share your AI Packs

 Not applicable 224 0.8.37 Apache-2.0 OR MIT
icebreaker Listed

A local AI chat app powered by 🦀Rust, 🧊iced, 🤗Hugging Face, and 🦙llama.cpp

 0 468 2026.2.0 MIT
ollamaMQ App Listed

High-performance LLM backends proxy with per-user fair-share queuing, round-robin scheduling, and a real-time TUI dashboard. Built in Rust.

 Not applicable 133 0.5.0 MIT
New 3 projects
switchyard New

Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.

Python bindings

 2 3,501 0.3.0 Apache-2.0
llm-kernel New

Foundation library for Rust AI-native apps — provider catalog, LLM client, MCP server, search, telemetry, and safety

 8 3 0.33.1 Apache-2.0
respan-gateway App New

An LLM gateway with a neutral core and compiled-in plugins.

 Not applicable 630 0.3.0 Apache-2.0 OR MIT