llm-chain
Library Listed Dormant
A library for running chains of LLMs (such as ChatGPT) in series to complete complex tasks, such as text summation.
- Downloads
- 2,575
- Dependents
- 1
- Stars
- 1,602
- Forks
- 141
- Contributors
- 39
- Commits
- 400
- Latest release
- 0.13.0 ·
About
llm-chain is a collection of Rust crates designed to help you create advanced LLM applications such as chatbots, agents, and more. As a comprehensive LLM-Ops platform we have strong support for both cloud and locally-hosted LLMs. We also provide robust support for prompt templates and chaining together prompts in multi-step chains, enabling complex tasks that LLMs can't handle in a single step. We also provide vector store integrations making it easy to give your model long-term memory and subject matter knowledge. This empowers you to build sophisticated applications.
Examples 💡
To help you get started, here is an example demonstrating how to use llm-chain. You can find more examples in the examples folder in the repository.
let exec = executor!()?;
let res = prompt!(
"You are a robot assistant for making personalized greetings",
"Make a personalized greeting for Joe"
)
.run(parameters()!, &exec)
.await?;
println!("{}", res);
➡️ tutorial: get started with llm-chain ➡️ quick-start: Create project based on our template
Read the full README
Features 🌟
- Prompt templates: Create reusable and easily customizable prompt templates for consistent and structured interactions with LLMs.
- Chains: Build powerful chains of prompts that allow you to execute more complex tasks, step by step, leveraging the full potential of LLMs.
- ChatGPT support: Supports ChatGPT models, with plans to add OpenAI's other models in the future.
- LLaMa support: Provides seamless integration with LLaMa models, enabling natural language understanding and generation tasks with Facebook's research models.
- Alpaca support: Incorporates support for Stanford's Alpaca models, expanding the range of available language models for advanced AI applications.
llm.rssupport: Use llms in rust without dependencies on C++ code with our support forllm.rs- Tools: Enhance your AI agents' capabilities by giving them access to various tools, such as running Bash commands, executing Python scripts, or performing web searches, enabling more complex and powerful interactions.
- Extensibility: Designed with extensibility in mind, making it easy to integrate additional LLMs as the ecosystem grows.
- Community-driven: We welcome and encourage contributions from the community to help improve and expand the capabilities of
llm-chain.
Getting Started 🚀
To start using llm-chain, add it as a dependency in your Cargo.toml (you need Rust 1.65.0 or newer):
[dependencies]
llm-chain = "0.12.0"
llm-chain-openai = "0.12.0"
The examples for llm-chain-openai require you to set the OPENAI_API_KEY environment variable which you can do like this:
export OPENAI_API_KEY="sk-YOUR_OPEN_AI_KEY_HERE"
Then, refer to the documentation and examples to learn how to create prompt templates, chains, and more.
Contributing 🤝
We warmly welcome contributions from everyone! If you're interested in helping improve llm-chain, please check out our CONTRIBUTING.md file for guidelines and best practices.
License 📄
llm-chain is licensed under the MIT License.
Connect with Us 🌐
If you have any questions, suggestions, or feedback, feel free to open an issue or join our community discord. We're always excited to hear from our users and learn about your experiences with llm-chain.
We hope you enjoy using llm-chain to unlock the full potential of Large Language Models in your projects. Happy coding! 🎉
Compatibility
- Runs on
- CUDA
What shows it
- CUDA: llm-chain-llama-sys feature cuda
- Native code
- Required
- Binds native code: llm-chain-llama-sys
- Build uses a native toolchain: bindgen
- Python bindings
- No Python binding crate found
- License
- MIT
Compare with similar projects
Order: strongest tier first, then most downloads, then name, with unmeasured values last. A library counts downloads over 30 days. An app counts binary downloads per release. An app with none counts its crate downloads over 30 days. ML Rust runs this catalogue, so its closest project always gets a row.
| Project | Downloads | Dependents | Stars | Latest release | Runs on (GPU) | Native code | License |
|---|---|---|---|---|---|---|---|
|
A library for running chains of LLMs (such as ChatGPT) in series to complete complex tasks, such as text summation. |
2,575 downloads over 30 days | 1 | 1,602 | 0.13.0 | CUDA | Binds native code: llm-chain-llama-sys. Build uses a native toolchain: bindgen | MIT |
|
rig Featured
An opinionated library for building LLM powered applications. |
64,485 downloads over 30 days | 234 | 9,096 | 0.46.0 | GPU support unknown | Binds native code: libsqlite3-sys (feature sqlite), ring (feature surrealdb) | MIT |
|
autoagents Listed
Agent Framework for Building Autonomous Agents |
8,627 downloads over 30 days | 4 | 779 | 0.4.0 | CUDA, WebGPU, Metal, ROCm, Vulkan | Binds native code: llama-cpp-sys-2, ort-sys, alsa-sys (feature audio-capture), intel-mkl-src (feature full), rquickjs-sys (feature codeact) | Apache-2.0 OR MIT |
|
memvid Listed
Core library for Memvid v2, a crash-safe, deterministic, single-file AI memory. |
5,276 downloads over 30 days | 2 | 17,386 | 2.0.140 | CUDA, Metal | Binds native code: zstd-sys, link-cplusplus (feature llama-cpp), llama_cpp_sys (feature llama-cpp), ort-sys (feature logic_mesh) | Apache-2.0 |
|
floneum Listed
A simple interface for pretrained AI models |
649 downloads over 30 days | 7 | 2,236 | 0.4.0 | CUDA, Metal | Binds native code: alsa-sys, lmdb-master-sys, accelerate-src (feature accelerate), intel-mkl-src (feature mkl), ort-sys (feature voice_detection) and 1 more | Apache-2.0 OR MIT |
|
autogpt Listed
🦀 A Pure Rust Framework For Building AGIs. |
2 downloads over 30 days | 0 | 117 | 0.4.5 | GPU support unknown | Binds native code: ring, zstd-sys, libgit2-sys (feature git), libz-sys (feature git) | MIT |
|
An open protocol that gives AI agents a secure, sandboxed place to run code and use tools — with lean context usage. AXP works alongside MCP |
Not measured | Not applicable | 3 | Not measured | Not measured | Not measured | Apache-2.0 |
All projects in Build LLM apps and agentsAll projects in Run and serve models
Why ListedNo archive, New or Featured rule places it, so it is Listed.
What it lacks for Featured
- It has 0 active dependents and 0 new dependents in 365 days. Featured needs 11 active dependents or 9 new dependents in 365 days. The repository route reads 1,602 stars, 141 forks and 39 contributors. It needs 4,539 stars, 434 forks and 79 contributors together.
- The project is dormant and not finished. Dormancy rule
What else the check found
- The last activity is on 31 Oct 2024, 739 days ago. That reaches the 365 days the rules expect, so the project is dormant. Dormancy rule
- The oldest outside issue waits 1290 days for a reply, past the limit of 270. No maintainer replied in 365 days. Rot signals rule
- The latest release requires the deprecated dependency paste. RUSTSEC-2024-0436 Rot signals rule
- The project is dormant with 2 rot signals, which reaches the limit of 2. This is dead check 1 of 2, so the entry is not yet archived. Dead rule
Not measured: Latest release fails cargo check.
Exact rules: Listed, Featured library. The check on applied thresholds version 9.
Every rule outcome, as the check records it
expected-interval: version 0.13.0 base 140, raised to the 365-day floor: E = 365 daysdormancy: last activity 2024-10-31, 739 days ago, E = 365: dormantrot: oldest unanswered issue 1290 days (limit 270), no maintainer reply in 365 daysrot: deprecated requirement `paste (RUSTSEC-2024-0436, https://rustsec.org/advisories/RUSTSEC-2024-0436.html)`dead: dormant with 2 rot signals (limit 2): dead on check 1 of 2, not yet archivedfeatured: not featured: active_users 0 < 11 and new_adopters 0 < 9 and repository route stars 1602 (needs 4539), forks 141 (needs 434), contributors 39 (needs 79); dormant and not stablelisted: listed: no archive, new or featured rule applies
Crates12 crates
Measurements and sources
Each signal row shows the raw value, its source and the fetch date. The Sources list gathers every distinct source on this page. Movement needs more history.
Sources6 sources
- Description: the crates.io description
- crates.io database dump, fetched
- RustSec advisory database, fetched
- GitHub repository, fetched
- crates.io package, fetched
- GitHub contributors, fetched
Adoption0 active dependents, 0 new dependents in 365 days1 not measured
| Signal | Value | Source | Fetched | Counts |
|---|---|---|---|---|
| Active dependents | 0 | crates.io database dump | Yes | |
| New dependents (365 days) | 0 | crates.io database dump | Yes | |
| Peak active dependents | 1 | crates.io database dump | Yes | |
| Active dependents as a share of the peak | 1 | crates.io database dump | Yes | |
| Binary downloads per release | Not measured | Yes |
MaintenanceLatest human commit: 2 years ago3 not measured
| Signal | Value | Source | Fetched | Counts |
|---|---|---|---|---|
| Latest human commit | 2024-10-31 | GitHub repository | Yes | |
| Latest release | 2023-11-15 | crates.io database dump | Yes | |
| First release | 2023-03-25 | crates.io database dump | Yes | |
| Latest version | 0.13.0 | crates.io database dump | Yes | |
| Days the oldest outside issue waits for a reply | 1290 | GitHub repository | Yes | |
| Maintainer replies over 365 days | 0 | GitHub repository | Yes | |
| Repository archived | false | GitHub repository | Yes | |
| Repository gone | false | GitHub repository | Yes | |
| Release commit or manifest in the repo | true | crates.io package | Yes | |
| Published docs | true | crates.io database dump | Yes | |
| Latest release fails cargo check | Not measured | Yes | ||
| Build check date | Not measured | Yes | ||
| Build check toolchain | Not measured | Yes |
SecurityUnpatched vulnerabilities: none
| Signal | Value | Source | Fetched | Counts |
|---|---|---|---|---|
| Unpatched vulnerabilities past the grace window | none | RustSec advisory database | Yes | |
| RustSec unmaintained advisory | none | RustSec advisory database | Yes | |
| Deprecation notice | none | crates.io database dump | Yes | |
| Deprecated requirement | paste (RUSTSEC-2024-0436, https://rustsec.org/advisories/RUSTSEC-2024-0436.html) | crates.io database dump | Yes |
Distribution30 releases, 2,575 downloads over 30 days5 not measured
| Signal | Value | Source | Fetched | Counts |
|---|---|---|---|---|
| Releases | 30 | crates.io database dump | Yes | |
| Downloads over 30 days | 2575 | crates.io database dump | Yes | |
| Binary downloads over the last 3 releases | Not measured | Yes | ||
| Homebrew installs on request over 365 days | Not measured | Yes | ||
| Repology repository families | Not measured | Yes | ||
| Docker pull growth over 90 days | Not measured | Yes | ||
| Docker pulls at the growth baseline | Not measured | Yes | ||
| Every version a prerelease | false | crates.io database dump | Yes | |
| Every version 0.0.x | false | crates.io database dump | Yes | |
| Every version yanked | false | crates.io database dump | Yes | |
| Crate deleted from crates.io | false | crates.io database dump | Yes |
Repository1,602 stars, 141 forks, 39 contributors, 400 commits. Stars alone never qualify a project.
| Signal | Value | Source | Fetched | Counts |
|---|---|---|---|---|
| GitHub stars | 1602 | GitHub repository | Yes — one part of the repository route | |
| GitHub forks | 141 | GitHub repository | Yes — one part of the repository route | |
| Contributors with a GitHub account | 39 | GitHub contributors | Yes — one part of the repository route | |
| Commits on the default branch | 400 | GitHub repository | No | |
| Repository's main crate left out of the entry | none | crates.io database dump | Yes |
Facts that never count
| Signal | Value | Source | Fetched | Counts |
|---|---|---|---|---|
| License | MIT | crates.io database dump | No | |
| Runs on, from listed crates and their direct dependencies | CUDA | crates.io database dump | No | |
| What shows each backend | CUDA: llm-chain-llama-sys feature cuda | crates.io database dump | No | |
| Native code, from listed crates and their dependencies | Binds native code: llm-chain-llama-sys. Build uses a native toolchain: bindgen | crates.io database dump | No | |
| Python bindings, from direct dependencies of listed crates | No Python binding crate found | crates.io database dump | No | |
| Crates that depend on a listed crate directly | 1 | crates.io database dump | No |
Corrections and review history
No correction applies to this entry.
Judgments
A judgment enters only through an approved issue and a merged pull request.
No judgment applies to this entry.