tinyvector

App Listed Dormant

A tiny embedding database in pure Rust.

Checked ยท Sources

Downloads
Not measured
Dependents
Not applicable
Stars
440
Forks
26
Contributors
2
Commits
21

About

From the project README ยท

tinyvector - a tiny embedding database in pure Rust


โœจ Features

  • Tiny: It's in the name. It's literally just an axum server. Extremely easy to customize, around 600 lines of code.
  • Fast: Tinyvector should have comparable speed to advanced vector databases when it comes on small to medium datasets, and slightly better accuracy.
  • Vertically Scales: Tinyvector stores all indexes in memory for fast querying. Very easy to scale up to 100 million+ vector dimensions without issue.
  • Open Source: MIT Licensed, free forever.
Soon
  • Powerful Queries: Allow filtering by the provided vector metadata without slowing the search down.
  • Integrated Models: Soon you won't have to bring your own vectors, just generate them on the server automaticaly. Aiming to support support SBert, Hugging Face models, OpenAI, Cohere, etc.
  • Typescript/Python Libraries: Should be able to auto-generate pretty good clients using the included OpenAPI schema.

๐Ÿš€ Getting Started

๐Ÿณ Docker

We provide a lightweight Docker container that you can run anywhere. It only takes one command to get up and running with the latest changes:

docker run \
  -p 8000:8000 \
  ghcr.io/m1guelpf/tinyvector:edge
Read the full README

Note When running via Docker Compose or Kubernetes, make sure to bind a volume to /tinyvector/storage for persistence. This is handled automatically in the command above.

๐Ÿ› ๏ธ Building from scratch

You can build tinyvector from the latest tagged release by running cargo install tinyvector (you might need to install Rust first). Then, run tinyvector to start up the server.

You can also build it from the latest commit by cloning the repo and running cargo build --release, and run it with ./target/release/tinyvector.

๐Ÿ’ก Why use tinyvector?

Most vector databases are overkill for simple setups. For example:

  • Using embeddings to chat with your documents. Most document search is nowhere close to what you'd need to justify accelerating search speed with HNSW or FAISS.
  • Doing search for your website or store. Unless you're selling 1,000,000 items, you don't need Pinecone.

๐Ÿงฉ Embeddings?

Embeddings are a way to compare similar things, in the same way humans compare similar things, by converting text into a small list of numbers. Similar pieces of text will have similar numbers, different ones have very different numbers.

Read OpenAI's explanation.

๐Ÿ™ Acknowledgements

  • Will Depue's tinyvector (python+sqlite+numpy) inspired me to build a vector database from scratch (and borrow the name). Will also contributed plenty of ideas to optimize performance.

๐Ÿ“„ License

This project is open-sourced under the MIT license. See the License file for more information.

License
MIT
Crate facts
Not measured
  • Runs on, Native code and Python bindings read crates on crates.io. This entry lists no crate.

Compare with similar projects

Order: strongest tier first, then most downloads, then name, with unmeasured values last. A library counts downloads over 30 days. An app counts binary downloads per release. An app with none counts its crate downloads over 30 days. ML Rust runs this catalogue, so its closest project always gets a row.

tinyvector beside the projects that share a topic with it
ProjectDownloadsDependentsStarsLatest releaseRuns on (GPU)Native codeLicense
tinyvector This page App Listed Dormant

A tiny embedding database in pure Rust.

Not measured Not applicable 440 Not measured Not measured Not measured MIT
lancedb Featured

LanceDB: A serverless, low-latency vector database for AI applications

615,090 downloads over 30 days 102 11,863 0.41.0 GPU support unknown No native code found Apache-2.0
ruvector Listed

High-performance Rust vector database core with HNSW indexing

39,411 downloads over 30 days 51 4,675 2.5.0 CUDA, WebGPU, Metal Binds native code: libsqlite3-sys, napi-sys, ort-sys, pgrx-pg-sys, pqcrypto-internals and 5 more MIT
splintr Listed

Tokenizer for Rust and Python: pure Rust by default, with 18 bundled vocabularies and four backends covering BPE, SentencePiece and WordPiece. Its output matches Hugging Face tokenizers id for id on 14 model families, including GPT-2, Qwen, Whisper, T5 and BERT.

Python bindings

8,204 downloads over 30 days 7 63 0.22.2 GPU support unknown Binds native code: pcre2-sys (feature pcre2) MIT
velesdb Listed

High-performance vector database engine written in Rust

2,396 downloads over 30 days 0 102 8.1.0 WebGPU Binds native code: tauri, tauri-plugin-velesdb, atk-sys, gdk-pixbuf-sys, gdk-sys and 9 more Not measured
memvdb Listed Dormant

A Rust in-memory vector database

305 downloads over 30 days 2 2 0.1.1 GPU support unknown No native code found MIT
chromadb-rs Archived

A Rust client library for the ChromaDB vector database.

3,548 downloads over 30 days 7 46 2.3.0 GPU support unknown No native code found MIT
Why ListedNo archive, New or Featured rule places it, so it is Listed.

What it lacks for Featured

What else the check found

  • The last activity is on 5 Jul 2023, 1223 days ago. That reaches the 365 days the rules expect, so the project is dormant. Dormancy rule
  • The oldest outside issue waits 1223 days for a reply, past the limit of 270. No maintainer replied in 365 days. Rot signals rule

Not measured: Latest release, Unpatched vulnerabilities past the grace window, First release.

Exact rules: Listed, Featured app. The check on applied thresholds version 9.

Every rule outcome, as the check records it
  • expected-interval: app: E = 365 days
  • dormancy: last activity 2023-07-05, 1223 days ago, E = 365: dormant
  • rot: oldest unanswered issue 1223 days (limit 270), no maintainer reply in 365 days
  • featured: not featured: dormant and not stable
  • listed: listed: no archive, new or featured rule applies

Measurements and sources

Each signal row shows the raw value, its source and the fetch date. The Sources list gathers every distinct source on this page. Movement needs more history.

Sources4 sources
AdoptionNot measured
Adoption measurements
SignalValueSourceFetchedCounts
Active dependentsNot measuredYes
New dependents (365 days)Not measuredYes
Peak active dependentsNot measuredYes
Active dependents as a share of the peakNot measuredYes
Binary downloads per releaseNot measuredYes
MaintenanceLatest human commit: 3 years ago8 not measured
Maintenance measurements
SignalValueSourceFetchedCounts
Latest human commit2023-07-05GitHub repositoryYes
Latest releaseNot measuredYes
First releaseNot measuredYes
Latest versionNot measuredYes
Days the oldest outside issue waits for a reply1223GitHub repositoryYes
Maintainer replies over 365 days0GitHub repositoryYes
Repository archivedfalseGitHub repositoryYes
Repository gonefalseGitHub repositoryYes
Release commit or manifest in the repoNot measuredYes
Published docsNot measuredYes
Latest release fails cargo checkNot measuredYes
Build check dateNot measuredYes
Build check toolchainNot measuredYes
SecurityNot measured
Security measurements
SignalValueSourceFetchedCounts
Unpatched vulnerabilities past the grace windowNot measuredYes
RustSec unmaintained advisoryNot measuredYes
Deprecation noticeNot measuredYes
Deprecated requirementNot measuredYes
Distribution0 binary downloads over the last 3 releases10 not measured
Distribution measurements
SignalValueSourceFetchedCounts
ReleasesNot measuredYes
Downloads over 30 daysNot measuredYes
Binary downloads over the last 3 releases0GitHub releasesYes
Homebrew installs on request over 365 daysNot measuredYes
Repology repository familiesNot measuredYes
Docker pull growth over 90 daysNot measuredYes
Docker pulls at the growth baselineNot measuredYes
Every version a prereleaseNot measuredYes
Every version 0.0.xNot measuredYes
Every version yankedNot measuredYes
Crate deleted from crates.ioNot measuredYes
Repository440 stars, 26 forks, 2 contributors, 21 commits. Stars alone never qualify a project.1 not measured
Repository measurements
SignalValueSourceFetchedCounts
GitHub stars440GitHub repositoryYes โ€” one part of the repository route
GitHub forks26GitHub repositoryYes โ€” one part of the repository route
Contributors with a GitHub account2GitHub contributorsYes โ€” one part of the repository route
Commits on the default branch21GitHub repositoryNo
Repository's main crate left out of the entryNot measuredYes
Facts that never count
Facts that never count measurements
SignalValueSourceFetchedCounts
LicenseMITGitHub repositoryNo
Runs on, from listed crates and their direct dependenciesNot measuredNo
What shows each backendNot measuredNo
Native code, from listed crates and their dependenciesNot measuredNo
Python bindings, from direct dependencies of listed cratesNot measuredNo
Crates that depend on a listed crate directlyNot measuredNo

Corrections and review history

Report a correction

No correction applies to this entry.

Judgments

A judgment enters only through an approved issue and a merged pull request.

No judgment applies to this entry.