frostem
Library New
Pre-built Snowball stemmers for Rust (tracks snowball main)
- Downloads
- 504,939
- Dependents
- 4
- Stars
- 4
- Forks
- 1
- Contributors
- 2
- Commits
- 26
- Latest release
- 2.20261016.1 ·
About
Pre-built Snowball stemmers for Rust.
frostem tracks upstream snowballstem/snowball main and publishes the generated Rust stemmers behind a small, stable facade. You do not need the Snowball compiler at build time.
Install
[dependencies]
frostem = "1"
All algorithms are enabled by default. To shrink the dependency, disable defaults and pick languages:
[dependencies]
frostem = { version = "1", default-features = false, features = ["english", "german"] }
Usage
use frostem::{Algorithm, Stemmer};
fn main() {
let stemmer = Stemmer::new(Algorithm::English);
assert_eq!(stemmer.stem("fruitlessly"), "fruitless");
// Names and aliases from Snowball modules.txt (case-insensitive)
let de = Stemmer::try_from_name("de").unwrap();
assert_eq!(de.stem("automaten"), "automat");
}
Inputs should already be lowercased when that is meaningful for the language.
Upstream provenance (git commit / time) is recorded in upstream-pin.toml in
this repository, not exposed as Rust API. Consumers should rely on the crate
version (major.YYYYMMDD.patch).
Read the full README
Versioning
| Component | Meaning |
|---|---|
| major | frostem public Rust API |
| minor | UTC date (YYYYMMDD) of the upstream commit that last changed algorithms/ |
| patch | Releases with no algorithms/ change (codegen/runtime-only upstream sync, frostem-only fixes, collisions) |
Example: 1.20260729.0 — facade API v1; last upstream algorithm change on 2026-07-29 UTC.
- API breaks are detected with
cargo-semver-checksand bump major. - Daily automation publishes whenever upstream
mainHEAD advances. - minor advances only when upstream
algorithms/differs from the previous pin (stem definitions / new or removed.sblfiles). The minor number is that commit’s UTCYYYYMMDD. - Upstream movement that does not touch
algorithms/(compiler, runtime, docs, other backends, …) keeps the previous minor and bumps patch. - Tag or crates.io version collisions also bump patch.
Algorithm is #[non_exhaustive]: new upstream languages are a minor change, not a major break.
Algorithms
Every Snowball algorithm under algorithms/*.sbl is included (including curiosities such as lovins). Feature names match the algorithm ids (e.g. english, dutch_porter, earlymodernenglish).
Use Algorithm::all() for the set enabled in a given build.
Maintenance
Regenerate from upstream (requires a C toolchain and make):
python3 scripts/sync_from_snowball.py
cargo test
Options:
--snowball-dir DIR use an existing checkout instead of .snowball-src
--major N override major (default: keep current)
--minor YYYYMMDD override minor (default: algorithms/ gate)
--patch N override patch (default: algorithms/ gate)
scripts/sync_from_snowball.py applies the algorithms gate locally and in CI:
if upstream algorithms/ changed vs upstream-pin.toml, minor becomes the
commit’s UTC YYYYMMDD and patch is 0; otherwise minor is kept and patch
increments. Daily CI only adds major bumps from cargo-semver-checks and
extra patch bumps for tag/crates.io collisions.
CI runs a daily sync against main, publishes to crates.io when the upstream commit changes (Trusted Publishing / OIDC), and creates a GitHub Release whose notes summarize Snowball upstream commits and frostem changes since the previous tag.
Trusted Publishing
Publishing from CI uses Trusted Publishing (OIDC via rust-lang/crates-io-auth-action). No CARGO_REGISTRY_TOKEN secret is required for routine releases.
Configured for this repo as:
cargo install cargo-trustpub
cargo trustpub add --publisher github --owner Xuanwo --repo frostem --pipeline daily.yml
cargo trustpub status
(daily.yml must match .github/workflows/daily.yml. No GitHub Environment is used.)
After a successful CI publish, you may optionally require Trusted Publishing for all future versions:
cargo trustpub set --trustpub-only true
If you rename the workflow file or add a GitHub Environment, update the config with cargo trustpub (or the crates.io UI) so it matches exactly.
License
BSD-3-Clause. Stemming algorithms and the Snowball runtime are from the
Snowball project; see LICENSE and
LICENSE-SNOWBALL.
Compatibility
- Runs on
- GPU support unknown
What shows it
- no dependency or feature matches a backend row
- Native code
- None found
- No native code found
- Python bindings
- No Python binding crate found
- License
- BSD-3-Clause
Compare with similar projects
Order: strongest tier first, then most downloads, then name, with unmeasured values last. A library counts downloads over 30 days. An app counts binary downloads per release. An app with none counts its crate downloads over 30 days. ML Rust runs this catalogue, so its closest project always gets a row.
| Project | Downloads | Dependents | Stars | Latest release | Runs on (GPU) | Native code | License |
|---|---|---|---|---|---|---|---|
|
Pre-built Snowball stemmers for Rust (tracks snowball main) |
504,939 downloads over 30 days | 4 | 4 | 2.20261016.1 | GPU support unknown | No native code found | BSD-3-Clause |
|
tiktoken-rs Featured
Library for encoding and decoding with the tiktoken library in Rust |
3,939,182 downloads over 30 days | 449 | 410 | 0.12.1 | GPU support unknown | No native code found | MIT |
|
whatlang-rs Featured
Fast and lightweight language identification library for Rust. |
882,019 downloads over 30 days | 74 | 1,087 | 0.18.0 | GPU support unknown | No native code found | MIT |
|
A rust implementation of some popular snowball stemming algorithms |
5,399,112 downloads over 30 days | 128 | 136 | 1.2.0 | GPU support unknown | No native code found | BSD-3-Clause OR MIT |
|
whichlang Listed
A blazingly fast and lightweight language detection library for Rust. |
52,880 downloads over 30 days | 11 | 464 | 0.1.1 | GPU support unknown | No native code found | MIT |
|
snowball Listed
Rust implementation of Snowball stemming algorithms for 33 languages |
21,654 downloads over 30 days | 3 | 891 | 0.1.0 | GPU support unknown | No native code found | BSD-3-Clause |
|
splintr Listed
Tokenizer for Rust and Python: pure Rust by default, with 18 bundled vocabularies and four backends covering BPE, SentencePiece and WordPiece. Its output matches Hugging Face tokenizers id for id on 14 model families, including GPT-2, Qwen, Whisper, T5 and BERT. Python bindings |
8,204 downloads over 30 days | 7 | 63 | 0.22.2 | GPU support unknown | Binds native code: pcre2-sys (feature pcre2) | MIT |
Why NewIts first release on 4 Aug 2026 is under 180 days old.
The check tests the Featured gates once the first release passes this age limit.
What else the check found
- The last activity is on 17 Oct 2026, 23 days ago. The rules expect an update within 600 days. Dormancy rule
Exact rules: New. The check on applied thresholds version 9.
Every rule outcome, as the check records it
expected-interval: version 2.20261016.1 base 300, doubled for 504939 downloads per month: E = 600 daysdormancy: last activity 2026-10-17, 23 days ago, E = 600: activenew: new: first release 2026-08-04 is under 180 days old
Measurements and sources
Each signal row shows the raw value, its source and the fetch date. The Sources list gathers every distinct source on this page. Movement needs more history.
Sources6 sources
- Description: the crates.io description
- crates.io database dump, fetched
- RustSec advisory database, fetched
- GitHub repository, fetched
- crates.io package, fetched
- GitHub contributors, fetched
Adoption4 active dependents, 4 new dependents in 365 days1 not measured
| Signal | Value | Source | Fetched | Counts |
|---|---|---|---|---|
| Active dependents | 4 | crates.io database dump | Yes | |
| New dependents (365 days) | 4 | crates.io database dump | Yes | |
| Peak active dependents | 3.5 | crates.io database dump | Yes | |
| Active dependents as a share of the peak | 1 | crates.io database dump | Yes | |
| Binary downloads per release | Not measured | Yes |
MaintenanceLatest human commit: 3 months ago3 not measured
| Signal | Value | Source | Fetched | Counts |
|---|---|---|---|---|
| Latest human commit | 2026-08-05 | GitHub repository | Yes | |
| Latest release | 2026-10-17 | crates.io database dump | Yes | |
| First release | 2026-08-04 | crates.io database dump | Yes | |
| Latest version | 2.20261016.1 | crates.io database dump | Yes | |
| Days the oldest outside issue waits for a reply | 0 | GitHub repository | Yes | |
| Maintainer replies over 365 days | 0 | GitHub repository | Yes | |
| Repository archived | false | GitHub repository | Yes | |
| Repository gone | false | GitHub repository | Yes | |
| Release commit or manifest in the repo | true | crates.io package | Yes | |
| Published docs | true | crates.io database dump | Yes | |
| Latest release fails cargo check | Not measured | Yes | ||
| Build check date | Not measured | Yes | ||
| Build check toolchain | Not measured | Yes |
SecurityUnpatched vulnerabilities: none
| Signal | Value | Source | Fetched | Counts |
|---|---|---|---|---|
| Unpatched vulnerabilities past the grace window | none | RustSec advisory database | Yes | |
| RustSec unmaintained advisory | none | RustSec advisory database | Yes | |
| Deprecation notice | none | crates.io database dump | Yes | |
| Deprecated requirement | none | crates.io database dump | Yes |
Distribution17 releases, 504,939 downloads over 30 days5 not measured
| Signal | Value | Source | Fetched | Counts |
|---|---|---|---|---|
| Releases | 17 | crates.io database dump | Yes | |
| Downloads over 30 days | 504939 | crates.io database dump | Yes | |
| Binary downloads over the last 3 releases | Not measured | Yes | ||
| Homebrew installs on request over 365 days | Not measured | Yes | ||
| Repology repository families | Not measured | Yes | ||
| Docker pull growth over 90 days | Not measured | Yes | ||
| Docker pulls at the growth baseline | Not measured | Yes | ||
| Every version a prerelease | false | crates.io database dump | Yes | |
| Every version 0.0.x | false | crates.io database dump | Yes | |
| Every version yanked | false | crates.io database dump | Yes | |
| Crate deleted from crates.io | false | crates.io database dump | Yes |
Repository4 stars, 1 forks, 2 contributors, 26 commits. Stars alone never qualify a project.
| Signal | Value | Source | Fetched | Counts |
|---|---|---|---|---|
| GitHub stars | 4 | GitHub repository | Yes — one part of the repository route | |
| GitHub forks | 1 | GitHub repository | Yes — one part of the repository route | |
| Contributors with a GitHub account | 2 | GitHub contributors | Yes — one part of the repository route | |
| Commits on the default branch | 26 | GitHub repository | No | |
| Repository's main crate left out of the entry | none | crates.io database dump | Yes |
Facts that never count
| Signal | Value | Source | Fetched | Counts |
|---|---|---|---|---|
| License | BSD-3-Clause | crates.io database dump | No | |
| Runs on, from listed crates and their direct dependencies | GPU support unknown | crates.io database dump | No | |
| What shows each backend | no dependency or feature matches a backend row | crates.io database dump | No | |
| Native code, from listed crates and their dependencies | No native code found | crates.io database dump | No | |
| Python bindings, from direct dependencies of listed crates | No Python binding crate found | crates.io database dump | No | |
| Crates that depend on a listed crate directly | 4 | crates.io database dump | No |
Corrections and review history
No correction applies to this entry.
Judgments
A judgment enters only through an approved issue and a merged pull request.
No judgment applies to this entry.