lindera

Library Featured

A morphological analysis library.

Checked · Sources

Downloads
647,661
Dependents
39
Stars
705
Forks
68
Contributors
37
Commits
1,115
Latest release
6.2.0 ·

About

From the project README ·

A morphological analysis library in Rust. This project is forked from kuromoji-rs.

Lindera aims to build a library which is easy to install and provides concise APIs for various Rust applications.

Documentation

[dependencies]
lindera = "7"

Note: Upgrading from v6? See the migration guide for details.

Pre-built dictionaries are available from GitHub Releases. Download a dictionary archive (e.g. lindera-ipadic-*.zip) and specify the path when loading. When using the CLI, lindera download ipadic downloads and installs a dictionary automatically.

Performance

Lindera tokenizes Japanese text (IPADIC) at roughly 10-20 MB/s single-threaded, depending on hardware and whether the Viterbi lattice is reused across calls. Run make bench to reproduce the benchmark suite (lindera/benches/) on your own machine; see #875 for detailed methodology and comparison numbers.

Python Bindings

Lindera also provides Python bindings. You can install it via pip:

pip install lindera

For more details, see the lindera-python directory.

Node.js Bindings

Lindera also provides Node.js bindings. You can install it via npm:

npm install lindera
Read the full README

For more details, see the lindera-nodejs directory.

Ruby Bindings

Lindera also provides Ruby bindings. From v6.1.0 they install from RubyGems as lindera. The gem compiles its native extension during installation, so it needs a Rust toolchain and libclang:

gem install lindera

For more details, see the lindera-ruby directory.

PHP Bindings

Lindera also provides PHP bindings as a PHP extension. From v6.1.0 it is published on Packagist as lindera/lindera and installed with PIE:

pie install lindera/lindera

See the lindera-php directory for details.

WebAssembly Bindings

Lindera also provides WebAssembly bindings. You can install it via npm:

npm install lindera-wasm

The package is built with wasm-pack's web target and works in browsers natively as well as with modern bundlers (Vite, Webpack 5).

For more details and a demo application, see the lindera-wasm directory.

License

MIT

Runs on
GPU support unknown
What shows it
  • no dependency or feature matches a backend row
Native code
Required
  • Binds native code: napi-sys, rb-sys
Python bindings
Has Python bindings
  • lindera-python needs Python
License
MIT

Compare with similar projects

Order: strongest tier first, then most downloads, then name, with unmeasured values last. A library counts downloads over 30 days. An app counts binary downloads per release. An app with none counts its crate downloads over 30 days. ML Rust runs this catalogue, so its closest project always gets a row.

lindera beside the projects that share a topic with it
ProjectDownloadsDependentsStarsLatest releaseRuns on (GPU)Native codeLicense
lindera This page Featured

A morphological analysis library.

Python bindings

647,661 downloads over 30 days 39 705 6.2.0 GPU support unknown Binds native code: napi-sys, rb-sys MIT
tiktoken-rs Featured

Library for encoding and decoding with the tiktoken library in Rust

3,939,182 downloads over 30 days 449 410 0.12.1 GPU support unknown No native code found MIT
whatlang-rs Featured

Fast and lightweight language identification library for Rust.

882,019 downloads over 30 days 74 1,087 0.18.0 GPU support unknown No native code found MIT
lingua-rs Featured

An accurate natural language detection library, suitable for short text and mixed-language text

Python bindings

286,625 downloads over 30 days 22 1,152 1.8.0 GPU support unknown Binds native code: cld2-sys (feature accuracy-reports) Apache-2.0
sentencex Listed

Sentence segmentation library with wide language support optimized for speed and utility.

114,914 downloads over 30 days 1 145 0.1.34 GPU support unknown No native code found MIT
whichlang Listed

A blazingly fast and lightweight language detection library for Rust.

52,880 downloads over 30 days 11 464 0.1.1 GPU support unknown No native code found MIT
splintr Listed

Tokenizer for Rust and Python: pure Rust by default, with 18 bundled vocabularies and four backends covering BPE, SentencePiece and WordPiece. Its output matches Hugging Face tokenizers id for id on 14 model families, including GPT-2, Qwen, Whisper, T5 and BERT.

Python bindings

8,204 downloads over 30 days 7 63 0.22.2 GPU support unknown Binds native code: pcre2-sys (feature pcre2) MIT
Why FeaturedIt passes every Featured gate.

What it meets

  • It has 20 active dependents and 17 new dependents in 365 days. Featured needs 11 active dependents or 9 new dependents in 365 days.
  • Active dependents are at 100% of their peak. Featured needs at least 50%.
  • Docs are present. The release commit or a manifest ties the crate to the repository.
  • No vulnerability advisory stays unpatched past the grace window. At least one version is neither a prerelease nor 0.0.x.
  • The last activity is on 9 Nov 2026, 0 days ago. The rules expect an update within 800 days. Dormancy rule

Exact rules: Featured library. The check on applied thresholds version 9.

Every rule outcome, as the check records it
  • expected-interval: version 6.2.0 base 200, doubled for 647661 downloads per month, doubled for 19.5 active users: E = 800 days
  • dormancy: last activity 2026-11-09, 0 days ago, E = 800: active
  • featured: featured: active_users 19.5, new_adopters 17, former_glory 1
Crates31 crates

Measurements and sources

Each signal row shows the raw value, its source and the fetch date. The Sources list gathers every distinct source on this page. Movement needs more history.

Sources6 sources
Adoption20 active dependents, 17 new dependents in 365 days1 not measured
Adoption measurements
SignalValueSourceFetchedCounts
Active dependents19.5crates.io database dumpYes
New dependents (365 days)17crates.io database dumpYes
Peak active dependents19.5crates.io database dumpYes
Active dependents as a share of the peak1crates.io database dumpYes
Binary downloads per releaseNot measuredYes
MaintenanceLatest human commit: on the check date3 not measured
Maintenance measurements
SignalValueSourceFetchedCounts
Latest human commit2026-11-09GitHub repositoryYes
Latest release2026-09-26crates.io database dumpYes
First release2020-02-03crates.io database dumpYes
Latest version6.2.0crates.io database dumpYes
Days the oldest outside issue waits for a reply0GitHub repositoryYes
Maintainer replies over 365 days84GitHub repositoryYes
Repository archivedfalseGitHub repositoryYes
Repository gonefalseGitHub repositoryYes
Release commit or manifest in the repotruecrates.io packageYes
Published docstruecrates.io database dumpYes
Latest release fails cargo checkNot measuredYes
Build check dateNot measuredYes
Build check toolchainNot measuredYes
SecurityUnpatched vulnerabilities: none
Security measurements
SignalValueSourceFetchedCounts
Unpatched vulnerabilities past the grace windownoneRustSec advisory databaseYes
RustSec unmaintained advisorynoneRustSec advisory databaseYes
Deprecation noticenonecrates.io database dumpYes
Deprecated requirementnonecrates.io database dumpYes
Distribution140 releases, 647,661 downloads over 30 days5 not measured
Distribution measurements
SignalValueSourceFetchedCounts
Releases140crates.io database dumpYes
Downloads over 30 days647661crates.io database dumpYes
Binary downloads over the last 3 releasesNot measuredYes
Homebrew installs on request over 365 daysNot measuredYes
Repology repository familiesNot measuredYes
Docker pull growth over 90 daysNot measuredYes
Docker pulls at the growth baselineNot measuredYes
Every version a prereleasefalsecrates.io database dumpYes
Every version 0.0.xfalsecrates.io database dumpYes
Every version yankedfalsecrates.io database dumpYes
Crate deleted from crates.iofalsecrates.io database dumpYes
Repository705 stars, 68 forks, 37 contributors, 1,115 commits. Stars alone never qualify a project.
Repository measurements
SignalValueSourceFetchedCounts
GitHub stars705GitHub repositoryYes — one part of the repository route
GitHub forks68GitHub repositoryYes — one part of the repository route
Contributors with a GitHub account37GitHub contributorsYes — one part of the repository route
Commits on the default branch1115GitHub repositoryNo
Repository's main crate left out of the entrynonecrates.io database dumpYes
Facts that never count
Facts that never count measurements
SignalValueSourceFetchedCounts
LicenseMITcrates.io database dumpNo
Runs on, from listed crates and their direct dependenciesGPU support unknowncrates.io database dumpNo
What shows each backendno dependency or feature matches a backend rowcrates.io database dumpNo
Native code, from listed crates and their dependenciesBinds native code: napi-sys, rb-syscrates.io database dumpNo
Python bindings, from direct dependencies of listed cratesHas Python bindings: lindera-python needs Pythoncrates.io database dumpNo
Crates that depend on a listed crate directly39crates.io database dumpNo

Corrections and review history

Report a correction

No correction applies to this entry.

Judgments

A judgment enters only through an approved issue and a merged pull request.

No judgment applies to this entry.