Lindera

A morphological analysis library in Rust. This project is forked from kuromoji-rs.

Lindera aims to build a library which is easy to install and provides concise APIs for various Rust applications.

• English Documentation
• Japanese Documentation (日本語ドキュメント)

[dependencies]
lindera = "7"

Note: Upgrading from v6? See the migration guide for details.

Pre-built dictionaries are available from GitHub Releases. Download a dictionary archive (e.g. lindera-ipadic-*.zip) and specify the path when loading. When using the CLI, lindera download ipadic downloads and installs a dictionary automatically.

Lindera tokenizes Japanese text (IPADIC) at roughly 10-20 MB/s single-threaded, depending on hardware and whether the Viterbi lattice is reused across calls. Run make bench to reproduce the benchmark suite (lindera/benches/) on your own machine; see #875 for detailed methodology and comparison numbers.

Lindera also provides Python bindings. You can install it via pip:

pip install lindera

For more details, see the lindera-python directory.

Lindera also provides Node.js bindings. You can install it via npm:

npm install lindera

For more details, see the lindera-nodejs directory.

Lindera also provides Ruby bindings. From v6.1.0 they install from RubyGems as lindera. The gem compiles its native extension during installation, so it needs a Rust toolchain and libclang:

gem install lindera

For more details, see the lindera-ruby directory.

Lindera also provides PHP bindings as a PHP extension. From v6.1.0 it is published on Packagist as lindera/lindera and installed with PIE:

pie install lindera/lindera

See the lindera-php directory for details.

Lindera also provides WebAssembly bindings. You can install it via npm:

npm install lindera-wasm

The package is built with wasm-pack's web target and works in browsers natively as well as with modern bundlers (Vite, Webpack 5).

For more details and a demo application, see the lindera-wasm directory.

MIT