Skip to content
Kotoshu Kotoshu 言修
News

2026-09-07 release. 7 September 2026

Language detection and OOV bucket tables in @kotoshu/wasm 0.4.0

loadLid and detectLanguage bring 176-language identification, and bucket-backed out-of-vocabulary embedding lets Teh reach The through the model path.

  1. The lid-176 model (~1 MB + vocab) ships through the registry v1.4.0 mirror. The playground detect control loads it once, scores the editor text, and proposes a language switch — never auto-switches an explicit choice.
  2. Bucket-table siblings for English and German close the model-side Teh gap: n-grams absent from the vocabulary fall back to hashed bucket rows, while in-vocabulary behavior stays byte-identical.

see also @kotoshu/wasm on npm Playground