Models

Ansh

Multilingual Indic tokenizers with 128k, 160k, and 256k vocabularies.

Releases

Ansh-128k, 160k, 256k

Open tokenizers on Hugging Face.

128k160k256k

Theme →Datasets and models →Publications →