clika_runtime.tokenizer

Text ⇄ token ids: loaders, encode/decode, chat templates, streaming decode.

Name	Kind
Encoded	class
StreamingDecoder	class
Tokenizer	class