//clika-runtime/io.clika.runtime/Tokenizer/streamingDecoder

streamingDecoder

[common]
fun streamingDecoder(skipSpecialTokens: Boolean = true): StreamingDecoder

A streaming decoder over this tokenizer, for one generation stream at a time.