Skip to main content

//clika-runtime/io.clika.modelverse/TtsLoadOptions/contextLength

contextLength

[common]
val contextLength: Int = 0

The context window in tokens: the longest prompt plus generated speech frames the model's key-value cache opens for. 0 is auto: the largest window that fits the device's free memory beside the weights, bounded by the checkpoint's own; a value names the window, clamped to the checkpoint's. A sentence needs about a thousand tokens; a smaller window is what lets a phone load the model.