Skip to main content

//clika-runtime/io.clika.modelverse/LoadOptions/maxActive

maxActive

[common]
val maxActive: Int = 0

The requests the model serves at once: a text model's decode sessions (the key-value cache's slot count a chat session or a served model opens), a speech model's admitted requests. 0 keeps one, the single-session footprint; a phone app keeps it there.