Skip to main content

//clika-runtime/io.clika.modelverse/BenchCell

BenchCell

[common]
data class BenchCell(val isl: Long, val osl: Long, val lateIsl: Long = 0)

One cell of the sweep (Modelverse.bench): isl prompt tokens in, osl tokens decoded, both exact (the prompts are synthesized in the model's own vocabulary at that length and the decode is pinned to the count). A positive lateIsl adds one more session with a prompt of that many tokens that joins once every regular session has streamed its first token, the shape of a long prompt arriving while others decode; the row then reports what its prefill cost the running sessions (itlMaxMs, itlP99Ms) and what the prompt waited itself (lateTtftMs). The command line spells a cell ISL:OSL or ISL:OSL+LATE.

Constructors​

BenchCell[common]
constructor(isl: Long, osl: Long, lateIsl: Long = 0)

Properties​

NameSummary
isl[common]
val isl: Long
lateIsl[common]
val lateIsl: Long = 0
osl[common]
val osl: Long