Skip to main content

//clika-runtime/io.clika.runtime/BatcherConfig

BatcherConfig

[common]
data class BatcherConfig(val maxBatch: Long = 0, val workBudget: Long = 0, val stepTokenBudget: Long = 0)

Continuous-batch composition knobs: sessions per step, work per step, tokens launched per step (0 = unbounded).

Constructors​

BatcherConfig[common]
constructor(maxBatch: Long = 0, workBudget: Long = 0, stepTokenBudget: Long = 0)

Properties​

NameSummary
maxBatch[common]
val maxBatch: Long = 0
stepTokenBudget[common]
val stepTokenBudget: Long = 0
workBudget[common]
val workBudget: Long = 0