//clika-runtime/io.clika.runtime/BatchableState
BatchableState
[common]
interface BatchableState
The reads the continuous batcher takes of a session's state, on the engine's thread, every step: the carried load, its ceiling (the headroom admits work) and the units the next step launches (1 for a decode step; a prompt ingested in chunks reports its next chunk's length). Keep them cheap and never raise: a raise is reported and reads as 0.
Functions
| Name | Summary |
|---|---|
| capacity | [common] abstract fun capacity(): Long |
| occupancy | [common] abstract fun occupancy(): Long |
| stepTokens | [common] open fun stepTokens(): Long |