Skip to main content

//clika-runtime/io.clika.modelverse/BenchCacheMode

BenchCacheMode

[common]
enum BenchCacheMode : Enum<BenchCacheMode>

The key-value cache the bench's decoders run on: the paged pool (the serving default, whose prefix cache the admittedTok and retires columns report) or one window per session.

Entries​

PAGED[common]
PAGED
CONTINUOUS[common]
CONTINUOUS

Properties​

NameSummary
name[common]
val name: String
ordinal[common]
val ordinal: Int

Functions​

NameSummary
valueOf[common]
fun valueOf(value: String): BenchCacheMode
Returns the enum constant of this type with the specified name. The string must match exactly an identifier used to declare an enum constant in this type. (Extraneous whitespace characters are not permitted.)
values[common]
fun values(): Array<BenchCacheMode>
Returns an array containing the constants of this enum type, in the order they're declared.