Skip to main content

//clika-runtime/io.clika.modelverse/ResidencyReport

ResidencyReport

[common]
data class ResidencyReport(val parts: List<ResidencyPart>, val totalBytes: Long)

What a loaded model holds on each device, as the runtime's pools report it (PreTrainedModel.residency). The weights are the pool growth the load left on the device; two loads running at once on one device are not told apart by that read, so load one at a time where the number matters.

Constructors​

ResidencyReport[common]
constructor(parts: List<ResidencyPart>, totalBytes: Long)

Properties​

NameSummary
parts[common]
val parts: List<ResidencyPart>
totalBytes[common]
val totalBytes: Long
The parts' bytes summed.