//clika-runtime/io.clika.modelverse/ResidencyPart
ResidencyPart
[common]
data class ResidencyPart(val name: String, val device: String, val weightsBytes: Long, val kvCacheBytes: Long, val otherBytes: Long, val totalBytes: Long)
What one part of a loaded model holds on one device (ResidencyReport).
Constructors
| ResidencyPart | [common] constructor(name: String, device: String, weightsBytes: Long, kvCacheBytes: Long, otherBytes: Long, totalBytes: Long) |
Properties
| Name | Summary |
|---|---|
| device | [common] val device: String The device as the library labels it, <Api>:<index> (CPU:-1 for the whole machine's cpu, CUDA:0). |
| kvCacheBytes | [common] val kvCacheBytes: Long |
| name | [common] val name: String The part's name (the family's, or a tower's). |
| otherBytes | [common] val otherBytes: Long |
| totalBytes | [common] val totalBytes: Long |
| weightsBytes | [common] val weightsBytes: Long |