Skip to main content

//clika-runtime/io.clika.modelverse/RerankReport

RerankReport

[common]
data class RerankReport(val latencyMs: Float, val accelerator: String, val canceled: Boolean)

The facts of one reranking request.

Constructors​

RerankReport[common]
constructor(latencyMs: Float, accelerator: String, canceled: Boolean)

Properties​

NameSummary
accelerator[common]
val accelerator: String
The accelerator the model ran on (cpu, cuda:0, vulkan:0).
canceled[common]
val canceled: Boolean
True when the request was canceled before its scores were handed over.
latencyMs[common]
val latencyMs: Float
Wall time from the request's start to its scores, in milliseconds.