Skip to main content

//clika-runtime/io.clika.modelverse/EmbeddingReport

EmbeddingReport

[common]
data class EmbeddingReport(val latencyMs: Float, val accelerator: String, val canceled: Boolean)

The facts of one text-embedding request.

Constructors​

EmbeddingReport[common]
constructor(latencyMs: Float, accelerator: String, canceled: Boolean)

Properties​

NameSummary
accelerator[common]
val accelerator: String
The accelerator the model ran on (cpu, cuda:0, vulkan:0).
canceled[common]
val canceled: Boolean
True when the request was canceled before its vectors were handed over.
latencyMs[common]
val latencyMs: Float
Wall time from the request's start to its vectors, in milliseconds.