Skip to main content

ClikaRT::runtime::Request

struct

Header: ClikaRT/runtime/serving.h

A request: named input tensors plus optional scheduling hints.

Data members​

inputs​

NamedTensors inputs

named inputs; keys are the schema's input edge names

Declared in ClikaRT/runtime/serving.h, line 28

priority​

std::int32_t priority = 0

higher runs sooner

Declared in ClikaRT/runtime/serving.h, line 29

deadline_ms​

std::optional<std::int64_t> deadline_ms

soft deadline (unset = none)

Declared in ClikaRT/runtime/serving.h, line 30

streaming​

bool streaming = false

emit per-step chunks

Declared in ClikaRT/runtime/serving.h, line 31