ClikaRT::runtime::ResponseChunk

struct

Header: ClikaRT/runtime/serving.h

One streamed chunk of a session's output. final == true marks the last chunk of a cleanly finishing session's stream. Driving a model directly, that chunk carries the finishing step's outputs when it produced any (a finish with no outputs delivers an empty final marker instead); a Pipeline's stream always terminates with one empty final marker, the payload rides on_complete. An erroring or cancelled session never marks a chunk final: on_complete (or the blocking retrieval) is the authoritative terminal signal in every case.

Data members

outputs

NamedTensors outputs

this chunk's outputs

Declared in ClikaRT/runtime/serving.h, line 48

final

bool final = false

true on the stream's last chunk

Declared in ClikaRT/runtime/serving.h, line 49