Skip to main content

ClikaRT::runtime::UnitProjection

struct

Header: ClikaRT/runtime/context.h

A request's need in the model's own capacity units (see Model::capacity_units), as Model::project_units reads it from the request's inputs before admission. -1 means unknown: the request is then admitted under the session cap alone.

Data members​

total​

std::int64_t total = -1

through the request's output cap

Declared in ClikaRT/runtime/context.h, line 89

first_step​

std::int64_t first_step = -1

what the admitting step commits: the prompt, or its first chunk

Declared in ClikaRT/runtime/context.h, line 90