Skip to main content

ClikaRT::runtime::SchedulerConfig

struct

Header: ClikaRT/runtime/serving.h

Admission policy knobs: how many sessions may be active concurrently, and how admission accounts for the model's capacity.

Data members​

max_active_sessions​

std::size_t max_active_sessions = 1

concurrent-session ceiling (1 = serial)

Declared in ClikaRT/runtime/serving.h, line 101

capacity_policy​

CapacityPolicy capacity_policy = CapacityPolicy::SlotCap

The capacity policy (above). max_active_sessions stays the ceiling under every policy; the default changes nothing about admission.

Declared in ClikaRT/runtime/serving.h, line 104