Skip to main content

ClikaRT::io::LoadPlan

struct

Header: ClikaRT/io/tensors_container.h

The recommended load PLAN: the policy plus the placement budget a weight-residency scheduler consumes: how many bytes of weights to KEEP device-resident (the rest streams; evicted after use, prefetched ahead of it). When the checkpoint fits under the runtime's offload-headroom share of the device's available memory, the budget is the checkpoint's total_bytes() (keep everything) and policy.sticky is false; when it doesn't fit, the budget is that headroom share and policy.sticky is true; when the available figure is unknown, the budget is 0 and the policy is plain; the runtime never guesses.

Data members​

policy​

LoadPolicy policy

how the planned load materializes (see LoadPolicy)

Declared in ClikaRT/io/tensors_container.h, line 306

resident_byte_budget​

std::uint64_t resident_byte_budget = 0

Bytes of weights to keep device-resident.

Declared in ClikaRT/io/tensors_container.h, line 308