ClikaRT::graph::CompileOptions

struct

Header: ClikaRT/graph/input_specs.h

How io::OnnxModel::compile builds the graph. The compile returns the graph as built: optimize() runs the graph optimizer when wanted (its DefaultsOptions hold the specialization and channels-last choices), and finalize() places the graph on the weights device and readies it to run.

Shapes: with neither specs nor sample_inputs, dynamic input dims stay dynamic; the graph binds real shapes at run time. Providing either pins the named dims to concrete values, which specializes the compiled graph to those shapes and unlocks shape-driven optimization; a dim shared by name across inputs (an ONNX dim_param) propagates, and detected KV-cache inputs are derived automatically, so speccing the genuine data inputs is enough. sample_inputs is the easy road: example tensors whose shapes and dtypes matter and whose values do not; specs is the precise road. Both may combine (each input takes whichever covers it; specs wins).

Data members

specs

spec::InputSpecs specs

Per-input shape specification (the precise road).

Declared in ClikaRT/graph/input_specs.h, line 292

sample_inputs

NamedTensors sample_inputs

Example input tensors, by input name; each contributes its shape as a fixed profile for that input (the easy road; values are never read).

Declared in ClikaRT/graph/input_specs.h, line 295

weights

io::LoadPolicy weights

Weight residency: target device/stream and eviction stickiness. The device is where ModelGraph::finalize() places the graph (to() changes it before then).

Declared in ClikaRT/graph/input_specs.h, line 299