Skip to main content

StepIndices

The device-side index tensors one varlen step consumes.

cu_seqlens_k (property)​

(self) -> clika_runtime._core.Tensor

cu_seqlens_q (property)​

(self) -> clika_runtime._core.Tensor

kvcache_start (property)​

(self) -> clika_runtime._core.Tensor

max_seqlen_k (property)​

(self) -> int

__init__​

__init__(self, /, *args, **kwargs)

Initialize self. See help(type(self)) for accurate signature.

for_layer​

for_layerfor_layer(self, layer: int) -> clika_runtime._core.nn.StepIndices

for_layer(self, layer: int) -> clika_runtime._core.nn.StepIndices

The index view this layer binds (its row group's tensors; the flat fields on a uniform cache).