Skip to main content

Encoded

attention_mask (property)

[B, S] Int32, 1 = token / 0 = pad (padded layout only).

cu_seqlens (property)

[B + 1] Int32 exclusive prefix sums (the varlen table).

ids (property)

Per-sequence id rows; always present.

input_ids (property)

[B, S] padded or [sum(S)] varlen Int32 tensor, when requested.

seq_lengths (property)

[B] Int32 per-sequence token counts.

__init__

__init__(self, /, *args, **kwargs)

Initialize self. See help(type(self)) for accurate signature.