GroupQueryAttentionVarlenOptions

type GroupQueryAttentionVarlenOptions struct {
	IsCausal	*bool
	Softcap		*float64
	SlidingWindow	*int64
	SmoothSoftmax	*bool
	RotaryMode	*RotaryMode
	NumHeads	*int64
	KvNumHeads	*int64
	QkNormEps	*float64
}

GroupQueryAttentionVarlenOptions carries the defaulted options of Api.OpGroupQueryAttentionVarlen (`ClikaRT::ops::group_query_attention_varlen`). A nil options pointer, or any nil field, means that option's default.