GroupQueryAttentionOptions

type GroupQueryAttentionOptions struct {
	IsCausal	*bool
	Softcap		*float64
	SlidingWindow	*int64
	SmoothSoftmax	*bool
	RotaryMode	*RotaryMode
	NumHeads	*int64
	KvNumHeads	*int64
	QkNormEps	*float64
}

GroupQueryAttentionOptions carries the defaulted options of Api.OpGroupQueryAttention (`ClikaRT::ops::group_query_attention`). A nil options pointer, or any nil field, means that option's default.