Skip to main content

AttentionVarlenOptions

type AttentionVarlenOptions struct {
	IsCausal	*bool
	Softcap		*float64
	SlidingWindow	*int64
	SmoothSoftmax	*bool
}

AttentionVarlenOptions carries the defaulted options of Api.OpAttentionVarlen (`ClikaRT::ops::attention_varlen`). A nil options pointer, or any nil field, means that option's default.