Skip to main content

RotaryEmbeddingVarlenOptions

type RotaryEmbeddingVarlenOptions struct {
Mode *RotaryMode
RotaryDim *int64
Theta *float64
Scaling *RopeScaling
Scale *float64
LowFreqFactor *float64
HighFreqFactor *float64
OriginalMaxPos *int64
BetaFast *float64
BetaSlow *float64
}

RotaryEmbeddingVarlenOptions carries the defaulted options of Api.OpRotaryEmbeddingVarlen (`ClikaRT::ops::rotary_embedding_varlen`). A nil options pointer, or any nil field, means that option's default.