//clika-runtime/io.clika.runtime/Ops/rmsNorm

rmsNorm

[common]
fun rmsNorm(input: Tensor, normalizedShape: LongArray, weight: Tensor? = null, bias: Tensor? = null, eps: Double? = null, activation: Activation? = null): Tensor

rmsNorm(input: Tensor, normalizedShape: LongArray, weight: Tensor? = null, bias: Tensor? = null, eps: Double? = null, activation: Activation? = null): the rms_norm operator. Root-mean-square normalization over the trailing normalized_shape dims (no mean subtraction). The transformer-style norm: statistics are the mean SQUARE only, per position over the trailing dims. Optional fused activation applies to the post-affine value (gated kinds are not accepted).