Skip to main content

//clika-runtime/io.clika.runtime/Activation/SITU

SITU

[common]
SITU

Soft-capped gated activation; BOTH halves transform: out = β·tanh(gate/β)·sigmoid(gate) · lβ·tanh(up/lβ). The two soft-cap scalars ride ops::matmul/ops::linear as situ_beta (β, the gate cap) and situ_linear_beta (lβ, the up cap); both must be 0 and come from the model's own config; passing Situ without them (or either scalar with any other kind) rejects. Computed at fp32 end-to-end with one demote at the store for f16/bf16 outputs.

Properties​

NameSummary
code[common]
val code: Int
name[common]
val name: String
ordinal[common]
val ordinal: Int