Skip to main content

//clika-runtime/io.clika.runtime/Ops/geglu

geglu

[common]
fun geglu(input: Tensor, approximate: GeluMode = GeluMode.NONE): Tensor

geglu(input: Tensor, approximate: GeluMode = GeluMode.NONE): the geglu operator. GeGLU gated activation over a concatenated gate‖up tensor. The input's LAST dimension must be even (2d); the output halves it (d). approximate selects the exact (erf) or tanh GELU for the gate.