Skip to main content

//clika-runtime/io.clika.runtime/Ops/reglu

reglu

[common]
fun reglu(input: Tensor): Tensor

reglu(input: Tensor): the reglu operator. ReGLU gated activation over a concatenated gate‖up input. The relu-gated member of the GLU family, beside geglu / swiglu: [.., 2d] in, [.., d] out; the last dim must be even.