Skip to main content

ReGLU

ReGLU()

ReGLU over a concatenated [, 2d] gate-then-up input, emitting [, d]: relu(gate) * up.

The module form of clika_runtime.nn.functional.reglu: construct it once, then call it like a function.

__init__​

__init__(self) -> 'None'

Initialize self. See help(type(self)) for accurate signature.

forward​

forward(self, input: 'Tensor') -> 'Tensor'

forward(input) -> Tensor

Runs clika_runtime.nn.functional.reglu on input; returns a new tensor.