GELU
GELU(approximate="none")
Gaussian error linear unit: input * Phi(input), the exact erf form by default or the tanh approximation.
The module form of clika_runtime.nn.functional.gelu: construct it once
with the settings, then call it like a function.
Args: approximate: the GELU variant; "none" is the exact form.
__init__
__init__(self, approximate: '_GeluMode' = 'none') -> 'None'
Initialize self. See help(type(self)) for accurate signature.
extra_repr
extra_repr(self) -> 'str'
extra_repr() -> str
One line of per-class detail for :meth:__repr__; a layer prints
its geometry here (in_features=64, out_features=256).
forward
forward(self, input: 'Tensor') -> 'Tensor'
forward(input) -> Tensor
Runs clika_runtime.nn.functional.gelu on input with the stored
settings; returns a new tensor.