ClikaRT::nn::GELU

class

Header: ClikaRT/nn/generated/activation.h
Inherits: ClikaRT::nn::Module

Gaussian error linear unit: input * Phi(input), the exact erf form by default or the tanh approximation. The module form of ClikaRT::ops::gelu, which documents the full contract (shapes, dtypes, errors); construct once, then call it like a function.

Member functions

GELU()

explicit GELU(GELUOptions options = {})

Constructs the module from options (every default when omitted).

Declared in ClikaRT/nn/generated/activation.h, line 334

forward()

Tensor forward(Tensor input) const

forward_impl, unwrapped: raises ClikaRT::Error on failure.

Declared in ClikaRT/nn/generated/activation.h, line 345

operator()()

Tensor operator()(Tensor input) const

Same as forward.

Declared in ClikaRT/nn/generated/activation.h, line 349

options()

const GELUOptions& options() const

The settings this module was constructed with.

Declared in ClikaRT/nn/generated/activation.h, line 353