ClikaRT::nn::GeGLU

class

Header: ClikaRT/nn/generated/activation.h
Inherits: ClikaRT::nn::Module

GeGLU over a concatenated [*, 2d] gate-then-up input, emitting [*, d]: gelu(gate) * up. The module form of ClikaRT::ops::geglu, which documents the full contract (shapes, dtypes, errors); construct once, then call it like a function.

Member functions

GeGLU()

explicit GeGLU(GeGLUOptions options = {})

Constructs the module from options (every default when omitted).

Declared in ClikaRT/nn/generated/activation.h, line 1291

forward()

Tensor forward(Tensor input) const

forward_impl, unwrapped: raises ClikaRT::Error on failure.

Declared in ClikaRT/nn/generated/activation.h, line 1302

operator()()

Tensor operator()(Tensor input) const

Same as forward.

Declared in ClikaRT/nn/generated/activation.h, line 1306

options()

const GeGLUOptions& options() const

The settings this module was constructed with.

Declared in ClikaRT/nn/generated/activation.h, line 1310