Skip to main content

ClikaRT::nn::SwiGLUOptions

struct

Header: ClikaRT/nn/generated/activation.h

Settings of SwiGLU: chain the setters, or assign the fields.

Member functions​

alpha(double)​

SwiGLUOptions& alpha(double v)

Sets alpha, the sigmoid sharpness on the gate half.

Declared in ClikaRT/nn/generated/activation.h, line 1210

alpha()​

double alpha() const

Reads alpha.

Declared in ClikaRT/nn/generated/activation.h, line 1212

beta(double)​

SwiGLUOptions& beta(double v)

Sets beta, added to the clamped up half.

Declared in ClikaRT/nn/generated/activation.h, line 1217

beta()​

double beta() const

Reads beta.

Declared in ClikaRT/nn/generated/activation.h, line 1219

limit(double)​

SwiGLUOptions& limit(double v)

Sets limit, the clamp bound on both halves; infinity disables the clamp.

Declared in ClikaRT/nn/generated/activation.h, line 1225

limit()​

double limit() const

Reads limit.

Declared in ClikaRT/nn/generated/activation.h, line 1227

Data members​

alpha_​

double alpha_ = 1.0

The sigmoid sharpness on the gate half. Default 1.0.

Declared in ClikaRT/nn/generated/activation.h, line 1214

beta_​

double beta_ = 0.0

Added to the clamped up half. Default 0.0.

Declared in ClikaRT/nn/generated/activation.h, line 1221

limit_​

double limit_ = std::numeric_limits<double>::infinity()

The clamp bound on both halves; infinity disables the clamp. Default std::numeric_limits<double>::infinity().

Declared in ClikaRT/nn/generated/activation.h, line 1230