Skip to main content

ClikaRT::nn::SwiGLUOptions

struct

Header: ClikaRT/nn/generated/activation.h

Settings of SwiGLU: chain the setters, or assign the fields.

Member functions​

alpha(double)​

SwiGLUOptions& alpha(double v)

Sets alpha, the sigmoid sharpness on the gate half.

Declared in ClikaRT/nn/generated/activation.h, line 1399

alpha()​

double alpha() const

Reads alpha.

Declared in ClikaRT/nn/generated/activation.h, line 1401

beta(double)​

SwiGLUOptions& beta(double v)

Sets beta, added to the clamped up half.

Declared in ClikaRT/nn/generated/activation.h, line 1406

beta()​

double beta() const

Reads beta.

Declared in ClikaRT/nn/generated/activation.h, line 1408

limit(double)​

SwiGLUOptions& limit(double v)

Sets limit, the clamp bound on both halves; infinity disables the clamp.

Declared in ClikaRT/nn/generated/activation.h, line 1414

limit()​

double limit() const

Reads limit.

Declared in ClikaRT/nn/generated/activation.h, line 1416

Data members​

alpha_​

double alpha_ = 1.0

The sigmoid sharpness on the gate half. Default 1.0.

Declared in ClikaRT/nn/generated/activation.h, line 1403

beta_​

double beta_ = 0.0

Added to the clamped up half. Default 0.0.

Declared in ClikaRT/nn/generated/activation.h, line 1410

limit_​

double limit_ = std::numeric_limits<double>::infinity()

The clamp bound on both halves; infinity disables the clamp. Default std::numeric_limits<double>::infinity().

Declared in ClikaRT/nn/generated/activation.h, line 1419