ClikaRT::ops::swiglu

function

swiglu()

Tensor swiglu(
    Tensor x,
    double alpha = 1.0,
    double beta = 0.0,
    double limit = std::numeric_limits<double>::infinity()
)

SwiGLU over a concatenated [*, 2d] gate‖up input → [*, d], the clamped gated form: out = (clamp(up, ±limit) + beta) · G · sigmoid(alpha·G) with G = min(gate, limit). The defaults reduce exactly to the plain silu(gate) · up. The last dim must be even.

Declared in ClikaRT/compute/ops.h, line 1127