Skip to main content

ClikaRT::ops::fused

namespace

Enumerations​

enum SwigluFusion​

enum class SwigluFusion : std::uint8_t

How the gate‖up halves are laid out in a gated MoE FC1 output.

EnumeratorValueDescription
Unfused0gate comes from a SEPARATE fc3 matrix
Interleaved1one fused [E, 2I, H]; gate = even, up = odd columns
Concat2one fused [E, 2I, H]; gate = first half, up = second

Declared in ClikaRT/compute/fused_op_enums.h, line 14

enum QComputeMode​

enum class QComputeMode : std::uint8_t

How a weight-only-quantized contraction (qmatmul_woq / qlinear_woq / the *_woq conv family) contracts a floating-point activation against a quantized weight. ExactFP (the default) dequantizes the weight and runs the float dot, bit-faithful to the stored scale / zero-point. DynamicInt8 dynamically quantizes the activation to int8 and runs an integer dot, faster on dot-product hardware, at a small accuracy cost (the activation loses precision). A ROUTING HINT, not a shape contract: shapes outside a backend's fused coverage fall back to exact math.

EnumeratorValueDescription
ExactFP0
DynamicInt81

Declared in ClikaRT/compute/fused_op_enums.h, line 28

ClikaRT/compute/fused_op_enums.h​

#include <ClikaRT/compute/fused_op_enums.h>

Enum parameters of the FUSED operators: how a gated MoE lays out its gate‖up halves, and how a weight-only-quantized contraction is computed. Values are PINNED (ABI): never reorder or remove a value; append new ones at the end.