Skip to main content

SwigluFusion

How the gate‖up halves are laid out in a gated MoE FC1 output.