Skip to main content

clika_runtime.nn

clika_runtime.nn: build models as module trees.

Compose layers by attribute assignment inside a :class:Module subclass, define forward, and call the module like a function; state_dict / load_state_dict move checkpoints by dotted names, to places the tree, forward hooks observe or rewrite a call, and print(module) shows the tree. :class:Parameter and :class:Buffer are the tensors a module registers by type; the containers (:class:Sequential, :class:ModuleList, :class:ModuleDict, :class:ParameterList, :class:ParameterDict) compose without a hand-written forward; :mod:clika_runtime.nn.init fills weights in place. Stateless operations (activations, losses, padding, attention) live in :mod:clika_runtime.nn.functional.

The layer set covers both weight postures: dense (:class:Linear, :class:Conv with :class:Conv1d / :class:Conv2d / :class:Conv3d, :class:ConvTranspose with its 1d / 2d / 3d spellings, :class:Embedding, :class:LayerNorm, :class:RMSNorm, :class:MultiheadAttention, :class:MoE) and quantized (:class:QLinear, :class:QLinearWoQ, :class:QConv, :class:QConvWoQ, :class:QMoEWoQ); :class:Embedding serves a quantized table through the same class. Every layer takes the familiar constructor (device= / dtype= tail, a mode such as activation="gelu" by name), and its weights read as :class:Parameter views (layer.weight). :class:Dropout and its channel-wise and alpha variants regularize under train() and pass their input through under eval(); :class:Identity returns its input. :class:KVCache is the serving-side key/value cache with its configuration vocabulary; :func:fuse_linears names the linear-group fusion.

NameKind
AdaptiveAvgPool1dclass
AdaptiveAvgPool2dclass
AdaptiveAvgPool3dclass
AdaptiveMaxPool1dclass
AdaptiveMaxPool2dclass
AdaptiveMaxPool3dclass
Addclass
AlphaDropoutclass
AvgPool1dclass
AvgPool2dclass
AvgPool3dclass
BCELossclass
BCEWithLogitsLossclass
Bufferclass
CELUclass
CircularPadclass
CircularPad1dclass
CircularPad2dclass
CircularPad3dclass
Clampclass
ConstantPadclass
ConstantPad1dclass
ConstantPad2dclass
ConstantPad3dclass
Convclass
Conv1dclass
Conv2dclass
Conv3dclass
ConvTransposeclass
ConvTranspose1dclass
ConvTranspose2dclass
ConvTranspose3dclass
CosineSimilarityclass
CrossEntropyLossclass
Divclass
Dropoutclass
Dropout1dclass
Dropout2dclass
Dropout3dclass
ELUclass
Embeddingclass
FeatureAlphaDropoutclass
Flattenclass
Foldclass
GELUclass
GLUclass
GeGLUclass
Hardshrinkclass
Hardsigmoidclass
Hardswishclass
Hardtanhclass
HuberLossclass
Identityclass
KLDivLossclass
KVBlockSchemeclass
KVCacheclass
KVCacheConfigclass
KVCacheModeclass
KVLayerSpecclass
KVQuantSpecclass
L1Lossclass
LayerNormclass
LeakyReLUclass
Linearclass
LogSigmoidclass
LogSoftmaxclass
MSELossclass
MaxPool1dclass
MaxPool2dclass
MaxPool3dclass
Maximumclass
Minimumclass
Mishclass
MoEclass
Moduleclass
ModuleDictclass
ModuleListclass
Mulclass
MultiheadAttentionclass
NLLLossclass
PagedParamsclass
PairwiseDistanceclass
Parameterclass
ParameterDictclass
ParameterListclass
PixelShuffleclass
PixelUnshuffleclass
Powclass
QConvclass
QConvWoQclass
QLinearclass
QLinearWoQclass
QMoEWoQclass
RMSNormclass
ReGLUclass
ReLUclass
ReLU6class
ReflectionPadclass
ReflectionPad1dclass
ReflectionPad2dclass
ReflectionPad3dclass
ReplicationPadclass
ReplicationPad1dclass
ReplicationPad2dclass
ReplicationPad3dclass
SELUclass
Sequentialclass
SiLUclass
Sigmoidclass
SmoothL1Lossclass
Softmaxclass
Softminclass
Softplusclass
Softshrinkclass
Softsignclass
StepIndicesclass
Subclass
SwiGLUclass
Tanhclass
Thresholdclass
Unflattenclass
Unfoldclass
Upsampleclass
WeightResidencyclass
Whereclass
ZeroPadclass
ZeroPad1dclass
ZeroPad2dclass
ZeroPad3dclass
functionsmodule functions