Skip to main content

clika_runtime.modelverse.pipelines functions

pipeline​

pipeline(task: 'str', model: 'str | Any | None' = None, *, options: 'LoadOptions | None' = None, stage_observer: 'Any' = None, **load_options: 'Any') -> 'Pipeline'

The callable for task over model: a source to load (a local directory, a hub repo id, a .gguf file) or an already loaded model of the task's kind. The keyword arguments are :class:LoadOptions fields (device, dtype, max_seq, revision, ...). An unknown task raises ValueError naming the eleven. stage_observer installs the model's stage observer (set_stage_observer on the loaded model: the stages of every call, on their own threads) where the model's kind reports stages.