ClikaRT::runtime::Pipeline

class

Header: ClikaRT/runtime/pipeline.h

A multi-step serving ensemble: each step wraps a Model with its own executor tuning, wired by input/output name maps into one request/response surface.

Build with create(steps, external_schema); enqueue/await follow the Executor surface. Move-only handle.

Static member functions

create()

static Pipeline create(std::vector<PipelineStep> steps, ModelSchema external_schema = {})

Build a pipeline from its steps (in flow order) and the pipeline's external I/O schema (the request inputs it accepts + the response outputs it emits). Each step's Model is contained HERE (in your translation unit) so an override's throw is caught caller-side and fails the session; it never unwinds into the engine.

Declared in ClikaRT/runtime/pipeline.h, line 56

Member functions

Pipeline()

Pipeline(Pipeline&& other) noexcept

Declared in ClikaRT/runtime/pipeline.h, line 72

operator=()

Pipeline& operator=(Pipeline&& other) noexcept

Move-only handle; the moved-from object is empty.

Declared in ClikaRT/runtime/pipeline.h, line 74

~Pipeline()

~Pipeline()

Implicitly shuts down every step's engine.

Declared in ClikaRT/runtime/pipeline.h, line 76

enqueue(Request)

SessionId enqueue(Request request)

Submit a request; returns its session handle. Non-blocking.

Declared in ClikaRT/runtime/pipeline.h, line 80

enqueue(Request, RequestCallbacks)

SessionId enqueue(Request request, RequestCallbacks callbacks)

Submit a request; returns its session handle. Non-blocking.

Declared in ClikaRT/runtime/pipeline.h, line 86

await()

Response await(SessionId session)

Block until session completes; return its final response.

Declared in ClikaRT/runtime/pipeline.h, line 109

shutdown()

void shutdown()

Drain in-flight work and stop. When shutdown() returns, every accepted session has completed and await() still returns its result. A later enqueue() is refused with an InvalidArgument-status error whose code_name() is "FAILED_PRECONDITION".

Declared in ClikaRT/runtime/pipeline.h, line 116