//clika-runtime/io.clika.modelverse/Modelverse/serve

serve

[common]
fun serve(model: GenerativeModel, options: ServeOptions = ServeOptions()): Server

A Server over a loaded model under options, not yet listening (Server.start). The server holds the model: the model's close() refuses until the server is closed.

[common]
fun serve(task: String, source: String, loadOptions: LoadOptions = LoadOptions(), options: ServeOptions = ServeOptions()): Server

A Server over the model source loads as (through AutoModel.fromPretrained with task, text-generation by default), not yet listening. The server owns nothing more than any other: the loaded model is answered through Server.model and is the caller's to close after the server.