Skip to main content

TextGenerationPipeline

pipe(prompt, **decode_knobs) -> [{"generated_text": prompt + reply}]; a list of prompts answers one list per prompt, the prompts generated as one batch (:meth:GenerativeModel.generate_batch); a conversation (a list of {"role", "content"} turns) answers the turns plus the assistant's.