---
title: "AutoTokenizer"
sidebar_label: "AutoTokenizer"
description: "Kotlin binding reference: AutoTokenizer."
---

<!-- Generated by tools/api_reference/generate_api_docs.py. Do not edit. -->

//[clika-runtime](../../../index.md)/[io.clika.modelverse](../index.md)/[AutoTokenizer](index.md)

# AutoTokenizer

[common]\
object [AutoTokenizer](index.md)

The tokenizer of the checkpoint at source (a local directory or a hub repo id; a hub source fetches the configuration and tokenizer files alone), the same tokenizer a loaded model of the checkpoint uses.

## Functions

| Name | Summary |
|---|---|
| [fromPretrained](fromPretrained.md) | [common]<br>fun [fromPretrained](fromPretrained.md)(source: [String](https://kotlinlang.org/api/core/kotlin-stdlib/kotlin/-string/index.html), options: [LoadOptions](../LoadOptions/index.md) = LoadOptions()): [Tokenizer](../../io.clika.runtime/Tokenizer/index.md) |