Skip to main content

Api

A loaded runtime: the shared library plus its abi-version api table.

An Api is a HANDLE to one loaded runtime: Api::clone_handle yields a second handle to the same table, and the library stays mapped until the last handle drops. A Tensor borrows the handle that produced it (Tensor<'a> is a borrow type), so a handle a callback owns is what lets that callback build tensors after the registering borrow has ended (see Api::clone_handle).

FamilyMembers
capture_scope2
compiled_function6
eager_scope2
encoded7
gguf_checkpoint3
model_graph5
onnx_model16
op636
profile_session10
qtensor2
quantization_config13
stream10
streaming_decoder3
string_list3
synchronous_stream_scope3
tensor89
tensor_list3
tensors_container12
token_list7
tokenizer26
tracing_scope3
core56