Skip to main content

ClikaRT::nn::QEmbeddingOptions

struct

Header: ClikaRT/nn/qembedding.h

Settings of QEmbedding: chain the setters, or assign the fields.

Member functions​

dtype(DataType)​

QEmbeddingOptions& dtype(DataType v)

Sets dtype, the dtype of the gathered rows.

Declared in ClikaRT/nn/qembedding.h, line 43

device(Device)​

QEmbeddingOptions& device(Device v)

Sets device, the placement of the table.

Declared in ClikaRT/nn/qembedding.h, line 45

dtype()​

const std::optional<DataType>& dtype() const

Reads dtype.

Declared in ClikaRT/nn/qembedding.h, line 48

device()​

const std::optional<Device>& device() const

Reads device.

Declared in ClikaRT/nn/qembedding.h, line 50

Data members​

dtype_​

std::optional<DataType> dtype_

The dtype the gathered rows decode to, one of Float32 / Float16 / BFloat16; unset (the default) selects the scheme's own float target. The packed codes are never cast.

Declared in ClikaRT/nn/qembedding.h, line 55

device_​

std::optional<Device> device_

Where the table lives; unset (the default) is the weight's own placement for the from-weight make, CPU for the declared form.

Declared in ClikaRT/nn/qembedding.h, line 58