DeploymentSettings_ONNXRuntime_ONNX

CLASS - DeploymentSettings_ONNXRuntime_ONNX(

• graph_author: Optional[str] =  None
• graph_description: Optional[str] =  None
• input_shapes_for_deployment: List[Tuple[Optional[int], ...]] =  None
• utilize_full_int_range: bool =  False

)

Ancestors - (BaseDeploymentSettings)

Use this if you wish to deploy to ONNXRuntime in Settings.deployment_settings.

Class Variables

• utilize_full_int_range (bool) - Set to True if you're planning to run the model on a CPU that supports AVX512-VNNI.

See Also

 https://onnxruntime.ai/docs/performance/model-optimizations/quantization.html#when-and-why-do-i-need-to-try-u8u8

DeploymentSettings_TFLite

CLASS - DeploymentSettings_TFLite(

• graph_author: Optional[str] =  None
• graph_description: Optional[str] =  None
• input_shapes_for_deployment: List[Tuple[Optional[int], ...]] =  None

)

Ancestors - (BaseDeploymentSettings)

Use this if you wish to deploy to TFLite in Settings.deployment_settings.

DeploymentSettings_TensorRT_ONNX

CLASS - DeploymentSettings_TensorRT_ONNX(

• graph_author: Optional[str] =  None
• graph_description: Optional[str] =  None
• input_shapes_for_deployment: List[Tuple[Optional[int], ...]] =  None

)

Ancestors - (BaseDeploymentSettings)

Use this if you wish to deploy to TensorRT in Settings.deployment_settings.