tcim_lite.runtime

Functions

get_device_num

Retrieves the number of Houmo devices with the specified backend name.

get_supported_backend

Retrieves the list of backend names supported by the current Houmo device.

get_version

Gets the version and release date of the TCIM library.

load

Loads a built TCIM model with the specified model file.

load_model_info

Loads and returns the model information as a JSON string from a binary model file (.hmm or .hmms).

Classes

Buffer

Represents a buffer that is used to save data on host CPU and Houmo device.

DevManager

Describes the device set on which the target model runs.

Device

The device type where the data is stored.

Module

Represents a module instance used for model inference in runtime.

Option

Static configuration options for loading models.

RunOption

Dynamic options when the module run.

Stream

Represents a stream that is used by the module for inference.

Tensor

Represents an input, output, or intermediate computation result.

TensorInfo

Represents information about a tensor, including its shape, data type, memory layout, and other relevant attributes.

WeightManager

Represents weight manager reference for Module.