agentlab.llm.base_api

Classes

`AbstractChatModel`()
`BaseModelArgs`(model_name[, ...])	Base class for all model arguments.

class agentlab.llm.base_api.AbstractChatModel

Bases: ABC

get_stats()

class agentlab.llm.base_api.BaseModelArgs(model_name: str, max_total_tokens: int = None, max_input_tokens: int = None, max_new_tokens: int = None, temperature: float = 0.1, vision_support: bool = False)

Bases: ABC

Base class for all model arguments.

close_server()

abstract make_model() → AbstractChatModel

max_input_tokens: int = None

max_new_tokens: int = None

max_total_tokens: int = None

model_name: str

prepare_server()

temperature: float = 0.1

vision_support: bool = False