Main SDK Classes
The must-know classes to properly use Deepchecks SDK.
Deepchecks Client
The DeepchecksLLMClient
instance serves as a gateway to the Deepchecks platform. All SDK operations will be conducted through it. The silent_mode
argument controls the behavior in case something goes wrong. It is recommended to set it to True
when using it in a production environment.
from deepchecks_llm_client import DeepchecksLLMClient
dc_client = DeepchecksLLMClient(
api_token="Fill API Key Here",
silent_mode=True
)
LogInteractionType
An Interaction represents an interaction in the Deepchecks platform and is the primary object for logging data. For additional information about the Deepchecks data structure, see Hierarchy & Data Upload Format.
from deepchecks_llm_client.data_types import LogInteractionType
single_sample = LogInteractionType(
user_interaction_id="id-1",
input="my user input1",
output="my model output1",
started_at='2024-09-01T23:59:59',
finished_at=datetime.now().astimezone(),
annotation="Good", # Either Good, Bad, Unkwown(annotator was unsure), or None
)
AnnotationType
In addition to the estimated annotation calculated by Deepchecks, users can (and are encouraged to) supply their own annotations when available. This can be done via the annotation argument which accepts either the AnnotationType
enum or string values. Possible annotations are "Good", "Bad" and "Unkown" which should be used only in cases where a human annotator saw the interaction and could not decide on its nature.
Updated 10 days ago