0.25.0 Release Notes
about 1 month ago by Shir Chorev
This version includes new user roles, updated design for the expected output data, and metadata information for the automatic annotation pipeline, along with more features, stability and performance improvements, that are part of our 0.25.0 release.
Deepchecks LLM Evaluation 0.25.0 Release
- 🎨 New Expected Output Design
- ⏳ Estimated Annotations Configuration - Metadata & Download
- 🫵 User Roles
What’s New and Improved?
-
Expected Output Design
- When "expected_output"s are logged for an interaction, they are now conveniently available alongside the original output, allowing easy comparison, highlighting and evaluating alongside the Expected Output Similarity property.
-
Estimated Annotations Configuration Updates
-
The interaction type auto annotation configuration now allows:
- Seeing when the auto-annotation YAML was last uploaded and by whom.
- Downloading the current or default (preset) configuration for that interaction type.
-
-
User roles
- Deepchecks now supports different user roles. The following are the three preset roles:
- Viewers - can view the applications and data inside the Deepchecks system
- Members - can upload data, update the properties and evaluation configurations
- Admins - full control, including inviting and removing users from organization, and organization deletion
- Deepchecks now supports different user roles. The following are the three preset roles: