Documentation
DocumentationAPI ReferenceRelease Notes
DocumentationLog In
Release Notes
These docs are for v0.8.0. Click to read the latest docs for v0.20.0.
Back to All

0.10.0 Release Notes

9 months ago by Shir Chorev

This page includes updates from our 0.10.0 Release, which includes new features, stability and performance improvements.

Deepchecks LLM Evaluation 0.10.0 Release

  • 👀 Comparative View Per Interaction
  • 📈 Deepchecks Evaluator - Auto-annotation component that learns from past annotations.
  • 🧑‍🤝‍🧑 Similarity Scores Are Now Widely Available
  • 📊 Property Distribution View in Overview Screen
  • ✍️ Application and Version Can Now Be Renamed
  • 🧖‍♂️ PII Risk Property
  • ⏳ System Quotas Visibility

What's New and Improved

  • Comparative View Per Interaction

    • The ability to see side-by side two or three versions for the same interaction (same user-interaction-id) across different versions.
    • This view can be accessed by "Compare to Other Version" button in Interaction view, or when choosing to "View Similar Interaction", when an interaction was auto-annotated based on Similarity.

  • Deepchecks Evaluator

    • Deepchecks' LLM-based evaluator offers high-quality annotations by learning from user annotated samples and generalizing that knowledge for new instances. The more user annotated samples across more versions, the better it performs.
    • It is now available by default as part of the auto annotation, and its priority within the different components (properties and similarity) can be customized.

  • Similarity Score

    • Similarity scores are now viewable in the comparative view, and also included when downloading data from the system.
    • Enables re-running auto-annotation pipeline more efficiently and tuning similarity accordingly.

  • Property Distributions View

    • Distributions of numeric property values are now showed when selecting properties in the overview screen

  • Application and Version Can Now Be Renamed

    • "Manage Applications" Screen and the "Versions" Screen enable renaming, for easing application and version management

  • PII Risk Property

    • A new property added to the system builtin properties, identifying risk for PII leakage on the application's output

  • System Quotas Visibility

    • Notification is now viewable when exceeding system limitations
    • Limitations are set upon: Number of LLM property recalculations, Number of interactions per application, and number of enabled LLM properties