Documentation
DocumentationAPI ReferenceRelease Notes
DocumentationLog In
Release Notes
These docs are for v0.8.0. Click to read the latest docs for v0.21.0.
Back to All

0.10.0 Release Notes

10 months ago by Shir Chorev

This page includes updates from our 0.10.0 Release, which includes new features, stability and performance improvements.

Deepchecks LLM Evaluation 0.10.0 Release

  • 👀 Comparative View Per Interaction
  • 📈 Deepchecks Evaluator - Auto-annotation component that learns from past annotations.
  • 🧑‍🤝‍🧑 Similarity Scores Are Now Widely Available
  • 📊 Property Distribution View in Overview Screen
  • ✍️ Application and Version Can Now Be Renamed
  • 🧖‍♂️ PII Risk Property
  • ⏳ System Quotas Visibility

What's New and Improved

  • Comparative View Per Interaction

    • The ability to see side-by side two or three versions for the same interaction (same user-interaction-id) across different versions.
    • This view can be accessed by "Compare to Other Version" button in Interaction view, or when choosing to "View Similar Interaction", when an interaction was auto-annotated based on Similarity.

  • Deepchecks Evaluator

    • Deepchecks' LLM-based evaluator offers high-quality annotations by learning from user annotated samples and generalizing that knowledge for new instances. The more user annotated samples across more versions, the better it performs.
    • It is now available by default as part of the auto annotation, and its priority within the different components (properties and similarity) can be customized.

  • Similarity Score

    • Similarity scores are now viewable in the comparative view, and also included when downloading data from the system.
    • Enables re-running auto-annotation pipeline more efficiently and tuning similarity accordingly.

  • Property Distributions View

    • Distributions of numeric property values are now showed when selecting properties in the overview screen

  • Application and Version Can Now Be Renamed

    • "Manage Applications" Screen and the "Versions" Screen enable renaming, for easing application and version management

  • PII Risk Property

    • A new property added to the system builtin properties, identifying risk for PII leakage on the application's output

  • System Quotas Visibility

    • Notification is now viewable when exceeding system limitations
    • Limitations are set upon: Number of LLM property recalculations, Number of interactions per application, and number of enabled LLM properties