Jump to Content
Documentation
Documentation
API Reference
Release Notes
v0.6.0
v0.7.0
v0.8.0
v0.9.0
v0.10.0
v0.11.0
v0.12.0
v0.13.0
v0.14.0
v0.15.0
v0.16.0
v0.17.0
v0.18.0
v0.19.0
v0.20.0
v0.21.0
v0.22.0
v0.23.0
v0.24.0
v0.25.0
v0.26.0
v0.27.0
v0.28.0
v0.29.0
v0.30.0
v0.31.0
v0.32.0
v0.33.0
v0.34.0
v0.35.0
v0.36.0
v0.37.0
v0.38.0
v0.38.1
v0.39.0
v0.40.0
v0.41.0
v0.42.0
v0.43.0
Documentation
Log In
Documentation
Search
Ask AI
Log In
v0.30.0
Documentation
API Reference
Release Notes
Oracle Cloud (OCI)
These docs are for v0.30.0. Click to read the latest docs for v0.43.0.
Getting Started
Welcome to Deepchecks LLM Evaluation
Supported Use Cases
Features
Automatic Annotations
Version Comparison
Root Cause Analysis (RCA)
Production Monitoring
Experiment Management
Additional Features
Properties
Built-in Properties
Retrieval Use-Case Properties
Prompt Properties
User-Value Properties
Hierarchy & Data Structure
Tracing on the Deepchecks System
Deepchecks in Action
Investment Agent Demo
Uploading the Data
Overview
Root Cause Analysis: Investigating Performance Issues
Compare Between Versions
Production Monitoring
Q&A Demo: GVHD Data
Uploading the Data
Identify Problems Using Properties, Estimated Annotations and Insights
User-Value Properties and Prompt Properties
Compare Between Versions
Monitor Production Data and Research Degradation
Summarization Demo: E-Commerce Data
Uploading the Data
Configuring the Automatic Annotation
Compare Between Versions
Production Monitoring
Classification Demo: Movie Genre
Uploading the Data
Evaluation Set Analysis
Production Monitoring
How To Guides
Data Integration
Data Model Cheat-Sheet
Step by Step Integration Walkthrough
Deepchecks' SDK
Setup: Python SDK Installation & API Key Retrieval
Main SDK Classes
Data Upload
Data Download
Code Snippets: Full Examples
Configure Auto Annotation
Selecting the Right Properties
Threshold Detection
Auto Annotation Design
The Configuration YAML
Perform Root Cause Analysis
Identifying Failures
Analyzing Failures
End-to-End RCA Examples
Build & Maintain a High-Quality Evaluation Set
Building Your Initial Evaluation Set
Measuring Evaluation Set Quality
When and How to Update Your Evaluation Set
Agent Evaluation
AI-Assisted Manual Annotations
Hard Sample Mining for Fine-Tuning
Pentesting Your LLM-Based App
Get the Most Out of Your DPUs
Integrations
Deepchecks in AWS SageMaker
LLMs
OpenAI
Azure OpenAI
Vertex AI
Anthropic
Nvidia NIM
Oracle Cloud (OCI)
AWS Bedrock
Production Monitoring
Datadog Integration
New Relic Integration
Langchain Tracing
Configuring Nvidia's Guardrails with Deepchecks
Powered by
Oracle Cloud (OCI)
Updated 5 months ago
Nvidia NIM
AWS Bedrock
Ask AI
