evidently-drift-detector

Solid

Evidently AI skill for data drift detection, model performance monitoring, target drift analysis, and automated reporting for ML systems in production.

AI & Automation 814 stars 53 forks Updated today MIT

Install

View on GitHub

Quality Score: 95/100

Stars 20%
97
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Evidently Drift Detector Detect data drift, monitor model performance, and generate automated reports using Evidently AI. ## Overview This skill provides comprehensive capabilities for ML monitoring using Evidently AI. It enables detection of data drift, concept drift, target drift, and model performance degradation in production ML systems. ## Capabilities ### Data Drift Detection - Feature-level drift detection - Dataset-level drift analysis - Multiple drift detection methods (KS, PSI, Wasserstein, etc.) - Distribution visualization - Drift magnitude quantification ### Model Performance Monitoring - Classification metrics tracking - Regression metrics tracking - Performance degradation detection - Slice-based analysis - Error analysis ### Target Drift Analysis - Target distribution changes - Label drift detection - Prediction drift monitoring - Class balance monitoring ### Automated Reporting - HTML report generation - JSON metrics export - Dashboard integration - Custom metric creation - Test suite execution ### Production Monitoring - Real-time monitoring integration - Alerting threshold configuration - Time-series drift tracking - Batch comparison analysis ## Prerequisites ### Installation ```bash pip install evidently>=0.4.0 ``` ### Optional Dependencies ```bash # For Spark support pip install evidently[spark] # For specific visualizations pip install plotly nbformat ``` ## Usage Patterns ### Basic Data Drift Report ```python from evidently import Colum...

Details

Author
a5c-ai
Repository
a5c-ai/babysitter
Created
4 months ago
Last Updated
today
Language
JavaScript
License
MIT

Related Skills