arize-observability

Solid

Arize AI skill for production ML monitoring, embedding drift, and performance analysis.

AI & Automation 814 stars 53 forks Updated today MIT

Install

View on GitHub

Quality Score: 95/100

Stars 20%
97
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# arize-observability ## Overview Arize AI skill for production ML monitoring, embedding drift detection, and comprehensive performance analysis. ## Capabilities - Production data logging - Embedding drift detection for NLP/CV models - Performance monitoring dashboards - Root cause analysis - Slice and dice analysis for segments - Bias monitoring - A/B test monitoring - Custom metrics and monitors ## Target Processes - Model Performance Monitoring and Drift Detection - ML System Observability and Incident Response - Model Evaluation and Validation Framework ## Tools and Libraries - Arize AI SDK - pandas - numpy ## Input Schema ```json { "type": "object", "required": ["action"], "properties": { "action": { "type": "string", "enum": ["log", "monitor", "analyze", "alert-config", "compare"], "description": "Arize action to perform" }, "logConfig": { "type": "object", "properties": { "modelId": { "type": "string" }, "modelVersion": { "type": "string" }, "modelType": { "type": "string", "enum": ["score_categorical", "regression", "ranking"] }, "environment": { "type": "string", "enum": ["training", "validation", "production"] }, "dataPath": { "type": "string" }, "predictionIdColumn": { "type": "string" }, "timestampColumn": { "type": "string" }, "featureColumns": { "type": "array", "items": { "type": "string" } }, "embeddingColumns": { "type": "array", "...

Details

Author
a5c-ai
Repository
a5c-ai/babysitter
Created
4 months ago
Last Updated
today
Language
JavaScript
License
MIT

Related Skills