← ClaudeAtlas

deepchecks-testslisted

Use for any question or task about checking ML data before or after training, including train-test leakage, data integrity problems, and models far better offline than in production. Runs Deepchecks data integrity, train-test validation and model evaluation suites on tabular, NLP or vision data, reruns them on production samples for drift and gates CI on passed conditions.
testland/qa-skills · ★ 0 · Testing & QA · score 72
Install: claude install-skill testland/qa-skills
# deepchecks-tests Deepchecks is *"a holistic open-source solution for all of your AI & ML validation needs"* per the [Deepchecks welcome]. Validates **data integrity, train-test splits, model evaluation, end-to-end model development from research through production**. ## When to use - Pre-training: validate data integrity + train-test leakage. - Pre-deployment: model evaluation suite as merge gate. - Production monitoring: same suite re-run on production samples to detect drift. ## Step 1 - Install ```bash pip install deepchecks ``` Per the [Deepchecks welcome] page. ## Step 2 - Wrap data For tabular models: ```python from deepchecks.tabular import Dataset train_ds = Dataset( train_df, label="target", cat_features=CATEGORICAL_COLUMNS, ) test_ds = Dataset( test_df, label="target", cat_features=CATEGORICAL_COLUMNS, ) ``` `cat_features` matters for distribution checks. The Vision and NLP APIs differ - see the [Deepchecks welcome] section linking quickstarts for each data type. ## Step 3 - Run the data integrity suite ```python from deepchecks.tabular.suites import data_integrity integrity = data_integrity() result = integrity.run(train_ds) result.save_as_html("data_integrity.html") ``` Catches: duplicate rows, missing values, mixed types, conflicting labels, single-value features, string mismatches. ## Step 4 - Run the train-test validation suite ```python from deepchecks.tabular.suites import train_test_validation validation = train_