← ClaudeAtlas

giskard-testslisted

Use for any question or task about testing a trained tabular or NLP model before it ships, including robustness to small input changes, data leakage and fairness, or a pre-merge check after a feature or hyperparameter change. Runs Giskard scan and its test catalog for performance, robustness, fairness, data leakage and ethical issues, and emits suites that pass or fail in CI.
testland/qa-skills · ★ 0 · Testing & QA · score 72
Install: claude install-skill testland/qa-skills
# giskard-tests Giskard wraps any prediction function and DataFrame, then runs a `scan()` that surfaces *"performance biases, unrobustness, data leakage, stochasticity, underconfidence, ethical issues"* per the [Giskard tabular quickstart]. ## When to use - Pre-deployment model audit (fairness + robustness scan). - Pre-merge gate after a feature-engineering or hyperparameter change - re-run scan, fail PR if new vulnerabilities surface. - Generating an initial test suite for a model with no existing tests. ## Step 1 - Install ```bash pip install giskard --upgrade ``` Per the [Giskard tabular quickstart]. ## Step 2 - Wrap the dataset ```python from giskard import Dataset giskard_dataset = Dataset( df=raw_data, target=TARGET_COLUMN, name="Titanic dataset", cat_columns=CATEGORICAL_COLUMNS, ) ``` `cat_columns` matters - Giskard treats categoricals differently for slicing + drift detection. ## Step 3 - Wrap the model ```python from giskard import Model import numpy as np import pandas as pd def prediction_function(df: pd.DataFrame) -> np.ndarray: preprocessed_df = preprocessing_function(df) return classifier.predict_proba(preprocessed_df) giskard_model = Model( model=prediction_function, model_type="classification", name="Titanic model", classification_labels=classifier.classes_, feature_names=FEATURE_NAMES, ) ``` The `prediction_function` returns probabilities (not class labels) for classification - required by Giskard's