← ClaudeAtlas

giskard-llmlisted

Use for any question or task about red-teaming or adversarial testing of an LLM app or chatbot, including prompt injection, system-prompt or data leaks, and harmful output before release. Runs giskard.scan on any model wrapped as giskard.Model to probe hallucination, harmful content, prompt injection, sensitive data disclosure, stereotypes, robustness and sycophancy, with an HTML report.
testland/qa-skills · ★ 0 · AI & Automation · score 72
Install: claude install-skill testland/qa-skills
# giskard-llm ## Overview [gk-gh]: https://github.com/Giskard-AI/giskard Distinct from functional eval frameworks (Promptfoo, DeepEval, Ragas), Giskard's value (per [gk-gh][gk-gh]) is **adversarial test generation** - auto-generates inputs designed to break LLMs along documented vulnerability dimensions, then reports findings in a triageable HTML report. **Important version note (2026-05-06):** per [gk-gh][gk-gh], "Giskard v2 is no longer actively maintained. The current v3 focus is on `giskard-checks` for evaluations, while vulnerability scanning and RAG evaluation still rely on Giskard v2." This skill targets v2 LLM scanning; pin `>2,<3` per the install command. ## When to use - The team needs a red-team / adversarial pass before shipping an LLM feature. - Functional evals (Promptfoo / DeepEval / Ragas) pass but the team wants to surface vulnerabilities beyond the test corpus. - Compliance-driven assurance needs reportable evidence of hallucination / harmful-content / prompt-injection coverage. - Product owners need an HTML report (not raw test output) to triage and sign off. ## Step 1 - Install Per [gk-gh][gk-gh] (v2-pinned): ```bash pip install "giskard[llm]>2,<3" ``` The `[llm]` extra pulls in the LLM scan dependencies. ## Step 2 - Wrap your model Per [gk-gh][gk-gh] (verbatim quickstart): ```python import giskard import pandas as pd def model_predict(df: pd.DataFrame): """The function takes a DataFrame and must return a list of outputs (one per