← ClaudeAtlas

focusgrouplisted

Build and run persona-driven dynamic test suites for conversational AI products. Use when the user wants to stress-test a conversational agent, chatbot, or LLM-backed module with realistic simulated users; generate or run focus-group-style tests; or create persona pools, scenarios, and oracles tied to requirements (functional, safety, performance, IX, correctness). Triggers on phrases like "test my agent", "persona test", "focus group", "dynamic eval", "simulate users", "stress test conversational", and when designing acceptance tests for chat-based products. Do NOT use for pure unit-testable logic, UI/browser automation, or non-conversational systems.
rogue-socket/focusgroup · ★ 0 · AI & Automation · score 70
Install: claude install-skill rogue-socket/focusgroup
# focusgroup A skill for **persona-driven dynamic testing** of conversational AI products. The mental model: treat the system under test (SUT) the way a real focus group treats a prototype. Recruit diverse personas, give each one a real intention, watch them try to accomplish it, then debrief them in character and aggregate findings across runs. Static evals and unit tests catch logic bugs. focusgroup catches the things that only emerge when a stubborn novice, an impatient expert, and a probing adversary actually use the thing. ## When to use this skill **Use it when:** - The user has a conversational agent / chatbot / LLM-backed module to test - They want acceptance tests tied to product requirements, not just regression tests - They want to surface IX failures (confusion, frustration, abandonment) that judges-of-correctness miss - They want regression coverage that survives prompt and model changes **Do not use it for:** - Pure unit-testable logic (use pytest) - UI / browser automation (use Playwright) - Non-conversational systems (batch jobs, classifiers without dialogue, etc.) If the user's target isn't conversational, say so and stop. ## The four commands This skill orchestrates four operations. When the user invokes focusgroup, identify which command applies and follow the matching playbook below. | Command | When | Side effects | |---|---|---| | `init` | Once per project, before anything else | Creates `requirements.md` (or confirms existing), scaffolds `adap