lythoskill-arena

Solid

Test play for skills and deck configurations. DEFAULT: agent reads config, spawns parallel subagents via native Agent tool, judges outputs. Single-deck test AND multi-deck A/B comparison both run agent-orchestrated (no CLI). Cross-player comparison (kimi vs codex) is the ONLY case that needs the CLI runner. Always restores parent deck. No install, no working-set pollution, no deck overwrite. Subagent-friendly: resumes interrupted runs from saved state. CRITICAL: experiments run in `/tmp`, never in committed directories. Subagent inherits parent CWD — prompt must explicitly set workDir.

AI & Automation 3 stars 0 forks Updated 3 weeks ago MIT

Install

View on GitHub

Quality Score: 80/100

Stars 20%
20
Recency 20%
90
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
80
License 10%
100
Description 5%
100

Skill Content

# Skill Arena > Test play for skills and deck configurations. Not "which is best" — "which is best for what." ## Decision Tree (READ FIRST) ``` User says: "test/compare/arena/benchmark/A vs B" │ ├── Cross-PLAYER? (kimi vs codex vs claude) │ OR user explicitly says useAgent/specific player │ OR platform doesn't support Agent tool subagents │ → CLI runner REQUIRED (useAgent → Bun.spawn) │ → bunx @lythos/skill-arena vs --config arena.toml │ → Each side spawns its player CLI process │ └── Same player, different DECKS? (DEFAULT) → Agent-orchestrated — NO CLI → YOU spawn subagents via Agent tool → CLI prepare-workdir + CLI archive + parallel dispatch → Judge subagent collects + scores ``` ## Default: Agent-Orchestrated (single & cross-deck vs) **This is how arena works 95% of the time.** The agent and CLI operate as a two-way control transfer protocol. Agent delegates mechanical invariants to CLI. CLI hands control back via its exit paths (success → next step; error → fix command). Agent stays in its own main loop — the subagent pattern is container spawn, not external RPC. ```mermaid flowchart TD A["🤖 Agent: parse request"] --> B{Cross-PLAYER?} B -->|Yes| C[🔧 CLI vs --config] B -->|No — DEFAULT| D["🤖 Agent → 🔧 CLI: prepare-workdir"] D -->|"✅ workdir ready"| E["🤖 Agent: spawn subagents"] E --> F["🤖 Subagents: execute + write artifacts"] F --> G["🤖 Agent: c...

Details

Author
lythos-labs
Repository
lythos-labs/lythoskill
Created
3 months ago
Last Updated
3 weeks ago
Language
TypeScript
License
MIT

Bundled in these plugins

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Featured

agent-deck

Terminal session manager for AI coding agents. Use when user mentions "agent-deck", "session", "sub-agent", "MCP attach", "git worktree", or needs to (1) create/start/stop/restart/fork sessions, (2) attach/detach MCPs, (3) manage groups/profiles, (4) get session output, (5) configure agent-deck, (6) troubleshoot issues, (7) launch sub-agents, or (8) create/manage worktree sessions. Covers CLI commands, TUI shortcuts, config.toml options, and automation.

765 Updated 3 days ago
asheshgoplani
AI & Automation Listed

skill-ab-eval

skill-ab-eval — A/B test skill lift, compare CLI agents. Use when: "evaluate skill", "skill A/B", "compare CLIs".

0 Updated 2 weeks ago
cskwork
AI & Automation Solid

lythoskill-deck

Declarative skill deck governance. `deck link` reconciles the working set to match skill-deck.toml — deny-by-default removes undeclared skills. DEFAULT patterns: PHASE SWITCH via separate deck files (deck link --deck phase<N>.toml), SEED bootstrap (minimal deck → agent self-expands via deck add + curator discovery). Always restores parent deck. Zero state pollution between phases. INNATE FIRST: after compaction, session reload, or skill refresh — read every innate skill's full SKILL.md before any tool skill. Innate = eagerly loaded, always full context. Tool = lazy, read only on trigger. CRITICAL when writing a deck for others: verify every locator path against the REAL repo structure before publishing.

3 Updated 3 weeks ago
lythos-labs