paperclip-evals

Featured

Choose, inspect, validate, and report Paperclip Runner or Product E2E evaluations while preserving evidence, provenance, cost, and failure classification.

AI & Automation 114,742 stars 19046 forks Updated today MIT

Install

View on GitHub

Quality Score: 92/100

Stars 20%
100
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Paperclip evals Use this skill when a request concerns Paperclip evaluation selection, interpretation, evidence, history, or a live run. Read `doc/evals.md` in the Paperclip repository first. It defines the two families and their boundaries. ## Discover the repository Do not assume the skill's installed location is inside a checkout. Locate the repo explicitly with `git rev-parse --show-toplevel` from the current directory, or inspect likely workspace roots and select the checkout containing `package.json`, `tests/runner-e2e`, and `packages/paperclip-runner`. Locate the private sibling `paperclip-evals` only when a Runner Eval needs its definitions; use an explicit `PAPERCLIP_EVALS_ROOT` or a discovered sibling checkout. Never invent a relative path from this copied skill into the repository. ## Route the request Choose **Runner Evals** for real runner/provider protocol behavior against the mock control plane. Authoritative details are in `packages/paperclip-runner/docs/runner-protocol-live-evals.md` and the sibling `paperclip-evals/evals/paperclip-runner` definitions. Choose **Product E2E Evals** for real browser/server/database/runner/provider workflows, including local and Daytona environments. Read `tests/runner-e2e/README.md`, then the suite's section in `SUITES.md`, `FIXTURES.md`, `SECURITY.md`, or `EVERYDAY-WORKFLOWS.md` as relevant. Everyday Workflows remain Product E2E even when imported into Evalbook. “Headless” is a browser mode, not a family. ## Work safe...

Details

Author
paperclipai
Repository
paperclipai/paperclip
Created
8 months ago
Last Updated
today
Language
TypeScript
License
MIT

Similar Skills

Semantically similar based on skill content — not just same category