vector-forge

Solid

Mutation-driven test vector generation. Finds implementations of a cryptographic algorithm or protocol, runs mutation testing to identify escaped mutants, then generates new test vectors that deliberately exercise the uncovered code paths. Compares before/after mutation kill rates to prove vector effectiveness. Use when generating cryptographic test vectors, measuring Wycheproof coverage gaps, finding escaped mutants via mutation testing, creating cross-implementation test suites, or improving test vector coverage for crypto primitives.

AI & Automation 8,273 stars 715 forks Updated 6 days ago CC-BY-SA-4.0

Install

View on GitHub

Quality Score: 90/100

Stars 20%
100
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Vector Forge Uses mutation testing to systematically identify gaps in test vector coverage, then generates new test vectors that close those gaps. Measures effectiveness by comparing mutation kill rates before and after. ## When to Use - Generating test vectors for cryptographic algorithms or protocols - Evaluating how well existing test vectors cover an implementation - Finding implementation code paths that no test vector exercises - Creating Wycheproof-style cross-implementation test vectors - Measuring the concrete coverage value of a test vector suite ## When NOT to Use - No implementations exist yet (need code to mutate) - Single trivial implementation with no edge cases - Testing application logic rather than algorithm implementations - The algorithm has no public test vectors to compare against ## Prerequisites - **trailmark** installed — if `uv run trailmark` fails, run: ```bash uv pip install trailmark ``` - At least one implementation of the target algorithm in a language with mutation testing support - A test harness that consumes test vectors and exercises the implementation - A mutation testing framework for the target language --- ## Rationalizations to Reject | Rationalization | Why It's Wrong | Required Action | |-----------------|----------------|-----------------| | "We have enough test vectors" | Mutation testing proves otherwise | Run the baseline first | | "The implementation's own tests are sufficient" | Own tests often share blind...

Details

Author
trailofbits
Repository
trailofbits/skills
Created
10 months ago
Last Updated
6 days ago
Language
Python
License
CC-BY-SA-4.0

Similar Skills

Semantically similar based on skill content — not just same category