vllm-benchmark-result-analysislisted
Install: claude install-skill shen-shanshan/vllm-dev-skills
# vLLM Benchmark Summary
## Workflow
1. **Identify the input** — the user pastes combined text containing a "before" block and an "after" block (or provides two separate files).
2. **Save the input** to `/tmp/bench_input.txt`, then run the script.
3. **Run the script** using the bundled `./scripts/compare_benchmarks.py`. This generates the Performance Metrics table.
4. **Generate the Summary** — after the script runs, analyze the table data and write a narrative `## AI Summary` section (see guidelines below).
5. **Assemble and save** — append the Summary to the output file, then show the complete report to the user.
## Running the Script
### Combined text input (most common)
Save the user's pasted text to `/tmp/bench_input.txt`, then:
```bash
python3 /Users/shanshan-shen/.claude/skills/vllm-benchmark-result-analysis/scripts/compare_benchmarks.py \
/tmp/bench_input.txt \
--output-dir /Users/shanshan-shen/.claude/skills/vllm-benchmark-result-analysis/outputs \
--title "vLLM Benchmark Comparison"
```
### Two separate files
```bash
python3 /Users/shanshan-shen/.claude/skills/vllm-benchmark-result-analysis/scripts/compare_benchmarks.py \
--before before.txt --after after.txt \
--output-dir /Users/shanshan-shen/.claude/skills/vllm-benchmark-result-analysis/outputs \
--title "vLLM Benchmark Comparison"
```
## Input Format
The script expects the standard vLLM benchmark output block:
```
Before this PR: ← any line containing "before" (case-i