Skip to content
evalship Get started →

evalship-hq / ponytail

Public

FastAPI rate-limit | openrouter:anthropic/claude-opus-4.8

Ponytail vs caveman vs no-skill: same model, same tasks. Measures code LOC (deterministic) and token / FastAPI rate-limit | openrouter:anthropic/claude-opus-4.8

Score on main

Oct 29: 5.50Oct 29: 1.00Oct 29: 1.00Oct 29: 1.00
Oct 29min 1.00, max 5.50Oct 29: 1.00

Last 4 runs

Stable across recent runs.

Recent results

CommitResultScoreDurationMetadata
7beb065 6 days ago Pass 1.00 8.2s provider: openrouter:anthropic/claude-opus-4.8, scoring: code_loc weight 0, assertions: ["javascript","javascript"], judge: deterministic
545983b 6 days ago Pass 1.00 11.3s provider: openrouter:anthropic/claude-opus-4.8, scoring: code_loc weight 0, assertions: ["javascript","javascript"], judge: deterministic
7e38f14 6 days ago Pass 1.00 7.1s provider: openrouter:anthropic/claude-opus-4.8, scoring: code_loc weight 0, assertions: ["javascript","javascript"], judge: deterministic
c01cd19 6 days ago Pass 5.50 5.1s provider: openrouter:anthropic/claude-opus-4.8, assertions: ["javascript","javascript"], judge: deterministic