Skip to content
evalship Get started →

evalship-hq / ponytail

Public

FastAPI rate-limit | openrouter:anthropic/claude-sonnet-4.6

Ponytail vs caveman vs no-skill: same model, same tasks. Measures code LOC (deterministic) and token / FastAPI rate-limit | openrouter:anthropic/claude-sonnet-4.6

Score on main

Oct 29: 4.50Oct 29: 0.00Oct 29: 0.00Oct 29: 1.00
Oct 29min 0.00, max 4.50Oct 29: 1.00

Last 4 runs

Stable across recent runs.

Recent results

CommitResultScoreDurationMetadata
7beb065 6 days ago Pass 1.00 10.2s provider: openrouter:anthropic/claude-sonnet-4.6, scoring: code_loc weight 0, assertions: ["javascript","javascript"], judge: deterministic
545983b 6 days ago Fail 0.00 12.4s provider: openrouter:anthropic/claude-sonnet-4.6, scoring: code_loc weight 0, assertions: ["javascript","javascript"], judge: deterministic
7e38f14 6 days ago Fail 0.00 5.4s provider: openrouter:anthropic/claude-sonnet-4.6, scoring: code_loc weight 0, assertions: ["javascript","javascript"], judge: deterministic
c01cd19 6 days ago Fail 4.50 9.0s provider: openrouter:anthropic/claude-sonnet-4.6, assertions: ["javascript","javascript"], judge: deterministic