Skip to content
evalship Get started →

evalship-hq / ponytail

Public

FastAPI rate-limit | openrouter:anthropic/claude-haiku-4.5

Ponytail vs caveman vs no-skill: same model, same tasks. Measures code LOC (deterministic) and token / FastAPI rate-limit | openrouter:anthropic/claude-haiku-4.5

Score on main

Oct 29: 9.50Oct 29: 1.00Oct 29: 1.00Oct 29: 1.00
Oct 29min 1.00, max 9.50Oct 29: 1.00

Last 4 runs

Stable across recent runs.

Recent results

CommitResultScoreDurationMetadata
7beb065 6 days ago Pass 1.00 3.3s provider: openrouter:anthropic/claude-haiku-4.5, scoring: code_loc weight 0, assertions: ["javascript","javascript"], judge: deterministic
545983b 6 days ago Pass 1.00 3.9s provider: openrouter:anthropic/claude-haiku-4.5, scoring: code_loc weight 0, assertions: ["javascript","javascript"], judge: deterministic
7e38f14 6 days ago Pass 1.00 2.7s provider: openrouter:anthropic/claude-haiku-4.5, scoring: code_loc weight 0, assertions: ["javascript","javascript"], judge: deterministic
c01cd19 6 days ago Pass 9.50 3.2s provider: openrouter:anthropic/claude-haiku-4.5, assertions: ["javascript","javascript"], judge: deterministic