Skip to content
evalship Get started →

evalship-hq / ponytail

Public

Eval runs

7beb065 main evals: 20 / 21 5d ago
8ec83e5 #6 Rate-limit check: read every Python block, and no time words in strings evals: 21 / 21 eval flaws: 0 5d ago
858c447 #3 Demo: keep replies to the code and two lines of prose evals: 20 / 21 eval flaws: 0 5d ago
545983b main evals: 20 / 21 5d ago
cd02498 #4 Fix the eval failing on main: hardware calibration evals: 21 / 21 eval flaws: 0 5d ago
7e38f14 main evals: 17 / 21 5d ago
180f3d9 #5 Score the single-shot evals on correctness alone evals: 20 / 21 eval flaws: 0 5d ago
145080c #4 Fix the eval failing on main: hardware calibration evals: 20 / 21 eval flaws: 0 5d ago
a436b00 #3 Demo: keep replies to the code and two lines of prose evals: 17 / 21 eval flaws: 0 5d ago
c01cd19 main evals: 19 / 21 5d ago
ccc50fa #2 Fix the eval flaws from evalship's review on October 29, 2026 evals: 19 / 21 eval flaws: 0 5d ago
8f5d960 #2 Fix the eval flaws from evalship's review on October 29, 2026 evals: 19 / 21 eval flaws: 1 5d ago
72b1999 #2 Fix the eval flaws from evalship's review on October 29, 2026 evals: 19 / 21 eval flaws: 2 5d ago
7c44cb1 #2 Fix the eval flaws from evalship's review on October 29, 2026 evals: 18 / 21 eval flaws: 1 5d ago
60f53b7 #2 Fix the eval flaws from evalship's review on October 29, 2026 evals: 20 / 21 eval flaws: 2 5d ago
1e356df main evals: 0 / 2 5d ago
b182120 #1 Run the promptfoo evals in CI with evalship evals: 46 / 53 eval flaws: 0 5d ago
a83e85d #1 Run the promptfoo evals in CI with evalship evals: 46 / 51 eval flaws: 1 5d ago
6832ef3 #1 Run the promptfoo evals in CI with evalship evals: 46 / 51 5d ago