Skip to content
evalship Get started →

acme_demo / support-bot

Public Demo

A demo repo with sample data. Set up your own repo

To do
#128 changed AI calls no eval covers Test 1 AI call · Shorter support prompt seen 3h ago
Next: fix the 2 remaining flaws Test
Eval runs
00d6905 #128 Shorter support prompt prompt coverage: 3 / 4 evals: 42 / 46 3h ago
1112b67 main evals: 45 / 46 1d ago
5f180be main evals: 45 / 46 2d ago
1f21388 main evals: 45 / 46 3d ago
d65bfad main evals: 44 / 46 4d ago
8898a24 main evals: 45 / 46 5d ago
29f3a0e main evals: 45 / 46 6d ago
d34a7b8 main evals: 44 / 46 7d ago
cbc8ede main evals: 45 / 46 8d ago
3625a09 main evals: 45 / 46 9d ago
8cc18b2 main evals: 45 / 46 10d ago
6a65d11 main evals: 45 / 46 11d ago
14cc377 main evals: 45 / 46 12d ago
f39099d main evals: 45 / 46 13d ago
dc990fc main evals: 45 / 46 14d ago
0799731 main evals: 45 / 46 15d ago
0297114 main evals: 45 / 46 16d ago
b311f42 main evals: 45 / 46 17d ago
29ebe42 main evals: 45 / 46 18d ago
96b6ee0 main evals: 45 / 46 19d ago
All 32 runs →

Last 7 days

Evals passing on main
45 / 46
Regressions in PRs
2 → 2
Eval flaws in PRs
0
Untested AI calls merged
0
Flaky evals
1
Eval cost
$29.94
Eval time per PR
–