Skip to content
evalship Get started →

acme_demo / support-bot

Public Demo

A demo repo with sample data. Set up your own repo

Long thread

summarizer / long-thread, tests/evals/test_summarizer.py

Score on main

Oct 5: 0.79Oct 6: 0.77Oct 7: 0.79Oct 8: 0.77Oct 9: 0.76Oct 10: 0.79Oct 11: 0.80Oct 12: 0.80Oct 13: 0.77Oct 14: 0.78Oct 15: 0.78Oct 16: 0.79Oct 17: 0.79Oct 18: 0.80Oct 19: 0.79Oct 20: 0.80Oct 21: 0.76Oct 22: 0.77Oct 23: 0.79Oct 24: 0.77Oct 25: 0.79Oct 26: 0.78Oct 27: 0.79Oct 28: 0.77Oct 29: 0.79Oct 30: 0.78Oct 31: 0.78Nov 1: 0.76Nov 2: 0.77Nov 3: 0.78
Oct 5min 0.76, max 0.80Nov 3: 0.78

Last 30 runs

Stable across recent runs.

Recent results

CommitResultScoreDurationMetadata
1112b67 1 day ago Pass 0.78 2.0s
5f180be 2 days ago Pass 0.77 2.0s
1f21388 3 days ago Pass 0.76 2.0s
d65bfad 4 days ago Pass 0.78 2.0s
8898a24 5 days ago Pass 0.78 2.0s
29f3a0e 6 days ago Pass 0.79 2.0s
d34a7b8 7 days ago Pass 0.77 2.0s
cbc8ede 8 days ago Pass 0.79 2.0s
3625a09 9 days ago Pass 0.78 2.0s
8cc18b2 10 days ago Pass 0.79 2.0s
6a65d11 11 days ago Pass 0.77 2.0s
14cc377 12 days ago Pass 0.79 2.0s
f39099d 13 days ago Pass 0.77 2.0s
dc990fc 14 days ago Pass 0.76 2.0s
0799731 15 days ago Pass 0.80 2.0s