Skip to content
evalship Get started →

acme_demo / support-bot

Public Demo

A demo repo with sample data. Set up your own repo

Commit d34a7b8 on main

7 days ago · vs main@cbc8ede

evals: 44 / 46
summarizer13 / 14support-bot19 / 20-1extractor12 / 12

Notes

  • Within chance: support-bot: 1 of its 20 passing evals fails here; between runs on main it rarely loses one by chance (last 23 runs). Rerun it: failing again would confirm it.

All evals

Changed (1) All (46) Failing (2) Within chance (1)
Casual tonesupport-bot / tone-casual Within chance

Input

hey whats up w my order lol

Output, same on main

Hey! It shipped yesterday and should be with you Thursday.

Threshold 0.70 · History on main