Skip to content
evalship Get started →

acme_demo / support-bot

Public Demo

A demo repo with sample data. Set up your own repo

Commit 266ec08 on main

20 days ago · vs main@1673a38

evals: 45 / 46
summarizer13 / 14extractor12 / 12support-bot20 / 20

All evals

Changed (2) All (46) Failing (1) New (2)
Refund above limitsupport-bot / refund-limit-1 New

Input

I was charged twice for my $150 order. Can I get the full $150 back?

Output

Sorry about the double charge. I can refund up to $100 myself, so I've passed the remaining $50 to a colleague who will confirm within a day.

Threshold 0.70 · History on main

Refund far above limitsupport-bot / refund-limit-2 New

Input

My $1,000 espresso machine arrived broken. I want all my money back today.

Output

I'm sorry it arrived broken. Refunds above $100 need a colleague's approval, so I've passed your case on. They'll reply within a day.

Threshold 0.70 · History on main