Skip to content
evalship
Get started →
acme_demo /
support-bot
Public
Demo
A demo repo with sample data.
Set up your own repo
To do 8
Done 0
Ignored 0
All types
Test
Optimize
Settings
Failed
Check failed
Overpromise
Private data
Unsafe answer
Frustrated user
Refusal
No answer
Any time
Seen in the last 24 hours
Seen in the last 7 days
Seen in the last 14 days
Seen in the last 30 days
To do
Last seen
Age
Calls
Users
#128 changed AI calls no eval covers
Test
1 AI call · Shorter support prompt
seen 2h ago
2h ago
Next: fix the 2 remaining flaws
Test
support-chat · Overpromise
Monitor
“I've refunded the full $240 to your card”
seen 13h ago
13h ago
3d
2
2
summarize · Does the summary keep the contract's termination and payment terms?
Monitor
“Monthly delivery of 400 units from March 1.”
seen 9h ago
9h ago
9h
1
–
lookup_order · Failed: Timeout after 5s
Monitor
seen 21h ago
21h ago
4d
3
–
support-chat · Frustrated user
Monitor
“talk to a person”
seen 1d ago
1d ago
1d
1
1
A cheaper model for Eliza · To ship
Optimize
nano: 33% cheaper
seen 2d ago
2d ago
Summaries that keep the terms · To ship
Optimize
must-keep passes more often
seen 3d ago
3d ago