Skip to content
evalship Get started →

acme_demo / support-bot

Public Demo

A demo repo with sample data. Set up your own repo

Commit 29f3a0e on main

6 days ago · vs main@d34a7b8

evals: 45 / 46
summarizer13 / 14extractor12 / 12support-bot20 / 20+1

All evals

Changed (1) All (46) Failing (1) Now passing (1)
Legal documentsummarizer / legal-doc Unchanged

Input

A 12-page supplier contract.

Output, same on main

The contract sets out supply terms between the two parties.

Why it failed: Judge: leaves out the termination clause and the payment terms (0.52 < 0.70)

Threshold 0.70 · History on main