1. 1 Connect GitHub
  2. 2 Pick a repo
  3. 3 Set up CI
  4. 4 Done

Connect GitHub

Install the evalship GitHub App on the repos that have evals. It reads eval results from GitHub Actions and posts one comment per pull request. It can't push code.

Install on GitHub I already installed it: sign in

What the App can access

  • Read: code, GitHub Actions artifacts, metadata
  • Write: checks and pull request comments