Skip to main content
Open Evals at jabrod.com/app/evals.
1

Add a target

Tell Evals how to call your app: its URL, any headers, a JSON body with {{input}} where the question goes, and where the answer is in the response. See Targets.
Body
Answer path: choices.0.message.content
2

Upload a test set

A CSV or JSONL file, one case per row. Only input is required. See Test sets.
cases.csv
3

Pick suites and run

Choose the suites that apply. A run calls your app once per case and scores the answers. One run per account at a time.
4

Read the report

Pass rate by suite, then every case with its answer, the passages it used, and a reason for each verdict. See Reports.
Change your app, then run the same test set against the same target again. The report compares the two runs. See Regression runs.