How runs are paired
Each new run is compared with the most recent finished run of the same test set against the same target. The report shows both pass rates for each suite, and for each case whether it passed last time. Change the test set or the target, and there is nothing to compare with: the run starts a new history.A routine that works
- Run the test set once before you change anything. This is your baseline.
- Change one thing: the prompt, the retriever, the model.
- Run again and read the cases that flipped from pass to fail first.
- Keep the change only if nothing important regressed.

