HTTP target
Any app that takes a JSON request over HTTP and answers with JSON.
Evals sends a
POST with Content-Type: application/json. It replaces {{input}} in the body with the case’s input, escaped for JSON, so {{input}} must sit inside a string. Each call times out after 90 seconds.
Paths
A path is a dot-separated route into the response JSON. Array items are numbers.Response
- Contexts path points to the passages your app retrieved: an array of strings, or of objects with
textorcontent, and optionallytitleandlocator. The Grounded suite needs it. - Tool calls path points to an array of tool calls in OpenAI’s shape (
function.name,function.arguments) or a flat{name, arguments}shape. Arguments may be a JSON string. The Tool call arguments suite needs it.
Keys and safety
Header values are stored as you enter them. Use a key made only for testing, and revoke it when you are done. From jabrod.com, Evals cannot reachlocalhost or private network addresses. Test a staging URL that is reachable from the internet.

