Skip to main content
A target is what a run sends questions to. There are two kinds.

HTTP target

Any app that takes a JSON request over HTTP and answers with JSON. Evals sends a POST with Content-Type: application/json. It replaces {{input}} in the body with the case’s input, escaped for JSON, so {{input}} must sit inside a string. Each call times out after 90 seconds.

Paths

A path is a dot-separated route into the response JSON. Array items are numbers.
Response
  • Contexts path points to the passages your app retrieved: an array of strings, or of objects with text or content, and optionally title and locator. The Grounded suite needs it.
  • Tool calls path points to an array of tool calls in OpenAI’s shape (function.name, function.arguments) or a flat {name, arguments} shape. Arguments may be a JSON string. The Tool call arguments suite needs it.

Keys and safety

Header values are stored as you enter them. Use a key made only for testing, and revoke it when you are done. From jabrod.com, Evals cannot reach localhost or private network addresses. Test a staging URL that is reachable from the internet.

Context workspace

Pick one of your Context workspaces. Evals asks it each question directly and receives the answer and the passages it used, so the Grounded suite works with no paths to set.