chat/greeting
● passed- Judged on
- “The reply greets the user by name and offers one next step.”
- Pass rate
- 100%
- Runs
- ● 20
- Last duration
- 1.6s
eve-eval-trend
20 runs · 14 evals · generated 28/07/2026, 14:30
Getting worse
Judge score 0.90 → 0.73 across 20 runs.
Pass rate 100%, unchanged.
What moved
- ↓
chat/greetingjudge 0.90 → 0.73 - ↓
chat/handoffjudge 0.90 → 0.73 - ↓
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-goingjudge 0.90 → 0.73 - ↓
intents/handoverjudge 0.90 → 0.73 - ↓
multi/three-conditionsjudge 0.90 → 0.73 - ↓
search/retrievaljudge 0.90 → 0.73 - ↓
tools/geocodejudge 0.90 → 0.73 - ↓
weather/forecastjudge 0.90 → 0.73
4 unchanged · 1 not run · 1 more moved
Per eval
● passed▲ scored✕ failed– skipped· not in that run
Each card covers the last 20 runs, oldest → latest.
chat/handoff
● passed- Judged on
- “The reply names the queue it is handing over to.”
- Pass rate
- 100%
- Runs
- ● 20
- Last duration
- 2.2s
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going
● passed- Pass rate
- 100%
- Runs
- ● 20
- Last duration
- 900ms
intents/handover
● passed- Judged on
- “The reply routes to a human when the user asks for one.”
- Pass rate
- 100%
- Runs
- ● 20
- Last duration
- 1.2s
multi/three-conditions
● passed- Judged on
- “The reply answers the question that was asked.”
- “The reply stays under four sentences.”
- “The reply does not invent a source it was not given.”
- Pass rate
- 100%
- Runs
- ● 20
- Last duration
- 4.1s
search/retrieval
● passed- Judged on
- “The answer cites at least one retrieved document.”
- Pass rate
- 100%
- Runs
- ● 20
- Last duration
- 3.1s
tools/geocode
● passed- Pass rate
- 100%
- Runs
- ● 14
- Last duration
- 310ms
weather/forecast
● passed- Judged on
- “The reply gives a forecast for the requested day, not the current conditions.”
- Pass rate
- 100%
- Runs
- ● 20
- Last duration
- 30.0s
weather/units
● passed- Judged on
- “Temperatures are given in Celsius.”
- Pass rate
- 100%
- Runs
- ● 20
- Last duration
- 1.9s
edge/no-assertions
● passed- Pass rate
- 100%
- Runs
- ● 20
- Last duration
- 120ms
edge/with-image
● passed- Pass rate
- 100%
- Runs
- ● 20
- Last duration
- 21.0s
edge/with-output
● passed- Pass rate
- 100%
- Runs
- ● 20
- Last duration
- 2.0s
intents/seasonal
– skipped- Pass rate
- —
- Runs
- – 20
- Last duration
- —
tools/weather-lookup
● passed- Pass rate
- 100%
- Runs
- ● 20
- Last duration
- 240ms
Runs (20)
29/07/2026, 09:15 ● 13 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.73 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.73 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.73 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.73 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.73 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.73 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.73 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.73 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.73 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
28/07/2026, 09:15 ● 13 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.72 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.72 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.72 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.72 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.72 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.72 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.72 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.72 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.72 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
27/07/2026, 09:15 ● 13 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.76 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.76 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.76 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.76 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.76 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.76 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.76 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.76 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.76 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
26/07/2026, 09:15 ● 13 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.75 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.75 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.75 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.75 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.75 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.75 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.75 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.75 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.75 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
25/07/2026, 09:15 ● 13 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.74 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.74 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.74 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.74 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.74 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.74 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.74 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.74 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.74 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
24/07/2026, 09:15 ● 13 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.78 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.78 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.78 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.78 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.78 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.78 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.78 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.78 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.78 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
23/07/2026, 09:15 ● 13 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.77 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.77 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.77 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.77 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.77 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.77 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.77 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.77 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.77 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
22/07/2026, 09:15 ● 13 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.81 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.81 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.81 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.81 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.81 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.81 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.81 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.81 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.81 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
21/07/2026, 09:15 ● 13 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.80 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.80 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.80 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.80 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.80 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.80 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.80 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.80 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.80 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
20/07/2026, 09:15 ● 13 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.79 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.79 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.79 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.79 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.79 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.79 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.79 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.79 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.79 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
19/07/2026, 09:15 ● 12 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.84 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.84 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.84 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.84 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.84 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.84 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.84 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.84 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
18/07/2026, 09:15 ● 12 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.83 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.83 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.83 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.83 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.83 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.83 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.83 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.83 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
17/07/2026, 09:15 ● 12 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.87 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.87 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.87 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.87 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.87 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.87 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.87 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.87 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
16/07/2026, 09:15 ● 12 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.86 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.86 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.86 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.86 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.86 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.86 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.86 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.86 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
15/07/2026, 09:15 ● 12 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.85 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.85 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.85 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.85 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.85 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.85 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.85 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.85 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
14/07/2026, 09:15 ● 12 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.89 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.89 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.89 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.89 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.89 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.89 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.89 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.89 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
13/07/2026, 09:15 ● 13 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.88 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.88 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.88 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.88 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.88 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.88 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.88 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.88 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.88 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
12/07/2026, 09:15 ● 13 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.92 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.92 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.92 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.92 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.92 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.92 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.92 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.92 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.92 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
11/07/2026, 09:15 ● 13 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.91 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.91 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.91 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.91 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.91 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.91 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.91 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.91 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.91 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
10/07/2026, 09:15 ● 13 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.90 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.90 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.90 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.90 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.90 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.90 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.90 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.90 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.90 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |