chat/greeting
● passed- Judged on
- “The reply greets the user by name and offers one next step.”
- Pass rate
- 100%
- Runs
- ● 20
- Last duration
- 1.6s
eve-eval-trend
24 runs · 14 evals · generated 28/07/2026, 14:30
Getting worse
Judge score 0.93 → 0.76 across the last 20 runs, through one model change and one judge change.
Pass rate 85%, down 15pts.
What moved
- ↓
weather/forecastpassing → failing, judge 0.94 → 0.00 - ↓
weather/unitspassing → scored, judge 0.89 → 0.58 - ↓
search/retrievaljudge 0.92 → 0.72 - ↓
chat/handoff12 flips, still passing - ↓
intents/handover2 flips, still passing
8 unchanged · 1 not run
Per eval
● passed▲ scored✕ failed– skipped· not in that run
Each card covers the last 20 runs, oldest → latest, of 24; earlier runs are in the table below.
chat/handoff
● passed- Judged on
- “The reply names the queue it is handing over to.”
- Pass rate
- 70%
- Runs
- ● 14✕ 6
- Last duration
- 2.2s
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going
● passed- Pass rate
- 100%
- Runs
- ● 20
- Last duration
- 900ms
intents/handover
● passed- Judged on
- “The reply routes to a human when the user asks for one.”
- Pass rate
- 95%
- Runs
- ● 19✕ 1
- Last duration
- 1.2s
multi/three-conditions
● passed- Judged on
- “The reply answers the question that was asked.”
- “The reply stays under four sentences.”
- “The reply does not invent a source it was not given.”
- Pass rate
- 100%
- Runs
- ● 20
- Last duration
- 4.1s
search/retrieval
● passed- Judged on
- “The answer cites at least one retrieved document.”
- Pass rate
- 100%
- Runs
- ● 20
- Last duration
- 3.1s
tools/geocode
● passed- Pass rate
- 100%
- Runs
- ● 14
- Last duration
- 310ms
weather/forecast
✕ failed- Judged on
- “The reply gives a forecast for the requested day, not the current conditions.”
- Pass rate
- 95%
- Runs
- ● 19✕ 1
- Last duration
- 30.0s
weather/units
▲ scored- Judged on
- “Temperatures are given in Celsius.”
- Pass rate
- 85%
- Runs
- ● 17▲ 3
- Last duration
- 1.9s
edge/no-assertions
● passed- Pass rate
- 100%
- Runs
- ● 20
- Last duration
- 120ms
edge/with-image
● passed- Pass rate
- 100%
- Runs
- ● 20
- Last duration
- 21.0s
edge/with-output
● passed- Pass rate
- 100%
- Runs
- ● 20
- Last duration
- 2.0s
intents/seasonal
– skipped- Pass rate
- —
- Runs
- – 20
- Last duration
- —
tools/weather-lookup
● passed- Pass rate
- 100%
- Runs
- ● 20
- Last duration
- 240ms
Retired
No source file, so these no longer run. Their runs stay in the table below.
-
legacy/removed-eval● 16
Runs
29/07/2026, 09:15 ● 11 passed▲ 1 scored✕ 1 failed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.94 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.88 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.72 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.91 | 0.70 | ● pass |
weather/forecast ✕ failed↑ Scroll to top
✕ Timed out after 30000ms waiting for the tool call
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.00 | 0.70 | ✕ miss |
weather/units ▲ scored↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.58 | 0.70 | ✕ miss |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.95 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.89 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.93 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
28/07/2026, 09:15 ● 11 passed▲ 1 scored✕ 1 failed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.97 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.88 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.72 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.94 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.95 | 0.70 | ● pass |
weather/units ▲ scored↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.58 | 0.70 | ✕ miss |
intents/handover ✕ failed↑ Scroll to top
✕ no matching intent
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.30 | 0.70 | ✕ miss |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.92 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.96 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
27/07/2026, 09:15 ● 11 passed▲ 1 scored✕ 1 failed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.95 | 0.70 | ● pass |
chat/handoff ✕ failed↑ Scroll to top
✕ assistant handed over without naming the queue
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.41 | 0.70 | ✕ miss |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.72 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.92 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.93 | 0.70 | ● pass |
weather/units ▲ scored↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.58 | 0.70 | ✕ miss |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.95 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.90 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.94 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
26/07/2026, 09:15 ● 13 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.93 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.88 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.73 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.90 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.91 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.86 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.95 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.88 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.92 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
25/07/2026, 09:15 ● 13 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.96 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.88 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.74 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.93 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.94 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.89 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.95 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.91 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.95 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
24/07/2026, 09:15 ● 12 passed✕ 1 failed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.94 | 0.70 | ● pass |
chat/handoff ✕ failed↑ Scroll to top
✕ assistant handed over without naming the queue
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.41 | 0.70 | ✕ miss |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.75 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.91 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.92 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.87 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.95 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.89 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.93 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
23/07/2026, 09:15 ● 13 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.97 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.88 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.77 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.94 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.95 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.90 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.95 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.92 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.96 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
22/07/2026, 09:15 ● 13 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.95 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.88 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.78 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.92 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.93 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.88 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.95 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.90 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.94 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
21/07/2026, 09:15 ● 13 passed✕ 1 failed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.93 | 0.70 | ● pass |
chat/handoff ✕ failed↑ Scroll to top
✕ assistant handed over without naming the queue
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.41 | 0.70 | ✕ miss |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.79 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.90 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.91 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.86 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.95 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.88 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.92 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
legacy/removed-eval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
20/07/2026, 09:15 ● 14 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.96 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.88 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.80 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.93 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.94 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.89 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.95 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.91 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.95 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
legacy/removed-eval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
19/07/2026, 09:15 ● 13 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.94 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.88 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.81 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.92 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.87 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.95 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.89 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.93 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
legacy/removed-eval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
18/07/2026, 09:15 ● 12 passed✕ 1 failed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.97 | 0.70 | ● pass |
chat/handoff ✕ failed↑ Scroll to top
✕ assistant handed over without naming the queue
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.41 | 0.70 | ✕ miss |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.83 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.95 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.90 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.95 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.92 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.96 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
legacy/removed-eval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
17/07/2026, 09:15 ● 13 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.95 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.88 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.84 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.93 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.88 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.95 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.90 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.94 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
legacy/removed-eval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
16/07/2026, 09:15 ● 13 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.93 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.88 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.85 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.91 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.86 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.95 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.88 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.92 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
legacy/removed-eval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
15/07/2026, 09:15 ● 12 passed✕ 1 failed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.96 | 0.70 | ● pass |
chat/handoff ✕ failed↑ Scroll to top
✕ assistant handed over without naming the queue
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.41 | 0.70 | ✕ miss |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.86 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.94 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.89 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.95 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.91 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.95 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
legacy/removed-eval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
14/07/2026, 09:15 ● 13 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.94 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.88 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.87 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.92 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.87 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.95 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.89 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.93 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
legacy/removed-eval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
13/07/2026, 09:15 ● 14 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.97 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.88 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.89 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.94 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.95 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.90 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.95 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.92 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.96 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
legacy/removed-eval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
12/07/2026, 09:15 ● 13 passed✕ 1 failed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.95 | 0.70 | ● pass |
chat/handoff ✕ failed↑ Scroll to top
✕ assistant handed over without naming the queue
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.41 | 0.70 | ✕ miss |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.90 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.92 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.93 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.88 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.95 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.90 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.94 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
legacy/removed-eval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
11/07/2026, 09:15 ● 14 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.93 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.88 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.91 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.90 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.91 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.86 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.95 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.88 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.92 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
legacy/removed-eval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
10/07/2026, 09:15 ● 14 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.96 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.88 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.92 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.93 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.94 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.89 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.95 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.91 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.95 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
legacy/removed-eval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
09/07/2026, 09:15 ● 13 passed✕ 1 failed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.94 | 0.70 | ● pass |
chat/handoff ✕ failed↑ Scroll to top
✕ assistant handed over without naming the queue
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.41 | 0.70 | ✕ miss |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.93 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.91 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.92 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.87 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.95 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.89 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.93 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
legacy/removed-eval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
08/07/2026, 09:15 ● 14 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.97 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.88 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.95 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.94 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.95 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.90 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.95 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.92 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.96 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
legacy/removed-eval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
07/07/2026, 09:15 ● 14 passed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.95 | 0.70 | ● pass |
chat/handoff ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.88 | 0.70 | ● pass |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.96 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.92 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.93 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.88 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.95 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.90 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.94 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
legacy/removed-eval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
06/07/2026, 09:15 ● 13 passed✕ 1 failed– 1 skipped
chat/greeting ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply greets the user by name and offers one next step.” |
soft | 0.93 | 0.70 | ● pass |
chat/handoff ✕ failed↑ Scroll to top
✕ assistant handed over without naming the queue
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply names the queue it is handing over to.” |
soft | 0.41 | 0.70 | ✕ miss |
search/retrieval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The answer cites at least one retrieved document.” |
soft | 0.97 | 0.70 | ● pass |
tools/weather-lookup ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
tools/geocode ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.90 | 0.70 | ● pass |
weather/forecast ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply gives a forecast for the requested day, not the current conditions.” |
soft | 0.91 | 0.70 | ● pass |
weather/units ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “Temperatures are given in Celsius.” |
soft | 0.86 | 0.70 | ● pass |
intents/handover ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA “The reply routes to a human when the user asks for one.” |
soft | 0.95 | 0.70 | ● pass |
intents/seasonal – skipped↑ Scroll to top
– skipped: only runs between November and January
No assertions recorded.
multi/three-conditions ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.88 | 0.70 | ● pass |
edge/a-deliberately-long-eval-id-that-runs-past-the-card-header-and-keeps-going ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| judge.autoevals.closedQA | soft | 0.92 | 0.70 | ● pass |
edge/no-assertions ● passed↑ Scroll to top
No assertions recorded.
edge/with-output ● passed↑ Scroll to top
It is currently 14°C and overcast in Bristol, with light rain expected after 4pm. Winds are light from the south-west at around 11 km/h.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
edge/with-image ● passed↑ Scroll to top
Here is the fox on a skateboard.
image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
- image review: most — the fox and the skatepark are there, but its tail is not curled around its paws.
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
legacy/removed-eval ● passed↑ Scroll to top
| Assertion | Severity | Score | Min | Result |
|---|---|---|---|---|
| succeeded | gate | 1.00 | — | ● pass |
Every model is unticked, so there is nothing to list.