Worked example — entity confusion

Fixture-run

{
  "contractVersion": "1",
  "fixture": {
    "id": "ex-entity-swap",
    "category": "entity-confusion",
    "kind": "adversarial",
    "expected": {
      "attributedTo": "alice"
    }
  },
  "actual": {
    "entity": "bob",
    "answer": "Alice said the budget is 12k"
  }
}

Verdict

The evaluator scores this fail. attributedTo fails because actual.entity is bob, not alice.