Summary

The benchmark tests multi-turn task completion, hallucination resistance when capabilities are missing and disambiguation of ambiguous requests. Agents must chain tools and policies while interacting with a simulated user in a changing environment.

Why it matters

Useful agents need to know when they lack information or authority, not merely complete more tasks. Evaluating limit-awareness is directly relevant to consumer assistants and other systems with real-world actions.

Sources