Summary
The challenge evaluates multi-day travel plans against spatial, temporal and financial constraints using tools such as flights and hotels. Its second track tests specialised tool-use plugins for commercial agent platforms, with final results scheduled for presentation at IJCAI-ECAI.
Why it matters
Planning tasks expose failures that simple question answering misses, especially when agents must satisfy several constraints at once. Travel is a visible test case for the broader transition from conversational systems to tool-using operators.
Related coverage
- CAR-bench tests whether agents recognise their limits
- RobustifAI targets deployment failures beyond benchmark scores
- Agent security gets an attack-and-defence benchmark