Vision-Language Models Can't Track a Ball Under a Cup — VET-Bench Exposes Fundamental Spatial Reasoning Gaps

A new benchmark based on the shell game finds state-of-the-art VLMs performing at random chance (33%) on object tracking tasks, revealing that video 'understanding' remains largely illusory.