Mmastodon Technology Robotics first seen 23 h ago, last 7 h ago, peak #1

New Spa-Bench benchmark tests robot spatial grounding

Original: Spa-Bench is a real-robot benchmark for spatial grounding in vision-language-action models. Across evaluated policies, s

Researchers have introduced Spa-Bench, a real-robot benchmark designed to measure spatial grounding in vision-language-action models. Early results show that evaluated robot policies perform noticeably worse when tasks move from in-distribution to out-of-distribution spatial configurations, exposing a key weakness in current systems. The paper, released on arXiv's robotics section, gives the field a standardised way to compare how well robots understand spatial relationships in real-world settings.

Why now: The benchmark highlights a documented performance gap in vision-language-action models, which matters to robotics researchers tracking real-world generalisation.

Spa-Bench vision-language-action models arXiv

Open on mastodon →

Rank over time, top of the chart is #1. 13 snapshots from 23 h ago to 7 h ago.

Evidence

Spa-Bench is a real-robot benchmark for spatial grounding in vision-language-action models. Across evaluated policies, success falls from in-distribution to out-of-distribution spatial configurations. Source: arXiv cs.RO https:// arxiv.org/abs/2610.12696 # Robotics · sipirtu · 1

API: https://socialmediatrends-api.osmike.com/v1/trends/1948402