Phantom Success, Silent Failure: Auditing the Success Checkers of Simulated Manipulation Benchmarks
arXiv:2611.25179v1 Announce Type: cross Abstract: Simulated manipulation benchmarks measure policy performance using hand-written success checkers that label each episode as a success or failure. Passing an expert demonstration shows that a checker accepts one way of completing the task. Learned…
Read original reporting ↗This Observatory page contains only an indexed headline and short summary. It does not reproduce the article or substitute for the publisher’s reporting, corrections, context or terms.
Read the original at arXiv cs.RO ↗