r/MachineLearning · · 1 min read

All major robotics and VLA papers, ranked and benchmarked in a single place [P]

Mirrored from r/MachineLearning for archival readability. Support the source by reading on the original site.

All major robotics and VLA papers, ranked and benchmarked in a single place [P]

Hi folks,

There is now a dedicated Robotics page on Papers with Code that lists the major benchmarks, trending papers with linked code, and open-source artifacts.

Find it here: https://paperswithcode.co/tasks/robotics

https://preview.redd.it/wvhcgu1q1fdh1.png?width=3034&format=png&auto=webp&s=9a43021f7b8e1b840b09f55bb8aee0c4b2d54215

Major benchmarks that most papers report evaluations on are:

- LIBERO, as well as its subsets like LIBERO-Long and LIBERO-Spatial

- SimplerEnv WidowX

- RoboTwin

and more. Currently, we have about 110 entries on each benchmark.

Each benchmark's progress is visualized over time:

https://preview.redd.it/myl3ysvv2fdh1.png?width=2880&format=png&auto=webp&s=3fae2b73d592f2c7ddd3118ec2c5a0d5c5e93b65

We also show which models are open source and which aren't.

Let me know which others I missed. I'd be happy to add them.

Also happy to hear any feedback, new tasks, or features to add!

Kind regards,

Niels

ML Engineer @ HF

submitted by /u/NielsRogge
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/MachineLearning