TOTO Benchmark

Train Offline Test Online (TOTO) is an online benchmark that provides:

  • An open-source manipulation dataset
  • Access to shared robots for evaluation
We release a dataset which consists of:
    1,262,997 images of robot actions
    1895 trajectories of scooping data
    1003 trajectories of pouring data
    15 different materials
    6 different object locations
We are organizing a competition at NeurIPS 2023. Click below to learn more!

Get Started