Language - Action

01 CALVIN

• http://calvin.cs.uni-freiburg.de/
• https://github.com/mees/calvin/tree/main
• 2112.03227.pdf (arxiv.org)
• Data Size: 1.4 tb

02 RT-1Dataset

• Download link: gresearch – Bucket details – Cloud Storage – Google Cloud console
• Related Code: google-research/robotics_transformer
• REF.
  • https://www.tensorflow.org/datasets/api_docs/python/tfds
  • https://github.com/google-research/rlds
• Data Size: 108 gb

03 Language-table

• google-research/language-table: Suite of human-collected datasets and a multi-task continuous control benchmark for open vocabulary visuolinguomotor learning.
• C. Lynch, A. Wahid, J. Tompson, T. Ding, J. Betker, R. Baruch, T. Armstrong, and P. Florence. Interactive language: Talking to robots in real time. arXiv preprint arXiv:2210.06407, 2022.
• Bassline Benchmark in RT-2 paper

04 ARNOLD