RSS 2026 Workshop & Challenge

Post-Training for Robotics Foundation Models

From Pretrained Policies to Real-World Mastery.
Room CB11.00.401, University of Technology Sydney · July 13 2026

About
Post-training is a crucial stage in robotics foundation model research: it enables robots to go beyond large-scale pretraining on expert demonstrations and further improve performance through their own interaction with the environment. By collecting interaction rollouts, distinguishing good and bad behaviors, and iteratively optimizing policies, post-training can substantially enhance precision, failure recovery, and generalization—bringing robotics foundation models closer to reliable real-world deployment.

This challenge and workshop will focus on the foundational questions and key challenges in the post-training stage of robotics foundation models. The event consists of two tightly coupled components: (1) a pre-workshop challenge and (2) an in-person workshop at RSS. The workshop program will include four parts: the pre-workshop challenge, invited speaker talks, team presentations, and a panel discussion.

We expect the workshop to (i) establish shared problem definitions and evaluation protocols for robotics foundation model post-training, (ii) surface empirical lessons and failure modes from real-robot rollouts, and (iii) catalyze reusable resources (e.g., benchmarking protocol, reports, and baselines) that enable more reproducible and scalable research in this area.

Challenge

The challenge is structured in two rounds. In Phase 1, all teams are evaluated on a standardized real-robot bimanual manipulation benchmark using a shared dataset. In Phase 2, the top teams are selected and supported in iterative rollout collection to further improve their policies via post-training.

Phase 1 — Evaluation Tracks

Phase 1 evaluates submitted policies on 3–5 standardized real-robot tasks across two ranking tracks. Teams perform offline training on the released dataset (expert data + baseline success and failure rollouts) and submit policies for benchmark evaluation.

Single-Task Track

Policies are evaluated and ranked on each task independently. Best for specialists optimizing for individual task performance.

Multi-Task Track

A single policy is evaluated jointly across all tasks. Best for generalist policies that share representations across skills.

Task Samples & Scoring

Phase 1 includes three real-robot bimanual manipulation tasks. Select a task below to view a sample rollout video and its scoring criteria.

Scoring Criteria · insert-mouse-battery
  • Place the mouse in the center of the table with the battery slot facing right. +0.4
  • Insert the battery in the correct polarity, but not fully inserted. +0.4
  • Battery is fully inserted. +0.2
Steps are cumulative — completing the final step yields a total score of 1.0.
Left wrist
Top
Right wrist
Dataset

For Phase 1, we release a standardized real-robot bimanual dataset designed for offline training. The dataset contains four complementary components:

Standardized Real-Robot Bimanual Dataset
Expert Data

High-quality human teleoperation demonstrations on the benchmark tasks.

Baseline Success Rollouts

Trajectories where a baseline policy successfully completed the task.

Baseline Failure Rollouts

Trajectories where the baseline policy failed — useful negative signal for post-training.

Human-in-the-Loop Data

Human interventions, corrections, and preference labels collected during baseline rollouts.

All four components are intended for offline training in Phase 1. Hosted on Hugging Face Datasets.

Download on Hugging Face
Tutorial
How to Participate

Step-by-step instructions for joining the challenge — including environment setup, dataset access, baseline reproduction, evaluation protocol, and submission format — are hosted in our GitHub repositories. Reference code and starter scripts are provided so teams can get up and running quickly.

Phase 2 — Iterative Improvement

Based on Phase 1 results, the top 3 teams advance to Phase 2. During this round, selected teams collect rollouts by deploying their own policies and use those rollouts to further improve performance via post-training.

  • Top 3 teams selected from Phase 1 ranking
  • Iterative rollout collection supported by the organizers
  • Final policies presented at the workshop @ RSS 2026
Schedule
Key Dates
Now → May 31, 2026
Team registration open
Now → June 10, 2026
Phase 1 evaluation window (may be extended if necessary)
Early June, 2026
Top 3 teams announced
June 10 – July 5, 2026
Phase 2 iterative improvement
July 13, 2026
Workshop @ RSS — team reports & panel
Phases
  • Registration — team sign-up and track selection
  • Phase 1: Ranking — single-task & multi-task evaluation
  • Phase 2: Iterative Improvement — top 3 teams
  • Workshop @ RSS — team presentations and panel discussion
Awards
💰 $20,000+ Total Prize Pool

Listed prizes apply to each track (Single-Task & Multi-Task).

🥇
1st Place
$5,000
🥈
2nd Place
$3,000
🥉
3rd Place
$2,000
🏅
4th – 10th
$500 each
Top-performing teams will also be invited to give a presentation at the workshop.
Practical issues, lessons, and experiences from the challenge will be compiled into a technical report shared with the community.
Leaderboard
Results are reported separately for the two challenge rounds: Phase 1 (final benchmark evaluation of all submitted policies) and Phase 2 (iterative improvement by the top teams). Ranking is by Average Success Rate first, with Average Progress Score as the tie-breaker.

Phase 2 teams deploy their own policies to collect rollouts and improve them iteratively via post-training. Every iteration (iter 1–3) is evaluated on the same three tasks and reported below, with each team's Phase 1 result shown as the baseline. The table is updated as new iterations are evaluated.

# Team / Model Run insert-mouse-battery tower-of-hanoi-game seal-water-bottle-cap Average
ScoreSR ScoreSR ScoreSR ScoreSR
🥇1
Haruki
U-Tokyo
trials: 10 / 10 / 10
Phase 1 9090% 6650% 9090% 8276.7%
2
Haruki
U-Tokyo
trials: 15 / 15 / 12
iter 2 100100% 6350% 6060% 74.370%
🥈3
VLAlab-JP
trials: 15 / 11 / 15
iter 1 8670% 6360% 5750% 68.760%
🥉4
PengfangQian
Fudan & SII
trials: 10 / 10 / 10
Phase 1 9090% 3330% 8060% 67.760%
5
VLAlab-JP
trials: 10 / 10 / 10
Phase 1 100100% 4040% 3030% 56.756.7%
6
Zhangyu
Tsinghua
trials: 10 / 10 / 10
Phase 1 8670% 5950% 3830% 6150%
7
Haruki
U-Tokyo
trials: 15 / 15 / 15
iter 1 7470% 6360% 3920% 58.750%
8
Zhangyu
Tsinghua
trials: 15 / 15 / 15
iter 1 100100% 3630% 3120% 55.750%
9
PengfangQian
Fudan & SII
trials: 15 / 15 / 10
iter 2 160% 5650% 5350% 41.733.3%
10
VLAlab-JP
trials: 12 / 12 / 12
iter 3 6840% 00% 5550% 4130%
11
VLAlab-JP
trials: 15 / 10 / 15
iter 2 4020% 90% 7260% 40.326.7%
Not fully evaluated — tasks with fewer than 10 rollouts count as 0 in the average
PengfangQian
Fudan & SII
trials: 15 / 15 / —
iter 3 9490% 5840% 50.743.3%
Zhangyu
Tsinghua
trials: 10 / 10 / —
iter 2 9280% 30% 31.726.7%
Haruki
U-Tokyo
trials: — / 12 / 12
iter 3 3010% 7460% 34.723.3%
PengfangQian
Fudan & SII
trials: 11 / 14 / 4
iter 1 20% 30% 2525% 1.70%
Zhangyu
Tsinghua
trials: — / 10 / —
iter 3 00% 00%

Each row is one evaluated run: a team's Phase 1 baseline or a Phase 2 iteration (iter 1–3). Score / SR are computed over the first 10 evaluation rollouts per task; rollouts beyond 10 serve only as a tie-breaker. Ranking is by Average SR, then Average Score. Medals (🥇🥈🥉) mark the top-3 teams, placed on each team's best run. Runs below the divider were not fully evaluated — tasks with fewer than 10 rollouts (or not evaluated, ) count as 0 in the average.

Registration

Team registration is now open. Please fill in the Google Form below with your team information and track preference. Submission instructions will be shared with registered teams.

Register your team

Invited Speakers

Karl Pertsch

Physical Intelligence

Abhishek Gupta

University of Washington

Jianlan Luo

Shanghai Innovation Institute


Invited Talks
Karl Pertsch
Post-Training Policies without Post-Training
Karl Pertsch · Physical Intelligence

Abstract. Traditionally, policy training pipelines are split into two phases: a pre-training phase, that instills generalization, and a post-training phase, that tunes for maximum performance. The best post-trained policies are often created through skillful data curation, which discards a large fraction of the available training data and leaves a lot of robustness on the table. In this talk, I will discuss our recent work on achieving post-training performance without post-training in the pi07 model. Through careful conditioning of the pre-training process, we can train policies that match the performance of our best post-training pipelines, while retaining the full generality of the pre-training process.

Bio. Karl Pertsch is a member of the technical staff at Physical Intelligence. Before, he was a postdoc at UC Berkeley and Stanford, and obtained his PhD from USC. His work focuses on building generalist robot policies that can solve a wide range of physical manipulation tasks in the real world. His work has been awarded the Best Conference Paper Award at ICRA'24, two Outstanding Paper Awards Finalists at CoRL'24, and a Best Paper Finalist at RSS'25.

Abhishek Gupta
What can simulation do for robotic post-training?
Abhishek Gupta · University of Washington

Abstract. Robotic post-training via reinforcement learning, while promising, has yet to see the same success that has been observed in domains like large language modeling. There is a considerable difference in assumptions in post-training between the robotics and language domains, making many standard RL algorithms ineffective. We posit that using simulation for post-training in a real-to-sim-to-real loop can bridge this gap, allowing for cheap, fast data collection for post-training. But the use of simulation for post-training must contend with the inevitable gap between imperfect simulation and reality, both from real-to-sim and from sim-to-real. We will present a simple way to bridge this gap, enabling post-training via RL to significantly improve the success rate, throughput and robustness of robotic foundation models. We will end with broader perspectives on the role of simulation in post-training of generalist robotic policies.

Bio. Abhishek Gupta is an assistant professor in the Paul G. Allen School of Computer Science and Engineering at the University of Washington since 2022. He leads the Washington Embodied Intelligence and Robotics Development lab focusing on robot learning and reinforcement learning. Previously, he was a postdoctoral scholar at MIT, collaborating with Russ Tedrake and Pulkit Agrawal. Prior to that he received his Ph.D. and B.S. degrees from UC Berkeley, working with Sergey Levine and Pieter Abbeel. Abhishek is the recipient of the IEEE RAS Early Career Award, the Toyota Research Institute Young Investigator award and an Amazon Science Hub award, along with award nominations at several top conferences and workshops. His research interests lie in scalable reinforcement learning methods for robot learning, in particular methods for continual adaptation in the real world.

Jianlan Luo
Robotic Foundation Models That Learn While Deploying
Jianlan Luo · Shanghai Innovation Institute

Abstract. Robotic foundation models are emerging as a scalable path toward generalist robots. Large-scale pretraining provides the foundation for broad representations and initial capabilities, while post-training on real-world deployment experience refines and expands these capabilities toward reliable operation. In this talk, I will present a closed-loop approach to physical AI through two complementary efforts. First, I will introduce tau-0, an open-source robot foundation model trained on diverse robot and non-robot data to learn predictive representations of physical interactions. Second, I will discuss Learning While Deploying, a framework that turns deployment into a continual post-training process, converting real-world successes and failures into policy improvement through real-world learning. Together, these components form a data flywheel for physical AI: pretrain from large-scale diverse data, deploy in real environments, learn from interaction, and continuously improve robot capabilities through real-world experience.

Bio. Jianlan Luo is an Associate Professor at the Shanghai Innovation Institute and Chief Scientist at AGIBOT. He received his Ph.D. from the University of California, Berkeley. After completing his Ph.D., he worked as a researcher at Google before returning to UC Berkeley as a postdoctoral scholar. His research focuses on building principled and scalable robotic learning systems that enable reliable, high-performance behavior in complex real-world environments. His work has been recognized by honors including MIT Technology Review's TR35 China, and has been featured in media outlets including WIRED, TechCrunch and more.


Schedule

July 13, 2026 · 8:30 – 12:30 (Sydney time, AEST)

Time Event
8:30 - 8:40 Opening Remarks
8:40 - 9:10 Invited Talk 1 · Karl Pertsch
9:10 - 9:40 Invited Talk 2 · Abhishek Gupta
9:40 - 10:10 Invited Talk 3 · Jianlan Luo
10:10 - 10:40 Coffee Chat & Sponsor Showcase
10:40 - 11:40 Participating Team Presentations
11:40 - 12:10 Panel Discussion & Audience Q&A
12:10 - 12:30 Closing & Summary

Discussion Topics

Discussion topics for this workshop include, but are not limited to:

Post-Training Paradigms for Robotics Foundation Models
Efficient Post-Training System Design
Q-function and Value Function Learning
Human-in-the-Loop and Feedback-Driven Methods
Learning from Human Videos
Continual Post-Training and Catastrophic Forgetting
Real-Robot Evaluation and Deployment Constraints
Robustness and Generalization under Distribution Shift
Safety and Alignment in Robotics Post-Training

Organizers

Shiduo Zhang

Fudan University · WorldEngine

Yue Wang

University of Southern California

Haonan Chang

WorldEngine

Hang Zhao

Tsinghua University

Yicheng Liu

Tsinghua University

Vitor Guizilini

Toyota Research Institute

Andrew Wagenmaker

UC Berkeley

Anushri Dixit

University of California, Los Angeles

Chao Yu

Tsinghua University

Dhruv Shah

Princeton University

Max Simchowitz

Carnegie Mellon University


Industry Partners



Citation

If you use this dataset or reference the challenge in your research, please cite us:

@misc{posttraining_robotics_2026,
  title        = {Post-Training for Robotics Foundation Models Dataset and Challenge},
  author       = {Zhang, Shiduo and Wang, Yue and Chang, Haonan and Zhao, Hang and
                  Liu, Yicheng and Guizilini, Vitor and Bobu, Andreea and Wagenmaker, Andrew and
                  Dixit, Anushri and Yu, Chao and Shah, Dhruv and Simchowitz, Max},
  year         = {2026},
  howpublished = {RSS 2026 Workshop & Challenge},
  url          = {https://posttraining-for-robotics.github.io}
}

Contact

For any questions about the workshop or the challenge, please reach out to:

Shiduo Zhang · sdzhang23@m.fudan.edu.cn