FZI-RECAP is a dataset on remote assistance for automated vehicles, recorded from the perspective of the control center. It contains data from FZI operators supervising an automated shuttle in staged corner cases and a research vehicle in real urban traffic.
The dataset consists of nine mission windows, 25.8 minutes in total. A mission window is a continuous recording of part of an automated drive to a set destination. In eight of them, all on KIT Campus Ost, the vehicle stopped at an obstacle it could not pass within its authorized driving area; the control center resolved each case by approving a detour through operator-defined waypoints, after which the vehicle continued automatically. The ninth window, 7.8 minutes in public traffic in Karlsruhe's Oststadt, contains no intervention and serves as a nominal reference. Two windows also include the vehicle's own recording of the same seconds.
Each window combines vehicle state, occupancy maps, planning data, operator waypoints, the derived remote-operation state, cellular link quality and anonymized front-camera images in one time-aligned ROS 2 bag.