We propose a simple drag-and-drop interface on a touch screen to give instructions to an object-delivery robot. The user uses a finger to drag a target object and drop it to a target location on the screen that shows an image of the floor provided by a ceiling camera. The system then autonomously executes a delivery task without continuous control by the user. We employ user-guided computer vision methods to identify and track an object in a scene without prior registration. We conducted a user study, which showed that the participants completed separate tasks more successfully when using our method than when using a remote controller.
Kentaro Ishii, Yoshiki Takeoka, Masahiko Inami, Takeo Igarashi.
Drag-and-Drop Interface for Registration-Free Object Delivery.
The 19th IEEE International Symposium on Robot and Human Interactive Communication, RO-MAN2010, pp.228-233, September 2010.
[PDF] [Video]