中国邮电高校学报(英文) ›› 2011, Vol. 18 ›› Issue (1): 105-112.doi: 10.1016/S1005-8885(10)60035-0

• Others • 上一篇    下一篇

3D augmented reality teleoperated robot system based on dual vision

高欣1,胡欢2,贾庆轩2,孙汉旭2,宋荆洲2   

  1. 1. 北京邮电大学
    2.
  • 收稿日期:2010-08-19 修回日期:2010-11-15 出版日期:2011-02-28 发布日期:2011-02-28
  • 通讯作者: 高欣 E-mail: xlhhh74@bupt.edu.cn
  • 基金资助:

    国家自然科学基金;中央高校基本科研业务费资助

3D augmented reality teleoperated robot system based on dual vision

  • Received:2010-08-19 Revised:2010-11-15 Online:2011-02-28 Published:2011-02-28
  • Contact: Xin GAO E-mail: xlhhh74@bupt.edu.cn

摘要:

A 3D augmented reality navigation system using stereoscopic images is developed for teleoperated robot systems. The accurate matching between the simulated model and the video image of the actual robot can be realized, which helps the operator to accomplish the remote control task correctly and reliably. The system introduces the disparity map translation transformation method to take parallax images for stereoscopic displays, providing the operator an immersive 3D experience. Meanwhile, a fast and accurate registration method of dynamic stereo video is proposed, and effective integration of a virtual robot and the real stereo scene can be achieved. Preliminary experiments show that operation error of the system is maintained at less than 2.2 mm and the average error is 0.854 7, 0.909 3 and 0.697 2 mm at x, y, z direction respectively. Lots of experiments such as pressing the button, pulling the drawer and so on are also conducted to evaluate the performance of the system. The feasibility studies show that the depth information of structure can be rapidly and recognized in remote environment site. The augmented reality of the image overlay system could increase the operating accuracy and reduce the procedure time as a result of intuitive 3D viewing.

关键词:

teleoperated robotic system, augmented reality, immersive interface, stereo display, binocular registration

Abstract:

A 3D augmented reality navigation system using stereoscopic images is developed for teleoperated robot systems. The accurate matching between the simulated model and the video image of the actual robot can be realized, which helps the operator to accomplish the remote control task correctly and reliably. The system introduces the disparity map translation transformation method to take parallax images for stereoscopic displays, providing the operator an immersive 3D experience. Meanwhile, a fast and accurate registration method of dynamic stereo video is proposed, and effective integration of a virtual robot and the real stereo scene can be achieved. Preliminary experiments show that operation error of the system is maintained at less than 2.2 mm and the average error is 0.854 7, 0.909 3 and 0.697 2 mm at x, y, z direction respectively. Lots of experiments such as pressing the button, pulling the drawer and so on are also conducted to evaluate the performance of the system. The feasibility studies show that the depth information of structure can be rapidly and recognized in remote environment site. The augmented reality of the image overlay system could increase the operating accuracy and reduce the procedure time as a result of intuitive 3D viewing.

Key words:

teleoperated robotic system, augmented reality, immersive interface, stereo display, binocular registration