Publication detail

Combining Interactive Spatial Augmented Reality with Head-Mounted Display for End-User Collaborative Robot Programming

BAMBUŠEK, D. MATERNA, Z. KAPINUS, M. BERAN, V. SMRŽ, P.

Original Title

Combining Interactive Spatial Augmented Reality with Head-Mounted Display for End-User Collaborative Robot Programming

Type

conference paper

Language

English

Original Abstract

This paper proposes an intuitive approach for collaborative robot end-user programming using a combination of interactive spatial augmented reality (ISAR) and head-mounted display (HMD). It aims to reduce user's workload and to let the user program the robot faster than in classical approaches (e.g. kinesthetic teaching). The proposed approach, where user is using a mixed-reality HMD - Microsoft HoloLens - and touch-enabled table with SAR projected interface as input devices, is compared to a baseline approach, where robot's arms and a touch-enabled table are used as input devices only. Main advantages of the proposed approach are the possibility to program the collaborative workspace without the presence of the robot, its speed in comparison to the kinesthetic teaching and an ability to quickly visualize learned program instructions, in form of virtual objects, to enhance the users' orientation within those programs. The approach was evaluated on a set of 20 users using the within-subject experiment design. Evaluation consisted of two pick and place tasks, where users had to start from the scratch as well as to update the existing program. Based on the experiment results, the proposed approach is better in qualitative measures by 33.84% and by 28.46% in quantitative measures over the baseline approach for both tasks.

Keywords

Spatial Augmented Reality, Head-Mounted Display, Microsoft HoloLens, Collaborative Robots, Robot Programming, Human-Robot Interaction

Authors

BAMBUŠEK, D.; MATERNA, Z.; KAPINUS, M.; BERAN, V.; SMRŽ, P.

Released

15. 6. 2019

Publisher

Institute of Electrical and Electronics Engineers

Location

New Delhi

ISBN

978-1-7281-2622-7

Book

2019 28th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)

Pages from

1

Pages to

9

Pages count

8

URL

https://www.fit.vut.cz/research/publication/12007/

BibTex

@inproceedings{BUT161453,
  author="Daniel {Bambušek} and Zdeněk {Materna} and Michal {Kapinus} and Vítězslav {Beran} and Pavel {Smrž}",
  title="Combining Interactive Spatial Augmented Reality with Head-Mounted Display for End-User Collaborative Robot Programming",
  booktitle="2019 28th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)",
  year="2019",
  pages="1--9",
  publisher="Institute of Electrical and Electronics Engineers",
  address="New Delhi",
  doi="10.1109/RO-MAN46459.2019.8956315",
  isbn="978-1-7281-2622-7",
  url="https://www.fit.vut.cz/research/publication/12007/"
}

Documents

ISAR_HMD.pdf