Human-robot interaction and tracking using low cost 3D vision systems
Keywords:
low cost vision system, Kalman filter, augmented reality, kinematics, human-machine interactionAbstract
This paper describes a platform which allows humans to interact with robotic arms using augmented reality. Low cost “kinect” cameras (Xbox 360) are used for tracking human skeletons and locations of robot’s end effectors. The main goal of this paper is to develop robust trackers on this platform. Concretely, a Kalman filter is used for tracking robotic arms using data received from these sensors. It comes to finding a low cost platform for human-robot interactions.
References
S. Domínguez, E. Zalama and J. Gomez, Desarrollo de una cabeza robótica con capacidad de seguimiento visual e identificación de personas, XXVI, Jornadas de automática, 2005.
J. Gonzalez, C. Galindo, J.A. Fernandez, J.L. Blanco, A. Muñoz and V. Arevalo, La silla robótica SENA. Un enfoque basado en la interacción hombre-máquina, Revista Iberoamericana de Automática e Informática Industrial, 2008, pp. 38-47.
J. Kruger, T.K. Lien and A. Verl, Cooperation of human and machines in assembly lines, CIRP Annals-Manufacturing Technology, 2009, pp. 628-646.
F. Ramirez, Avances en interacción hombre-máquina ECIPERU Revista del encuentro científico internacional, 2010, pp. 29-36.
E. Olmos, M. Bosch and A. Sánchez, Programación de Robots a través de XML, XXX, Jornadas de Automática, Valladolid, España, 2009.
J.L. Posadas, P. Pérez, J.E. Simó, G. Benet and F. Blanes, Communications Structure for Sensory Data in Mobile Robots, Engineering Applications of Artificial Intelligence, 15, 3, pp. 341- 350, 2002.
* * *, Prime Sensor™ NITE 1.3 Algorithms notes. http://www.primesense.com.
* * *, PrimeSense TM. NITE Controls User Guide. http://www.primesense.com.
Burrus, Nicolas, Kinect calibration, 2011; URL:http://nicolas.burrus.name/index.php/research/ kinectcalibration.
* * *, MatLab: http://www.mathworks.es/products/matlab/index.html (November, 2011).
Greg Welch and Gary Bishop, An Introduction to the Kalman Filter, Design, 7, 1, 1-16, 2001.
T. Itoh, K. Kosuge, and T. Fukuda, Human-machine cooperative telemanipulation with motion and force scaling using task-oriented virtual tool dynamics, IEEE Transactions on Robotics and Automation, 16, 5, 505-516, 2000.
F. Leishman, O. Horn, and G. Bourhis, Smart wheelchair control through a deictic approach, Robotics and Autonomous Systems, 58, 10, 1149-1158, 2010.
Published
Issue
Section
Copyright (c) 2020 The Romanian Journal of Technical Sciences. Applied Mechanics.
This work is licensed under a Creative Commons Attribution 4.0 International License.