Technical Brief

Enhanced Whole-Arm Robot Teleoperation Using a Semi-Autonomous Control Policy

[+] Author and Article Information
Hsien-I Lin

Graduate Institute of Automation Technology,
National Taipei University of Technology,
Taipei 10608,Taiwan
e-mail: sofin@ntut.edu.tw

Chi-Li Chen

Graduate Institute of Automation Technology,
National Taipei University of Technology,
Taipei 10608,Taiwan

Contributed by the Dynamic Systems Division of ASME for publication in the JOURNAL OF DYNAMIC SYSTEMS, MEASUREMENT, AND CONTROL. Manuscript received August 2, 2012; final manuscript received December 12, 2013; published online February 19, 2014. Assoc. Editor: Alexander Leonessa.

J. Dyn. Sys., Meas., Control 136(3), 034502 (Feb 19, 2014) (6 pages) Paper No: DS-12-1257; doi: 10.1115/1.4026310 History: Received August 02, 2012; Revised December 12, 2013

Previous work in robot teleoperation focused on the movement of a robot's end-effector by a human operator. However, a lack of pose control in teleoperation resulted in the robot arm frequently colliding with obstacles. Furthermore, even with pose control, it is still difficult for the robot to quickly and accurately move to the target due to mechanical discrepancies between human and robot. This paper proposes a semi-autonomous method to teleoperate the robot arm by integrating whole-arm teleoperation in joint-space control and autonomous end-effector position control. The proposed method is validated through experimental work on a robot arm with 6 degrees of freedom, with results showing significant improvement in human control for reaching for objects safely, quickly, and accurately.

Copyright © 2014 by ASME
Your Session has timed out. Please sign back in to continue.


Arcara, P., and Melchiorri, C., 2002, “Control Schemes for Teleoperation With Time Delay: A Comparative Study,” Robot. and Auton. Syst., 38(1), pp. 49–64. [CrossRef]
Nguyen, H. G., Pezeshkian, N., Gupta, A., and Farrington, N., 2004, “Maintaining Communication Link for a Robot Operating in a Hazardous Environment,” ANS 10th International Conference on Robotics and Remote System for Hazard Environment.
Murphy, R. R., 2005, An Introduction to AI Robotics, The MIT Press, Cambridge, MA.
Kagami, S., Kuffner, J., Nishiwaki, K., Okada, K., Inaba, M., and Inoue, H., 2003, “Humanoid Arm Motion Planning Using Stereo Vision and RRT Search,” Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst., pp. 2167–2172.
Nori, F., Natale, L., Sandini, G., and Metta, G., 2007, “Autonomous Learning of 3d Reaching in a Humanoid Robot,” Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst., pp. 1142–1147.
Stilman, M., Schamburek, J.-U., Kuffner, J., and Asfour, T., 2007, “Manipulation Planning Among Movable Obstacles,” Proc. IEEE Int. Conf. Robot. Autom., pp. 3327–3332.
Hirzinger, G., Brunner, B., Dietrich, J., and Heindl, J., 1993, “Sensor-Based Space Robotics-Rotex and Its Telerobotic Features,” IEEE Trans. Robot. Autom., 9(5), pp. 649–663. [CrossRef]
Oda, M., 2000, “Experiences and Lessons Learned From the Ets-Vii Robot Satellite,” Proc. IEEE Int. Conf. Robot. Autom., pp. 914–919.
Hirukawaa, H., Kanehiroa, F., Kanekoa, K., Kajitaa, S., Fujiwaraa, K., Kawaia, Y., Tomitaa, F., Hiraia, S., Taniea, K., Isozumib, T., Akachib, K., Kawasakib, T., Otab, S., Yokoyamac, K., Handac, H., Fukased, Y., Maedad, J. I., Nakamurae, Y., Tachie, S., and Inoue, H., 2004, “Humanoid Robotics Platforms Developed in HRP,” Robot. and Auton. Syst., 48(4), pp. 165–175. [CrossRef]
Kofman, J., Wu, X., Luu, T. J., and Verma, S., 2005, “Teleoperation of a Robot Manipulator Using a Vision-Based Human-Robot Interface,” IEEE Trans. Ind. Electron., 52(5), pp. 1206–1219. [CrossRef]
Kang, S. B., and Ikeuchi, K., 1997, “Toward Automatic Robot Instruction From Perception Mapping Human Grasps to Manipulator Grasps,” IEEE Trans. Robot. Autom., 13(1), pp. 81–95. [CrossRef]
Nehaniv, C. L., and Dautenhahn, K., 2002, “The Correspondence Problem,” Imitation in Animals and Artifacts, K.Dautenhahn and C. L.Nehaniv, eds., MIT Press, Cambridge, MA, pp. 41–61.
Argall, B. D., Chernovab, S., Veloso, M., and Browninga, B., 2009, “Sensor-Based Space Robotics-Rotex and Its Telerobotic Features,” Robot. and Auton. Syst., 57(5), pp. 469–483. [CrossRef]
Dordevic, G. S., Rasic, M., Kostic, D., and Potkonjak, V., 2000, “Representation of Robot Motion Control Skill,” IEEE Trans. Syst., Man, Cybern. C, 30(2), pp. 219–238. [CrossRef]


Grahic Jump Location
Fig. 1

Control modes of the proposed semi-autonomous system

Grahic Jump Location
Fig. 2

Distance margin of safety controlled by the semi-autonomous control policy, (a) The control points defined by the semi-autonomous control policy, and (b) the distance sections represented by the defined points, A, B, and C

Grahic Jump Location
Fig. 3

State machine of the proposed semi-autonomous control policy

Grahic Jump Location
Fig. 4

Twelve markers placed to capture the human arm motion

Grahic Jump Location
Fig. 5

Task environment. The robot was asked to pick up the apple while avoiding (a) a gray box in experiment A and (b) a transparent box in experiment B

Grahic Jump Location
Fig. 6

Experiment C: robot was asked to pick up the ping-pong ball on the right-hand side and place it in the cup on the other side



Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging and repositioning the boxes below.

Related Journal Articles
Related eBook Content
Topic Collections

Sorry! You do not have access to this content. For assistance or to subscribe, please contact us:

  • TELEPHONE: 1-800-843-2763 (Toll-free in the USA)
  • EMAIL: asmedigitalcollection@asme.org
Sign In