<abstract xmlns="http://www.w3.org/1999/xhtml">

<p>This paper describes a hand-arm system equipped with optical three-axis tactile sensors and a binocular vision sensor. The vision compensates for the limitations of tactile information and tactile sensing, and vice versa. The tactile sensor can obtain geometrical data as real scale, while image data requires calibration to obtain length as a metric unit. Even if stereovision is used, we cannot obtain sufficient precision. In the evaluation test, the robotic hand equipped with tactile sensors traces an object including convex and concave portions to evaluate edge trace precision. Error of distance obtained by the binocular vision is around ± 10 mm when distance between the camera and object is around 600 mm. When the hand-arm robot touches the convex portion of the object, size data obtained by the vision is modified within ± 0.5 mm accuracy. Since the robotic finger is too thick to touch the bottom of the concave, size data of the concave portion obtained by tactile sensing includes relatively large error of around 4 mm. However, the robot finger can follow the contour with ± 0.5 mm accuracy except for the bottom portion. Therefore, vision sensing is not sufficient for precise edge exploration and modification based on tactile sensing is required.</p></abstract>

This paper describes a hand-arm system equipped with optical three-axis tactile sensors and a binocular vision sensor. The vision compensates for the limitations of tactile information and tactile sensing, and vice versa. The tactile sensor can obtain geometrical data as real scale, while image data requires calibration to obtain length as a metric unit. Even if stereovision is used, we cannot obtain sufficient precision. In the evaluation test, the robotic hand equipped with tactile sensors traces an object including convex and concave portions to evaluate edge trace precision. Error of distance obtained by the binocular vision is around ± 10 mm when distance between the camera and object is around 600 mm. When the hand-arm robot touches the convex portion of the object, size data obtained by the vision is modified within ± 0.5 mm accuracy. Since the robotic finger is too thick to touch the bottom of the concave, size data of the concave portion obtained by tactile sensing includes relatively large error of around 4 mm. However, the robot finger can follow the contour with ± 0.5 mm accuracy except for the bottom portion. Therefore, vision sensing is not sufficient for precise edge exploration and modification based on tactile sensing is required.

Edge Extraction using Image and Three-Axis Tactile Data

International Journal on Smart Sensing and Intelligent Systems

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

{"article-title":"Edge Extraction using Image and Three-Axis Tactile Data"}

This paper describes a hand-arm system equipped with optical three-axis tactile sensors and a binocular vision sensor. The vision compensates for the...

Edge Extraction using Image and Three-Axis Tactile Data

Publié en ligne: 01 sept. 2011

Pages: 508 - 526

Reçu: 12 juin 2011

Accepté: 22 août 2011

DOI: https://doi.org/10.21307/ijssis-2017-454

© 2011 Sukarnur Che Abdullah et al., published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.