<abstract xmlns="http://www.w3.org/1999/xhtml"><p>Visual information is very important in human communication. It is used in any type of sign language communication, and in non-verbal communication of the entire population, as well. Therefore, visual information is crucial for communication of hearing impaired people. Video is the most common way to capture this type of information and it is very important to correctly process it. In this paper we propose a method for finding video frames representing single sign in the finger alphabet. The single sign is identified using standard video quality metrics. The calculations of the metrics are performed only within a region, which is determined by combination of object tracking and salient regions detection method based on human visual attention. For key frame selection, combination of sliding system for finding local extreme and adaptive threshold based on local averaging and variation is used. Proposed method is effective and achieves significantly better results in comparison with other commonly used methods.</p></abstract>

Visual information is very important in human communication. It is used in any type of sign language communication, and in non-verbal communication of the entire population, as well. Therefore, visual information is crucial for communication of hearing impaired people. Video is the most common way to capture this type of information and it is very important to correctly process it. In this paper we propose a method for finding video frames representing single sign in the finger alphabet. The single sign is identified using standard video quality metrics. The calculations of the metrics are performed only within a region, which is determined by combination of object tracking and salient regions detection method based on human visual attention. For key frame selection, combination of sliding system for finding local extreme and adaptive threshold based on local averaging and variation is used. Proposed method is effective and achieves significantly better results in comparison with other commonly used methods.

Detection of Frames With Single Complete Signs of Finger Alphabet in Video Sequence Using Visual Attention Approach

Department of Applied Informatics, Comenius University in Bratislava, Mlynsk´a Dolina, 842 48 Bratislava, Slovakia

Institute of Telecommunications, Slovak University of Technology in Bratislava, Ilkoviˇcova 3, 812 19 Bratislava, Slovakia

Journal of Electrical Engineering

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

Visual information is very important in human communication. It is used in any type of sign language communication, and in non-verbal communication of the...

Detection of Frames With Single Complete Signs of Finger Alphabet in Video Sequence Using Visual Attention Approach

Publié en ligne: 14 juil. 2015

Pages: 142 - 148

Reçu: 17 déc. 2014

DOI: https://doi.org/10.2478/jee-2015-0022

© Faculty of Electrical Engineering and Information Technology, Slovak University of Technology

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.