<abstract xmlns="http://www.w3.org/1999/xhtml">

<p>Text is an important invention of humanity, which plays a key role in human life, so far from dark ages. Text in image is closely related to the scene or a product and is widely used in vision based application. In this paper we are addressing the problem of visual understanding with text. The main focus is combining textual cues and visual cues in deep neural network. First the text is recognized and classified from the image. Then we combine the attended word embedding and visual feature vector which are then optimized by CNN for Fine-grained image classification. We carried out the experiments on soft drink dataset in Pakistan. The results shows that the system achieves significant performance which can be potentially beneficial for real world application e.g. product search.</p>
</abstract>

Text is an important invention of humanity, which plays a key role in human life, so far from dark ages. Text in image is closely related to the scene or a product and is widely used in vision based application. In this paper we are addressing the problem of visual understanding with text. The main focus is combining textual cues and visual cues in deep neural network. First the text is recognized and classified from the image. Then we combine the attended word embedding and visual feature vector which are then optimized by CNN for Fine-grained image classification. We carried out the experiments on soft drink dataset in Pakistan. The results shows that the system achieves significant performance which can be potentially beneficial for real world application e.g. product search.

Using Text and Visual Cues for Fine-Grained Classification

International Journal of Advanced Network, Monitoring and Controls

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

{"article-title":"Using Text and Visual Cues for Fine-Grained Classification"}

Text is an important invention of humanity, which plays a key role in human life, so far from dark ages. Text in image is closely related to the scene or a...

Using Text and Visual Cues for Fine-Grained Classification

Published Online: Feb 22, 2021

Page range: 42 - 49

DOI: https://doi.org/10.21307/ijanmc-2021-026

Keywords
Scene Text, Product Text, Fine-Grained Classification, Convolution Neural Network, Attention, Product Search

© 2021 Zaryab Shaker et al., published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Figure 1.

Figure 2.

Figure 3.

Figure 4.

Using Text and Visual Cues for Fine-Grained Classification

Published Online: Feb 22, 2021

Page range: 42 - 49

DOI: https://doi.org/10.21307/ijanmc-2021-026

KeywordsScene Text, Product Text, Fine-Grained Classification, Convolution Neural Network, Attention, Product Search

© 2021 Zaryab Shaker et al., published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Figure 1.

Figure 2.

Figure 3.

Figure 4.

Keywords
Scene Text, Product Text, Fine-Grained Classification, Convolution Neural Network, Attention, Product Search