<abstract xmlns="http://www.w3.org/1999/xhtml">

<p>The capsule network has good spatial recognition and has good accuracy in classification and recognition tasks. However, because of the dynamic routing algorithm in the capsule network, the training speed of the capsule network is slow. In order to make better use of the capsule network, reduce For its training cost, this paper proposes a capsule network based on the attention mechanism, and adds the CBAM attention module to the original capsule network to improve the network’s ability to extract information in the feature map channel and information in the feature map space, and improve the network’s learning ability, To reduce the number of network training, thereby reducing the cost of training. This paper conducts experiments based on the original neural network to verify the effectiveness and feasibility of adding the CBAM module to the capsule network. The final result is that the CBAM module can speed up the convergence speed of the capsule network by 50%.</p>
</abstract>

The capsule network has good spatial recognition and has good accuracy in classification and recognition tasks. However, because of the dynamic routing algorithm in the capsule network, the training speed of the capsule network is slow. In order to make better use of the capsule network, reduce For its training cost, this paper proposes a capsule network based on the attention mechanism, and adds the CBAM attention module to the original capsule network to improve the network’s ability to extract information in the feature map channel and information in the feature map space, and improve the network’s learning ability, To reduce the number of network training, thereby reducing the cost of training. This paper conducts experiments based on the original neural network to verify the effectiveness and feasibility of adding the CBAM module to the capsule network. The final result is that the CBAM module can speed up the convergence speed of the capsule network by 50%.

Research on Capsule Network Based on Attention Mechanism

International Journal of Advanced Network, Monitoring and Controls

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

{"article-title":"Research on Capsule Network Based on Attention Mechanism"}

The capsule network has good spatial recognition and has good accuracy in classification and recognition tasks. However, because of the dynamic routing...

Research on Capsule Network Based on Attention Mechanism

Published Online: Feb 21, 2022

Page range: 1 - 8

DOI: https://doi.org/10.21307/ijanmc-2021-011

Keywords
Component, Capsule Net, CBAM, Attention

© 2021 Yan Jiao et al; published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Research on Capsule Network Based on Attention Mechanism

Published Online: Feb 21, 2022

Page range: 1 - 8

DOI: https://doi.org/10.21307/ijanmc-2021-011

KeywordsComponent, Capsule Net, CBAM, Attention

© 2021 Yan Jiao et al; published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Keywords
Component, Capsule Net, CBAM, Attention