<abstract xmlns="http://www.w3.org/1999/xhtml">

<p>Introducing variation in the training dataset through data augmentation has been a popular technique to make Convolutional Neural Networks (CNNs) spatially invariant but leads to increased dataset volume and computation cost. Instead of data augmentation, augmentation of feature maps is proposed to introduce variations in the features extracted by a CNN. To achieve this, a rotation transformer layer called Rotation Invariance Transformer (RiT) is developed, which applies rotation transformation to augment CNN features. The RiT layer can be used to augment output features from any convolution layer within a CNN. However, its maximum effectiveness is shown when placed at the output end of final convolution layer. We test RiT in the application of scale-invariance where we attempt to classify scaled images from benchmark datasets. Our results show promising improvements in the networks ability to be scale invariant whilst keeping the model computation cost low.</p>
</abstract>

Introducing variation in the training dataset through data augmentation has been a popular technique to make Convolutional Neural Networks (CNNs) spatially invariant but leads to increased dataset volume and computation cost. Instead of data augmentation, augmentation of feature maps is proposed to introduce variations in the features extracted by a CNN. To achieve this, a rotation transformer layer called Rotation Invariance Transformer (RiT) is developed, which applies rotation transformation to augment CNN features. The RiT layer can be used to augment output features from any convolution layer within a CNN. However, its maximum effectiveness is shown when placed at the output end of final convolution layer. We test RiT in the application of scale-invariance where we attempt to classify scaled images from benchmark datasets. Our results show promising improvements in the networks ability to be scale invariant whilst keeping the model computation cost low.

Feature Map Augmentation to Improve Scale Invariance in Convolutional Neural Networks

Journal of Artificial Intelligence and Soft Computing Research

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

Introducing variation in the training dataset through data augmentation has been a popular technique to make Convolutional Neural Networks (CNNs) spatially...

Feature Map Augmentation to Improve Scale Invariance in Convolutional Neural Networks

Published Online: Nov 28, 2022

Page range: 51 - 74

Received: Feb 21, 2022

Accepted: Oct 19, 2022

DOI: https://doi.org/10.2478/jaiscr-2023-0004

Keywords
Convolutional Neural Network, Feature Map Augmentation, Global Features, Scale-Invariant, Vision System

© 2023 Dinesh Kumar et al., published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

Feature Map Augmentation to Improve Scale Invariance in Convolutional Neural Networks

Published Online: Nov 28, 2022

Page range: 51 - 74

Received: Feb 21, 2022

Accepted: Oct 19, 2022

DOI: https://doi.org/10.2478/jaiscr-2023-0004

KeywordsConvolutional Neural Network, Feature Map Augmentation, Global Features, Scale-Invariant, Vision System

© 2023 Dinesh Kumar et al., published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

Keywords
Convolutional Neural Network, Feature Map Augmentation, Global Features, Scale-Invariant, Vision System