<abstract xmlns="http://www.w3.org/1999/xhtml">

<p>Introducing variation in the training dataset through data augmentation has been a popular technique to make Convolutional Neural Networks (CNNs) spatially invariant but leads to increased dataset volume and computation cost. Instead of data augmentation, augmentation of feature maps is proposed to introduce variations in the features extracted by a CNN. To achieve this, a rotation transformer layer called Rotation Invariance Transformer (RiT) is developed, which applies rotation transformation to augment CNN features. The RiT layer can be used to augment output features from any convolution layer within a CNN. However, its maximum effectiveness is shown when placed at the output end of final convolution layer. We test RiT in the application of scale-invariance where we attempt to classify scaled images from benchmark datasets. Our results show promising improvements in the networks ability to be scale invariant whilst keeping the model computation cost low.</p>
</abstract>

Introducing variation in the training dataset through data augmentation has been a popular technique to make Convolutional Neural Networks (CNNs) spatially invariant but leads to increased dataset volume and computation cost. Instead of data augmentation, augmentation of feature maps is proposed to introduce variations in the features extracted by a CNN. To achieve this, a rotation transformer layer called Rotation Invariance Transformer (RiT) is developed, which applies rotation transformation to augment CNN features. The RiT layer can be used to augment output features from any convolution layer within a CNN. However, its maximum effectiveness is shown when placed at the output end of final convolution layer. We test RiT in the application of scale-invariance where we attempt to classify scaled images from benchmark datasets. Our results show promising improvements in the networks ability to be scale invariant whilst keeping the model computation cost low.

Feature Map Augmentation to Improve Scale Invariance in Convolutional Neural Networks

Journal of Artificial Intelligence and Soft Computing Research

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

Introducing variation in the training dataset through data augmentation has been a popular technique to make Convolutional Neural Networks (CNNs) spatially...

Feature Map Augmentation to Improve Scale Invariance in Convolutional Neural Networks

Publicado en línea: 28 nov 2022

Páginas: 51 - 74

Recibido: 21 feb 2022

Aceptado: 19 oct 2022

DOI: https://doi.org/10.2478/jaiscr-2023-0004

Palabras clave
Convolutional Neural Network, Feature Map Augmentation, Global Features, Scale-Invariant, Vision System

© 2023 Dinesh Kumar et al., published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

Feature Map Augmentation to Improve Scale Invariance in Convolutional Neural Networks

Publicado en línea: 28 nov 2022

Páginas: 51 - 74

Recibido: 21 feb 2022

Aceptado: 19 oct 2022

DOI: https://doi.org/10.2478/jaiscr-2023-0004

Palabras claveConvolutional Neural Network, Feature Map Augmentation, Global Features, Scale-Invariant, Vision System

© 2023 Dinesh Kumar et al., published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

Palabras clave
Convolutional Neural Network, Feature Map Augmentation, Global Features, Scale-Invariant, Vision System