<abstract xml:lang="en" xmlns="http://www.w3.org/1999/xhtml"><p>In this paper the Sigma-if artificial neural network model is considered, which is a generalization of an MLP network with sigmoidal neurons. It was found to be a potentially universal tool for automatic creation of distributed classification and selective attention systems. To overcome the high nonlinearity of the aggregation function of Sigma-if neurons, the training process of the Sigma-if network combines an error backpropagation algorithm with the self-consistency paradigm widely used in physics. But for the same reason, the classical backpropagation delta rule for the MLP network cannot be used. The general equation for the backpropagation generalized delta rule for the Sigma-if neural network is derived and a selection of experimental results that confirm its usefulness are presented.</p></abstract>

In this paper the Sigma-if artificial neural network model is considered, which is a generalization of an MLP network with sigmoidal neurons. It was found to be a potentially universal tool for automatic creation of distributed classification and selective attention systems. To overcome the high nonlinearity of the aggregation function of Sigma-if neurons, the training process of the Sigma-if network combines an error backpropagation algorithm with the self-consistency paradigm widely used in physics. But for the same reason, the classical backpropagation delta rule for the MLP network cannot be used. The general equation for the backpropagation generalized delta rule for the Sigma-if neural network is derived and a selection of experimental results that confirm its usefulness are presented.

Backpropagation generalized delta rule for the selective attention Sigma-if artificial neural network

Institute of Informatics, Wrocław University of Technology, Wyb. Wyspiańskiego 27, 50-370 Wrocław, Poland

International Journal of Applied Mathematics and Computer Science

In this paper the Sigma-if artificial neural network model is considered, which is a generalization of an MLP network with sigmoidal neurons. It was found to...

Backpropagation generalized delta rule for the selective attention Sigma-if artificial neural network

Publié en ligne: 28 juin 2012

Pages: 449 - 459

DOI: https://doi.org/10.2478/v10006-012-0034-5

Mots clés
artificial neural networks, selective attention, self consistency, error backpropagation, delta rule

This content is open access.

Backpropagation generalized delta rule for the selective attention Sigma-if artificial neural network

Publié en ligne: 28 juin 2012

Pages: 449 - 459

DOI: https://doi.org/10.2478/v10006-012-0034-5

Mots clésartificial neural networks, selective attention, self consistency, error backpropagation, delta rule

This content is open access.

Mots clés
artificial neural networks, selective attention, self consistency, error backpropagation, delta rule