<abstract xmlns="http://www.w3.org/1999/xhtml"><p> This paper demonstrates the possible conclusions which can be drawn from an analysis of entropy and information. Because of its universality, entropy can be widely used in different subjects, especially in biomedicine. Based on simulated data the similarities and differences between the grouping of attributes and testing of their independencies are shown. It follows that a complete exploration of data sets requires both of these elements. A new concept introduced in this paper is that of normed information gain, allowing the use of any logarithm in the definition of entropy.</p></abstract>

This paper demonstrates the possible conclusions which can be drawn from an analysis of entropy and information. Because of its universality, entropy can be widely used in different subjects, especially in biomedicine. Based on simulated data the similarities and differences between the grouping of attributes and testing of their independencies are shown. It follows that a complete exploration of data sets requires both of these elements. A new concept introduced in this paper is that of normed information gain, allowing the use of any logarithm in the definition of entropy.

The use of information and information gain in the analysis of attribute dependencies

Department of Mathematical and Statistical Methods, Poznań University of Life Sciences, Poznań, Poland

Biometrical Letters

This paper demonstrates the possible conclusions which can be drawn from an analysis of entropy and information. Because of its universality, entropy can be...

The use of information and information gain in the analysis of attribute dependencies

Published Online: Aug 17, 2013

Page range: 149 - 158

DOI: https://doi.org/10.2478/bile-2013-0011

This content is open access.