Information (Entropy)
Let T be a set of examples
Let C1, C2, Ö, Cn be class labels
freq(Ci,T) = number of examples in T that belong to class Ci.
|T| = number of examples in T
Select example and announce its class:
info = - log2 freq(Ci,T)/|T|
Previous slide
Next slide
Back to first slide
View graphic version