Entropy after a split

• Let X be an attribute with n possible values.

• Let Tj be the examples that have the value j for attribute X.Average entropy that results from making split on X:infoX(T) = __ ( |Ti| / |T| ) * info(Ti), sum over n possible values of X.

Previous slide

Next slide

Back to first slide

View graphic version