Reduced Error Pruning
Pruning a node consists of removing all subtrees, making it a leaf, and assigning it the most common classification of the associated training examples.
Prune nodes iteratively and greedily: next remove the node that most improves accuracy over the validation set
- but never remove a node that decreases accuracy
A good method if you have lots of cases