03/11/98 Machine Learning

Table of Contents

03/11/98 Machine Learning

Example

Basic Algorithm

Basic Algorithm (cont.)

What Makes a Good Attribute for Splitting?

How to choose the next attribute

The Entropy (Disorder) of a Collection

Entropy and Information Gain

Expected Information Gain Calculation

Example

Choosing the First Attribute

After the First Iteration

Final Tree

Some Additional Technical Problems

Data Overfitting

Overfitting (continued)

Reduced Error Pruning

Overfitting (continued)

Missing Attribute Values

Example: Fractional Values

Decision Tree Learning

Email: hanks@cs.washington.edu

Home Page: http://www.cs.washington.edu/education/courses/473/

Download presentation source