Minimum Description Length Principle

72#72 52#52 73#73

52#52 74#74

52#52 75#75 (1)

Interesting fact from information theory:

The optimal (shortest expected coding length) code for an event with probability 76#76 is 77#77 bits.

So interpret (1):

• 78#78 is length of 3#3 under optimal code
• 79#79 is length of 5#5 given 3#3 under optimal code

80#80 prefer the hypothesis that minimizes

81#81