2015 Information Theory Lecture Notes Brian M. Kurkoski December 11, 2015 2 Contents 1 Measuring Information: Entropy 7 1.1 Entropy and the Horse Race . . . . . . . . . .…
