Information Theory Through Toy Examples

An illustrated introduction to the intuition, terminology, & math behind information theory. Elucidates entropy & information through application to dice rolling (independent variables) and the interplay between readings from ambient outdoor light & precipitation meters (dependent variables).