Shannon's Theory

Duane A. Bailey
We discuss the theory of information, due to Claude Shannon. This theory suggests that the notions of entropy, uncertainty, randomness, and information are all interrelated.
Outline of this class (resources are below)
  1. Monty Hall and his problem.
  2. Simple notion: the bit (Tukey)
  3. Shannon's theory.
  4. Shannon's Mind Reading Machine.
  5. Boltzmann's entropy, and how it's related.
  6. Compression: How much wood could a woodchuck chuck?
Resources needed for this class: These items require Acrobat Reader.
These items are Java applets, and require Java to be installed on your machine.