We will read, carefully and back to back, David
MacKay's 'Information Theory, Inference, and Learning Algorithms '.
Note that this is a book on (among other things) information theory
proper, not on the philosophy of information. On the other hand, being
conversant with information theory is an increasingly important skill
for people working, at least, on the philosophies of mind and language.
We'll work through end-of-chapter exercises, etc., and, in general, will
not shy away from the math; but we'll also make sure that anyone
interested, regardless of previous background, is able to tag along.