Chapter 6 Entropy and Shannon’s First Theorem. Information Existence: I(p) = log_( 1 / p ) units of information: in base 2 = a bit in basee = a nat in.
