Shannon thought that the information content of anything can be measured in bits. To write a number N in bits, we need to take a log base 2 of N.

Note that thermodynamic “entropy” and the “entropy” in information theory both capture increasing randomness.