Information Theory - History of information theory, Quantities of information, Entropy (information theory), Joint entropy, Conditional entropy, Mutual information, Kullbacku2013Leibler divergence, Coding theory, Noisy-channel coding theorem, Entropy in thermodynamics and information theory, Intelligence (information gathering)