Template:Information theory

Information theory
Entropy Differential entropy Conditional entropy Joint entropy Mutual information Conditional mutual information Entropy rate
Asymptotic equipartition property Rate–distortion theory
Shannon's source coding theorem Noisy-channel coding theorem