The mathematical study of quantifying, compressing, and reliably transmitting information.
Shannon Entropy