The study of quantifying and transmitting information, including measures such as entropy and mutual information.