This covers the principles of entropy and information theory and their application in statistical mechanics.