What is the entropy of a communication system that consists of six messages with probabilities $$\frac{1}{8},\,\frac{1}{8},\,\frac{1}{8},\,\frac{1}{4}$$ and $$\frac{1}{4}$$ respectively?
A. 1 bit/message
B. 2.5 bits/message
C. 3 bits/message
D. 4.5 bits/message
Answer: Option B
Join The Discussion