Examveda

What is the entropy of a communication system that consists of six messages with probabilities $$\frac{1}{8},\,\frac{1}{8},\,\frac{1}{8},\,\frac{1}{4}$$   and $$\frac{1}{4}$$ respectively?

A. 1 bit/message

B. 2.5 bits/message

C. 3 bits/message

D. 4.5 bits/message

Answer: Option B


Join The Discussion

Related Questions on Information Theory and Coding