Consider a source with four symbols. The entropy of the source will be maximum when probabilities of occurrence of symbols are:
A. $$\left\{ {1,\,0,\,0,\,0} \right\}$$
B. $$\left\{ {\frac{1}{4},\,\frac{1}{4},\,\frac{1}{4},\,\frac{1}{4}} \right\}$$
C. $$\left\{ {\frac{1}{2},\,\frac{1}{4},\,\frac{1}{8},\,\frac{1}{8}} \right\}$$
D. $$\left\{ {\frac{1}{3},\,\frac{1}{3},\,\frac{1}{3},\,0} \right\}$$
Answer: Option B
Join The Discussion