Examveda

Consider a source with four symbols. The entropy of the source will be maximum when probabilities of occurrence of symbols are:

A. $$\left\{ {1,\,0,\,0,\,0} \right\}$$

B. $$\left\{ {\frac{1}{4},\,\frac{1}{4},\,\frac{1}{4},\,\frac{1}{4}} \right\}$$

C. $$\left\{ {\frac{1}{2},\,\frac{1}{4},\,\frac{1}{8},\,\frac{1}{8}} \right\}$$

D. $$\left\{ {\frac{1}{3},\,\frac{1}{3},\,\frac{1}{3},\,0} \right\}$$

Answer: Option B


Join The Discussion

Related Questions on Information Theory and Coding