Consider a discrete memoryless source with source alphabet S = {s0, s1, s2} with probabilities P(s0) = $$\frac{1}{4}$$, P(s1) = $$\frac{1}{4}$$ and P(s2) = $$\frac{1}{2}$$
The entropy of the source is
A. $$\frac{1}{2}$$ bit
B. $$\frac{2}{3}$$ bit
C. $$\frac{3}{2}$$ bit
D. $$\frac{1}{3}$$ bit
Answer: Option C
Related Questions on Information Theory and Coding
A. The same as FDM
B. The same as TDM
C. A combination of FDM and TDM
D. Quite different from FDM and TDM
A. C2 ≈ 2C1
B. C2 ≈ C1 + B
C. C2 ≈ C1 + 2B
D. C2 ≈ C1 + 0.3B
A. 1 and 2
B. 2 and 3
C. 1 and 3
D. None of the above
Which decoding method involves the evaluation by means of Fano Algorithm?
A. Maximum Likelihood Decoding
B. Sequential Decoding
C. Both A and B
D. None of the above

Join The Discussion