A source generates four messages m1, m2, m3 and m4, with probabilities 0.5, 0.25, 0.125 and 0.125 respectively. The messages are generated independently of each other. A source coder assigns binary code to each message. Which of the following codes has minimum average length and is also uniquely decodable (sequence as per m1, m2, m3, m4)?
A. 00, 01, 10, 11
B. 0, 1, 10, 11
C. 110, 111, 10, 0
D. 0, 10, 110, 111
Answer: Option D
Related Questions on Information Theory and Coding
A. The same as FDM
B. The same as TDM
C. A combination of FDM and TDM
D. Quite different from FDM and TDM
A. C2 ≈ 2C1
B. C2 ≈ C1 + B
C. C2 ≈ C1 + 2B
D. C2 ≈ C1 + 0.3B
A. 1 and 2
B. 2 and 3
C. 1 and 3
D. None of the above
Which decoding method involves the evaluation by means of Fano Algorithm?
A. Maximum Likelihood Decoding
B. Sequential Decoding
C. Both A and B
D. None of the above

Join The Discussion