A source alphabet consists of N symbols with the probability of the first two symbols being the same. A source encoder increases the probability of the first symbol by a small amount ε and decreases that of the second by ε. After encoding, the entropy of the source
A. Increases
B. Remains the same
C. Increases only if N = 2
D. Decreases
Answer: Option D
Related Questions on Information Theory and Coding
A. The same as FDM
B. The same as TDM
C. A combination of FDM and TDM
D. Quite different from FDM and TDM
A. C2 ≈ 2C1
B. C2 ≈ C1 + B
C. C2 ≈ C1 + 2B
D. C2 ≈ C1 + 0.3B
A. 1 and 2
B. 2 and 3
C. 1 and 3
D. None of the above
Which decoding method involves the evaluation by means of Fano Algorithm?
A. Maximum Likelihood Decoding
B. Sequential Decoding
C. Both A and B
D. None of the above

Join The Discussion