A discrete memory less source has two symbols x1 and x2...

Home / Electronics And Communications Engineering / Information Theory And Coding / Question

Examveda

A discrete memory less source has two symbols x₁ and x₂ with probabilities p(x₁) and p(x₂) respectively, then the entropy of the source H(X) is

A. H(X) = p(x₁)log₁₀p(x₁) + p(x₂)log₁₀p(x₂)

B. H(X) = -p(x₁)log₁₀p(x₁) - p(x₂)log₁₀p(x₂)

C. H(X) = -p(x₁)log₂p(x₁) - p(x₂)log₂p (x₂)

D. H(X) = p(x₁)log₂p(x₁) + p(x₂)log₂p(x₂)

Answer: Option C

Related Questions on Information Theory and Coding

A. The same as FDM

B. The same as TDM

C. A combination of FDM and TDM

D. Quite different from FDM and TDM

View Answer

A. C₂ ≈ 2C₁

B. C₂ ≈ C₁ + B

C. C₂ ≈ C₁ + 2B

D. C₂ ≈ C₁ + 0.3B

View Answer

A. 1 and 2

B. 2 and 3

C. 1 and 3

D. None of the above

View Answer

A. Maximum Likelihood Decoding

B. Sequential Decoding

C. Both A and B

D. None of the above

View Answer