Amount of Information & average information, Entropy - MCQs

Amount of Information & average information, Entropy - MCQs

Q1. The expected information contained in a message is called

a) Entropy
b) Efficiency
c) Coded signal
d) None of the above

View Answer / Hide Answer

Q2. The information I contained in a message with probability of occurrence is given by (k is constant)

a) I = k log₂1/P
b) I = k log₂P
c) I = k log₂1/2P
d) I = k log₂1/P²

View Answer / Hide Answer

Q3. The memory less source refers to

a) No previous information
b) No message storage
c) Emitted message is independent of previous message
d) None of the above

View Answer / Hide Answer

Q4. Entropy is

a) Average information per message
b) Information in a signal
c) Amplitude of signal
d) All of the above

View Answer / Hide Answer

Q5. The relation between entropy and mutual information is

a) I(X;Y) = H(X) - H(X/Y)
b) I(X;Y) = H(X/Y) - H(Y/X)
c) I(X;Y) = H(X) - H(Y)
d) I(X;Y) = H(Y) - H(X)

View Answer / Hide Answer

Q6. The mutual information

a) Is symmetric
b) Always non negative
c) Both a) and b) are correct
d) None of the above

View Answer / Hide Answer