engineering recuitment NIC NIELIT Scientist B 2023 Mock Test Communication Systems Information Theory Entropy Coding
Consider a source with four symbols. The entropy of the source will be maximum when probabilities of occurrence of symbols are:
1
{1, 0, 0, 0}
2
\(\left\{\frac{1}{4}, \frac{1}{4}, \frac{1}{4}, \frac{1}{4}\right\}\)
3
\(\left\{\frac{1}{2}, \frac{1}{4}, \frac{1}{8}, \frac{1}{8}\right\}\)
4
\(\left\{\frac{1}{3}, \frac{1}{3}, \frac{1}{3}, 0\right\}\)