engineering recuitment BHEL Engineer Trainee Mock Test 2025 Communication Systems Information Theory Entropy Coding
Consider a discrete memoryless source with source alphabet S = {s0, s1, s2} with probabilities:
\(P\left( {{s_0}} \right) = \frac{1}{4},P\left( {{s_1}} \right) = \frac{1}{4}~and~P\left( {{s_2}} \right) = \frac{1}{2}\)
The entropy of the source is
1
\(\frac{1}{2} ~bit\)
2
\(\frac{2}{3} ~bit\)
3
\(\frac{3}{2} ~bit\)
4
\(\frac{1}{3} ~bit\)