Question
Calculate the following for the data given below:
i) Entropy
ii) Coding redundancy of Binary code
iii) Coding redundancy of Huffman code
| Symbol: | 1 | 2 | 3 | 4 | 5 | 6 |
| Huffman code: | 0 | 10 | 110 | 1110 | 11110 | 111111 |
| Binary code: | 000 | 001 | 010 | 011 | 100 | 101 |
| Probability: | 0.4 | 0.2 | 0.2 | 0.1 | 0.05 | 0.05 |
[Given, log 0.05= -4.32]
Answer :
Word Count : 256
_________ _____ ______ _________ ____ __________ __________.
_________ __________ ________ ______ _________ __________ _______ __________ _____ ______ ______ _______.
______ ______ _________ __________ ________ ________.
__________ _________ ________ ______ __________ _________ __________.
____ _______ ___ _________ _____ __________ _________.
___ ______ _____ ____ ______ _________ ____ _______ __________ _________ __________.
_________ ____ ________ ______ ___ _______.
______ ___ _____ ________ _____ _______.
________ __________ _______ __________ __________ _____ _________ ___ _______ ______ ___ _______.
___ ________ _________ _______ _______ _______ ___ ________ _______.
_______ _________ _______ _________ ________ __________ ________ _______ ___ ________ _____.
_________ _________ ____ _____ __________ ___ ________ _________ ___.
____ ________ _________ ____ _________ ______ _______ _______ __________.
_________ ____ _______ _________ ________ _____ ________ ________.
___ _________ _____ ________ _________ ______ _______.
____ ________ __________ _______ _________.
________ ________ ____ ______ ________ _______ ____ _________ ________ ___.
________ ___ _____ ______ _____ _____ _____ ____ ______ ____ _________.
___ _______ _____ _______ ________ _________ _________.
____ ________ ________ __________ _______ ______ __________ ________ ____ _____.
_________ _____ _________ _____ _____ ___ ____ ___ _________ __________ ____.
_____ ________ _____ ____ __________ ______ _______ ______ ____ ____.
_____ ______ _______ _______ _______ __________ __________ ________.
Get Full Answer on WhatsApp
To calculate the entropy, coding redundancy of binary code, and coding redundancy of Huffman code, we can use the following formulas:
i) Entropy (H):
\[ H = - \sum_{i=1}^{n} p_i \cdot \log_2(p_i) \]
ii) Coding Redundancy of Binary Code (R_binary):
\[ R_{\text{binary}} = \frac{1}{2} \sum_{i=1}^{n} p_i \cdot L_{\text{binary},i} \]
_________ _____ ______ _________ ____ __________ __________.
_________ __________ ________ ______ _________ __________ _______ __________ _____ ______ ______ _______.
______ ______ _________ __________ ________ ________.
__________ _________ ________ ______ __________ _________ __________.
____ _______ ___ _________ _____ __________ _________.
___ ______ _____ ____ ______ _________ ____ _______ __________ _________ __________.
_________ ____ ________ ______ ___ _______.
______ ___ _____ ________ _____ _______.
________ __________ _______ __________ __________ _____ _________ ___ _______ ______ ___ _______.
___ ________ _________ _______ _______ _______ ___ ________ _______.
_______ _________ _______ _________ ________ __________ ________ _______ ___ ________ _____.
_________ _________ ____ _____ __________ ___ ________ _________ ___.
____ ________ _________ ____ _________ ______ _______ _______ __________.
_________ ____ _______ _________ ________ _____ ________ ________.
___ _________ _____ ________ _________ ______ _______.
____ ________ __________ _______ _________.
________ ________ ____ ______ ________ _______ ____ _________ ________ ___.
________ ___ _____ ______ _____ _____ _____ ____ ______ ____ _________.
___ _______ _____ _______ ________ _________ _________.
____ ________ ________ __________ _______ ______ __________ ________ ____ _____.
_________ _____ _________ _____ _____ ___ ____ ___ _________ __________ ____.
_____ ________ _____ ____ __________ ______ _______ ______ ____ ____.
_____ ______ _______ _______ _______ __________ __________ ________.
Get Full Answer on WhatsApp
IGNOU NEWS
Assignment Submission Last Date Extended Till 30 June 2026 Click Here★★★IGNOU June 2026 TEE Date Sheet Released Click Here★★★