Matthew Bernstein personal blog
Shannon’s Source Coding Theorem (2020)
The mathematical field of information theory attempts to mathematically describe the concept of “information”. In the first two posts, we discussed the concepts of self-information and information entropy. In this post, we step through Shannon’s Source Coding Theorem to see how the information entropy of a probability…
- Points
- 127
- HN comments
- 38
- Submissions
- 1
- Cited by
- 0 commenters
Math & AlgorithmsScience & Space2023
On Hacker News
| Submitted | Title on HN | Points | Comments |
|---|---|---|---|
| Jun 18, 2023 | Shannon’s Source Coding Theorem (2020) by ElFitz | 127 | 38 |
