Questions tagged [entropy]
116 questions
10
votes
1 answer
How to practically measure entropy of a file?
I'm trying to measure now much non redundant (actual) information my file contains. Some call this the amount of entropy.
Of course there is the standard p(x) log{p(x)}, but I think that Shannon was only considering it from the point of view of…
Paul Uszak
- 1,602
- 1
- 13
- 21
1
vote
2 answers
Comparing the entropy of a painting to a photograph
This is a quote from the book, "The Three-Body Problem" (page 112 in the paperback):
He remembered taking a class in information theory as a third-year student in college. The professor had put up two pictures: One was the famous Song Dynasty…
John C
- 111
- 1