Shannon Entropy: Axiomatic Characterization and Application
Loading...
Date
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
Description
We have presented a new axiomatic derivation of Shannon Entropy for a discrete probability distribution on the basis of the postulates of additivity and concavity of the entropy function.We have then modified shannon entropy to take account of observational uncertainty.The modified entropy reduces, in the limiting case, to the form of Shannon differential entropy. As an application we have derived the expression for classical entropy of statistical mechanics from the quantized form of the entropy.
11 pages
11 pages