The Boltzmann/Shannon entropy as a measure of correlation
| dc.creator | Van Drie, John H. | |
| dc.date | 2000-01-17 | |
| dc.date.accessioned | 2026-07-07T04:27:36Z | |
| dc.date.available | 2026-07-07T04:27:36Z | |
| dc.description | IIt is demonstrated that the entropy of statistical mechanics and of information theory, $S({\bf p}) = -\sum p_i \log p_i $ may be viewed as a measure of correlation. Given a probability distribution on two discrete variables, $p_{ij}$, we define the correlation-destroying transformation $C: p_{ij} \to π_{ij}$, which creates a new distribution on those same variables in which no correlation exists between the variables, i.e. $π_{ij} = P_i Q_j$. It is then shown that the entropy obeys the relation $S({\bf p}) \leq S({\bf π}) = S({\bf P}) + S({\bf Q})$, i.e. the entropy is non-decreasing under these correlation-destroying transformations. | |
| dc.identifier | https://arxiv.org/abs/math-ph/0001024 | |
| dc.identifier | http://arxiv.org/abs/math-ph/0001024 | |
| dc.identifier.uri | http://salesiana.dossiersoluciones.com/handle/123456789/56472 | |
| dc.subject | Mathematical Physics | |
| dc.subject | 94A17 | |
| dc.title | The Boltzmann/Shannon entropy as a measure of correlation | |
| dc.type | text |