Word-Valued Sources: an Ergodic Theorem, an AEP and the Conservation of Entropy
| dc.creator | Timo, Roy | |
| dc.creator | Blackmore, Kim | |
| dc.creator | Hanlen, Leif | |
| dc.date | 2009-04-24 | |
| dc.date.accessioned | 2026-07-07T13:08:24Z | |
| dc.date.available | 2026-07-07T13:08:24Z | |
| dc.description | A word-valued source $\mathbf{Y} = Y_1,Y_2,...$ is discrete random process that is formed by sequentially encoding the symbols of a random process $\mathbf{X} = X_1,X_2,...$ with codewords from a codebook $\mathscr{C}$. These processes appear frequently in information theory (in particular, in the analysis of source-coding algorithms), so it is of interest to give conditions on $\mathbf{X}$ and $\mathscr{C}$ for which $\mathbf{Y}$ will satisfy an ergodic theorem and possess an Asymptotic Equipartition Property (AEP). In this correspondence, we prove the following: (1) if $\mathbf{X}$ is asymptotically mean stationary, then $\mathbf{Y}$ will satisfy a pointwise ergodic theorem and possess an AEP; and, (2) if the codebook $\mathscr{C}$ is prefix-free, then the entropy rate of $\mathbf{Y}$ is equal to the entropy rate of $\mathbf{X}$ normalized by the average codeword length. | |
| dc.description | 21 pages | |
| dc.identifier | https://arxiv.org/abs/0904.3778 | |
| dc.identifier | http://arxiv.org/abs/0904.3778 | |
| dc.identifier.uri | http://salesiana.dossiersoluciones.com/handle/123456789/228406 | |
| dc.subject | Information Theory | |
| dc.title | Word-Valued Sources: an Ergodic Theorem, an AEP and the Conservation of Entropy | |
| dc.type | text |