Week 11 Worksheet Solutions
- The partition is generating for the shift map so we may just compute
giving an entropy of .
- With respect to normalized counting measure, every partition of has entropy at most and therefore, for any partition we have
which is zero.
- It is directly verified that , and
are the only string of lengths 1 and 2 respectively that do not contain consecutive ones. Fix and let be a string of zeroes and ones with no consecutive ones. If then there are possibilities for the repaining strings as any string of length not containing consecutive ones can appear. If then but then there are possibilities for the remaining strings. Thus .
- Fix and let be the fair coin measure. As is ergodic for we can deduce that
for almost every . But no sequence in has consecutive ones in it, so we must have .
- The coin measure on has entropy
which, for every is less than . As isomorphic systems have the same entropy, no coin measure on gives a system isomorphic to the fair coin measure on .
- The corresponding transition matrix is
and since all entries of are positive we may apply Parry's theorem to calculate the entropy. The eigenvalues of B are
and we set . The entropy is .
The vectors
are left and right eigenvectors respectively of with eigenvalue . Parry's theorem tells us to take
and