(a) Let ij > 0 . Show that there exists l 1 such that p ij ( l ) > 0 . (b) Assume the state space contains m elements. Show that l in part (a) can be chosen less than or equal to m . .

1. (a) Let ij > 0 . Show that there exists l 1 such that p ij ( l ) > 0 . (b) Assume the state space
contains m elements. Show that l in part (a) can be chosen less than or equal to m .