We have after t -steps
with \boldsymbol{w}(0) the distribution at t=0 and \boldsymbol{W} representing the transition probability matrix.