Since both W and w represent probabilities, they have to be normalized, i.e., we require that at each time step we have
∑iwi(t)=1,and
∑jW(j→i)=1,which applies for all j-values. The further constraints are 0≤Wij≤1 and 0≤wj≤1. Note that the probability for remaining at the same place is in general not necessarily equal zero.