Processing math: 100%

 

 

 

Markov processes, the probabilities

Since both W and w represent probabilities, they have to be normalized, i.e., we require that at each time step we have

iwi(t)=1,

and

jW(ji)=1,

which applies for all j-values. The further constraints are 0Wij1 and 0wj1. Note that the probability for remaining at the same place is in general not necessarily equal zero.