Processing math: 100%

 

 

 

Markov processes

For the Markov process we have a transition probability from a position x=jl to a position x=il given by Wij(ϵ)=W(iljl,ϵ)={12|ij|=10else, where Wij is normally called the transition probability and we can represent it, see below, as a matrix. Here we have specialized to a case where the transition probability is known.

Our new PDF wi(t=ϵ) is now related to the PDF at t=0 through the relation wi(t=ϵ)=jW(ji)wj(t=0).

This equation represents the discretized time-development of an original PDF with equal probability of jumping left or right.