
Please help with this problem. Thanks
Show transcribed image text For Problems 4-6, consider a Markov chain X (Xn)n20 with state space 11, 2, 3, 4 and transition matrix 0.3 0 0.7 0 0.4 0.1 0.4 0.1 0.3 0 0.7 0 0 0.2 0.4 0.4 Problem 4. Find the distribution a (2) of X2, if the initial distribution is 0 1 0 0 Problem 5. Find the stationary distribution for this Markov chain. Problem 6. Find transient and recurrent states.
For Problems 4-6, consider a Markov chain X (Xn)n20 with state space 11, 2, 3, 4 and transition matrix 0.3 0 0.7 0 0.4 0.1 0.4 0.1 0.3 0 0.7 0 0 0.2 0.4 0.4 Problem 4. Find the distribution a (2) of X2, if the initial distribution is 0 1 0 0 Problem 5. Find the stationary distribution for this Markov chain. Problem 6. Find transient and recurrent states.





