Finite Math and Applied Calculus (6th Edition)

Published by Brooks Cole
ISBN 10: 1133607705
ISBN 13: 978-1-13360-770-0

Chapter 7 - Section 7.7 - Markov Systems - Exercises - Page 532: 36

Answer

$v_\infty=\begin{bmatrix} \dfrac{5}{14} & \dfrac{1}{28} & \dfrac{17}{28} \end{bmatrix}$

Work Step by Step

The steady-state distribution vector $v_\infty$ can be written as: $v_\infty P=v_\infty$ where, $v_\infty=[x~~y~~z]$ This gives: $[x~~y~~z] \begin{bmatrix} 0.1 & 0.1 &0.8 \\0.5& 0&0.5\\0.5&0&0.5 \\ \end{bmatrix} =[x~~y~~z]$ We can have the following equations: $$0.1x+0.5y+0.5z=x\\ 0.1 x=y\\ 0.8x+0.5y+0.5z=z$$ or, $$-0.9x+0.5y+0.5z=0\\ 0.1 x-y=0\\ 0.8x+0.5y-0.5z=0$$ Also, we have: $x+y+z=1$ So, the new system of equations are: $x+y+z=1\\ 0.1 x-y=0 \\ 0.8x+0.5y-0.5z=0$ After solving the above equations, we get: $x=\dfrac{5}{14} ; y=\dfrac{1}{28} ; z=\dfrac{17}{28}$ Thus, the required steady-state distribution vector $v_\infty$ is: $v_\infty=\begin{bmatrix} \dfrac{5}{14} & \dfrac{1}{28} & \dfrac{17}{28} \end{bmatrix}$
Update this answer!

You can help us out by revising, improving and updating this answer.

Update this answer

After you claim an answer you’ll have 24 hours to send in a draft. An editor will review the submission and either publish your submission or provide feedback.