We can get the transition probability matrix by following steps:
1. If a row of A has no 1’s, then replace each element by 1/N. For all other rows proceed as follows.
2. Divide each 1 in A by the number of 1’s in its row. Thus, if there is a row with three 1’s, then each of them is replaced by 1/3.
3. Multiply the resulting matrix by 1 − α.
4. Add α/N to every entry of the resulting matrix, to obtain P.
Shu
