申論題

3.(24%) Two players are tossing (possibly biased) coins, on each toss, the probability player 1 wins one cent is p, and the probability player 1 loses one cent is q = 1 - p, where c is the total number of pennies of both players. Define a Markov chain {X_n}, where X_n = j means that player 1 has j cents after the n-th toss. The game continues until one player goes broke (the other player wins).

(b) What is the trans sition probability matrix of this chain? (10 points)