Unit 4: Statistics and Probability
Topic 4.19: Markov chains (HL only) Questions
Practice 20 exam-style questions for IB Math AI SL Topic 4.19. Review the question stems below, then unlock the full Question Bank to access markschemes, model answers, and AI grading.
11 mark
2026
A column of a transition matrix is (0.6, 0.1, k)ᵀ. The value of k is:
Markscheme and model answer locked
Unlock Question2Write down2 marks
2026
A region has 'urban' and 'rural' residents. Each year 5% of urban residents move rural and 10% of rural residents move urban; the rest stay. Write down the transition matrix T (order urban, rural).
Markscheme and model answer locked
Unlock Question31 mark
2026
T = [[0.7, 0.4], [0.3, 0.6]]. The probability of moving from state 2 to state 1 in one step is:
Markscheme and model answer locked
Unlock Question41 mark
2026
To find the state vector 4 periods ahead you compute:
Markscheme and model answer locked
Unlock Question5Comment2 marks
2026
A cleaning robot moves around a small maze of junctions A, B, C, D, E and F, joined by one-way paths. Every path is listed below; paths fitted with a guide strip are marked.
A cleaning robot starts at A. At each junction it rests for a constant time and then leaves along one of the paths out of that junction: each normal path is equally likely, and a path fitted with a guide strip is twice as likely to be chosen as a normal path. The long-run proportion of time spent at junction D is estimated to be about 19.0%.
Comment on this answer, referring to at least one limitation of the model.
| From | To | Path |
|---|---|---|
| A | C | normal |
| A | E | normal |
| B | A | normal |
| B | D | fitted with a guide strip |
| C | B | normal |
| C | D | normal |
| C | F | fitted with a guide strip |
| D | E | normal |
| D | A | normal |
| E | B | fitted with a guide strip |
| E | F | normal |
| E | C | normal |
| F | D | normal |
| F | A | normal |
A cleaning robot starts at A. At each junction it rests for a constant time and then leaves along one of the paths out of that junction: each normal path is equally likely, and a path fitted with a guide strip is twice as likely to be chosen as a normal path. The long-run proportion of time spent at junction D is estimated to be about 19.0%.
Comment on this answer, referring to at least one limitation of the model.
Markscheme and model answer locked
Unlock Question6Comment2 marks
2026
A mouse moves around a small maze of junctions A, B, C, D, E and F, joined by one-way paths. Every path is listed below; paths sprinkled with sugar are marked.
A mouse starts at A. At each junction she rests for a constant time and then leaves along one of the paths out of that junction: each normal path is equally likely, and a path sprinkled with sugar is twice as likely to be chosen as a normal path. The long-run proportion of time spent at junction F is estimated to be about 21.8%.
Comment on this answer, referring to at least one limitation of the model.
| From | To | Path |
|---|---|---|
| A | B | normal |
| A | D | normal |
| A | E | sprinkled with sugar |
| B | A | normal |
| B | C | sprinkled with sugar |
| C | A | normal |
| C | D | normal |
| C | F | normal |
| D | C | normal |
| D | F | sprinkled with sugar |
| E | D | normal |
| E | F | sprinkled with sugar |
| F | A | normal |
| F | B | normal |
A mouse starts at A. At each junction she rests for a constant time and then leaves along one of the paths out of that junction: each normal path is equally likely, and a path sprinkled with sugar is twice as likely to be chosen as a normal path. The long-run proportion of time spent at junction F is estimated to be about 21.8%.
Comment on this answer, referring to at least one limitation of the model.
Markscheme and model answer locked
Unlock Question7State1 mark
2026
An engineer models a machine that is checked every hour and is found to be either working or faulty. The model is , where is the probability of being working and the probability of being faulty after the th hourly check, and .
State what represents in this context.
State what represents in this context.
Markscheme and model answer locked
Unlock Question8Write down2 marks
2026
A second model uses two states for the hockey team: W (won the match) and L (did not win). In the list of the last 200 matches, the transitions between consecutive matches are counted.
Relative frequencies are used to estimate the probabilities in a transition matrix , whose columns give the current state (W then L) and whose rows give the next state.
Write down the transition matrix .
| Transition | Frequency |
|---|---|
| WW (win then win) | 65 |
| WL (win then not win) | 48 |
| LW (not win then win) | 48 |
| LL (not win then not win) | 38 |
Relative frequencies are used to estimate the probabilities in a transition matrix , whose columns give the current state (W then L) and whose rows give the next state.
Write down the transition matrix .
Markscheme and model answer locked
Unlock Question9Determine3 marks
2026
An ant moves around a small maze of junctions A, B, C, D, E and F, joined by one-way paths. Every path is listed below; paths marked with a scent trail are marked.
An ant starts at A. At each junction it rests for a constant time and then leaves along one of the paths out of that junction: each normal path is equally likely, and a path marked with a scent trail is twice as likely to be chosen as a normal path.
Determine the transition matrix for this maze. Order the states A, B, C, D, E, F; column gives the probabilities of moving from the th junction.
| From | To | Path |
|---|---|---|
| A | B | normal |
| A | C | marked with a scent trail |
| B | C | normal |
| B | E | normal |
| B | F | normal |
| C | D | normal |
| C | A | normal |
| D | E | marked with a scent trail |
| D | B | normal |
| E | F | normal |
| E | A | normal |
| F | D | normal |
| F | C | marked with a scent trail |
An ant starts at A. At each junction it rests for a constant time and then leaves along one of the paths out of that junction: each normal path is equally likely, and a path marked with a scent trail is twice as likely to be chosen as a normal path.
Determine the transition matrix for this maze. Order the states A, B, C, D, E, F; column gives the probabilities of moving from the th junction.
Markscheme and model answer locked
Unlock Question10Find3 marks
2026
Rafael leaves a hire van overnight either at the depot or at home. If the hire van was left at the depot on a given night, the probability that it is left at the depot the following night is . If it was left at home on a given night, the probability that it is left at home the following night is . The transition matrix is , with columns in the order the depot, home.
On Monday morning Rafael collected the hire van from the depot, where it had been left overnight. Find the probability that the hire van is left at home on Saturday evening.
On Monday morning Rafael collected the hire van from the depot, where it had been left overnight. Find the probability that the hire van is left at home on Saturday evening.
Markscheme and model answer locked
Unlock Question11Find3 marks
2026
After the first round, Ines visits one of the schools each day, chosen using the transition matrix below. Each column gives the probabilities of the next visit from the school in its heading.
The distances from home, H, to A, B, C, D and E are 30, 58, 44, 35, 49 km respectively. Each day the journey is from home directly to the chosen school and then directly back home. Over a long period of time, find the expected distance travelled in a day.
| To \ From | A | B | C | D | E |
|---|---|---|---|---|---|
| A | 0.1 | 0.3 | 0 | 0.15 | 0.25 |
| B | 0.3 | 0 | 0 | 0.3 | 0.25 |
| C | 0.2 | 0.3 | 0 | 0.2 | 0.2 |
| D | 0.2 | 0.2 | 0.45 | 0.1 | 0.3 |
| E | 0.2 | 0.2 | 0.55 | 0.25 | 0 |
The distances from home, H, to A, B, C, D and E are 30, 58, 44, 35, 49 km respectively. Each day the journey is from home directly to the chosen school and then directly back home. Over a long period of time, find the expected distance travelled in a day.
Markscheme and model answer locked
Unlock Question12Write down1 mark
2026
After the first round, Ines visits one of the schools each day, chosen using the transition matrix below. Each column gives the probabilities of the next visit from the school in its heading.
After visiting school D, the probability that Ines visits school A next is 0.15.
Write down the value of .
| To \ From | A | B | C | D | E |
|---|---|---|---|---|---|
| A | 0.1 | 0.3 | 0 | 0.25 | |
| B | 0.3 | 0 | 0 | 0.3 | 0.25 |
| C | 0.3 | 0 | 0.2 | 0.2 | |
| D | 0.2 | 0.2 | 0.45 | 0.1 | 0.3 |
| E | 0.2 | 0.2 | 0.55 | 0 |
After visiting school D, the probability that Ines visits school A next is 0.15.
Write down the value of .
Markscheme and model answer locked
Unlock Question13Construct3 marks
2026
A study follows the customers of three mobile phone networks, A, B and C, in a region. Each year:
- From A, move to B and move to C.
- From B, move to A and move to C.
- From C, move to A and move to B.
All other customers stay with their network; any other changes may be ignored.
Represent this information in a transition matrix , using the order A, B, C.
- From A, move to B and move to C.
- From B, move to A and move to C.
- From C, move to A and move to B.
All other customers stay with their network; any other changes may be ignored.
Represent this information in a transition matrix , using the order A, B, C.
Markscheme and model answer locked
Unlock Question14Find3 marks
2026
Using T = [[0.95, 0.10], [0.05, 0.90]] and a start of 60 000 urban and 40 000 rural residents, find the numbers urban and rural after 1 year.
Markscheme and model answer locked
Unlock Question15Write down1 mark
2026
Each school day Mira has lunch in the canteen (C), brings a packed lunch (P) or buys lunch at a café (F). The choice depends only on the previous day. The transition diagram gives these probabilities (from one day to the next): C to C: 0.5; C to P: 0.3; C to F: 0.2; P to C: 0.4; P to P: 0.4; P to F: 0.2; F to C: 0.6; F to P: q; F to F: 0.3.
Write down the value of .
Write down the value of .
Markscheme and model answer locked
Unlock Question16Write down2 marks
2026
A second model uses two states for the chess club: W (won the match) and L (did not win). In the list of the last 240 matches, the transitions between consecutive matches are counted.
Relative frequencies are used to estimate the probabilities in a transition matrix , whose columns give the current state (W then L) and whose rows give the next state.
Write down the transition matrix .
| Transition | Frequency |
|---|---|
| WW (win then win) | 69 |
| WL (win then not win) | 60 |
| LW (not win then win) | 60 |
| LL (not win then not win) | 50 |
Relative frequencies are used to estimate the probabilities in a transition matrix , whose columns give the current state (W then L) and whose rows give the next state.
Write down the transition matrix .
Markscheme and model answer locked
Unlock Question17Predict3 marks
2026
A bakery records which loaf its regular customers buy each month. This month a proportion chose white and chose wholemeal, shown by . Choices are believed to change each month according to the transition matrix (columns: current choice, order white, wholemeal).
Use the transition matrix to predict the proportions that chose white and wholemeal in the previous month.
Use the transition matrix to predict the proportions that chose white and wholemeal in the previous month.
Markscheme and model answer locked
Unlock Question18Determine2 marks
2026
A study follows the customers of three mobile phone networks, A, B and C, in a region. Each year:
- From A, move to B and move to C.
- From B, move to A and move to C.
- From C, move to A and move to B.
All other customers stay with their network; any other changes may be ignored.
The transition matrix, with columns giving the "from" state and rows the "to" state in the order A, B, C, is .
At the start, the numbers of customers are 120 000 (A), 85 000 (B), 45 000 (C). The steady state vector is (in the order A, B, C).
Determine the long-term expected number of customers on network B.
- From A, move to B and move to C.
- From B, move to A and move to C.
- From C, move to A and move to B.
All other customers stay with their network; any other changes may be ignored.
The transition matrix, with columns giving the "from" state and rows the "to" state in the order A, B, C, is .
At the start, the numbers of customers are 120 000 (A), 85 000 (B), 45 000 (C). The steady state vector is (in the order A, B, C).
Determine the long-term expected number of customers on network B.
Markscheme and model answer locked
Unlock Question19Find2 marks
2026
The weather each day is either sunny (S) or rainy (R). The transition matrix of this Markov chain, with columns giving the current state (S then R) and rows the next state (S then R), is
$$\begin{pmatrix} 1 - a & b \\ a & 1 - b \end{pmatrix}$$
where and are between 0 and 1. One eigenvalue of this matrix is 1. An eigenvector for the eigenvalue 1 is .
Hence find an expression, in terms of and , for the long-run proportion of time spent in state S.
$$\begin{pmatrix} 1 - a & b \\ a & 1 - b \end{pmatrix}$$
where and are between 0 and 1. One eigenvalue of this matrix is 1. An eigenvector for the eigenvalue 1 is .
Hence find an expression, in terms of and , for the long-run proportion of time spent in state S.
Markscheme and model answer locked
Unlock Question20Find3 marks
2026
After the first round, Rosa visits one of the farms each day, chosen using the transition matrix below. Each column gives the probabilities of the next visit from the farm in its heading.
The distances from home, H, to A, B, C, D and E are 24, 45, 53, 41, 62 km respectively. Each day the journey is from home directly to the chosen farm and then directly back home. Over a long period of time, find the expected distance travelled in a day.
| To \ From | A | B | C | D | E |
|---|---|---|---|---|---|
| A | 0 | 0.2 | 0.1 | 0.25 | 0.3 |
| B | 0.6 | 0 | 0.3 | 0.25 | 0.2 |
| C | 0 | 0.3 | 0.1 | 0.1 | 0.2 |
| D | 0 | 0.3 | 0.3 | 0.1 | 0.3 |
| E | 0.4 | 0.2 | 0.2 | 0.3 | 0 |
The distances from home, H, to A, B, C, D and E are 24, 45, 53, 41, 62 km respectively. Each day the journey is from home directly to the chosen farm and then directly back home. Over a long period of time, find the expected distance travelled in a day.
Markscheme and model answer locked
Unlock QuestionReady to practice Topic 4.19?
Get instant AI feedback on your answers, view detailed markschemes, and track your progress across all IB Math AI SL topics.