Unit 4: Statistics and Probability

Topic 4.19: Markov chains (HL only) Questions

Practice 20 exam-style questions for IB Math AI SL Topic 4.19. Review the question stems below, then unlock the full Question Bank to access markschemes, model answers, and AI grading.

11 mark
2026
A column of a transition matrix is (0.6, 0.1, k)ᵀ. The value of k is:
Markscheme and model answer locked
Unlock Question
2Write down2 marks
2026
A region has 'urban' and 'rural' residents. Each year 5% of urban residents move rural and 10% of rural residents move urban; the rest stay. Write down the transition matrix T (order urban, rural).
Markscheme and model answer locked
Unlock Question
31 mark
2026
T = [[0.7, 0.4], [0.3, 0.6]]. The probability of moving from state 2 to state 1 in one step is:
Markscheme and model answer locked
Unlock Question
41 mark
2026
To find the state vector 4 periods ahead you compute:
Markscheme and model answer locked
Unlock Question
5Comment2 marks
2026
A cleaning robot moves around a small maze of junctions A, B, C, D, E and F, joined by one-way paths. Every path is listed below; paths fitted with a guide strip are marked.

FromToPath
ACnormal
AEnormal
BAnormal
BDfitted with a guide strip
CBnormal
CDnormal
CFfitted with a guide strip
DEnormal
DAnormal
EBfitted with a guide strip
EFnormal
ECnormal
FDnormal
FAnormal

A cleaning robot starts at A. At each junction it rests for a constant time and then leaves along one of the paths out of that junction: each normal path is equally likely, and a path fitted with a guide strip is twice as likely to be chosen as a normal path. The long-run proportion of time spent at junction D is estimated to be about 19.0%.

Comment on this answer, referring to at least one limitation of the model.
Markscheme and model answer locked
Unlock Question
6Comment2 marks
2026
A mouse moves around a small maze of junctions A, B, C, D, E and F, joined by one-way paths. Every path is listed below; paths sprinkled with sugar are marked.

FromToPath
ABnormal
ADnormal
AEsprinkled with sugar
BAnormal
BCsprinkled with sugar
CAnormal
CDnormal
CFnormal
DCnormal
DFsprinkled with sugar
EDnormal
EFsprinkled with sugar
FAnormal
FBnormal

A mouse starts at A. At each junction she rests for a constant time and then leaves along one of the paths out of that junction: each normal path is equally likely, and a path sprinkled with sugar is twice as likely to be chosen as a normal path. The long-run proportion of time spent at junction F is estimated to be about 21.8%.

Comment on this answer, referring to at least one limitation of the model.
Markscheme and model answer locked
Unlock Question
7State1 mark
2026
An engineer models a machine that is checked every hour and is found to be either working or faulty. The model is , where is the probability of being working and the probability of being faulty after the th hourly check, and .

State what represents in this context.
Markscheme and model answer locked
Unlock Question
8Write down2 marks
2026
A second model uses two states for the hockey team: W (won the match) and L (did not win). In the list of the last 200 matches, the transitions between consecutive matches are counted.

TransitionFrequency
WW (win then win)65
WL (win then not win)48
LW (not win then win)48
LL (not win then not win)38

Relative frequencies are used to estimate the probabilities in a transition matrix , whose columns give the current state (W then L) and whose rows give the next state.

Write down the transition matrix .
Markscheme and model answer locked
Unlock Question
9Determine3 marks
2026
An ant moves around a small maze of junctions A, B, C, D, E and F, joined by one-way paths. Every path is listed below; paths marked with a scent trail are marked.

FromToPath
ABnormal
ACmarked with a scent trail
BCnormal
BEnormal
BFnormal
CDnormal
CAnormal
DEmarked with a scent trail
DBnormal
EFnormal
EAnormal
FDnormal
FCmarked with a scent trail

An ant starts at A. At each junction it rests for a constant time and then leaves along one of the paths out of that junction: each normal path is equally likely, and a path marked with a scent trail is twice as likely to be chosen as a normal path.

Determine the transition matrix for this maze. Order the states A, B, C, D, E, F; column gives the probabilities of moving from the th junction.
Markscheme and model answer locked
Unlock Question
10Find3 marks
2026
Rafael leaves a hire van overnight either at the depot or at home. If the hire van was left at the depot on a given night, the probability that it is left at the depot the following night is . If it was left at home on a given night, the probability that it is left at home the following night is . The transition matrix is , with columns in the order the depot, home.

On Monday morning Rafael collected the hire van from the depot, where it had been left overnight. Find the probability that the hire van is left at home on Saturday evening.
Markscheme and model answer locked
Unlock Question
11Find3 marks
2026
After the first round, Ines visits one of the schools each day, chosen using the transition matrix below. Each column gives the probabilities of the next visit from the school in its heading.

To \ FromABCDE
A0.10.300.150.25
B0.3000.30.25
C0.20.300.20.2
D0.20.20.450.10.3
E0.20.20.550.250

The distances from home, H, to A, B, C, D and E are 30, 58, 44, 35, 49 km respectively. Each day the journey is from home directly to the chosen school and then directly back home. Over a long period of time, find the expected distance travelled in a day.
Markscheme and model answer locked
Unlock Question
12Write down1 mark
2026
After the first round, Ines visits one of the schools each day, chosen using the transition matrix below. Each column gives the probabilities of the next visit from the school in its heading.

To \ FromABCDE
A0.10.300.25
B0.3000.30.25
C0.300.20.2
D0.20.20.450.10.3
E0.20.20.550

After visiting school D, the probability that Ines visits school A next is 0.15.

Write down the value of .
Markscheme and model answer locked
Unlock Question
13Construct3 marks
2026
A study follows the customers of three mobile phone networks, A, B and C, in a region. Each year:

- From A, move to B and move to C.
- From B, move to A and move to C.
- From C, move to A and move to B.

All other customers stay with their network; any other changes may be ignored.

Represent this information in a transition matrix , using the order A, B, C.
Markscheme and model answer locked
Unlock Question
14Find3 marks
2026
Using T = [[0.95, 0.10], [0.05, 0.90]] and a start of 60 000 urban and 40 000 rural residents, find the numbers urban and rural after 1 year.
Markscheme and model answer locked
Unlock Question
15Write down1 mark
2026
Each school day Mira has lunch in the canteen (C), brings a packed lunch (P) or buys lunch at a café (F). The choice depends only on the previous day. The transition diagram gives these probabilities (from one day to the next): C to C: 0.5; C to P: 0.3; C to F: 0.2; P to C: 0.4; P to P: 0.4; P to F: 0.2; F to C: 0.6; F to P: q; F to F: 0.3.

Write down the value of .
Markscheme and model answer locked
Unlock Question
16Write down2 marks
2026
A second model uses two states for the chess club: W (won the match) and L (did not win). In the list of the last 240 matches, the transitions between consecutive matches are counted.

TransitionFrequency
WW (win then win)69
WL (win then not win)60
LW (not win then win)60
LL (not win then not win)50

Relative frequencies are used to estimate the probabilities in a transition matrix , whose columns give the current state (W then L) and whose rows give the next state.

Write down the transition matrix .
Markscheme and model answer locked
Unlock Question
17Predict3 marks
2026
A bakery records which loaf its regular customers buy each month. This month a proportion chose white and chose wholemeal, shown by . Choices are believed to change each month according to the transition matrix (columns: current choice, order white, wholemeal).

Use the transition matrix to predict the proportions that chose white and wholemeal in the previous month.
Markscheme and model answer locked
Unlock Question
18Determine2 marks
2026
A study follows the customers of three mobile phone networks, A, B and C, in a region. Each year:

- From A, move to B and move to C.
- From B, move to A and move to C.
- From C, move to A and move to B.

All other customers stay with their network; any other changes may be ignored.

The transition matrix, with columns giving the "from" state and rows the "to" state in the order A, B, C, is .

At the start, the numbers of customers are 120 000 (A), 85 000 (B), 45 000 (C). The steady state vector is (in the order A, B, C).

Determine the long-term expected number of customers on network B.
Markscheme and model answer locked
Unlock Question
19Find2 marks
2026
The weather each day is either sunny (S) or rainy (R). The transition matrix of this Markov chain, with columns giving the current state (S then R) and rows the next state (S then R), is

$$\begin{pmatrix} 1 - a & b \\ a & 1 - b \end{pmatrix}$$

where and are between 0 and 1. One eigenvalue of this matrix is 1. An eigenvector for the eigenvalue 1 is .

Hence find an expression, in terms of and , for the long-run proportion of time spent in state S.
Markscheme and model answer locked
Unlock Question
20Find3 marks
2026
After the first round, Rosa visits one of the farms each day, chosen using the transition matrix below. Each column gives the probabilities of the next visit from the farm in its heading.

To \ FromABCDE
A00.20.10.250.3
B0.600.30.250.2
C00.30.10.10.2
D00.30.30.10.3
E0.40.20.20.30

The distances from home, H, to A, B, C, D and E are 24, 45, 53, 41, 62 km respectively. Each day the journey is from home directly to the chosen farm and then directly back home. Over a long period of time, find the expected distance travelled in a day.
Markscheme and model answer locked
Unlock Question

Ready to practice Topic 4.19?

Get instant AI feedback on your answers, view detailed markschemes, and track your progress across all IB Math AI SL topics.