Biologists can model a population's genotype distribution across generations with a Markov chain. Suppose there are two individuals with genotype Aa, and in each successive generation, two individuals are selected from the (numerous) offspring of the previous generation. These pairs of individuals form the possible states: AA and AA; AA and Aa; Aa and Aa; AA and aa; Aa and aa; aa and aa. Note that the first and last states listed are absorbing states. If the process reaches the state Aa and Aa, and two independent choices are made from the offspring population, determine the probability that the process reaches the state AA and AA in the very next step.
Recall that a child receives one allele (letter) from each parent, with a probability of either allele being selected; for instance, the parents with genotype Aa will have a child with genotype AA with probability , Aa with probability and aa with probability .
Which of the following are true?
(1) Suppose state is null recurrent. The expected number of returns to state is infinite.
(2) Suppose state is positive recurrent. The expected number of returns to state is finite.
(3) Suppose state is transient. The expected number of steps needed to return to state is not finite.
A Markov chain has states that are the natural numbers and the transition probabilities at state are probability to go to , probability to go to and probability to remain at (state simply has probability of going to state ).
Are any states periodic?
Are any states transient?
If a process starts at state A, what is the expected number of steps until it reaches state D?
If a process starts at state A, what is the expected number of steps until it returns to state A?