0

I'm having trouble with Lawler problem 2.10:

Consider a branching process with offspring distribution given by {pn}. We will make the process into an irreducible Markov chain by asserting that if the population ever dies out, then the next generation will have one new individual [in other words, p(0,1)=1]. For which {pn} will this chain be positive recurrent, null recurrent, transient?

I somehow know that the chain is positive recurrent when μ=kkpk<1, but I'm not sure why.

I know that it would suffice to show that state 0 is positive recurrent, as the Markov chain is irreducible.

I would greatily appreciate any help.

1

So here's one approach: let Nn denote the size of your population at time n without the additional condition that p(0,1)=1 and let (Xi,j)1i,j< be i.i.d. random variables distributed according to your offspring distribution. That is, P(X1,1=k)=pk for all nonnegative integers k. Then:

ENn+1=E(k=1NnXn+1,k)=ENnEXn+1,1=μE(Nn)

The second equality here follows from the fact that all of the Xn+1,k's are independent of Nn. From this recurrence, we deduce that ENn=N0μn. Thus,

ENn=N0μn=k=1kP(Nn=k)k=1P(Nn=k)=1P(Nn=0)

Rearranging, this implies that:

P(Nn=0)1N0μn

Let τ0 denote the hitting time of 0 by Nn. Then P(Nn=0)=P(τ0n) since once our population dies, it stays dead. Thus, it follows that:

P(τ0>n)N0μn

From here, since τ0 is a nonnegative random variable, the layer- cake representation tells us that:

Eτ0=k=1P(τ0k)1+k=1P(τ0>k)1+k=1N0μk=1+N0μ1μ<

The summability of this last geometric series is where we made use of the fact that μ<1. Notice now that since your Markov chain behaves the same way as the original branching process up until the point we hit 0, τ0 is unchanged when we add on the condition that p(0,1)=1. In summa, we see that Eτ0< as desired and so the resulting Markov process is positive recurrent.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.