Back to 6602 Home Page
MATH 6602 3.0AF (Stochastic Processes)
Assignments  Fall 2008
Access to assignment solutions has now been withdrawn. If you took this course,
and need access, contact the instructor by email.
All references are to Karlin and Taylor, A first course in stochastic processes
Given the long break caused by the strike, you may find it useful to work through some or all of the above practice problems.
Note that I reworded
exercise 9 to make it clearer.
Solutions
Originally due Wednesday November 5, 2008. Because of the Senate amnesty declared for students participating in the Nov 5 YFS fee protest, and then the strike that started Nov 6, this assignment will now be due the 2nd class after the strike ends. Solutions will not be posted till then.
In addition to the above assignment, you should do the following two problems
(originally intended as preparation for the midterm).

Chapter 3, elementary problem 2a
 Find the stationary distribution and asymptotic behaviour of the nstep transition matrix of a Markov chain on states 0, 1, 2, 3, if P02=1/2, P03=1/2, P12=1/3, P13=2/3, P20=1/4, P21=3/4, P30=1/3, P31=2/3, and all other Pij=0.
In both these problems, figure out the asymptotic behaviour of the n step transition matrix, as n goes to infinity.
Solutions
due Tuesday October 14, 2008 (as the Monday is a holiday, and the Friday is our test)
Solutions
There was a typo in the solutions (now fixed) that meant I reversed heads and tails in grading two peoples' problem 5. If you think your problem 5 was correct, hand it back to me and I'll look at it again.
due Monday September 29, 2008 (extended to October 3, 2008)
Solutions