MIT 6.041 Probabilistic Systems Analysis and Applied Probability, Fall 2010 View the complete course: http://ocw.mit.edu/6-041F10 Instructor: John Tsitsiklis ...
========== The following content is
provided under a Creative Commons license. Your support will help MIT
OpenCourseWare continue to offer high quality educational
resources for free. To make a donation or view
additional materials from hundreds of MIT courses, visit
MIT OpenCourseWare at ocw.mit.edu. PROFESSOR: So we're going to
start now with a new chapter. We're going to talk about
Markov processes. The good news is that this is
a subject that is a lot more intuitive and simple in many
ways than, let's say, the Poisson processes. So hopefully this will
be enjoyable. So Markov processes
is, a general class of random processes. In some sense, it's more
elaborate than the Bernoulli and Poisson processes, because
now we're going to have dependencies between difference
...