2017-2018 Academic Catalog 
    
    Nov 25, 2024  
2017-2018 Academic Catalog [ARCHIVED CATALOG]

MATH 220 - Introduction to Stochastic Modeling


Stochastic processes considered in this course are collections of random variables indexed by a time parameter. These processes are used to model the dynamics of random events over time. Our focus is on Markov chains in discrete and continuous time, which form a widely used and relatively simple class of stochastic processes. The Markov property basically says that the future random behavior depends only on the current state of the process, and not on its past. These processes are used in a wide range of fields such as physics, chemistry, information sciences, queuing theory, statistics, economics and finance, social sciences, mathematical biology, and many more. This course is not only well suited for math majors but also for students in other fields with a background in probability and an interest in modeling.
Poisson processes which model events that occur continuously and independently of each other form a particular class of continuous time Markov processes. Examples include such diverse phenomena as the radioactive decay of atoms and telephone calls arriving at a call center. The probability distribution of the waiting time until the next occurrence of an event in a Poisson process is an exponential distribution. The generalization of waiting time to arbitrary distribution leads to the notion of renewal processes, which are often more realistic but harder to analyze. We will use these processes to model problems in a variety of fields, depending on students’ interests.

Prerequisites:  

Anticipated Terms Offered: Every other Spring