In this book, exercises are carried out regarding the following mathematical topics:<br />Markov chains and Markovian stochastic processes<br />time-dependent and time-independent stochastic processes<br />random walks and Brownian motion<br />Initial theoretical hints are also presented to make the performance of the exercises understood.