Materials for book: "Markov Chains for programmers"
I have put all code in the folder challenges
. There are two sub-folders in there:
project00
: contains all challenges using Makefile and defs.h
(to ease programming).project01
: a full project with all possibilities as discussed in the book.The decision to make project00
and congregate all code stems from the fact that I would like to have ONE SINGLE place to withold all functions.
So, in the eventuality of me (or other people) finding bugs, one will fix in only one place, not across many multiple challenges.
Generation and showing a bunch of uniformly distributed numbers.
Working with pseudo-random numbers and the exponential distribution.
Validation of DTMC models, testing some modelling options.
I explored here two numerical methods for DTMC:
Implementation of a DTMC simulator using uniformly distributed pseudo-random numbers.
Conversion of CTMC to its embedded DTMC counterpart. Discover the maximum element of a CTMC.
Simulation of a CTMC.