Topics in Online Markov Decision Processes