Markov Decision Processes With Their Applicat