In this paper, we describe various stochastic process models, mainly the Markov model, for medical decision-making. Particular attention is given to modeling, the Markov cohort model and the Markov decision process model for computation and limitation in stochastic models. We also discuss the current problems: how to collect the required data and the relation between the model solution and the actual decision.