GIGAZINE

A video showing how miraculous the probability of 'shikanokokonokoshitantan' appearing in a Markov chain is

A Markov chain is a sequence of random variables that satisfies P(X t+1 ∣X t ,X t−1 ,…,X 1 )=P(X t+1 ∣X t ). Simply put, it is a sequence in which X t+1 depends only on X t and appears before X t−1 ...
JSTOR Daily

Light-Tailed Asymptotics of Stationary Probability Vectors of Markov Chains of GI/G/1 Type

In this paper, we consider the asymptotic behavior of stationary probability vectors of Markov chains of GI/G/1 type. The generating function of the stationary probability vector is explicitly ...
JSTOR Daily

How Does the Value Function of a Markov Decision Process Depend on the Transition Probabilities?

Mathematics of Operations Research, Vol. 22, No. 4 (Nov., 1997), pp. 872-885 (14 pages) The present work deals with the comparison of (discrete time) Markov decision processes (MDPs), which differ ...
Risk

Recursive formulas for the default probability distribution with applications in Markov chain-based intensity models

The probability distribution of the number of defaults plays an important role in pricing problems of multiple-name credit derivatives. When the group size gets large, it becomes increasingly ...