Markov state projection

Project an initial probability row vector through a fixed transition matrix for a chosen number of steps.

The example value has been entered. Check it immediately or change the value.

Input is processed in the browser. Refreshing returns a sample value.

Result

Instructions and example

pₜ₊₁=pₜP; pₙ=p₀Pⁿ

Starting at 1,0 with matrix 0.8,0.2 / 0.1,0.9, 2 transitions give 0.66,0.34.

At most 8 states and 1,000 steps. Probabilities must be 0–1; row and initial sums must be within 10⁻¹² of 1. No automatic normalization. Floating-point results display at most 12 significant digits.

Frequently asked questions

Is the transition matrix row-stochastic?

Rows are current states and columns are next states. Each row lists outgoing probabilities.

Does projection guarantee a stationary limit?

No. Periodic or disconnected chains may not converge to a unique limit. Only the requested finite horizon is calculated.

Calculation criteria and reference materials

Verification of calculation criteria: · Calculation·verification principles · Report errors