Markov state projection
Project an initial probability row vector through a fixed transition matrix for a chosen number of steps.
The example value has been entered. Check it immediately or change the value.
Input is processed in the browser. Refreshing returns a sample value.
Instructions and example
pₜ₊₁=pₜP; pₙ=p₀Pⁿ
Starting at 1,0 with matrix 0.8,0.2 / 0.1,0.9, 2 transitions give 0.66,0.34.
At most 8 states and 1,000 steps. Probabilities must be 0–1; row and initial sums must be within 10⁻¹² of 1. No automatic normalization. Floating-point results display at most 12 significant digits.
Frequently asked questions
Is the transition matrix row-stochastic?
Rows are current states and columns are next states. Each row lists outgoing probabilities.
Does projection guarantee a stationary limit?
No. Periodic or disconnected chains may not converge to a unique limit. Only the requested finite horizon is calculated.
Calculation criteria and reference materials
- Georgia Tech: stochastic matrices
Repeated stochastic-matrix application and state distributions. This tool uses row vectors rather than the source’s column convention.
Verification of calculation criteria: · Calculation·verification principles · Report errors