A transition probability is the chance of moving from one position to another. If a knight can make 8 legal moves and picks uniformly at random, each transition has probability .
In a graph view: nodes are states, edges are transitions, and edge weights are probabilities. All outgoing edges from a state must sum to (something must happen). When transitions have different probabilities, you weight them . Rolling a loaded dice where 6 appears of the time changes everything.