Fast Computation of Conditional Probabilities in MDPs and Markov Chain Families (ArXiv cs.LO Recent Papers, 2026)