Text this: Fast Computation of Conditional Probabilities in MDPs and Markov Chain Families