Sure-almost-sure and Sure-limit-sure Window Mean Payoff in Markov Decision Processes (ArXiv cs.GT Recent Papers, 2026)