Text this: Offline Two-Player Zero-Sum Markov Games with KL Regularization