Similar Items: Offline Two-Player Zero-Sum Markov Games with KL Regularization