Bayesian Inference of Contextual Bandit Policies via Empirical Likelihood (Journal of Machine Learning Research, 2026)