Statistical field theory for Markov decision processes under uncertainty (Journal of Machine Learning Research, 2026)