Reinforcement Learning for Infinite-Dimensional Systems (Journal of Machine Learning Research, 2026)