Reinforcement Learning for Infinite-Dimensional Systems (JMLR, 2026)