Beyond Pairs: Your Language Model is Secretly Optimizing a Preference Graph (ArXiv cs.LG Recent Papers, 2026)