Graph-accelerated Markov Chain Monte Carlo using Approximate Samples (JMLR, 2026)