Similar Items: Discrete Flow Matching for Offline-to-Online Reinforcement Learning