Similar Items: Hierarchies of No-regret Algorithms