Similar Items: Reconstruction or Semantics? What Makes a Latent Space Useful for Robotic World Models