Text this: Uncovering Hidden Geometry in Transformers via Disentangling Position and Context