Text this: ALAM: Algebraically Consistent Latent Transitions for Vision-Language-Action Models