Text this: RigidFormer: Learning Rigid Dynamics using Transformers