Text this: Memory-Efficient Continual Learning with CLIP Models