Text this: Inherent Tradeoffs in Learning Fair Representations