Text this: Conformity Generates Collective Misalignment in AI Agents Societies