Text this: When Can Voting Help, Hurt, or Change Course? Exact Structure of Binary Test-Time Aggregation