Text this: Don't Be a Pot Stirrer! Authorized Vector Data Retrieval via Access-Aware Indexing