Similar Items: Temporal Structure Matters for Efficient Test-Time Adaptation in Wearable Human Activity Recognition