Text this: On the Problem of Latent Temporal Modulation in Diagnostic Decision-Making