Text this: Fine-Grained Graph Generation through Latent Mixture Scheduling