Prompting is not Enough: Exploring Knowledge Integration and Controllable Generation on Large Language Models (Big Data Mining and Analytics, 2026)