Language models offer promises in encoding quantum correlations and learning complex quantum states. This Perspective discusses the advantages of employing language models in quantum simulation, explores recent model developments, and offers insights into opportunities for realizing scalable and accurate quantum simulation.