Feb 212024 LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Microsoft presents LongRoPE Extending LLM context window beyond 2 million tokens. Join the discussion on this paper page.