Blog

May 1, 2024

Extending Llama-3’s Context Ten-Fold Overnight

Posted by in category: futurism

https://huggingface.co/papers/2404.

We extend the context length of Llama-3-8B-Instruct from 8K to 80K via QLoRA fine-tuning.


Join the discussion on this paper page.

Comments are closed.