LongLM
Explore Self-Extend for efficient LLM context window expansion without additional tuning. This project leverages intrinsic language model strengths through bi-level attention. Recent updates include LLama-3 support and ICML 2024 presentation. Suitable for researchers and developers targeting long-sequence model efficiency.
