Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
ahxt authored Jun 1, 2024
1 parent 715c1e3 commit cdbbb06
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,7 @@ Implementation of the proposed Self-Extend in [LLM Maybe LongLM: Self-Extend LLM


## Updates
- [05/31/2024]:🎉 SelfExtend was highlighted in a Google I/O session at [YouTube](https://youtu.be/TV7qCk1dBWA?t=2025) to demonstrate the long-context ability of Gemma!!!
- [05/01/2024]:🎉 SelfExtend has been accepted by ICML 2024! See you in Vienna!
- [04/19/2024]:💡 We added the support for LLama-3 with transformers==4.40. To use it with transformers==4.40, you may change the file name of [Llama_4_40.py](./self_extend_patch/Llama_4_40.py) to ``Llama.py`` to replace the [existing patch file](./self_extend_patch/Llama.py).
- (Although, Llama-3's offical model hub recommends using transformers==4.40, we find that with transformers==4.38.2, Llama-3 can also work well)
Expand Down

0 comments on commit cdbbb06

Please sign in to comment.