-
Notifications
You must be signed in to change notification settings - Fork 1.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Core] Enhancements and refactoring of LoRA method #695
[Core] Enhancements and refactoring of LoRA method #695
Conversation
1. Refactor LoRA code 2. Add method to delete LoRA adapters 3. Add method to unload the PEFT LoRA model. 4. Add `svd` weighted adapter support. 5. minor fixes
…nctionality-updates
The documentation is not available anymore as the PR was closed or merged. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The refactoring looks nice ! I left one suggestion, also can you make sure slow tests pass just in case?
We could also add tests for delete_adapter / unload but can be done in a follow up PR I think
…nctionality-updates
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Very nice addition. This should give users much better control about how they deal with the adapters. I like it a lot.
I left a few comments, please take a look. I would also like to see tests for the new functionality, but I would be okay with them being added in a later PR.
Co-authored-by: Benjamin Bossan <BenjaminBossan@users.noreply.github.com>
@pacman100 Nice additions, especially the tests. Some are still failing, could you please check? |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Outstanding work, LGTM
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This looks great to me, amazing work !
What does this PR do?