Skip to content
This repository has been archived by the owner on Apr 17, 2023. It is now read-only.

Great PRs are never closed #80

Draft
wants to merge 1 commit into
base: ote
Choose a base branch
from

Conversation

daniil-lyakhov
Copy link

New scheduler which delayed reduce on plateau on given number of epoch. Useful when model is not compressed yet and scheduler shouldn't drop lr

@daniil-lyakhov daniil-lyakhov changed the title Drop on plateu delayed Drop on plateu delayed lr scheduler Sep 25, 2021
@daniil-lyakhov daniil-lyakhov force-pushed the dl/drop_on_plateu_delayed branch 2 times, most recently from cc87788 to d666b4c Compare September 27, 2021 12:07
@kprokofi
Copy link

Is this PR alive?

@daniil-lyakhov
Copy link
Author

daniil-lyakhov commented Nov 23, 2021

Yes, there are some results archived on mobilenet_v3 models +int8 + sparsity, but this PR should be merged after NNCF mobilenet_v3 / efficientnet models pruning support, pleese keep it if it isn't too complicated

@kprokofi
Copy link

is this PR alive?

@daniil-lyakhov
Copy link
Author

I'm still working on linear layers pruning transformation support. Please keep if it's possible

@daniil-lyakhov daniil-lyakhov force-pushed the dl/drop_on_plateu_delayed branch from d666b4c to 0ab5334 Compare February 10, 2022 09:41
@nervana-ff
Copy link

Can one of the admins verify this patch?

@kprokofi
Copy link

kprokofi commented Aug 22, 2022

Pruning is immortal, isn't it?

@daniil-lyakhov
Copy link
Author

Yes, sir!

Pruning is immortal, isn't it?

@kprokofi
Copy link

Is this PR alive? :D

@kprokofi kprokofi changed the title Drop on plateu delayed lr scheduler Great PRs are never closed Mar 14, 2023
@daniil-lyakhov
Copy link
Author

Is this PR alive? :D

Natürlich! We are planning to implement this feature ASAP

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants