Pruning

Analysing pruning strategies.

Setup

# checkout the code and install all dependencies
git clone https://github.com/andrijazz/pruning
cd pruning
bash init_env.sh <PROJECT_NAME> <PATH_TO_YOUR_DATA_STORAGE>
pipenv install

# activate venv
pipenv shell

# train model
python run.py --mode train

# test models and plot results to w&b
python run.py --mode test

References

• https://jacobgil.github.io/deeplearning/pruning-deep-learning
• https://for.ai/blog/targeted-dropout/
• https://arxiv.org/pdf/1905.13678.pdf