deepseek-r1 Notebook: Add Option for DeepSeek-R1-Distill-Qwen-32B Model #2732
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Contributor
ekurniaw
commented
Feb 7, 2025
ekurniaw
commented
- Request to Add DeepSeek R1 Qwen 32B #2718
- The 32B is the one comparable in capability as OpenAI-o1-mini 100B.
- Tested with OpenVINO 2024.6 on ARL-S 285K CPU with 32 GB RAM and 500 GB drive (200 GB for vRAM swap file and 200 GB to store the model). Also, tested successfully on ARL-H 285H iGPU with 64 GB RAM.
- Tested with OpenVINO 2025.0 on ARL-S 285K CPU as well.
- The 32B is the one comparable in capability as OpenAI-o1-mini 100B.
|
@ekurniaw could you please also update notebook description and readme with model info? Also it is good to mention about RAM requirements |
- Add DeepSeek-R1-Distil-Qwen-32B model information to deepseek-r1 Notebook and README.md.
deepseek-r1 Notebook: Add Option for DeepSeek-R1-Distill-Qwen-32B Model
|
Check out this pull request on See visual diffs & provide feedback on Jupyter Notebooks. Powered by ReviewNB |
- Remove vRAM word.
Fix deepseek-r1 Notebook Spell Check
eaidova
approved these changes
Feb 10, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.