Skip to content

Issues: deepspeedai/Megatron-DeepSpeed

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

133 Open 58 Closed
133 Open 58 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

support qwen2.5-32b?
#466 opened Feb 24, 2025 by RyanOvO
Does it support deployment and invocation under the Ascend system & CANN?
#465 opened Feb 21, 2025 by RyanOvO
Converting hf weights to mds: unable to find latest file
#464 opened Feb 17, 2025 by anasegor
Finetune issue with Llama2-7b
#463 opened Feb 14, 2025 by anasegor
Any one used “—exit-signal-handler” ?
#460 opened Feb 5, 2025 by HenryTangIntel
Model Inference issues with GPT-MoE models
#458 opened Jan 25, 2025 by 1155157110
Train GPT2 with 2nodes, 2gpu, tp=2 IndexError at megatron/core/tensor_parallel/cross_entropy.py
#457 opened Jan 13, 2025 by yuanpeng-zhu
Universal checkpoint for megatron
#453 opened Dec 7, 2024 by JiashuWu
Model conversion problem
#449 opened Sep 26, 2024 by yuanzhiyong1999
1
Async allreduce for tensor-parallel
#447 opened Sep 23, 2024 by drcanchi
[TRACKER] Customer support related PR tracker for Intel devices
#446 opened Sep 20, 2024 by delock
7 of 12 tasks
how to calcuate the training throughput
#444 opened Sep 12, 2024 by bigtree2020
llama3 and llama3.1 support
#443 opened Sep 10, 2024 by fmiao2372
1
[Bug] Missing weight gradients from LinearWithGradAccumulationAndAsyncCommunication when Zero Bubble Pipeline Parallelism Is disabled
#442 opened Sep 1, 2024 by mksit
Optimizer problem when using finetune_llama.sh
#440 opened Aug 28, 2024 by Kaiizx
3
zero3 The checkpoint being loaded used a DP world size of 8 but the current world size is 16. Automatic adjustment of ZeRO's optimizer state partitioning with a new world size is not currently supported.
#439 opened Aug 26, 2024 by ArtificialZeng
Why pretrain_llama_distributed.sh use pretrain_gpt.py ?
#437 opened Aug 22, 2024 by BrucePeng92
[bug]: ipex install breaks non xpu devices
#435 opened Aug 8, 2024 by saforem2
2
A tutorial to help you finetune LLama-2-7b using this repository full of garbarge code with ZeRO2/3 enabled.
#430 opened Jul 25, 2024 by LLMChild
1
How to resume training between GPTModel() checkpoint and GPTModelPipe() checkpoint?
#405 opened Jun 27, 2024 by tiggerwu
MOE TFLOPS calculation
#398 opened Jun 5, 2024 by yingzhao27
why moe can not use zero3
#397 opened Jun 4, 2024 by kuangdao
Inquiry on Sequence Parallel Support for VocabParallelEmbedding
#389 opened May 18, 2024 by qinxiangyujiayou
about the optimizer param group
#387 opened May 17, 2024 by L-hongbin
屎山代码DeepSpeed
#386 opened May 11, 2024 by ControllableGeneration
3
ProTip! Adding no:label will show everything without a label.