Skip to content

Issues: AI-Hypercomputer/torchprime

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

37 Open 17 Closed
37 Open 17 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Perf regression from updating torch_xla from 2.6 stable to Feb 17 nightly
#119 opened Feb 21, 2025 by tengyifei
Able to build a docker container using locally build pytorch/xla wheels enhancement New feature or request
#118 opened Feb 21, 2025 by bhavya01
Able to persist logs into GCS
#116 opened Feb 20, 2025 by tengyifei
Able to load a Huggingface dataset from a GCS cache
#115 opened Feb 20, 2025 by tengyifei
[torch_xla] Changing the sharding of model.embed_tokens.weight produces NaN gradients in Llama 3.1 405B
#114 opened Feb 18, 2025 by tengyifei
@tengyifei
[torch_xla] Performance of Llama 3.1 405B matches Huggingface fork on 2 pods
#112 opened Feb 14, 2025 by tengyifei Good quality Llama 3.1 405B in torch_xla_models
1
@tengyifei
Introduce a torch and torchax roller
#103 opened Feb 10, 2025 by tengyifei
Create nightly and stable release docker images
#99 opened Feb 8, 2025 by tengyifei
[Performance Report] What metrics to report?
#96 opened Feb 7, 2025 by zpcore
pytest --fork makes test easily hang
#94 opened Feb 7, 2025 by tengyifei
[torch_xla] MVP correctness check for Llama 3.0 8B
#90 opened Feb 6, 2025 by tengyifei Good quality Llama 3.1 8B and 70B in torch_xla_models
@zpcore
4
Bring up Stable Diffusion 2.1
#88 opened Feb 5, 2025 by tengyifei
Bring up Stable Diffusion 2.0
#87 opened Feb 5, 2025 by tengyifei
Hide ShardedModule from state dict
#82 opened Feb 5, 2025 by tengyifei
@tengyifei
Regression testing for torchprime models
#81 opened Feb 4, 2025 by tengyifei
[torch_xla_models] Integrate activation offloading
#80 opened Feb 4, 2025 by tengyifei Good quality Llama 3.1 405B in torch_xla_models
Remove generated xplane_pb2.py
#74 opened Feb 3, 2025 by tengyifei
tp log to follow the logs of a task
#68 opened Jan 31, 2025 by tengyifei
Calculate step duration and MFU after a training run is done
#67 opened Jan 31, 2025 by tengyifei
@tengyifei
Test torchprime on multiple TPU pods
#66 opened Jan 30, 2025 by bhavya01
Extract common model layers in a separate directory and test each one
#65 opened Jan 30, 2025 by bhavya01
@bhavya01
1
[torchax] Initialize the model weights with the right distribution for each weight
#58 opened Jan 28, 2025 by tengyifei
Mixtral 8x22B is implemented and optimized
#45 opened Jan 21, 2025 by tengyifei
@bhavya01
Performance of Mixtral 8x7B matches the Huggingface fork
#44 opened Jan 21, 2025 by tengyifei
@bhavya01
[torch_xla_models] Integrate scan
#41 opened Jan 15, 2025 by tengyifei Good quality Llama 3.1 405B in torch_xla_models
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.