Skip to content

Issues: pytorch/torchtitan

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

75 Open 194 Closed
75 Open 194 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Nan's on step 1 of 405B model training
#951 opened Mar 11, 2025 by githubsgi
End-to-end training of DeepSeek V3
#942 opened Mar 7, 2025 by EugenHotaj
@kwen2501
2
[Feature] Add Multi-Token Prediction module enhancement New feature or request
#933 opened Mar 5, 2025 by lessw2020
@lessw2020
[TP] RuntimeError: shape '[1, 8192, -1, 128]' is invalid for input of size 524288 module: dtensor
#932 opened Mar 5, 2025 by aahehehe
1
CheckpointManager.save with async mode is vulnerable to race conditions module: checkpoint question Further information is requested
#930 opened Mar 5, 2025 by jamesbraza
6
Performance regression with FSDP2 due to exposed/non-overlapped comms module: fsdp
#929 opened Mar 5, 2025 by danielvegamyhre
@mori360
15
[Feature] Support skipping bad grad updates
#916 opened Mar 3, 2025 by yzhangcs
4
[Feature] add preflight NCCL and GEMM check to multinode slurm script
#915 opened Mar 3, 2025 by lessw2020
@lessw2020
[Feature] expose Torch Nan checker as configurable option in toml for those training at scale
#914 opened Mar 3, 2025 by lessw2020
@lessw2020
1
[Checkpointing] fails out if checkpoint folder does not exist when using keep_latest_k bug Something isn't working module: checkpoint
#911 opened Mar 2, 2025 by lessw2020
@fegin
1
[Checkpointing] Using keep_latest_k setting results in failure when using external mounted drive module: checkpoint
#909 opened Mar 1, 2025 by lessw2020
@fegin
1
[Possible PR discuss] Will a PR of training HF model be welcomed? community help wanted huggingface integration
#903 opened Feb 28, 2025 by junjzhang
1
7
Question about triton in deepseek implementtion question Further information is requested
#902 opened Feb 28, 2025 by zqwenn
@kwen2501
better handling of tensorwise float8 recipe in configuration
#901 opened Feb 27, 2025 by vkuzo
@vkuzo
1
[Feature request] Integrate DeepGEMM
#889 opened Feb 26, 2025 by lessw2020
@lessw2020
2
dcp.load fails on checkpoints prior to AdamW refactor module: checkpoint
#886 opened Feb 25, 2025 by eminorhan
@fegin
1
Possible to integrate DeepEP?
#885 opened Feb 25, 2025 by ericxsun
4
[Evaluation] Minimal support for downstream tasks community help wanted enhancement New feature or request
#883 opened Feb 24, 2025 by K-H-Ismail
4
[Float8] Rowwise with AsyncTP runs at roughly same perf as vanilla TP bug Something isn't working module: float8
#866 opened Feb 20, 2025 by lessw2020
@danielvegamyhre
4
How to define Custom Communication Operations for Custom Operators in Distributed Settings module: dtensor question Further information is requested
#852 opened Feb 17, 2025 by Doraemonzzz
@tianyu-l
3
"Universal" Checkpointing module: checkpoint question Further information is requested
#850 opened Feb 17, 2025 by jeromeku
4
Mitigation to HuggingFace Trainer enhancement New feature or request huggingface integration
#824 opened Feb 6, 2025 by huyiwen
7
HSDP causes loss instability module: fsdp question Further information is requested
#813 opened Jan 31, 2025 by apkumar
@weifengpy @mori360
3
debug model training hangs on NVIDIA B200 with >1 GPU bug Something isn't working module: c10d
#810 opened Jan 28, 2025 by vkuzo
3
unable to run 8b llama bug Something isn't working
#807 opened Jan 27, 2025 by asahni04
1
ProTip! Type g i on any issue or pull request to go back to the issue listing page.