Skip to content

Pull requests: pytorch/torchtitan

New pull request New
19 Open 224 Closed
19 Open 224 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Update requirements.txt
#323 opened May 11, 2024 by qiziAI Loading…
1
Make Transformer tolerate missing layers for PP
CLA Signed This label is managed by the Meta Open Source bot.
#322 opened May 10, 2024 by wconstab Loading…
2
Refactor freqs_cis slice to be safer for PP
CLA Signed This label is managed by the Meta Open Source bot.
#321 opened May 10, 2024 by wconstab Loading…
selective compilation - norm layers only
CLA Signed This label is managed by the Meta Open Source bot.
#320 opened May 10, 2024 by lessw2020 Loading…
18
Add support of DDP and CompiledAutograd.
CLA Signed This label is managed by the Meta Open Source bot.
#319 opened May 9, 2024 by fegin Loading…
6
Add Pipeline Parallel (and 2D PP+FSDP) support
CLA Signed This label is managed by the Meta Open Source bot.
#318 opened May 9, 2024 by wconstab Loading…
7
[fused_rmsnorm] Register as a custom operator for tracing
CLA Signed This label is managed by the Meta Open Source bot.
#303 opened May 3, 2024 by wconstab Loading…
9
[fused_rmsnorm] Avoid querying device inside forward
CLA Signed This label is managed by the Meta Open Source bot.
#301 opened May 3, 2024 by wconstab Loading…
[fused_rmsnorm] Avoid conditional on dynamic stride
CLA Signed This label is managed by the Meta Open Source bot.
#300 opened May 3, 2024 by wconstab Loading…
2
register fused rmsnorm as pytorch custom op
CLA Signed This label is managed by the Meta Open Source bot.
#296 opened May 2, 2024 by tianyu-l • Draft
[wip] differentiate Rstd vs rstd
CLA Signed This label is managed by the Meta Open Source bot.
#294 opened May 2, 2024 by lessw2020 Loading…
Enable TP+PP support
CLA Signed This label is managed by the Meta Open Source bot.
#285 opened Apr 29, 2024 by wconstab Loading…
2
Use stateful dataloader to checkpoint data iteration order and token buffer
CLA Signed This label is managed by the Meta Open Source bot.
#279 opened Apr 26, 2024 by gokulavasan Loading…
1
25
torch.compile each TransformerBlock instead of the whole model
CLA Signed This label is managed by the Meta Open Source bot.
#268 opened Apr 25, 2024 by wanchaol Loading…
19
RFC for ckpt apis
CLA Signed This label is managed by the Meta Open Source bot.
#226 opened Apr 13, 2024 by wconstab Loading…
9
[RFC] Sharded embeddings in separate FSDP group
CLA Signed This label is managed by the Meta Open Source bot.
#182 opened Apr 1, 2024 by awgu • Draft
run sdpa with dtensor
CLA Signed This label is managed by the Meta Open Source bot.
#180 opened Mar 30, 2024 by tianyu-l Loading…
5
[Draft] PP tracing works
CLA Signed This label is managed by the Meta Open Source bot.
#155 opened Mar 20, 2024 by kwen2501 • Draft
Implement fast checkpoint path
CLA Signed This label is managed by the Meta Open Source bot.
#127 opened Mar 12, 2024 by fegin Loading…
2
ProTip! Add no:assignee to see everything that’s not assigned.