{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":92541759,"defaultBranch":"main","name":"benchmark","ownerLogin":"pytorch","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2017-05-26T19:21:12.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/21003710?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1717087370.0","currentOid":""},"activityList":{"items":[{"before":"324b74702652346167488eefe0ff248ba36e15c7","after":"d54ca9f80ead108c8797441681e219becaf963d8","ref":"refs/heads/main","pushedAt":"2024-06-01T17:04:26.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"facebook-github-bot","name":"Facebook Community Bot","path":"/facebook-github-bot","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6422482?s=80&v=4"},"commit":{"message":"utility to generate bytecode from template function (#127359)\n\nSummary:\nThis will be helpful in reducing some of the hardcoded and python-version-dependent bytecode generation in various places in dynamo - e.g. resume function generation and object reconstruction.\n\nX-link: https://github.com/pytorch/pytorch/pull/127359\nApproved by: https://github.com/jansel\nghstack dependencies: #127329\n\nReviewed By: izaitsevfb\n\nDifferential Revision: D58015503\n\nPulled By: williamwen42\n\nfbshipit-source-id: efdf8394aaa34c4e3297dcd632cc61566b9b70d1","shortMessageHtmlLink":"utility to generate bytecode from template function (#127359)"}},{"before":"1dc4eee8a31ca196167d19605e041da8f683cf77","after":"324b74702652346167488eefe0ff248ba36e15c7","ref":"refs/heads/main","pushedAt":"2024-05-31T18:48:47.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"facebook-github-bot","name":"Facebook Community Bot","path":"/facebook-github-bot","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6422482?s=80&v=4"},"commit":{"message":"move detectron2 pin to the most recent tip (#2272)\n\nSummary:\nWith the existing pin, cpp extension compilation on ROCm fails.\n\n# Testing\n`$ pip install --user --verbose -r torchbenchmark/util/framework/detectron2/requirements.txt`\n\n(ensure the extension is successfully built)\n\nPull Request resolved: https://github.com/pytorch/benchmark/pull/2272\n\nReviewed By: davidberard98\n\nDifferential Revision: D57938441\n\nPulled By: xuzhao9\n\nfbshipit-source-id: 87f9e131b066a969c8c48afd692639363bddc4a0","shortMessageHtmlLink":"move detectron2 pin to the most recent tip (#2272)"}},{"before":"d70dc8b9ef11685ca4fe0e2908649dffa2ce24d0","after":"1dc4eee8a31ca196167d19605e041da8f683cf77","ref":"refs/heads/main","pushedAt":"2024-05-31T11:53:07.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"facebook-github-bot","name":"Facebook Community Bot","path":"/facebook-github-bot","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6422482?s=80&v=4"},"commit":{"message":"extract calculate_time_spent from print_time_report (#127362)\n\nSummary:\nFixes #ISSUE_NUMBER\n\nwrap certain steps in a separate function for easier TTFB instrumentation (fb internal use case)\n\nX-link: https://github.com/pytorch/pytorch/pull/127362\nApproved by: https://github.com/yanboliang, https://github.com/mengluy0125\n\nReviewed By: yanboliang, PaliC, mengluy0125\n\nDifferential Revision: D57889404\n\nPulled By: dshi7\n\nfbshipit-source-id: d87091f0f1470c6235f532050f7d61edd0d43878","shortMessageHtmlLink":"extract calculate_time_spent from print_time_report (#127362)"}},{"before":"91ac5189fa5d981416c46ee12ec36256359bcd35","after":"d7822effc4418c5a5a449f8523851d2c82284c6e","ref":"refs/heads/xz9/deploy-torchao-ci","pushedAt":"2024-05-31T03:08:31.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"xuzhao9","name":"Xu Zhao","path":"/xuzhao9","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/502017?s=80&v=4"},"commit":{"message":"More logging and warnings","shortMessageHtmlLink":"More logging and warnings"}},{"before":"48a205807fda3e9edacaf22efdd57a04c99004a7","after":"d70dc8b9ef11685ca4fe0e2908649dffa2ce24d0","ref":"refs/heads/main","pushedAt":"2024-05-30T21:16:41.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"facebook-github-bot","name":"Facebook Community Bot","path":"/facebook-github-bot","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6422482?s=80&v=4"},"commit":{"message":"Enable Huggingface and Timm models for interal buck runner (#2274)\n\nSummary:\nPull Request resolved: https://github.com/pytorch/benchmark/pull/2274\n\nX-link: https://github.com/pytorch/pytorch/pull/127460\n\nAdd huggingface and timm model runs to the internal pt2 benchmark runner.\n\nReviewed By: HDCharles, huydhn\n\nDifferential Revision: D57930582\n\nfbshipit-source-id: 5904e99d205d030a574e551c2c257c65f2e9c830","shortMessageHtmlLink":"Enable Huggingface and Timm models for interal buck runner (#2274)"}},{"before":"8a5f6b7c2f49ec799fcfa1bfb4dba2be3e67490c","after":"91ac5189fa5d981416c46ee12ec36256359bcd35","ref":"refs/heads/xz9/deploy-torchao-ci","pushedAt":"2024-05-30T18:52:22.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"xuzhao9","name":"Xu Zhao","path":"/xuzhao9","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/502017?s=80&v=4"},"commit":{"message":"More logging and warnings","shortMessageHtmlLink":"More logging and warnings"}},{"before":"d9dfd0d4072cb35d789dca8664a099bfb30397e4","after":"8a5f6b7c2f49ec799fcfa1bfb4dba2be3e67490c","ref":"refs/heads/xz9/deploy-torchao-ci","pushedAt":"2024-05-30T18:45:32.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"xuzhao9","name":"Xu Zhao","path":"/xuzhao9","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/502017?s=80&v=4"},"commit":{"message":"Another fix","shortMessageHtmlLink":"Another fix"}},{"before":"e186f8a84a6df9539cb6f89fcfb5bcdf948f3891","after":"d9dfd0d4072cb35d789dca8664a099bfb30397e4","ref":"refs/heads/xz9/deploy-torchao-ci","pushedAt":"2024-05-30T18:45:01.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"xuzhao9","name":"Xu Zhao","path":"/xuzhao9","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/502017?s=80&v=4"},"commit":{"message":"Copy timm and huggingface files from dynamobench","shortMessageHtmlLink":"Copy timm and huggingface files from dynamobench"}},{"before":"c6b071a146fd3678cab063ad5ee3e4539e51e804","after":"e186f8a84a6df9539cb6f89fcfb5bcdf948f3891","ref":"refs/heads/xz9/deploy-torchao-ci","pushedAt":"2024-05-30T18:41:36.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"xuzhao9","name":"Xu Zhao","path":"/xuzhao9","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/502017?s=80&v=4"},"commit":{"message":"Run torchbench first","shortMessageHtmlLink":"Run torchbench first"}},{"before":"22264db97a2022017ce9ff368f958178bb76892f","after":"c6b071a146fd3678cab063ad5ee3e4539e51e804","ref":"refs/heads/xz9/deploy-torchao-ci","pushedAt":"2024-05-30T18:33:59.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"xuzhao9","name":"Xu Zhao","path":"/xuzhao9","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/502017?s=80&v=4"},"commit":{"message":"Another fix","shortMessageHtmlLink":"Another fix"}},{"before":"0146901fd50ef85f36288bbd6fd2b8714ed8bf1a","after":"22264db97a2022017ce9ff368f958178bb76892f","ref":"refs/heads/xz9/deploy-torchao-ci","pushedAt":"2024-05-30T18:27:33.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"xuzhao9","name":"Xu Zhao","path":"/xuzhao9","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/502017?s=80&v=4"},"commit":{"message":"Another fix","shortMessageHtmlLink":"Another fix"}},{"before":"c70d56c00a509ea166da68c57907588bc7e99a82","after":"0146901fd50ef85f36288bbd6fd2b8714ed8bf1a","ref":"refs/heads/xz9/deploy-torchao-ci","pushedAt":"2024-05-30T18:26:41.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"xuzhao9","name":"Xu Zhao","path":"/xuzhao9","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/502017?s=80&v=4"},"commit":{"message":"Add run fix","shortMessageHtmlLink":"Add run fix"}},{"before":"80f042eb9d0b523d4d5c316891ca50eb259156c1","after":"c70d56c00a509ea166da68c57907588bc7e99a82","ref":"refs/heads/xz9/deploy-torchao-ci","pushedAt":"2024-05-30T18:13:04.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"xuzhao9","name":"Xu Zhao","path":"/xuzhao9","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/502017?s=80&v=4"},"commit":{"message":"Fix a couple of bugs","shortMessageHtmlLink":"Fix a couple of bugs"}},{"before":"48e0256a8dee0f5162ce867cde34bf2bc402200e","after":"80f042eb9d0b523d4d5c316891ca50eb259156c1","ref":"refs/heads/xz9/deploy-torchao-ci","pushedAt":"2024-05-30T16:54:41.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"xuzhao9","name":"Xu Zhao","path":"/xuzhao9","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/502017?s=80&v=4"},"commit":{"message":"Added the action","shortMessageHtmlLink":"Added the action"}},{"before":"d1f097688200015b44a1ed621338a441fc9646d6","after":"48e0256a8dee0f5162ce867cde34bf2bc402200e","ref":"refs/heads/xz9/deploy-torchao-ci","pushedAt":"2024-05-30T16:52:11.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"xuzhao9","name":"Xu Zhao","path":"/xuzhao9","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/502017?s=80&v=4"},"commit":{"message":"Added the action","shortMessageHtmlLink":"Added the action"}},{"before":"05438d3e4bc613df8ef401c76a247b5fa2b9d9b2","after":"d1f097688200015b44a1ed621338a441fc9646d6","ref":"refs/heads/xz9/deploy-torchao-ci","pushedAt":"2024-05-30T16:45:14.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"xuzhao9","name":"Xu Zhao","path":"/xuzhao9","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/502017?s=80&v=4"},"commit":{"message":"Skip installing torchbench","shortMessageHtmlLink":"Skip installing torchbench"}},{"before":null,"after":"05438d3e4bc613df8ef401c76a247b5fa2b9d9b2","ref":"refs/heads/xz9/deploy-torchao-ci","pushedAt":"2024-05-30T16:42:50.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"xuzhao9","name":"Xu Zhao","path":"/xuzhao9","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/502017?s=80&v=4"},"commit":{"message":"Added torchao nightly workflow","shortMessageHtmlLink":"Added torchao nightly workflow"}},{"before":"dba0e0f1b142c007cb81a13bf785d402f9175443","after":"0e80036f8ee0e6c14d3b15a318ba0e7693f37cef","ref":"refs/heads/atalman/r2.2.x","pushedAt":"2024-05-30T16:42:06.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"atalman","name":"Andrey Talman","path":"/atalman","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/7563158?s=80&v=4"},"commit":{"message":"Update setup_env.sh","shortMessageHtmlLink":"Update setup_env.sh"}},{"before":"aa413c897a628093adce4362de31af43d079dfb3","after":"dba0e0f1b142c007cb81a13bf785d402f9175443","ref":"refs/heads/atalman/r2.2.x","pushedAt":"2024-05-30T16:40:40.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"atalman","name":"Andrey Talman","path":"/atalman","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/7563158?s=80&v=4"},"commit":{"message":"Create 2.3.1.yaml","shortMessageHtmlLink":"Create 2.3.1.yaml"}},{"before":"a5f1710debe9d3b3adc639a706dfc81ba6feec1d","after":"48a205807fda3e9edacaf22efdd57a04c99004a7","ref":"refs/heads/main","pushedAt":"2024-05-30T03:24:29.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"facebook-github-bot","name":"Facebook Community Bot","path":"/facebook-github-bot","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6422482?s=80&v=4"},"commit":{"message":"Let random seed setting work on xpu device (#2270)\n\nSummary:\nThis Pull Request relates to [Roadmap Issue https://github.com/pytorch/benchmark/issues/1293](https://github.com/pytorch/benchmark/issues/1293) by enhancing our benchmark coverage.\n\nCurrently, Torchbench utilizes a custom random seed function that is incompatible with the XPU device backend.\nThis incompatibility affects models that include random data augmentation operations, leading to accuracy check failures due to variations in input data across two separate runs.\n\nIn this PR, we introduce support for setting a random seed for the XPU backend.\n\nPull Request resolved: https://github.com/pytorch/benchmark/pull/2270\n\nReviewed By: davidberard98\n\nDifferential Revision: D57884498\n\nPulled By: xuzhao9\n\nfbshipit-source-id: 24234674333945782b233191e42a8b344e90d74c","shortMessageHtmlLink":"Let random seed setting work on xpu device (#2270)"}},{"before":"d21607df3e02aee20bba9c6b31be638b18dc5ef3","after":"a5f1710debe9d3b3adc639a706dfc81ba6feec1d","ref":"refs/heads/main","pushedAt":"2024-05-29T19:40:20.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"facebook-github-bot","name":"Facebook Community Bot","path":"/facebook-github-bot","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6422482?s=80&v=4"},"commit":{"message":"Add CUTLASS + PT2-Triton kernels to gemm benchmark\n\nSummary:\nI did it by simply setting the max_autotune backend to only CUTLASS/TRITON as needed.\n\nI also modified the baseline benchmark to explicitly disable autotuning, so that we can be more confident that it is invoking the ATen kernel.\n\nReviewed By: bertmaher, xuzhao9, chenyang78\n\nDifferential Revision: D56685216\n\nfbshipit-source-id: 1638266254690b929f8c5591a194127c6a7c7be8","shortMessageHtmlLink":"Add CUTLASS + PT2-Triton kernels to gemm benchmark"}},{"before":"b9e088a5b0b36cda275779cd5d4762d33f2982b0","after":"d21607df3e02aee20bba9c6b31be638b18dc5ef3","ref":"refs/heads/main","pushedAt":"2024-05-29T15:40:39.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"facebook-github-bot","name":"Facebook Community Bot","path":"/facebook-github-bot","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6422482?s=80&v=4"},"commit":{"message":"fix typo for `usort` config in `pyproject.toml`\n\nSummary:\nThe `usort` config in `pyproject.toml` has no effect due to a typo. Fixing the typo make `usort` do more and generate the changes in the PR. Except `pyproject.toml`, all changes are generated by `lintrunner -a --take UFMT --all-files`.\n\nX-link: https://github.com/pytorch/pytorch/pull/127126\nApproved by: https://github.com/kit1980\n\nReviewed By: PaliC\n\nDifferential Revision: D57894793\n\nfbshipit-source-id: 6af4fcb5eae8fd114024359beb3fae7f3928de2e","shortMessageHtmlLink":"fix typo for usort config in pyproject.toml"}},{"before":"d861287475398ea3eb56f89b1241213db403a0b7","after":"b9e088a5b0b36cda275779cd5d4762d33f2982b0","ref":"refs/heads/main","pushedAt":"2024-05-29T15:26:26.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"facebook-github-bot","name":"Facebook Community Bot","path":"/facebook-github-bot","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6422482?s=80&v=4"},"commit":{"message":"cudagraphs: fix backward hooks & fsdp interaction (#126914)\n\nSummary:\nFixes\n\n> ERROR: expected to be in states [] but current state is TrainingState.IDLE\n\nError that would occur when composing pt2 fsdp and cudagraphs. Cudagraphs caches output tensor impls in the fast path, so we were inadvertently accumulating multiple hooks on what should have been fresh allocations.\n\nfrom code comment:\n```\n# this output represents a fresh allocated tensor.\n# We return the same TensorImpl from run to run to avoid overhead.\n# autograd.Function will reset the Autograd meta of output tensors\n# as part of aot_autograd, but _backward_hooks are stored on tensors separately,\n# so we need to manually reset hooks.\n``\n\nX-link: https://github.com/pytorch/pytorch/pull/126914\nApproved by: https://github.com/awgu, https://github.com/xmfan\n\nReviewed By: PaliC\n\nDifferential Revision: D57894638\n\nPulled By: eellison\n\nfbshipit-source-id: e588943f3d83d99edbf78aa38d374f66ce2d2b6f","shortMessageHtmlLink":"cudagraphs: fix backward hooks & fsdp interaction (#126914)"}},{"before":"68d77364de68cbe9132d4936a0738957be43d964","after":"d861287475398ea3eb56f89b1241213db403a0b7","ref":"refs/heads/main","pushedAt":"2024-05-28T22:30:51.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"facebook-github-bot","name":"Facebook Community Bot","path":"/facebook-github-bot","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6422482?s=80&v=4"},"commit":{"message":"Add the pt2 runner and collect triton kernels\n\nSummary: Add pt2 runner to torchbench and write about how to find generated Triton kernels from PT2.\n\nReviewed By: blaine-rister\n\nDifferential Revision: D57874376\n\nfbshipit-source-id: a3aaef17b0c3f65aef1b1b07a35e5703771bc9e1","shortMessageHtmlLink":"Add the pt2 runner and collect triton kernels"}},{"before":"96183a050a98bb49e9674d40d9bd103919b0ae1f","after":null,"ref":"refs/heads/fixup-T190511188-main","pushedAt":"2024-05-28T19:18:32.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"xuzhao9","name":"Xu Zhao","path":"/xuzhao9","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/502017?s=80&v=4"}},{"before":"f0801d6e1cc3021f7f77dc31df83c3693943e01b","after":"68d77364de68cbe9132d4936a0738957be43d964","ref":"refs/heads/main","pushedAt":"2024-05-28T19:18:15.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"xuzhao9","name":"Xu Zhao","path":"/xuzhao9","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/502017?s=80&v=4"},"commit":{"message":"Re-sync with internal repository (#2271)\n\nAdd torchao_backend.py to pt2 benchmark runner","shortMessageHtmlLink":"Re-sync with internal repository (#2271)"}},{"before":null,"after":"96183a050a98bb49e9674d40d9bd103919b0ae1f","ref":"refs/heads/fixup-T190511188-main","pushedAt":"2024-05-28T19:17:35.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"facebook-github-bot","name":"Facebook Community Bot","path":"/facebook-github-bot","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6422482?s=80&v=4"},"commit":{"message":"Re-sync with internal repository\n\nThe internal and external repositories are out of sync. This Pull Request attempts to brings them back in sync by patching the GitHub repository. Please carefully review this patch. You must disable ShipIt for your project in order to merge this pull request. DO NOT IMPORT this pull request. Instead, merge it directly on GitHub using the MERGE BUTTON. Re-enable ShipIt after merging.","shortMessageHtmlLink":"Re-sync with internal repository"}},{"before":"71646506e3662e63b7f30f7ece69947894dd591d","after":"f0801d6e1cc3021f7f77dc31df83c3693943e01b","ref":"refs/heads/main","pushedAt":"2024-05-28T17:39:25.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"facebook-github-bot","name":"Facebook Community Bot","path":"/facebook-github-bot","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6422482?s=80&v=4"},"commit":{"message":"Update ruff to 0.4.5 (#126979)\n\nSummary:\nUpdate ruff to 0.4.5 and addresses some false negatives that have been found in the newer version.\n\nX-link: https://github.com/pytorch/pytorch/pull/126979\nApproved by: https://github.com/ezyang\n\nReviewed By: PaliC\n\nDifferential Revision: D57838330\n\nfbshipit-source-id: 4a82b39d210aae80cd836738d5ca126fd4c15fe5","shortMessageHtmlLink":"Update ruff to 0.4.5 (#126979)"}},{"before":"23aa052a40532af3ae390e3a8a82707414fc5ba7","after":"71646506e3662e63b7f30f7ece69947894dd591d","ref":"refs/heads/main","pushedAt":"2024-05-28T16:30:07.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"facebook-github-bot","name":"Facebook Community Bot","path":"/facebook-github-bot","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6422482?s=80&v=4"},"commit":{"message":"fix typo for `usort` config in `pyproject.toml`\n\nSummary:\nThe `usort` config in `pyproject.toml` has no effect due to a typo. Fixing the typo make `usort` do more and generate the changes in the PR. Except `pyproject.toml`, all changes are generated by `lintrunner -a --take UFMT --all-files`.\n\nX-link: https://github.com/pytorch/pytorch/pull/127122\nApproved by: https://github.com/kit1980\n\nReviewed By: PaliC\n\nDifferential Revision: D57837972\n\nfbshipit-source-id: f240582058fc74142d26ea85f919b770f2bd5331","shortMessageHtmlLink":"fix typo for usort config in pyproject.toml"}},{"before":"d5d27628ddd374143bdca3aafb0c1d5d95180b2e","after":"23aa052a40532af3ae390e3a8a82707414fc5ba7","ref":"refs/heads/main","pushedAt":"2024-05-28T16:20:24.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"facebook-github-bot","name":"Facebook Community Bot","path":"/facebook-github-bot","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6422482?s=80&v=4"},"commit":{"message":"Deprecate device-specific GradScaler autocast API (#126527)\n\nSummary:\n# Motivation\n\n## for `torch.amp.GradScaler`,\n- `torch.cpu.amp.GradScaler(args...)` is completely equivalent to `torch. amp.GradScaler(\"cpu\", args...)`.\n- `torch.cuda.amp.GradScaler(args...)` is completely equivalent to `torch.amp.GradScaler(\"cuda\", args...)`.\n\nSo, we intend to depreate them and **strongly recommend** developer to use `torch.amp.GradScaler`.\n\n## for `custom_fwd` and `custom_bwd`,\nthis is a good solution to make the custom function run with or without effect even in an autocast-enabled region and can be shared by other backends, like CPU and XPU.\nSo we generalize it to be device-agnostic and put them int `torch/amp/autocast_mode.py` and re-expose to `torch.amp.custom_fwd` and `torch.amp.custom_bwd`. Meanwhile, we deprecate `torch.cuda.amp.custom_fwd` and `torch.cuda.amp.custom_bwd`.\n\n# Additional Context\nAdd UT to cover the deprecated warning.\nNo need for more UTs to cover the functionality of `torch.amp.custom_f/bwd`, the existing UTs that previously covered the functionality of `torch.cuda.amp.custom_f/bwd` can cover them.\nTo facilitate the review, we separate these code changes to two PRs. The first PR cover `torch.amp.GradScaler`. The follow-up covers `custom_fwd` and `custom_bwd`.\n\nX-link: https://github.com/pytorch/pytorch/pull/126527\nApproved by: https://github.com/jgong5, https://github.com/gujinghui, https://github.com/janeyx99, https://github.com/EikanWang\n\nReviewed By: PaliC\n\nDifferential Revision: D57838085\n\nfbshipit-source-id: 09a29e2535e66643d212276779605c573391666f","shortMessageHtmlLink":"Deprecate device-specific GradScaler autocast API (#126527)"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEWdDv2AA","startCursor":null,"endCursor":null}},"title":"Activity ยท pytorch/benchmark"}