CARVIEW |
Select Language
HTTP/2 200
date: Sun, 27 Jul 2025 12:54:32 GMT
content-type: text/html; charset=utf-8
vary: X-PJAX, X-PJAX-Container, Turbo-Visit, Turbo-Frame, X-Requested-With,Accept-Encoding, Accept, X-Requested-With
x-repository-download: git clone https://github.com/PaddlePaddle/Paddle.git
etag: W/"8f4a20b5eaf2d75c3edc5c830a236fc8"
cache-control: max-age=0, private, must-revalidate
strict-transport-security: max-age=31536000; includeSubdomains; preload
x-frame-options: deny
x-content-type-options: nosniff
x-xss-protection: 0
referrer-policy: no-referrer-when-downgrade
content-security-policy: default-src 'none'; base-uri 'self'; child-src github.githubassets.com github.com/assets-cdn/worker/ github.com/assets/ gist.github.com/assets-cdn/worker/; connect-src 'self' uploads.github.com www.githubstatus.com collector.github.com raw.githubusercontent.com api.github.com github-cloud.s3.amazonaws.com github-production-repository-file-5c1aeb.s3.amazonaws.com github-production-upload-manifest-file-7fdce7.s3.amazonaws.com github-production-user-asset-6210df.s3.amazonaws.com *.rel.tunnels.api.visualstudio.com wss://*.rel.tunnels.api.visualstudio.com objects-origin.githubusercontent.com copilot-proxy.githubusercontent.com proxy.individual.githubcopilot.com proxy.business.githubcopilot.com proxy.enterprise.githubcopilot.com *.actions.githubusercontent.com wss://*.actions.githubusercontent.com productionresultssa0.blob.core.windows.net/ productionresultssa1.blob.core.windows.net/ productionresultssa2.blob.core.windows.net/ productionresultssa3.blob.core.windows.net/ productionresultssa4.blob.core.windows.net/ productionresultssa5.blob.core.windows.net/ productionresultssa6.blob.core.windows.net/ productionresultssa7.blob.core.windows.net/ productionresultssa8.blob.core.windows.net/ productionresultssa9.blob.core.windows.net/ productionresultssa10.blob.core.windows.net/ productionresultssa11.blob.core.windows.net/ productionresultssa12.blob.core.windows.net/ productionresultssa13.blob.core.windows.net/ productionresultssa14.blob.core.windows.net/ productionresultssa15.blob.core.windows.net/ productionresultssa16.blob.core.windows.net/ productionresultssa17.blob.core.windows.net/ productionresultssa18.blob.core.windows.net/ productionresultssa19.blob.core.windows.net/ github-production-repository-image-32fea6.s3.amazonaws.com github-production-release-asset-2e65be.s3.amazonaws.com insights.github.com wss://alive.github.com api.githubcopilot.com api.individual.githubcopilot.com api.business.githubcopilot.com api.enterprise.githubcopilot.com; font-src github.githubassets.com; form-action 'self' github.com gist.github.com copilot-workspace.githubnext.com objects-origin.githubusercontent.com; frame-ancestors 'none'; frame-src viewscreen.githubusercontent.com notebooks.githubusercontent.com; img-src 'self' data: blob: github.githubassets.com media.githubusercontent.com camo.githubusercontent.com identicons.github.com avatars.githubusercontent.com private-avatars.githubusercontent.com github-cloud.s3.amazonaws.com objects.githubusercontent.com release-assets.githubusercontent.com secured-user-images.githubusercontent.com/ user-images.githubusercontent.com/ private-user-images.githubusercontent.com opengraph.githubassets.com copilotprodattachments.blob.core.windows.net/github-production-copilot-attachments/ github-production-user-asset-6210df.s3.amazonaws.com customer-stories-feed.github.com spotlights-feed.github.com objects-origin.githubusercontent.com *.githubusercontent.com; manifest-src 'self'; media-src github.com user-images.githubusercontent.com/ secured-user-images.githubusercontent.com/ private-user-images.githubusercontent.com github-production-user-asset-6210df.s3.amazonaws.com gist.github.com; script-src github.githubassets.com; style-src 'unsafe-inline' github.githubassets.com; upgrade-insecure-requests; worker-src github.githubassets.com github.com/assets-cdn/worker/ github.com/assets/ gist.github.com/assets-cdn/worker/
server: github.com
content-encoding: gzip
accept-ranges: bytes
set-cookie: _gh_sess=dEYSh7P2Rz1G9RizhnqDCqd0sVlCgJkOn%2FHp3ObCyPF4fbEyMw5vEx1lpVRD8kFAXdMdiL1%2FqfPoRtXQeO5So3%2BtLdjKTvF7kjCuyikWhPQdT58tY63YNObpsjcORWpZ3nBvTb9cP%2Byj7PAa0mPRdipmb%2FEpEdOTkzIQN7z%2BMn66shpyYhpv86KmJOJE5YDKG7ZrdaGKjo%2BNiExz8KVRNlyQYbrgY3sLq4ZtSx%2BgLRyP7VqKGnac5rNF3BjornGQoCs0r3hbXAlQ%2B6cJYVrnTQ%3D%3D--xjaP0KbsJPEUWf0E--LUSWrXQEcjdUx%2Be8p9G97w%3D%3D; Path=/; HttpOnly; Secure; SameSite=Lax
set-cookie: _octo=GH1.1.1216607775.1753620871; Path=/; Domain=github.com; Expires=Mon, 27 Jul 2026 12:54:31 GMT; Secure; SameSite=Lax
set-cookie: logged_in=no; Path=/; Domain=github.com; Expires=Mon, 27 Jul 2026 12:54:31 GMT; HttpOnly; Secure; SameSite=Lax
x-github-request-id: B68E:37D5F1:E3D558:12C7D30:68862187
[AutoParallel] Support pipeline parallelism backward non-computation … · PaddlePaddle/Paddle@3b44f88 · GitHub
Copy file name to clipboardExpand all lines: paddle/fluid/eager/auto_code_generator/generator/eager_gen.py
Copy file name to clipboardExpand all lines: paddle/fluid/eager/grad_node_info.cc
Copy file name to clipboardExpand all lines: paddle/fluid/eager/grad_node_info.h
Copy file name to clipboardExpand all lines: paddle/fluid/eager/grad_tensor_holder.cc
Copy file name to clipboardExpand all lines: paddle/fluid/eager/utils.cc
Copy file name to clipboardExpand all lines: paddle/phi/api/lib/api_gen_utils.cc
Copy file name to clipboardExpand all lines: paddle/phi/api/lib/api_gen_utils.h
Copy file name to clipboardExpand all lines: paddle/phi/api/lib/data_transform.cc
Copy file name to clipboardExpand all lines: paddle/phi/api/lib/tensor_utils.cc
Copy file name to clipboardExpand all lines: paddle/phi/api/yaml/generator/dist_api_gen.py
Skip to content
Navigation Menu
{{ message }}
-
Notifications
You must be signed in to change notification settings - Fork 5.8k
Commit 3b44f88
authored
[AutoParallel] Support pipeline parallelism backward non-computation clip. (#58609)
* [AutoParallel] Support paddle.distributed.reshard construct GradNode,
which is needed for pipeline parallel.
* Fix problem of CI, and fix pp testcase as review comments advising.
* Fix including files problem.
* Polish paddle.distributed.reshard implementation according to review comments.
* Fix some problems.
* Polish code.
* Fix problem of failed testcase.
* Move reshard function to tensor_utils.h, as files in phi/core is
not allowed to include files in phi/api.
* Add forgetting file.
* Fix some compilation problem.
* Remove useless PADDLE_WITH_DISTRIBUTE conditional compilation.
* Remove useless PADDLE_WITH_DISTRIBUTE conditional compilation.
* Fix problem of WITH_PYTHON=OFF compilation option.
* Fix bug of conditional compilation.
* [AutoParallel] Support pipeline parallel backward. Both pp single
strategy and dp-mp-pp hybrid strategy are verified. As CI machine
only has 2 cards and dp-mp-pp strategy needs 9 GPU cards, such case
will be added in testcase later.
* Polish pipeline parallel backward implementation.
* Remove useless modification.
* Add MLP dp-mp-pp hybrid strategy testcase, it can't be run on
CI Machine now as it needs 8 gpus.
* Remove useless modification.
* Fix problem of Tensor double free and polish code.
* Fix problem of ReshardOutputPartialAxisToReplicated.
* Revert "Revert "[AutoParallel] Support pipeline parallelism backward non-computation clip. (#58449)" (#58601)"
This reverts commit 79e24ec.1 parent 11c62e6 commit 3b44f88Copy full SHA for 3b44f88
File tree
Expand file treeCollapse file tree
15 files changed
+325
-101
lines changedFilter options
- paddle
- fluid/eager
- auto_code_generator/generator
- phi
- api
- lib
- yaml/generator
- core/distributed/auto_parallel
- test/auto_parallel
Expand file treeCollapse file tree
15 files changed
+325
-101
lines changedpaddle/fluid/eager/auto_code_generator/generator/eager_gen.py
Copy file name to clipboardExpand all lines: paddle/fluid/eager/auto_code_generator/generator/eager_gen.py+31-3Lines changed: 31 additions & 3 deletions
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
580 | 580 |
| |
581 | 581 |
| |
582 | 582 |
| |
| 583 | + | |
| 584 | + | |
| 585 | + | |
| 586 | + | |
| 587 | + | |
| 588 | + | |
| 589 | + | |
| 590 | + | |
| 591 | + | |
| 592 | + | |
| 593 | + | |
| 594 | + | |
| 595 | + | |
| 596 | + | |
| 597 | + | |
| 598 | + | |
| 599 | + | |
| 600 | + | |
583 | 601 |
| |
584 | 602 |
| |
585 | 603 |
| |
| |||
2224 | 2242 |
| |
2225 | 2243 |
| |
2226 | 2244 |
| |
2227 |
| - | |
| 2245 | + | |
| 2246 | + | |
| 2247 | + | |
2228 | 2248 |
| |
2229 | 2249 |
| |
2230 |
| - | |
| 2250 | + | |
| 2251 | + | |
| 2252 | + | |
| 2253 | + | |
| 2254 | + | |
2231 | 2255 |
| |
2232 |
| - | |
| 2256 | + | |
| 2257 | + | |
| 2258 | + | |
| 2259 | + | |
| 2260 | + | |
2233 | 2261 |
| |
2234 | 2262 |
| |
2235 | 2263 |
| |
|
paddle/fluid/eager/grad_node_info.cc
Copy file name to clipboardExpand all lines: paddle/fluid/eager/grad_node_info.cc+20-6Lines changed: 20 additions & 6 deletions
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
105 | 105 |
| |
106 | 106 |
| |
107 | 107 |
| |
108 |
| - | |
109 |
| - | |
110 |
| - | |
| 108 | + | |
| 109 | + | |
| 110 | + | |
| 111 | + | |
| 112 | + | |
| 113 | + | |
| 114 | + | |
| 115 | + | |
| 116 | + | |
| 117 | + | |
111 | 118 |
| |
112 | 119 |
| |
113 | 120 |
| |
| |||
183 | 190 |
| |
184 | 191 |
| |
185 | 192 |
| |
186 |
| - | |
187 |
| - | |
188 |
| - | |
| 193 | + | |
| 194 | + | |
| 195 | + | |
| 196 | + | |
| 197 | + | |
| 198 | + | |
| 199 | + | |
| 200 | + | |
| 201 | + | |
| 202 | + | |
189 | 203 |
| |
190 | 204 |
| |
191 | 205 |
| |
|
paddle/fluid/eager/grad_node_info.h
Copy file name to clipboardExpand all lines: paddle/fluid/eager/grad_node_info.h+1Lines changed: 1 addition & 0 deletions
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
21 | 21 |
| |
22 | 22 |
| |
23 | 23 |
| |
| 24 | + | |
24 | 25 |
| |
25 | 26 |
| |
26 | 27 |
| |
|
paddle/fluid/eager/grad_tensor_holder.cc
Copy file name to clipboardExpand all lines: paddle/fluid/eager/grad_tensor_holder.cc+13-2Lines changed: 13 additions & 2 deletions
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
111 | 111 |
| |
112 | 112 |
| |
113 | 113 |
| |
114 |
| - | |
115 |
| - | |
| 114 | + | |
| 115 | + | |
| 116 | + | |
| 117 | + | |
| 118 | + | |
| 119 | + | |
| 120 | + | |
| 121 | + | |
| 122 | + | |
| 123 | + | |
| 124 | + | |
| 125 | + | |
| 126 | + | |
116 | 127 |
| |
117 | 128 |
| |
118 | 129 |
| |
|
paddle/fluid/eager/utils.cc
Copy file name to clipboardExpand all lines: paddle/fluid/eager/utils.cc+10-2Lines changed: 10 additions & 2 deletions
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
16 | 16 |
| |
17 | 17 |
| |
18 | 18 |
| |
| 19 | + | |
19 | 20 |
| |
20 | 21 |
| |
21 | 22 |
| |
| |||
654 | 655 |
| |
655 | 656 |
| |
656 | 657 |
| |
| 658 | + | |
| 659 | + | |
| 660 | + | |
657 | 661 |
| |
658 | 662 |
| |
659 | 663 |
| |
660 | 664 |
| |
661 |
| - | |
| 665 | + | |
662 | 666 |
| |
663 | 667 |
| |
664 | 668 |
| |
| 669 | + | |
| 670 | + | |
665 | 671 |
| |
666 | 672 |
| |
667 | 673 |
| |
668 | 674 |
| |
669 |
| - | |
| 675 | + | |
670 | 676 |
| |
671 | 677 |
| |
672 | 678 |
| |
| 679 | + | |
| 680 | + | |
673 | 681 |
| |
674 | 682 |
| |
675 | 683 |
| |
|
paddle/phi/api/lib/api_gen_utils.cc
Copy file name to clipboardExpand all lines: paddle/phi/api/lib/api_gen_utils.cc+22-3Lines changed: 22 additions & 3 deletions
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
569 | 569 |
| |
570 | 570 |
| |
571 | 571 |
| |
572 |
| - | |
| 572 | + | |
| 573 | + | |
| 574 | + | |
573 | 575 |
| |
574 |
| - | |
575 |
| - | |
| 576 | + | |
| 577 | + | |
| 578 | + | |
| 579 | + | |
| 580 | + | |
| 581 | + | |
| 582 | + | |
| 583 | + | |
| 584 | + | |
| 585 | + | |
| 586 | + | |
| 587 | + | |
| 588 | + | |
| 589 | + | |
| 590 | + | |
| 591 | + | |
| 592 | + | |
| 593 | + | |
| 594 | + | |
576 | 595 |
| |
577 | 596 |
| |
578 | 597 |
| |
|
paddle/phi/api/lib/api_gen_utils.h
Copy file name to clipboardExpand all lines: paddle/phi/api/lib/api_gen_utils.h+2-1Lines changed: 2 additions & 1 deletion
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
153 | 153 |
| |
154 | 154 |
| |
155 | 155 |
| |
156 |
| - | |
| 156 | + | |
| 157 | + | |
157 | 158 |
| |
158 | 159 |
| |
159 | 160 |
| |
|
paddle/phi/api/lib/data_transform.cc
Copy file name to clipboardExpand all lines: paddle/phi/api/lib/data_transform.cc+6Lines changed: 6 additions & 0 deletions
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
814 | 814 |
| |
815 | 815 |
| |
816 | 816 |
| |
| 817 | + | |
| 818 | + | |
| 819 | + | |
| 820 | + | |
| 821 | + | |
| 822 | + | |
817 | 823 |
| |
818 | 824 |
| |
819 | 825 |
| |
|
paddle/phi/api/lib/tensor_utils.cc
Copy file name to clipboardExpand all lines: paddle/phi/api/lib/tensor_utils.cc+1-1Lines changed: 1 addition & 1 deletion
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
120 | 120 |
| |
121 | 121 |
| |
122 | 122 |
| |
123 |
| - | |
| 123 | + | |
124 | 124 |
| |
125 | 125 |
| |
126 | 126 |
| |
|
paddle/phi/api/yaml/generator/dist_api_gen.py
Copy file name to clipboardExpand all lines: paddle/phi/api/yaml/generator/dist_api_gen.py+11-6Lines changed: 11 additions & 6 deletions
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
48 | 48 |
| |
49 | 49 |
| |
50 | 50 |
| |
51 |
| - | |
| 51 | + | |
52 | 52 |
| |
53 | 53 |
| |
54 | 54 |
| |
55 | 55 |
| |
56 | 56 |
| |
57 |
| - | |
58 | 57 |
| |
| 58 | + | |
59 | 59 |
| |
60 | 60 |
| |
61 | 61 |
| |
| |||
233 | 233 |
| |
234 | 234 |
| |
235 | 235 |
| |
236 |
| - | |
| 236 | + | |
237 | 237 |
| |
238 | 238 |
| |
239 | 239 |
| |
| |||
360 | 360 |
| |
361 | 361 |
| |
362 | 362 |
| |
363 |
| - | |
| 363 | + | |
| 364 | + | |
364 | 365 |
| |
365 |
| - | |
| 366 | + | |
| 367 | + | |
366 | 368 |
| |
367 | 369 |
| |
368 | 370 |
| |
| |||
813 | 815 |
| |
814 | 816 |
| |
815 | 817 |
| |
| 818 | + | |
816 | 819 |
| |
817 | 820 |
| |
818 | 821 |
| |
| |||
1399 | 1402 |
| |
1400 | 1403 |
| |
1401 | 1404 |
| |
1402 |
| - | |
| 1405 | + | |
| 1406 | + | |
| 1407 | + | |
1403 | 1408 |
| |
1404 | 1409 |
| |
1405 | 1410 |
| |
|
You can’t perform that action at this time.
0 commit comments