Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[AutoParallel] fix problems in ClipGradByNorm #71421

Open
wants to merge 2 commits into
base: develop
Choose a base branch
from

Conversation

Waynezee
Copy link

@Waynezee Waynezee commented Mar 5, 2025

PR Category

Auto Parallel

PR Types

Bug fixes

Description

使用原地multiply来进行梯度裁剪,减少显存的使用;解决xpu下 send shape 为0的tensor报错的问题

Copy link

paddle-bot bot commented Mar 5, 2025

你的PR提交成功,感谢你对开源项目的贡献!
请关注后续CI自动化测试结果,详情请参考Paddle-CI手册
Your PR has been submitted. Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

@Waynezee Waynezee changed the title use inplace multiply to update grad in grad_clip [AutoParallel] fix problems in ClipGradByNorm Mar 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant