-
Notifications
You must be signed in to change notification settings - Fork 28
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fdy/fix ascendspeed #744
Fdy/fix ascendspeed #744
Conversation
|
||
cleanup() | ||
|
||
|
||
if __name__ == "__main__": | ||
n_gpus = torch.cuda.device_count() | ||
# world_size = 1 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
注释是什么情况?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
无用的, 我删掉了
|
||
|
||
def _wrap_new_group( | ||
ranks=None, timeout=default_pg_timeout, backend=None, pg_options=None |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
能不能加上 typing,其他地方也是
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
和 pytorch 现有的保持一致的。它有的我们都加了, 没有的暂时 follow吧。
* feature: refactor convolution backward
fix ascend speed 运行中 遇到的 一些问题。 其中 coalse 为临时方案