We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
openfile操作是嵌套在一个while true循环里面的,而且如果出现了exception没有任何处理,甚至没有输出错误信息,仅仅sleep一会继续while true。 在我训练的过程中发现,如果不用redis的话,它写文件没有加锁,可能导致多个线程同时写那份文件导致文件损坏,而读文件又是while true,所有会出现gpu 和cpu的利用率骤降几乎变为0,训不下去。 (小白排查bug大概是这个原因,有错误请指正,如果出现了相同情况的,建议用redis)
The text was updated successfully, but these errors were encountered:
No branches or pull requests
openfile操作是嵌套在一个while true循环里面的,而且如果出现了exception没有任何处理,甚至没有输出错误信息,仅仅sleep一会继续while true。
在我训练的过程中发现,如果不用redis的话,它写文件没有加锁,可能导致多个线程同时写那份文件导致文件损坏,而读文件又是while true,所有会出现gpu 和cpu的利用率骤降几乎变为0,训不下去。
(小白排查bug大概是这个原因,有错误请指正,如果出现了相同情况的,建议用redis)
The text was updated successfully, but these errors were encountered: