Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

建议都用redis,不用redis可能会触发bug #12

Open
semanym opened this issue Dec 17, 2024 · 0 comments
Open

建议都用redis,不用redis可能会触发bug #12

semanym opened this issue Dec 17, 2024 · 0 comments

Comments

@semanym
Copy link

semanym commented Dec 17, 2024

openfile操作是嵌套在一个while true循环里面的,而且如果出现了exception没有任何处理,甚至没有输出错误信息,仅仅sleep一会继续while true。
在我训练的过程中发现,如果不用redis的话,它写文件没有加锁,可能导致多个线程同时写那份文件导致文件损坏,而读文件又是while true,所有会出现gpu 和cpu的利用率骤降几乎变为0,训不下去。
(小白排查bug大概是这个原因,有错误请指正,如果出现了相同情况的,建议用redis)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant