We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
这个项目我在ubuntu(i7,32g内存,3060ti)上面跑,我只选了4w条数据,内存占用特别高,读完训练验证集32G内存就满了,然后就崩溃。但是在macbook(m1,8g内存)上就可以跑,而且不卡,只是训练得慢一点。
数据量是4000左右的时候,ubuntu还是能跑,挺快的,内存在用在12-16G之间。
这是为什么呀,有什么解决办法吗?
The text was updated successfully, but these errors were encountered:
这个模型需要的内存非常大,作者也写了需要128G+的内存,4w条数据32G肯定是不够的的,我5W条数据64G内存都会out of memory。 mac我没试过,不过作者给了个时间换内存的方法,你可以试下效果#11
Sorry, something went wrong.
谢谢你的回答。的确是这样的,我去研究一下。
GPU显存的消耗你有研究过吗,我现在用的2张16G显存的显卡,5W数据显示HIP out of memory
No branches or pull requests
这个项目我在ubuntu(i7,32g内存,3060ti)上面跑,我只选了4w条数据,内存占用特别高,读完训练验证集32G内存就满了,然后就崩溃。但是在macbook(m1,8g内存)上就可以跑,而且不卡,只是训练得慢一点。
数据量是4000左右的时候,ubuntu还是能跑,挺快的,内存在用在12-16G之间。
这是为什么呀,有什么解决办法吗?
The text was updated successfully, but these errors were encountered: