You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
OutOfMemoryError: CUDA out of memory. Tried to allocate 6.02 GiB. GPU 0 has a total capacity of 39.59 GiB of which 5.52 GiB is free.
Process 35878 has 674.00 MiB memory in use. Process 32242 has 33.41 GiB memory in use. Of the allocated memory 28.39 GiB is allocated by
PyTorch, and 3.70 GiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting
PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True to avoid fragmentation. See documentation for Memory Management
(https://pytorch.org/docs/stable/notes/cuda.html#environment-variables)
Which is kind of strange to me. My batch size is very small and here is my GPU machines spec
The only thing I can guess is that I have 7 dataset to evaluate but I still got no idea
Hi
I need some helps.
I am trying to evaluate my pre-trained model with Thai fine tasks. Here is my command
When I ran this command I got error
Which is kind of strange to me. My batch size is very small and here is my GPU machines spec
The only thing I can guess is that I have 7 dataset to evaluate but I still got no idea
Any Ideas?
I use lighteval 0.6.0.dev0 and torch 2.2.2+cu121. I clone this repo and
pip install -e .[dev]
The text was updated successfully, but these errors were encountered: