CUDA memory error, not using most of available memory
#1016 aperta il 15 ago 2023
Metriche repository
- Star
- (18.427 star)
- Metriche merge PR
- (Nessuna PR mergiata in 30 g)
Descrizione
Hello there!
I get the CUDA out of memory error, but when I look at my GPU's memory usage, I see that it only uses up to 4GB of memory before crashing, while my GPU's dedicated memory is 8GB (my shared memory is also 8GB if that's somehow relevant). My GPU is 1070 GTX which is supported by CUDA and I have installed the latest drivers and all that.
Moreover, when I use cache it actually does work and uses up to 7GB without changing the batch size (I'm using 4). I am using WSL 2 for running RVC on my machine, and as far as I know, the WSL isn't limiting GPU memory usage, so theoretically it should use up to 100% of my 8GB of memories.
If someone might have a clue about what's going on and how can I fix it, I would be happy to know!