CUDA out of memory. Tried to allocate 128.00 MiB. GPU 0 has a total capacty of 21.99 GiB of which 50.31 MiB is free. Process 4988 has 492.00 MiB memory in use. Process 7645 has 3.68 GiB memory in use. Process 7646 has 6.28 GiB memory in use. Process 8695 has 492.00 MiB memory in use. Process 32407 has 492.00 MiB memory in use. Process 32408 has 492.00 MiB memory in use. Process 20920 has 2.21 GiB memory in use. Process 13531 has 492.00 MiB memory in use. Process 29715 has 492.00 MiB memory in use. Including non-PyTorch memory, this process has 1.96 GiB memory in use. Process 20676 has 4.87 GiB memory in use. Of the allocated memory 1.34 GiB is allocated by PyTorch, and 318.33 MiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting max_split_size_mb to avoid fragmentation.  See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF