CUDA out of memory. Tried to allocate 24.00 MiB. GPU 0 has a total capacty of 21.99 GiB of which 19.06 MiB is free. Process 17512 has 3.85 GiB memory in use. Process 12291 has 988.00 MiB memory in use. Process 17951 has 492.00 MiB memory in use. Process 18068 has 492.00 MiB memory in use. Process 18180 has 492.00 MiB memory in use. Process 18315 has 492.00 MiB memory in use. Process 18449 has 492.00 MiB memory in use. Process 19027 has 492.00 MiB memory in use. Process 19324 has 988.00 MiB memory in use. Process 26234 has 3.76 GiB memory in use. Process 15836 has 988.00 MiB memory in use. Process 25997 has 3.65 GiB memory in use. Process 25364 has 3.65 GiB memory in use. Process 27573 has 492.00 MiB memory in use. Including non-PyTorch memory, this process has 728.00 MiB memory in use. Of the allocated memory 399.54 MiB is allocated by PyTorch, and 26.46 MiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting max_split_size_mb to avoid fragmentation.  See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF