Currently the default setting of 0.25 works on x86 and GPU with large VRAM (72/96 GB), but it needs to be higher for smaller GPUs.
I'd suggest to check the VRAM capability by nvidia-smi and then set the value according, for example:
- 24 GB: 0.8
- 48 GB: 0.5
- 72 GB or above: 0.25
Currently the default setting of 0.25 works on x86 and GPU with large VRAM (72/96 GB), but it needs to be higher for smaller GPUs.
I'd suggest to check the VRAM capability by
nvidia-smiand then set the value according, for example: