What are the requirements for GPU？OOM！

[haoranLhk]

I have 4 RTX4090s with 24GB . Why does it report OOM when multiple GPU inference is enabled and prompts are continuously sent to generate videos? But generating videos separately won't be OOM? What are the requirements for GPU? Thank you very much for your help!

The key parameter settings are as follows
GPUS=4
MODEL_NAME=pyramid_mmdit
VARIANT=diffusion_transformer_768p
TASK=t2v
--model_dtype bf16
--temp 16