OpenDrift in an HPC environment?

[AndresSepulveda]

Hello,

Has anyone used OpenDrift in an HPC environment? I mean sending the task to computing nodes, several to a same node as OD run each instance in one CPU.

My guess is that one has to install OD as a module to load and then submit the job with slurm. Has it been done?

[knutfrode]

Hi,
I have never run OpenDrift on HPC, but @mateuszmatu, @manuelaghito or @kristokv might have some relevant experience.

[manuelaghito]

Hi, I haven't tried with multiple nodes. I normally do split large simulations with large number of Lagrangian elements in many smaller simulations. I run everything in one node with many CPUs. I can run these simulations in many parallel processes each with a separate OD instance using python multiprocessing module and this can significantly reduce computation time in some situations. Then I use xarray concat to concatenate the output results before post processing operations.

[AndresSepulveda]

Thanks @manuelaghito Could you provide a sample code of what you are describing?

[manuelaghito]

Dear @AndresSepulveda we just added example_multiprocessing.py to the example scripts folder.

[AndresSepulveda]

Thank you @manuelaghito !