feat(parallel runner)!: Add cluster environments

[HCookie]

Description

Add cluster environments to delegate concern on parallel inference.

Backwards compatible with slurm running, as automatic detection of the cluster is implemented,

Allows for easier extension to additional clusters, with support now already for slurm, mpi, torchrun, distributed and manual invocation.

Manual Cluster

runner:
   parallel:
       cluster:
           manual: 4

Automatic

runner: parallel

Tests

• torchrun
• slurm
• mpi
• manual
• AzureML

What problem does this change solve?

Extends parallel running to allow for easy implementation of exotic clusters

As a contributor to the Anemoi framework, please ensure that your changes include unit tests, updates to any affected dependencies and documentation, and have been tested in a parallel setting (i.e., with multiple GPUs). As a reviewer, you are also responsible for verifying these aspects and requesting changes if they are not adequately addressed. For guidelines about those please refer to https://anemoi.readthedocs.io/en/latest/

By opening this pull request, I affirm that all authors agree to the Contributor License Agreement.

---

📚 Documentation preview 📚: https://anemoi-inference--365.org.readthedocs.build/en/365/