Skip to content

Feature/add modal backend - #16

Merged
Paulescu merged 21 commits into
mainfrom
feature/add-modal-backend
Mar 23, 2026
Merged

Feature/add modal backend#16
Paulescu merged 21 commits into
mainfrom
feature/add-modal-backend

Conversation

@alay2shah

Copy link
Copy Markdown
Collaborator

Adds support for running training jobs on Modal's serverless GPUs directly from a Mac or laptop. Add a modal: section to any existing config YAML and run leap-finetune config.yaml — the CLI detects it and submits to Modal instead of running locally.

Key changes:

  • Environment markers on Linux-only deps (flash-attn, deepspeed, mpi4py, liger-kernel, turm) so uv sync works on macOS
  • Modal added as a regular dependency
  • New backends/modal_backend.py handles image building, job submission, and detach mode
  • resolve_config_path extracted to its own module so SLURM/Modal paths avoid importing torch
  • GPU guard gives a clear error when running locally without CUDA

@alay2shah
alay2shah requested a review from Paulescu March 19, 2026 00:15
@alay2shah

Copy link
Copy Markdown
Collaborator Author

This is complete on my end @Paulescu

alay2shah and others added 4 commits March 21, 2026 17:26
Restore gpu to H100:4 and trackio_space_id to username/my-dashboard placeholder.
Stale design doc out of sync with the actual implementation. User-facing
docs for the Modal backend live in README.md.
@Paulescu
Paulescu merged commit 54a87ac into main Mar 23, 2026
1 check passed
@Paulescu
Paulescu deleted the feature/add-modal-backend branch March 23, 2026 22:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants