Skip to content

feat(models): local checkpoints, Models & Storage panel, no-download switch, Magenta SETUP pill#16

Merged
danieljtrujillo merged 2 commits into
mainfrom
feat/models-and-storage
Jun 12, 2026
Merged

feat(models): local checkpoints, Models & Storage panel, no-download switch, Magenta SETUP pill#16
danieljtrujillo merged 2 commits into
mainfrom
feat/models-and-storage

Conversation

@gantasmo

Copy link
Copy Markdown
Owner

Summary

  • Nothing downloads at startup, verified in code: models load on demand and resolve local-first (local folders -> HF cache -> one-time download)
  • from_pretrained accepts a local folder or .safetensors file; ambiguous folders are refused rather than guessed
  • New storage module (/api/storage): location map with sizes (incl. Magenta WSL assets/venv via wsl.exe), HF cache per-repo breakdown, open-in-Explorer gated to known roots, local-checkpoint registry, persistent local-only switch (SA3_LOCAL_ONLY)
  • Registered checkpoints appear under LOCAL CHECKPOINTS in the MAKE Model dropdown and generate through the normal load/park/wake lifecycle as local:<id>
  • Settings -> Models & Storage panel: catalog source chips, add/remove checkpoints, local-only toggle, location browser, HF cache table
  • Magenta engine/start refuses with 412 setup_required when the WSL side is missing; the dropdown pill shows SETUP pointing at Setup-MRT2.bat instead of a bare ERROR
  • USER_GUIDE 21.1 + 27 and the README models paragraph document all of it

Validation

  • ruff check + format clean at repo root; tsc -b clean
  • Live against the real rig: all 7 locations with correct sizes (incl. WSL UNC paths), HF cache scan (12.3 GB), catalog chips match reality (medium local, small download)
  • Registry round-trip live: registered the real D:-drive ARC checkpoint, it appeared under LOCAL CHECKPOINTS in the dropdown, then removed
  • Local-only PUT round-trip live; setup_state probe returns ready on this machine
  • Found + fixed two wsl.exe interop bugs en route (argv quote re-joining, CRLF stdin)
  • Pre-commit docs chain green, 9/9 screenshots

…switch, Magenta SETUP pill

Models stay under the user's control end to end:

- stable_audio_3: from_pretrained now accepts a local folder or
  .safetensors file (resolve_local_checkpoint pairs the checkpoint with
  its config JSON; ambiguous folders are refused rather than guessed).
- backend/modules/storage (new, /api/storage): location map with sizes
  (HF cache, SA3 local folders, generations, RAG index, torch hub, and
  the Magenta WSL assets/venv probed through wsl.exe with stdin scripts
  because wsl re-joins argv without quoting and text-mode stdin CRLF-
  breaks bash), per-repo HF cache breakdown, open-in-Explorer gated to
  known roots, a registry of user-added checkpoints persisted in
  data/local_checkpoints.json (gitignored), and a persistent local-only
  switch wired to SA3_LOCAL_ONLY.
- server: local:<id> models resolve through the registry into the same
  load/park/wake lifecycle; available_models reports them.
- MAKE: registered checkpoints appear under LOCAL CHECKPOINTS in the
  Model dropdown with ARC/RF-aware sampler defaults.
- Settings -> Models & Storage: catalog source chips (local/cached/
  download), add/remove checkpoints (files never touched), local-only
  toggle, location browser with sizes + Open, HF cache table.
- Magenta: engine/start refuses with 412 setup_required when the WSL
  venv or model checkpoint is missing (probed + cached); the dropdown
  pill shows SETUP with a tooltip pointing at Setup-MRT2.bat instead of
  a bare ERROR; engine/status carries the probe.
- Docs: USER_GUIDE 21.1 (resolution order, panel, endpoints), 27 pill
  states; README models paragraph.
@danieljtrujillo danieljtrujillo merged commit 508eefe into main Jun 12, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants