Apple Silicon Support

[nicosuave]

Awesome project. Apple Silicon support would be great to see!

[danielhanchen]

The more upvotes this gets will equal to the priority!! If it's a big must - I'll try my best to implement it!

[danielhanchen]

WAITT there's 17 upvotes for Apple Silicon support??? Oh my

[ChristianWeyer]

WAITT there's 17 upvotes for Apple Silicon support??? Oh my

30… 😎

[danielhanchen]

@ChristianWeyer Oh my 30!! Ok ok this definitely is a very good indication that people want Apple + MLX support :)) I will have to readjust my engineering roadmap :)

[mbtre]

1+ This would be absolutely awesome!

[danielhanchen]

Yeee I can see this is super popular - sadly I thought more about it - itll be a bit more complicated than I though + until I get a Mac (I use Linux + Windows!!!) it'll be a bit of an issue for me to test training runs :( I thought maybe I could just take MLX and sprinkle some Unsloth magic, but sadly that's not the case :(

[vlbosch]

@danielhanchen I have an M3 Max Macbook Pro with 128GB Unified RAM. Happy to help you port this great project to Apple Silicon 😃 If it's any helpful, I can spin up a VM and give you SSH access. IIRC macOS VM's on AS have direct GPU access and can run Metal with near native performance.

[CyborgArmy83]

Would also love to see Apple Silicon support in the future!

[danielhanchen]

Ill see but sadly I'm not a Mac user :(

[WiseFarAI]

I seriously think that if you made a crowdfunding and posted it here and on LLAMA subreddit we could collectively get you the funds to buy a good Apple Silicon machine. Although I am wondering if it's doable at this stage from a software perspective. I am not sure how much you would have to rely on frameworks like MLX / Metal, but I do know their development is very active for the last couple of months, so it might become viable soon.

[kevin801221]

Please support Apple Mac silicon M2、M3 series chips！！ It would be perfect！！！ pls！

[danielhanchen]

Oh my yikes ok this is ballooning!