Skip to content

Add Espresso to Swift section#1161

Open
christopherkarani wants to merge 1 commit intojosephmisiti:masterfrom
christopherkarani:add-espresso
Open

Add Espresso to Swift section#1161
christopherkarani wants to merge 1 commit intojosephmisiti:masterfrom
christopherkarani:add-espresso

Conversation

@christopherkarani
Copy link
Copy Markdown

Espresso compiles transformers directly to Apple Neural Engine via MIL, achieving 4.76x faster inference than CoreML on Apple Silicon.

  • Pure Swift, zero dependencies
  • MIT licensed
  • Direct ANE compilation (bypasses CoreML limitations)
  • GitHub

Thanks for maintaining this awesome list!

Espresso compiles transformers directly to Apple Neural Engine via MIL, achieving 4.76x faster inference than CoreML. Pure Swift, zero dependencies, MIT licensed.

Co-Authored-By: Paperclip <noreply@paperclip.ing>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant