Comparison between ESM-2 and ESM-3

[anonimoustt]

Hi,

I wanted to know, is ESM-3 generating more informative embeddings of a full protein sequence than the ESM-2 model? I see the length of am embedding is 1536 where as the length of the embedding is 320. I am using small version of ESM-3, and it is much longer time to generate embedding. For around 400 protein sequences, it is still running ( more than 15 hours ) to generate embedding. Using ESM-2 it did not take that long. So, I am really curious to see the difference between ESM-3 and ESM-2.