Hello lovely people of the Canton,
I hope I don't bother you once more with another feature addition. I recently wanted to compare Matryoshka reduced embedding models (essentially just a "trunc" on the embeddings) and realised this wasn't natively supported in the library.
Therefore, I am opening a pull request to add this functionality. Minimal edits, works out of the box on my end.
Upside: Easily evaluate whether your domain would have a "significant" performance drop is using dimensionality reduced embeddings or not.
Greetings
Andrianos
Hello lovely people of the Canton,
I hope I don't bother you once more with another feature addition. I recently wanted to compare Matryoshka reduced embedding models (essentially just a "trunc" on the embeddings) and realised this wasn't natively supported in the library.
Therefore, I am opening a pull request to add this functionality. Minimal edits, works out of the box on my end.
Upside: Easily evaluate whether your domain would have a "significant" performance drop is using dimensionality reduced embeddings or not.
Greetings
Andrianos