ONNX support

[Valoisa]

Hi all! Is it possible to export a SentenceTransformer fine-tuned with PEFT to ONNX format?

[BenjaminBossan]

I'm not very experienced with ONNX and don't know if it supports PEFT in general, since PEFT models have a couple of rather dynamic features like disabling and switching adapters. However, if you only need a single adapter, you can call unloaded_model = model.merge_and_unload() on a PEFT model to get back the same format as the base model. If the base model can be converted to ONNX, then the unloaded_model can also be converted.