How to use easse with a varying number of references?

[slvcsl]

I have a dataset for simplification in which I have one complex sentence and a varying number of simplifications.
For example, the first complex sentence can have 5 human-written simplifications, while the second only 3.

Is there a way to set easse to work in this case?

[louismartin]

Hi @slvcsl , thanks for the issue!
I think we have never had this setting in the past so it probably won't work out of the box.

Maybe you can try to see if you can get the evaluations functions to work manually?
E.g.

easse/easse/sari.py

Line 228 in a1108d2

def get_corpus_sari_operation_scores(

Feel free to submit a PR if you make it work.