-
Notifications
You must be signed in to change notification settings - Fork 368
Open
Description
Hi all,
Thanks for your great work. The README says lighteval should support RULER benchmark, and I do find relevant PRs (#722, #726, #826 ).
In your previous commit, I can find
but the file was removed. Is there any reason that removing the RULER benchmark? Also, can I easily reuse your previous implementation to perform benchmarking in the current lighteval version (v0.11.0)?
Jeronymous
Metadata
Metadata
Assignees
Labels
No labels