Skip to content

Conversation

NathanHB
Copy link
Member

@NathanHB NathanHB commented Oct 13, 2025

What this does:

  • move tasks from default_tasks into their own files
  • move extended tasks into their own files
  • move multilingual tasks into their own files
  • move community tasks into their own files
  • add docstring for default tasks
  • add docstring for multilingual tasks
  • add docstring for community tasks
  • make a space to explore all the tasks, based on the tasks docstrings.
  • modify the doc to reflect changes on how and where to add tasks

This allows for:

  • better maintenance
  • more readability (one task one file)
  • have a nice task finder :)
  • remove suites entirely

Also, getting rid of many duplicate tasks, for example, the same task in 2 different suites. I'm only keeping/moving all tasks to the lighteval suite so that we can eventually get rid of the suite system.

Viewer:

Screenshot 2025-10-16 at 16 14 22

@HuggingFaceDocBuilderDev
Copy link
Collaborator

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@NathanHB NathanHB requested a review from clefourrier October 17, 2025 14:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants