Description of the feature
Feature request
Currently, the Long-Horizon Memory benchmark (LMEB) is shown as a single Retrieval benchmark on the MTEB leaderboard. While this is technically correct because all LMEB tasks are evaluated as evidence retrieval tasks, it loses an important part of the benchmark structure.
LMEB is designed to evaluate long-horizon memory retrieval across four memory types:
- Episodic memory
- Dialogue memory
- Semantic memory
- Procedural memory
https://mteb-leaderboard.hf.space/benchmark/LMEB
However, the current MTEB page only reports the benchmark under Retrieval, with `Task Types = 1
This reduces the diagnostic value of the benchmark, especially for users who want to compare embedding models for long-term memory, agent memory, or memory-augmented RAG applications.
Description of the feature
Feature request
Currently, the Long-Horizon Memory benchmark (LMEB) is shown as a single Retrieval benchmark on the MTEB leaderboard. While this is technically correct because all LMEB tasks are evaluated as evidence retrieval tasks, it loses an important part of the benchmark structure.
LMEB is designed to evaluate long-horizon memory retrieval across four memory types:
https://mteb-leaderboard.hf.space/benchmark/LMEB
However, the current MTEB page only reports the benchmark under
Retrieval, with `Task Types = 1This reduces the diagnostic value of the benchmark, especially for users who want to compare embedding models for long-term memory, agent memory, or memory-augmented RAG applications.