EvalAP "Evaluation API and Platform" is a high-level service designed to perform evaluations for Etalab. This project provides an API to evaluate [LLM] models and an interface to navigate datasets, models, metrics and experiments.
Running evalap for the impatient:
# Install Dependencies
# sudo apt install just # install just in debian/ubuntu
pip install .
# Launch
docker compose -f compose.dev.yml up -d postgres
just run
You can then access the EvalAP UI at: http://localhost:8501
and find the EvalAP API at http://localhost:8000/docs
For guidance on how to use this project, please refer to the following resources:
- The documentation: https://evalap.etalab.gouv.fr/doc
- The public instance interface: https://evalap.etalab.gouv.fr/
- the demo notebooks: notebooks/
You can open issues for bugs you've found or features you think are missing. You can also submit pull requests to this repository. To get started, take a look at CONTRIBUTING.md.
MIT License