Skip to content

Extend the evalatuion.csv with the current maximum values, and keep them updated in the repositoriesΒ #404

@zimmski

Description

@zimmski

Please help us keep the number of duplicated issues small. We kindly ask you to add your input to the appropriate issue or PR in case your feature idea is already being tracked.

Problem

Maximum metrics can change over time for a language, repository, task, case, ... to freeze the maximums, we want to save them in the evaluation.csv

Solution (optional)

Tasks:

  • Read maximums from the repository files
  • Insert
    • add files-executed-maximum
    • add coverage-maximum
    • add tests-passing-maximum
    • add response-no-error-maximum
    • add response-with-code-maximum
    • add response-no-excess-maximum
  • Update maximums if the value gets bigger in the repository configuration

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions