Skip to content

Commit 0e2893b

Browse files
committed
Update README.md
1 parent 42a4949 commit 0e2893b

File tree

1 file changed

+3
-11
lines changed

1 file changed

+3
-11
lines changed

evaluation/README.md

Lines changed: 3 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -8,17 +8,9 @@ Natural Language Generation Performance:
88

99
[Extractiveness](https://huggingface.co/docs/lighteval/en/metric-list#automatic-metrics-for-generative-tasks):
1010

11-
* Extractiveness Coverage:
12-
- Extent to which a summary is derivative of a text
13-
- Percentage of words in the summary that are part of an extractive fragment with the article
14-
* Extractiveness Density:
15-
- How well the word sequence can be described as series of extractions
16-
- A summary might contain many individual words from the article and therefore have a high coverage.
17-
- However, if arranged in a new order, the words of the summary could still be used to convey ideas not present in the article
18-
- Average length of the extractive fragment to which each word in the summary belongs
19-
* Extractiveness Compression:
20-
- Word ratio between the article and the summary
21-
- Summarizing with higher compression is challenging as it requires capturing more precisely the critical aspects of the article text.
11+
* Extractiveness Coverage: Extent to which a summary is derivative of a text
12+
* Extractiveness Density: How well the word sequence can be described as series of extractions
13+
* Extractiveness Compression: Word ratio between the article and the summary
2214

2315
API Performance:
2416

0 commit comments

Comments
 (0)