You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
for `Context Precision without reference` definition, i.e
LLMContextPrecisionWithoutReference metric can be used when you have
both retrieved contexts and also reference contexts associated with a
user_input.
Here, it should be reference `answer` instead of reference `contexts` as
per my understanding
Similarly,
for `Context Precision with reference definition` i.e
LLMContextPrecisionWithReference metric is can be used when you have
both retrieved contexts and also reference answer associated with a
user_input.
here, reference answer should be replaced with reference context
Copy file name to clipboardExpand all lines: docs/concepts/metrics/available_metrics/context_precision.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -17,7 +17,7 @@ The following metrics uses LLM to identify if a retrieved context is relevant or
17
17
18
18
### Context Precision without reference
19
19
20
-
`LLMContextPrecisionWithoutReference` metric can be used when you have both retrieved contexts and also reference contexts associated with a `user_input`. To estimate if a retrieved contexts is relevant or not this method uses the LLM to compare each of the retrieved context or chunk present in `retrieved_contexts` with `response`.
20
+
`LLMContextPrecisionWithoutReference` metric can be used when you have both retrieved contexts and also reference answer associated with a `user_input`. To estimate if a retrieved contexts is relevant or not this method uses the LLM to compare each of the retrieved context or chunk present in `retrieved_contexts` with `response`.
21
21
22
22
#### Example
23
23
@@ -43,7 +43,7 @@ Output
43
43
44
44
### Context Precision with reference
45
45
46
-
`LLMContextPrecisionWithReference` metric is can be used when you have both retrieved contexts and also reference answer associated with a `user_input`. To estimate if a retrieved contexts is relevant or not this method uses the LLM to compare each of the retrieved context or chunk present in `retrieved_contexts` with `reference`.
46
+
`LLMContextPrecisionWithReference` metric is can be used when you have both retrieved contexts and also reference context associated with a `user_input`. To estimate if a retrieved contexts is relevant or not this method uses the LLM to compare each of the retrieved context or chunk present in `retrieved_contexts` with `reference`.
0 commit comments