Skip to content

[AVC] Support running evals with cached results #12403

@tjprescott

Description

@tjprescott

When writing test cases, it would be very helpful to be able to run the test case with cached API calls. For example, if you need to debug into the output code for your test, having to re-run the whole test and make API calls is slow, costly and unnecessary. It would be helpful if you could used a cached result so that instead of making a live call to an LLM, it simply returns the cached value. This would allow you to quickly reach the output code.

Metadata

Metadata

Assignees

Labels

APIView CopilotIssues related to APIView CopilotEvalsTracking work for AI evaluationfeature-requestThis issue requires a new behavior in the product in order be resolved.

Projects

Status

✅ Done

Relationships

None yet

Development

No branches or pull requests

Issue actions