Search results

Optional structured output fields are downgraded to strings in generated schemas

Status: Open.

#2609 In confident-ai/deepeval;

· YizukiAme opened on Apr 10, 2026

Nested Pydantic models stop being recognized after one inheritance layer

Status: Open.

#2608 In confident-ai/deepeval;

· YizukiAme opened on Apr 10, 2026

Relax posthog upper bound<6.0.0 to prevent installation conflicts.

awaiting release

Status: Open.

#2604 In confident-ai/deepeval;

· sipa-echo-ngbm opened on Apr 8, 2026

Contextual Precision over-penalizes overlapping chunks in financial-document RAG

Status: Open.

#2594 In confident-ai/deepeval;

· Ruthwik-Data opened on Apr 2, 2026

Clarvia MCP: Tool quality scoring for DeepEval benchmarking pipelines

Status: Open.

#2587 In confident-ai/deepeval;

· digitamaz opened on Mar 31, 2026

Turn._mcp_interaction PrivateAttr always False — MultiTurnMCPUseMetric/MCPTaskCompletionMetric scores degrade to near-zero

Status: Open.

#2579 In confident-ai/deepeval;

· cwoodcox opened on Mar 28, 2026

Feature Request: Multilingual RAG Evaluation Support (Non-Latin Scripts, Low-Resource Languages)

Status: Open.

#2578 In confident-ai/deepeval;

· rajantripathi opened on Mar 27, 2026

The RAGAS metrics is not working

Status: Open.

#2562 In confident-ai/deepeval;

· L-Shier opened on Mar 19, 2026

'NoneType' object has no attribute 'find'

Status: Open.

#2554 In confident-ai/deepeval;

· nicolablago opened on Mar 16, 2026

trace spans missing token counts and costs for gpt-5.2

Status: Open.

#2531 In confident-ai/deepeval;

· sultanovazamat opened on Mar 5, 2026

Proposal: ship WFGY 16-problem RAG failure taxonomy as a built-in tag set

Status: Open.

#2517 In confident-ai/deepeval;

· onestardao opened on Feb 28, 2026

Support PDF in LLMTestCase input for agentic evaluation

Status: Open.

#2511 In confident-ai/deepeval;

· anuar12 opened on Feb 26, 2026