Skip to content

feat: Enhanced the agent's response quality#1

Open
overseek944 wants to merge 10 commits intomainfrom
signal-langsmith
Open

feat: Enhanced the agent's response quality#1
overseek944 wants to merge 10 commits intomainfrom
signal-langsmith

Conversation

@overseek944
Copy link
Copy Markdown
Owner

@overseek944 overseek944 commented Mar 28, 2026

No description provided.

@github-actions

This comment was marked as outdated.

Repository owner deleted a comment from github-actions Bot Mar 29, 2026
Repository owner deleted a comment from github-actions Bot Mar 29, 2026
Repository owner deleted a comment from github-actions Bot Mar 29, 2026
@github-actions
Copy link
Copy Markdown

GEval Quality Gate Results

GEVAL DECISION REPORT (MULTI-CONTRACT)
========================================
Combine contracts rule: worst_case

Signals:
  sql_eval.sql_quality = 3.875
  sql_eval.sql_correctness = 0.75
  e2e_eval.response_quality = 2.25
  e2e_eval.correctness = 0.625

---
Contract file: .geval/contract.yaml
Contract: text2sql-quality-gate @ 1.0.0
Combine rule (policies): worst_case
Per-policy results:
  policies/quality.yaml: REQUIRE_APPROVAL (rules that matched: response_quality_gate) [winner: response_quality_gate]
Combined decision (this contract):
REQUIRE_APPROVAL
First non-PASS: policies/quality.yaml:response_quality_gate
Reason:
Response quality dropped below 2.5/5

======== OVERALL (PR) ========
REQUIRE_APPROVAL
.geval/contract.yaml:policies/quality.yaml:response_quality_gate
Reason:
Response quality dropped below 2.5/5
========================================

Approved By Human: manavpatel
📝 Reason: Looks good enough for beta
🕒 Timestamp: 2026-03-28T19:03:34Z

Repository owner deleted a comment from github-actions Bot Mar 29, 2026
@overseek944 overseek944 changed the title feat: integrate GEval quality gates into CI pipeline with automated L… feat: integrate Geval quality gates into CI pipeline with automated L… Mar 29, 2026
@overseek944 overseek944 changed the title feat: integrate Geval quality gates into CI pipeline with automated L… feat: Enhanced the agent's response quality Mar 29, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant