Skip to content

Actions: confident-ai/deepeval

Actions

Py Metrics Tests

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
test_metrics.yml
2,310 workflow runs
2,310 workflow runs

Filter by Event

⌥ + click/return to exclude

Filter by Status

⌥ + click/return to exclude

Filter by Branch

⌥ + click/return to exclude

Filter by Actor

⌥ + click/return to exclude
fix(test_case): validate MLLMImage local flag with an explicit ValueError Py Metrics Tests #2292: Pull request #3215 opened by Asthenia0412
43s Asthenia0412:fix/3214-mllm-image-local-validation
Asthenia0412:fix/3214-mllm-image-local-validation
43s
fix(benchmarks): validate Winogrande n_shots/n_problems with explicit exceptions Py Metrics Tests #2291: Pull request #3213 opened by Asthenia0412
35s Asthenia0412:fix/3212-winogrande-param-validation
Asthenia0412:fix/3212-winogrande-param-validation
35s
fix(scorer): cap truth_identification_score at 100 by de-duplicating indices Py Metrics Tests #2290: Pull request #3211 opened by Asthenia0412
41s Asthenia0412:fix/3210-truth-identification-dedup
Asthenia0412:fix/3210-truth-identification-dedup
41s
fix(benchmarks): validate HumanEval n/k params instead of a bare assert Py Metrics Tests #2289: Pull request #3209 synchronize by Asthenia0412
39s Asthenia0412:fix/3208-human-eval-param-validation
Asthenia0412:fix/3208-human-eval-param-validation
39s
fix(scorer): validate pass_at_k arguments to reject degenerate inputs Py Metrics Tests #2288: Pull request #3207 synchronize by Asthenia0412
42s Asthenia0412:fix/3206-pass-at-k-validation
Asthenia0412:fix/3206-pass-at-k-validation
42s
fix(benchmarks): validate HumanEval n/k params instead of a bare assert Py Metrics Tests #2287: Pull request #3209 opened by Asthenia0412
38s Asthenia0412:fix/3208-human-eval-param-validation
Asthenia0412:fix/3208-human-eval-param-validation
38s
fix(scorer): validate pass_at_k arguments to reject degenerate inputs Py Metrics Tests #2286: Pull request #3207 opened by Asthenia0412
38s Asthenia0412:fix/3206-pass-at-k-validation
Asthenia0412:fix/3206-pass-at-k-validation
38s
fix(metrics): reject non-positive window_size in sliding window helper Py Metrics Tests #2285: Pull request #3203 synchronize by Asthenia0412
36s Asthenia0412:fix/sliding-window-size-validation
Asthenia0412:fix/sliding-window-size-validation
36s
fix(arena): require at least two contestants to compare Py Metrics Tests #2284: Pull request #3201 synchronize by Asthenia0412
29s Asthenia0412:fix/arena-empty-contestants-validation
Asthenia0412:fix/arena-empty-contestants-validation
29s
fix(ci): format .scripts/release.py to unblock the repo-wide black lint Py Metrics Tests #2283: Pull request #3205 opened by Asthenia0412
36s Asthenia0412:fix/black-format-release-script
Asthenia0412:fix/black-format-release-script
36s
fix(metrics): reject non-positive window_size in sliding window helper Py Metrics Tests #2282: Pull request #3203 opened by Asthenia0412
39s Asthenia0412:fix/sliding-window-size-validation
Asthenia0412:fix/sliding-window-size-validation
39s
fix(arena): require at least two contestants to compare Py Metrics Tests #2281: Pull request #3201 opened by Asthenia0412
35s Asthenia0412:fix/arena-empty-contestants-validation
Asthenia0412:fix/arena-empty-contestants-validation
35s
feat(pattern_match): support literal (non-regex) pattern matching Py Metrics Tests #2280: Pull request #3199 opened by Asthenia0412
32s Asthenia0412:feat/pattern-match-literal-mode
Asthenia0412:feat/pattern-match-literal-mode
32s
fix: don't swallow exceptions in async eval loop cleanup Py Metrics Tests #2279: Pull request #3197 synchronize by Asthenia0412
37s Asthenia0412:fix/2903-finally-return-suppresses-exceptions
Asthenia0412:fix/2903-finally-return-suppresses-exceptions
37s
fix: don't swallow exceptions in async eval loop cleanup Py Metrics Tests #2278: Pull request #3197 synchronize by Asthenia0412
39s Asthenia0412:fix/2903-finally-return-suppresses-exceptions
Asthenia0412:fix/2903-finally-return-suppresses-exceptions
39s
fix: don't swallow exceptions in async eval loop cleanup Py Metrics Tests #2277: Pull request #3197 opened by Asthenia0412
42s Asthenia0412:fix/2903-finally-return-suppresses-exceptions
Asthenia0412:fix/2903-finally-return-suppresses-exceptions
42s
fix: support all documented log_hyperparameters decorator forms Py Metrics Tests #2276: Pull request #3196 opened by Asthenia0412
39s Asthenia0412:fix/3134-log-hyperparameters-forms
Asthenia0412:fix/3134-log-hyperparameters-forms
39s
fix(metrics): reject empty scenario/expected_outcome in conversational param checks Py Metrics Tests #2275: Pull request #3193 synchronize by Asthenia0412
39s Asthenia0412:fix/3192-conversational-empty-param-validation
Asthenia0412:fix/3192-conversational-empty-param-validation
39s
fix(benchmarks): compare prediction counts with equality, not identity Py Metrics Tests #2274: Pull request #3194 synchronize by Asthenia0412
34s Asthenia0412:fix/2982-benchmark-count-equality
Asthenia0412:fix/2982-benchmark-count-equality
34s
fix(key_handler): LOCAL_EMBEDDING_API_KEY enum value must be a string Py Metrics Tests #2273: Pull request #3195 synchronize by Asthenia0412
32s Asthenia0412:fix/2904-embedding-api-key-tuple
Asthenia0412:fix/2904-embedding-api-key-tuple
32s
fix(key_handler): LOCAL_EMBEDDING_API_KEY enum value must be a string Py Metrics Tests #2272: Pull request #3195 opened by Asthenia0412
39s Asthenia0412:fix/2904-embedding-api-key-tuple
Asthenia0412:fix/2904-embedding-api-key-tuple
39s
fix(benchmarks): compare prediction counts with equality, not identity Py Metrics Tests #2271: Pull request #3194 opened by Asthenia0412
36s Asthenia0412:fix/2982-benchmark-count-equality
Asthenia0412:fix/2982-benchmark-count-equality
36s
fix(metrics): reject empty scenario/expected_outcome in conversational param checks Py Metrics Tests #2270: Pull request #3193 opened by Asthenia0412
35s Asthenia0412:fix/3192-conversational-empty-param-validation
Asthenia0412:fix/3192-conversational-empty-param-validation
35s
fix(scorer): replace assert-based argument validation with explicit exceptions Py Metrics Tests #2269: Pull request #3191 opened by Asthenia0412
45s Asthenia0412:fix/3190-scorer-assert-validation
Asthenia0412:fix/3190-scorer-assert-validation
45s
fix(scorer): raise a clear ImportError when optional deps are missing Py Metrics Tests #2268: Pull request #3189 synchronize by Asthenia0412
36s Asthenia0412:fix/scorer-optional-dependency-errors
Asthenia0412:fix/scorer-optional-dependency-errors
36s