Skip to content

Conversation

Kludex
Copy link
Member

@Kludex Kludex commented Aug 13, 2025

No description provided.

Copy link

github-actions bot commented Aug 13, 2025

Docs Preview

commit: 97958cf
Preview URL: https://da3b2a95-pydantic-ai-previews.pydantic.workers.dev

@DouweM
Copy link
Collaborator

DouweM commented Aug 13, 2025

@Kludex Cross-posting here from Slack:

looks like the pydantic-evals job skips all tests in test/evals: https://github.com/pydantic/pydantic-ai/actions/runs/16942085788/job/48013554639

tests/evals/test_evaluator_base.py ssssssss                                                                                                    [  7%]
tests/evals/test_evaluator_context.py ss                                                                                                       [  9%]
tests/evals/test_evaluator_spec.py sssss                                                                                                       [ 13%]
tests/evals/test_llm_as_a_judge.py sssssssssss                                                                                                 [ 23%]
tests/evals/test_render_numbers.py ssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss                                                [ 78%]
tests/evals/test_reporting.py ssssss                                                                                                           [ 83%]
tests/evals/test_reports.py sssssss                                                                                                            [ 90%]
tests/evals/test_utils.py sssssssssss                                                                                                          [100%]

══════════════════════════════════════════════════════════════════ inline-snapshot ═══════════════════════════════════════════════════════════════════
INFO: inline-snapshot was disabled because you used xdist


Results (3.84s):
       114 skipped

I'm also not sure we should have pytest.importorskip('logfire') anywhere except tests that specifically test logfire

@Kludex Kludex closed this Aug 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants