Skip to content

Cohere model replies parsed and/or scored incorrectly #79

@MHindermann

Description

@MHindermann
2025-12-09 12:15:04,172 INFO:root:Processing T0483, line_10...
2025-12-09 12:15:11,825 INFO:httpx:HTTP Request: POST https://api.cohere.com/v2/chat "HTTP/1.1 200 OK"
2025-12-09 12:15:11,825 WARNING:ai_client.cohere_client:Failed to validate Cohere structured response: 1 validation error for CorrectedAdvert
number_of_corrections
  Field required [type=missing, input_value={'fixed_xml': '<file name...ctions were necessary.'}, input_type=dict]
    For further information visit https://errors.pydantic.dev/2.10/v/missing
2025-12-09 12:15:11,827 INFO:root:Saved answer to ..\results\2025-12-09\T0483\request_T0483_line_10.json
2025-12-09 12:15:11,827 INFO:root:Finished line_10 with score: {'score': 0.0, 'message': 'No valid response'}
2025-12-09 12:15:11,827 INFO:root:Processing T0483, line_11...
2025-12-09 12:15:18,663 INFO:httpx:HTTP Request: POST https://api.cohere.com/v2/chat "HTTP/1.1 200 OK"

File: request_T0483_line_10.json

Metadata

Metadata

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions