Skip to content

Comments

Print reasoning tokens if VERBOSE logging is enabled#378

Open
niyatisingal wants to merge 2 commits intodevelopfrom
dev/nsingal/print-reasoning-tokens-in-verbose-logging
Open

Print reasoning tokens if VERBOSE logging is enabled#378
niyatisingal wants to merge 2 commits intodevelopfrom
dev/nsingal/print-reasoning-tokens-in-verbose-logging

Conversation

@niyatisingal
Copy link
Collaborator

@niyatisingal niyatisingal commented Feb 24, 2026

Description

Checklist

  • I am familiar with the Contributing Guidelines.
  • All commits are signed-off (git commit -s) and GPG signed (git commit -S).
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.
  • If adjusting docker-compose.yaml environment variables have you ensured those are mimicked in the Helm values.yaml file.

@niyatisingal niyatisingal self-assigned this Feb 24, 2026
@niyatisingal niyatisingal force-pushed the dev/nsingal/print-reasoning-tokens-in-verbose-logging branch 6 times, most recently from 51c1df7 to 1db8d76 Compare February 24, 2026 06:34
@nv-pranjald
Copy link
Collaborator

When we use model which has reasoning token in reasoning_content. Is that case handled?

like newer nemotron model and I think nemotron nano model.

@niyatisingal
Copy link
Collaborator Author

niyatisingal commented Feb 24, 2026

When we use model which has reasoning token in reasoning_content. Is that case handled?

like newer nemotron model and I think nemotron nano model.

yes, this method extract_reasoning_and_content does that. I have called it inside streaming_filter_think methods.

niyatisingal and others added 2 commits February 25, 2026 10:02
Signed-off-by: Niyati Singal <nsingal@nvidia.com>
…recated SpanAttributes (#377)

Signed-off-by: Swapnil Masurekar <smasurekar@nvidia.com>
@niyatisingal niyatisingal force-pushed the dev/nsingal/print-reasoning-tokens-in-verbose-logging branch from 1db8d76 to cae6811 Compare February 25, 2026 04:32
@shubhadeepd
Copy link
Collaborator

@nv-pranjald please help review this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants