How to count input tokens

[duelinmarkers]

Is there a supported or straightforward way to send RubyLLM-built input to, for example, Anthropic's count_tokens endpoint?

[crmne]

This would be a great addition! Feel free to open an issue to discuss implementation design and would be lovely to have a PR after that! 🤘

[crmne]

Update: provider-side token counting is available in RubyLLM 2.0.0.rc3. Use chat.count_tokens to count a prepared chat request, including its instructions, tools, and schema where supported, or RubyLLM.count_tokens(text, model: ...) for text. Anthropic is supported. See the tokenization guide.