Skip to content

Latest commit

 

History

21 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 

Repository files navigation

count-tokens

Ultra-fast, client-side token counter for large text blobs using OpenAI-style BPEs.

What this is

  • Static site (GitHub Pages) that counts tokens entirely in your browser
  • Built with tiktoken-rs compiled to WebAssembly
  • Optimised for huge pastes (even repo-level): avoids per-token highlighting that makes other sites hang
  • Zero backend; no data leaves your machine

Supported encodings

  • cl100k_base
  • o200k_base

About

Ultra-fast, client-side token counter for large text blobs

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Contributors

Languages