fix: align tokenization defaults and explicit tiktoken fallback#7

nikazzio merged 1 commit intomainnikazzio/maxwell-demon:mainfrom

patch/tokenization-default-fallback-docsnikazzio/maxwell-demon:patch/tokenization-default-fallback-docsCopy head branch name to clipboard