-
Notifications
You must be signed in to change notification settings - Fork 0
A lightweight, educational implementation of Byte-Pair Encoding (BPE) tokenization with integrated Skip-Gram style embeddings, built from scratch in Python. Built for educational purposes and to explore how an LLM works using Shakespearian text for training.
devinstanley/simple-LLM
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
A lightweight, educational implementation of Byte-Pair Encoding (BPE) tokenization with integrated Skip-Gram style embeddings, built from scratch in Python. Built for educational purposes and to explore how an LLM works using Shakespearian text for training.
Topics
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published