I got this message on LW:
"
Hi Nicholas,
My name is Florent, and I really enjoy your idea of the Pantheon Interface. However, I prefer using the Groq API with open-source models like Llama (and they also provide some free tokens).
So today, I worked on a fork of your GitHub repo and tried to implement support for the Groq API.
You can find it here: https://github.com/FlorentMoulon/Pantheon-Groq-API
I saw that you already planned to add support for other APIs, and I probably didn't implement it the way you would, but I hope my work may help you. Or at least, it might encourage you to add the Groq API option in the future.
Another small thing I had to add was a small fix for Windows users (only when using the command npm run start). The issue is detailed in this other fork that I found: https://github.com/jralduaveuthey/Pantheon
Again, your idea is very cool, and I hope you will continue developing it.
Have a nice day.
"
I took a quick look at their code and it seemed fine, but ideally you should look at it yourself. I also looked briefly at Groq, and it seems like a very similar API to OpenAI, only it supports open source models. There was a lot of demand for us to make it possible to use open source models, so this would be really great to implement.
I got this message on LW:
"
Hi Nicholas,
My name is Florent, and I really enjoy your idea of the Pantheon Interface. However, I prefer using the Groq API with open-source models like Llama (and they also provide some free tokens).
So today, I worked on a fork of your GitHub repo and tried to implement support for the Groq API.
You can find it here: https://github.com/FlorentMoulon/Pantheon-Groq-API
I saw that you already planned to add support for other APIs, and I probably didn't implement it the way you would, but I hope my work may help you. Or at least, it might encourage you to add the Groq API option in the future.
Another small thing I had to add was a small fix for Windows users (only when using the command npm run start). The issue is detailed in this other fork that I found: https://github.com/jralduaveuthey/Pantheon
Again, your idea is very cool, and I hope you will continue developing it.
Have a nice day.
"
I took a quick look at their code and it seemed fine, but ideally you should look at it yourself. I also looked briefly at Groq, and it seems like a very similar API to OpenAI, only it supports open source models. There was a lot of demand for us to make it possible to use open source models, so this would be really great to implement.