You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+3-24Lines changed: 3 additions & 24 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -127,7 +127,7 @@ Otherwise:
127
127
128
128
129
129
### ... or from your app launcher:
130
-
After running `./setup.sh`, desktop launchers are installed automatically. Open your application menu and launch:
130
+
Desktop launchers are installed automatically. Open your application menu and launch:
131
131
132
132
- VOXD (gui)
133
133
- VOXD (tray)
@@ -173,7 +173,7 @@ Unknown keys are ignored.
173
173
Your spoken words can be magically cleaned and rendered into e.g. neatly formated email, or straight away into a programing code!
174
174
175
175
VOXD can optionally post-process your transcripts using LOCAL (on-machine, **llama.cpp**, **Ollama**) or cloud LLMs (like **OpenAI, Anthropic, or xAI**).
176
-
For the local AIPP, just accept **llama.cpp**during the setup or/and**[install Ollama](https://ollama.ai)** and download a model that can be run on your machine, e.g. `ollama pull gemma3:latest`.
176
+
For the local AIPP, **llama.cpp**will be available out-of-the-box. You can also**[install Ollama](https://ollama.ai)** and download a model that can be run on your machine, e.g. `ollama pull gemma3:latest`.
177
177
You can enable, configure, and manage prompts directly from the GUI.
178
178
179
179
### Enable AIPP:
@@ -192,27 +192,6 @@ In GUI or TRAY mode, all relevant settings are in: "*AI Post-Processing*".
192
192
193
193
---
194
194
195
-
## 🦙 llama.cpp Integration (Local AI)
196
-
197
-
VOXD includes **native llama.cpp support** for ultra-fast local AI processing without requiring Ollama. This gives you two llama.cpp modes:
198
-
199
-
-**`llamacpp_server`** - Uses llama.cpp's built-in HTTP server (recommended)
200
-
-**`llamacpp_direct`** - Direct Python bindings (fastest, but requires `llama-cpp-python`)
201
-
202
-
### Quick Setup
203
-
204
-
llama.cpp integration is **optional** during `setup.sh`. If you want to add it later:
205
-
206
-
```bash
207
-
# Re-run setup with llama.cpp option
208
-
./setup.sh # Will detect existing install and offer llama.cpp setup
209
-
```
210
-
211
-
- Clones and builds llama.cpp with optimal settings
212
-
- Downloads a default model (`qwen2.5-3b-instruct-q4_k_m.gguf`, ~1.9GB)
213
-
- Installs Python bindings (`llama-cpp-python`) for direct mode
214
-
- Configures VOXD to use llama.cpp providers
215
-
216
195
### AIPP Model Management
217
196
218
197
#### **Model Storage**
@@ -283,7 +262,7 @@ export XAI_API_KEY="..."
283
262
```
284
263
285
264
**Note:**
286
-
If an API key is missing, the respective cloud-based AIPP provider will not work.
265
+
If an API key is missing, the respective cloud-based AIPP provider will (surprise, surprise) not work.
0 commit comments