You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The existing sof_tflm_generate_keyword_dataset.sh is hard-wired to the
English multi-speaker piper-sample-generator (LibriTTS-R). It cannot
train a positive class in any other language because the phonemizer
inside that checkpoint only knows English graphemes.
Add a companion script that drives the regular piper-tts package against
any single-speaker voice from rhasspy/piper-voices (Finnish
fi_FI-harri, Swedish sv_SE-nst, etc.). To compensate for the missing
speaker-embedding axis it (a) randomizes Piper noise-scale / noise-w
per utterance while cycling several length-scale values and (b) fans
each synthesized clip out into sox pitch-cents plus pitch-preserving
tempo copies. Output layout, IR augmentation hook, and gain jitter
match the English generator so sof_tflm_train_pipeline.sh consumes it
unchanged.
Update the tune README with a language-agnostic pipeline table entry,
a non-English setup section.
Signed-off-by: Seppo Ingalsuo <seppo.ingalsuo@linux.intel.com>
Copy file name to clipboardExpand all lines: src/audio/tensorflow/README.md
+79-2Lines changed: 79 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -301,8 +301,9 @@ chains four steps into one command:
301
301
302
302
| Step | Script | What it does |
303
303
|------|--------|-------------|
304
-
| 0 |[sof_tflm_generate_keyword_dataset.sh](./tune/sof_tflm_generate_keyword_dataset.sh)| Synthesize `<label>/*.wav` for one keyword with Piper-TTS + augmentation (rerun once per keyword) |
| 0a |[sof_tflm_generate_keyword_dataset.sh](./tune/sof_tflm_generate_keyword_dataset.sh)| Synthesize `<label>/*.wav` for one English keyword with `piper-sample-generator` (multi-speaker LibriTTS-R) + augmentation |
305
+
| 0b |[sof_tflm_generate_keyword_dataset_piper_tts.sh](./tune/sof_tflm_generate_keyword_dataset_piper_tts.sh)| Same output layout, but for any single-speaker Piper voice (Finnish, Swedish, Hungarian, German, ...). Recovers speaker diversity via per-utterance prosody randomization + sox pitch/tempo perturbation |
306
+
| 1 |[sof_tflm_prepare_silence_unknown.sh](./tune/sof_tflm_prepare_silence_unknown.sh)| Slice `silence/` + sample `unknown/` from Speech Commands v2 (English is fine as a negative-class source even for non-English keywords) |
306
307
| 2 |[sof_mfcc_extract_features.sh](./tune/sof_mfcc_extract_features.sh)| Emit SOF mel40 features via `sof-testbench4`|
0 commit comments