Skip to content

Whisper

VRCWizard edited this page Apr 1, 2023 · 18 revisions

Implementation using WhisperNet a C# wrapper for whisper.cpp

STT method "Whisper"

  1. To get started using Whisper Download one of the models below or from the official whisper.cpp model list
    • Keep in mind that this implementation of Whisper uses your GPU.
    • The medium model may cause stuttering in a GPU intensive game like VRChat while in VR.
Recommended Model Download Size Memory
ggml-medium.bin 1.5 GB ~2.6 GB
ggml-small.bin 466 MB ~1.0 GB
ggml-base.bin 142 MB ~500 MB
ggml-tiny.bin 75 MB ~390 MB
  1. Add the model to Speech Provider > Local > Whisper.cpp Model (BIN file) image

Notes

  • Noises that the Whisper AI recognizes are filtered out by default. It can recognize music, keyboard and mouse clicks etc.

Need Help / Have Questions / Wanna make suggestions?

Donate

  • Leave me a Github Star ⭐ (it's free) or

Buy Me a Coffee at ko-fi.com

Clone this wiki locally