Can I run models like Tortoise TTS or OpenAI Whisper on SBCs like Orange Pi 5 or Odroid N2+?
-
$\begingroup$ Hi @best_of_man, welcome to the site. If you find the answers to your question useful, please consider upvoting them. Also, please consider accepting one (with the tick mark ✓ next to it) if you consider it correct or, alternatively, please describe in a comment why you consider it incorrect or not clear enough. $\endgroup$– noeNov 21 at 11:08
1 Answer
Yes, you may be able to run some sizes of Whisper, depending on the available amount of RAM.
Specifically, you may be able to run Whisper tiny or base through whisper.cpp. Here you can find benchmarks with different model sizes on a Raspberry Pi 4 with 2Gb. It will probably not be very fast, though.