Hacker News new | past | comments | ask | show | jobs | submit login

This is awesome! What is the performance like? particularly around WASM compiled Whisper.



Thanks! It really depends on your machine.

My mac mini is heavily constrained due to only having 2 proper cores and not much RAM. So the smallest models run best. The quantized tiny runs better than the regular tiny simply due to memory pressure.

So, in my testing on my mac mini it tends to take about 30% more time to process than the audio clip that was recorded. I added a specific warning that lets the user know to reduce their thread count if the processing time takes longer than a specific threshold.

Some of my stream viewers report it being pretty fast though. (much faster than what they see on my mac mini).




Consider applying for YC's Spring batch! Applications are open till Feb 11.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: