Hard to answer tbh your total latency depends heav...
# general-english
t
Hard to answer tbh your total latency depends heavily on your pipeline stack when i was using rimes mist model my latency was around 250ms just for voice generation during peak hours and later in the day it dropped to around 180ms so I would say realistically between transcription llm + evals and tts and a network operating at its bet you are looking at a 700ms- 1200ms latency
2 Views