if you use any SOTA mini model you can get realistically 500-750ms latency, 500 when it's running really good which is what this is and avg 750