Totally agree 300ms is already very solid. You’re...
# general-english
s
Totally agree 300ms is already very solid. You’re right though, sometimes small tweaks (GPU, batching, streaming, model config) can surprise you. If you decide to test further and want a second set of eyes, I’m happy to help
2 Views