Scaling Architecture Question
# general-english
d
I am creating an app that could scale to hundreds or more phone numbers, each providing information to the caller which is unique. The question I have is how best to set up the relationship between these phone numbers and the assistants. Ideally the bulk of that unique information is stored in a knowledge base. Do I.... (A) set up an assistant for each phone number (B) set up a single assistant and load the knowledge base dynamically If (A) then doesn't scaling becomes an issue? If (B) then how the heck do I dynamically load the knowledge base associated with the phone number? And what about concurrent calls? And what kind of performance hit might there be as the knowledge base get's loaded (if this is even possible)? Any and all input on this gratefully accepted!
Static vs Dynamic Assistants
@Stickler101 replied "Assistant for each phone number. Not enough context to know if scaling would be an issue. I don't know why it would be though. Your app could just create the assistants programmatically, as needed. Really not enough context to know if A or B would be a better option, in my opinion, but I lean towards A."
@Stickler101 I am planning on setting up a an app for programatically creating each assistant and loading each with the specific, unique knowledge base. I am going to associate a phone number with each assistant, also though the app. I guess the fundamental question is whether it is reasonable to have hundreds (or more) assistants associated with one given vapi account. If that is ok, then (A) is much simpler to implement.
s
I mean, that's what I'm about to do, so if it's a bad idea, I'd like to know about it, lol. I'd say just make sure you're taking concurrency limits into consideration.
d
Are you referring to concurrency limits on a given number or on the total account? I’m pretty sure we can throw money at vapi and they will take care of account concurrency.
s
Yeah we can pay more for it, just saying to factor it in to overhead.
d
@Stickler101 I got word back from vapi that (A) should scale to very large numbers. This approach is vastly simpler.