Custom LLM and Fine Tuned Model for VAPI
# support
j
I'm currently trying to implement custom logic for an AI to follow a certaing pathway everytime. I'm wondering if the approach is correct. I am building the pathways for the custom LLM and then I'm conecting it to a Fine Tuned OpenAI model that has my training data. There are a few function calling tools, including a transfer call node, a couple of end call nodes with different conditions, and a wait node (custom webhook) If I understand correctly I can set up these tools in the assistant settings, then reference these tools in the pathways json and in the main.py script so the assistant can use them at the correct stage. Right ?
Btw I have an enterprise account and would love to get the Slack channel link that support mentioned to me via email but didn't share a link to. Thank you in advance !
v
@JeanDeLassé Yes, you're on the right track! By setting up the tools in the assistant settings and referencing them in the pathways JSON and the main.py script, you can create a structured flow for your AI to follow. This will allow the assistant to use the appropriate tools at the correct stages of the conversation or process. When you define the pathways, you're essentially creating a decision tree that the AI will use to determine the next step based on the current context and input from the user. The pathways JSON will contain the logic and references to the tools, while the main.py script will handle the execution of the pathways and the invocation of the tools. Make sure that each tool is properly configured and that the parameters passed to them are valid. Also, ensure that the pathways are designed to handle different scenarios and that there's a clear understanding of how the AI should progress through each pathway. If you have any specific questions about setting up the tools or the pathways, or if you need further assistance, feel free to ask!
You can continue this conversation by mentioning me in the message.
j
@Vapi what about variables before the call start, how would those be set up? also would this approach also work for batch calling and how. Let's say I have a list of leads with name, city and marital status, can those be called all at the same time and using my conversation pathways ?
v
@JeanDeLassé Variables before the call start can be set up in several ways, depending on how your system is designed: 1. **Pre-call API**: If your system supports an API to initialize calls, you can pass the variables (like name, city, and marital status) as part of the API request to set up the call context. 2. **Configuration File or Database**: You can have a configuration file or a database entry for each call that includes the necessary variables, which the AI can retrieve and use when the call starts. 3. **Dynamic Scripting**: If you're using a dynamic scripting language within your pathways, you can assign variables at the beginning of the script based on the input data for each lead. For batch calling using your conversation pathways: - **Sequential Batch Calling**: If your system supports queueing, you can sequentially process each lead, applying the conversation pathways to each call one after the other. This would not be simultaneous but would allow for individual handling of each lead. - **Parallel Batch Calling**: For true simultaneous batch calling, you would need a system capable of handling multiple calls at once. Each call would be a separate instance, with its own set of variables and pathways. This would require a robust backend capable of scaling to handle multiple concurrent interactions. In both cases, the pathways would work the same way as they do for individual calls, provided that each call instance has its own set of variables and context. If you're looking to implement batch calling with simultaneous processing, you'll need to ensure that your backend infrastructure is designed to handle concurrent calls and that your pathways and tools are stateless or capable of managing state independently for each call. Remember to test your system thoroughly to ensure that it behaves as expected under batch processing conditions and that each call follows the correct pathways based on the variables provided.
j
@User please advise,
s
@JeanDeLassé mind sharing your account email address and your company name which is part of the enterprise plan at sahil@vapi.ai?
@JeanDeLassé nudding you
s
because of no response closing this ticket
4 Views