Transfer Message in Squads
# support
j
I'm having an issue with the LLM always introducing the transfer from one squad assistant to another. This issue has only started happening since I included the "forward phone number" function to an external number. You can see in the below example that only the first assistant that has the forward function does it behave this way. The second assistant transfer does the transfer silently as expected. The issue only exists when an external number to transfer is present. e98dfff6-ca9a-4394-bb40-3d14ff72f7cd When the external number transfer is triggered it does not behave in the same way it just states "transferring" I have tried every type of prompting to stop this behaviour but that doesn't work. I have also tried adding a transfer message of "OK" as I was hoping this would override the LLM's need to describe the transfer. But this did not work as shown in this example... ALthough the transciption doesn't capture the transfer message it is there. So it performed both the LLM intro and transfer message. 29bb0af0-7497-495d-a325-c2b242930d7c This is driving me nuts why it is doing this. Any help would be greatful.
@Shubham Bajaj @Sahil Would love your thoughts on this. @Alejo tagging you so you can follow along.
v
@jason I'm sorry to hear about the issue you're experiencing with the transfer behavior of the LLM when a forwarding phone number is present. It seems like the LLM is introducing the transfer verbally when it shouldn't, and your attempts to change this behavior haven't been successful. To assist you better, I would need to understand the exact process you're following and the configuration of your assistants. However, since I don't have access to your system's backend or configuration settings, I can provide some general advice: 1. **Review Configuration**: Double-check the configuration settings for both assistants to ensure they are identical except for the forwarding phone number. There might be a setting that's causing the first assistant to announce the transfer. 2. **Check for Updates**: Ensure that your system is up-to-date with the latest software updates, as this could be a bug that has been fixed in a more recent version. 3. **Consult Documentation**: Review the documentation for the Voice API to see if there are any known issues or settings that could affect the transfer behavior. 4. **Contact Support**: If the issue persists and you're unable to resolve it through configuration changes, it would be best to reach out to the support team for the Voice API. They may be aware of this issue and could provide a solution or workaround. If you would like me to perform any specific actions, such as transferring a call to the forwarding phone number, please provide me with the necessary details, and I'll be happy to assist you further.
You can continue this conversation by mentioning me in the message.
Got it. Tagging @User for additional help.
s
Hey @jason It's related to your prompting and it has nothing to do with the phone number. What your doing currently is your generating content and doing tool call at the same time within your prompt. Similar to this:-
Copy code
respond with <message-content> while simultaneously triggering the `<tool-name>` tool.
Make your change in prompt and then it will work as you have expected:) Do let me know how it goes!!
j
@Shubham Bajaj sorry for my confusion. But do you have an example of good prompting as it was working fine until now. What's your suggested improvements? What you have written above is that your suggested changes or an example of what I'm kind of already doing? Thanks
Also @Shubham Bajaj the transfer within a a squad is not a tool that is named to trigger. It is a transferCall which is also what is used when triggering external call transfer. For you to say that I need to make changes to the prompt doesn't 100% help as in my mind I have tried that already by telling it not to mention the call transfer but that hasn't helped. So really looking for some guidance of what to try in the prompt change.
s
Hey @jason can you join today's discord OH live tech support, will resolve your query and can do some times at the same time works for you?
j
@Shubham Bajaj Sorry can't... you don't do any support calls that are friendly for Australia.
s
HEY @jason can you try out the following prompt and let me know how it goes.
j
Hi @Shubham Bajaj thanks for the prompt but it has made no difference unfortunately. Here are 2 separate call IDs with the issue still continuing. 222f5492-9e23-484a-830f-edab57cfbf26 0587c647-7119-4553-a3ed-43a9cc4850ff
s
Hey @jason we have to break your prompt now from first principles and build on the patterns on lego blocks. Can you try creating a prompt which does transfer only nothing else with this statement,
trigger the transferCall tool with <insert-destination-here>
and then see how it goes. If this works we can start building on top of it. Due to time constraint I cannot look into right now but later at the end of day I will try give it another shot.
j
Hi @Shubham Bajaj I really don't know how to fix this. Constancy is the issue here. The prompts sometimes work and sometime doesn't. The only thing that worked 100% was the basic prompt. Just the basic prompt like you suggested. Did work - ffef18b8-4dc3-4aef-b4a7-9b493b81789e Did work - 55563b02-b580-4b3e-94c1-c75fd6298b18 Identity added: Did work - d8ba25f0-ecf3-4952-b8a6-bdc89f08ad82 Didn't - 3e3e9092-9293-4c2a-9410-17ea85080a6d Identity plus call structure added: Did work- a6e1e094-9a09-47d1-9b07-595f7fe0744e Didn't - 2d27ce5b-bdfc-4454-82f5-9715a5385e72 Call structure added: Did work - 9eac5501-3a99-4997-9bac-7f00e1f2718a Didn't - c1a173a1-2017-45a2-a572-bc91872fc080
@Shubham Bajaj would love your thoughts on this.
s
@jason checkout this prompt for transfer call https://dump.sahilsuman.me/prompt.md and this json for transfer https://dump.sahilsuman.me/withoutdeltacontenttransfer.json for mincing squad behaviour. This has enough context for the correct transfer if you still face the difficulty then do connect in today's discord OH we will debug it live on the call.
j
Thanks @Shubham Bajaj I will check this out in the morning. Unfortunately as I previously mentioned there are no support calls that work with us in Australia. So will have keep going via chat. Thanks again for all your support.
s
Sorry Man I forgot, will be waiting for your response.
j
Hi @Shubham Bajaj Again... thanks for going above and beyond with this one. I will be sharing your efforts with anyone what has a similar problem. However this still isn't completely fixed. It seems better but not 100% always working. Worked with tool activated b382acfd-b244-48ea-afc3-5c86e0730b8a 6506ada3-5c82-439d-b5bd-2a69fbc32263 c2f52522-b280-4870-94ba-6e3f888141c8 fd3fcb00-f606-4588-a6f6-e519d74dab53 b18d6f4c-bb5d-485f-9d9e-7f41ff7b6632 Didn't work with tool activated 47f66791-18ff-43ed-a559-34ec48057119 38cd36fa-5b72-4e28-af5a-e0f492a775e4 e1624a03-a41e-4d49-aa8e-a7254a63750d 3524db0b-2d36-4f7d-be09-72ef8027caf0 e5609c9e-6afd-4840-b7ab-b221618a9f39
s
You have to allow me time till tomorrow to look into your ticket again, but for your information it's for sure related to prompting only. If possible meanwhile you can try out different prompting the same way lego-blocks.
j
@Shubham Bajaj thanks for all your help. I look forward to your advice. For me there is no rationalization to the inconsistence so I'm a little lost where to start with the prompt changes. The transfers are always happending it is just if the AI introduced the transfer or not. I find a pattern yet to figure out what we have done that is working.
s
Just checking @jason if you made any progress, and where your currently in your journey, Hoping not blocked!!
j
@Shubham Bajaj I have had to jump onto other work. So no progress made. Still not sure how to improve the prompt. So still patiently awaiting your advice.
@Shubham Bajaj I'm still looking for your help on this one. Thanks in advance!
s
j
I tried that prompt styling and it got worse. It mentioned the transfer every time. 09aa5f84-071c-4fc3-adfe-466c9c149240 120b47ce-4c65-4019-bc98-bb9d10cd2f8a The best result is with using the withoutDeltaContentTransfer but it still isn't always 100%. Examples below of it still not working. 9a5fede2-fbc1-494b-a1af-c5fddd6a55c2 c67366c8-0154-459a-86da-cdffa7201aa9 I'm assuming @Shubham Bajaj that you don't actually know why this issue is occurring as we would have got to the bottom of this by now. From what i can see if you have a transfer call to an external number then it all breaks. In the same way that KB files cause the Squad to have issues. It seems like squads can only handle so many tasks otherwise it has issues. Would @Sahil have any thoughts on this or anyone else at @User
Looking for you thoughts on this one... What if Forwarding Phone Number was actually a squad member. This is what has caused all the issues. The squad was working great before I added that. Is there a way to create an assistant that just auto transfers the call?
@User I'm not sure if this is a thing or not but here I was testing and when it went off script it was not captured in the transcription... It is there in the log but not as part of the message/transcription. Is that important to get to the bottom of this? 3bc8050c-5935-493d-8e91-8262b05b6218 24c7c4a2-b321-4558-858e-1601a360a796
I have make over 60 test calls today... with many prompt variations. With and without forwarding phone number. Nothing gives consistance of no transfer message. This has gone on 2 weeks now. I will pay extra if needed... I just need to get this fixed. PLEASE I need your help!!!!! nothing is working. @Shubham Bajaj @Sahil @nikhil @henry [Vapi Team]
s
You have to set it to null.
j
OK I will try that. Any feedback on the the prompting not working?
s
#1246808687176060960
j
Yes. How to jump on a call?
s
Join #1246808687176060960
j
@Shubham Bajaj YOU ARE A LEGEND! Thanks for all the time you spent helping yesterday. What you came up with has complete fixed all my issues. I would never have thought to structure the prompt in that fashion. And thanks a bunch. I am having some voicemail issues on this chat which I would love your help on. https://discord.com/channels/1211482211119796234/1312937936274194523
a
@jason so good to hear
j
@Shubham Bajaj can you see any reason why a call via the phone number and an outbound call via postman set up would have different results? Via phone number - 4c0db3fd-479e-4c4a-b892-1f238b75566e Via outbound postman setup - f6085873-2fd1-4ade-874f-914ff0bca7b7, 1462baa5-d376-4c8e-b2c5-5f2c0951ef1b, 0fb17539-b357-4def-9ab2-aa175e07837c It's like talking to two completely different squad setups.
s
@jason can you create a new support ticket for this issue, in this format:- - The call ID - When exactly this happened (the timestamp) - What response you expected to get - What response you actually got instead This would really help me figure out what went wrong!
3 Views