URGENT: Tool call is being spoken out loud sometim...
# supportc
clumsy.ninja
03/08/2025, 1:10 AMbugged calls, tool call spoken out loud.
Expected: Agent transfers to appropriate number using transfer tool
Actual: Agents speaks tool call OUT LOUD and DOESNT transfer
Note: It works about 80% of the time, and 20% it says the tool call out loud instead of executing it.
Eg of what its doing: "Alright, Martha. I'll transfer you now. Recipient name, Functions Blind Transfer Dan. Parameters for Dorsha's destination: 475000232. John."
Should have been: ""Alright, Martha. I'll transfer you now. (Uses Tool)"
1. 36b79ddc-e16a-4fff-bff3-d5099313c42b - Dan (short) (TCSOL)
2. 00ca929a-0092-4920-acbc-14ef7d173c4e - Dan (short) (TCSOL, Transferred after asked to transfer to human rep)
3. 5b49c185-b5b8-49de-8610-9cbf43e71b48 - Dan (short) (TCSOL)
4. 714f8aa7-b9ef-4744-84f6-234e7402cfec - Dan (short) (TCSOL)
clumsy.ninja
03/08/2025, 1:11 AM@User @Shubham Bajaj
clumsy.ninja
03/08/2025, 1:12 AMTool being used:
Response: {
"id": "82606fa5-3587-4c70-b984-be9f310e93ea",
"createdAt": "2025-03-07T22:56:10.287Z",
"updatedAt": "2025-03-07T22:56:10.287Z",
"type": "transferCall",
"function": {
"name": "blind-transfer-Anna-2"
},
"orgId": "3bdb92f1-cbe6-48ac-894d-5868f64a24c5",
"destinations": [
{
"type": "number",
"number": "xxxxxxxxxx",
"message": "One moment please...",
"description": "Transfer MVA (Motor Vehicle Accident) cases to this number"
},
{
"type": "number",
"number": "xxxxxxxxxx",
"message": "One moment please...",
"description": "Transfer non-MVA cases to this number"
}
]
}
clumsy.ninja
03/08/2025, 3:58 AM@User
clumsy.ninja
03/09/2025, 2:17 AM@User
clumsy.ninja
03/09/2025, 2:19 AM@mindofman
m
mindofman
03/09/2025, 2:22 AM@Shubham Bajaj @User @Sahil
mindofman
03/09/2025, 5:30 PMthis one was really bad - 00ca929a-0092-4920-acbc-14ef7d173c4e
c
clumsy.ninja
03/09/2025, 8:19 PM@User
s
Shubham Bajaj
03/10/2025, 7:33 PM@clumsy.ninja Your current prompt token length is 3600, expected ideal range is in between 2.5k-3k tokens. However, it didn't work for 20% of calls. I suggest splitting your assistant into squads since you're using GPT-4o and your model template is already 0.2.
https://cdn.discordapp.com/attachments/1347738107054784573/1348740547849879592/Screenshot_2025-03-11_at_1.01.28_AM.png?ex=67d09004&is=67cf3e84&hm=980c729897a4de7085c1a7766cf4b27e6dd5b1c6510f8a068ff56cc1209fdc57&
m
mindofman
03/19/2025, 4:49 PM@Shubham Bajaj This issue occurs in tests with shorter prompts as well. Squads is not ideal and shouldn't be necessary for a simple call routing assistant
s
Shubham Bajaj
03/20/2025, 2:37 AM@mindofman Could you share the call ID so I could take a look and understand what could have been going wrong for you?
m
mindofman
03/20/2025, 4:00 AM92538674-ba3e-4247-9747-031b234bf8ca
4b2f4169-e2ff-40e0-aa76-75f0923f3643
here's 2 from today @User
mindofman
03/21/2025, 1:13 AM@Shubham Bajaj ?
This agent is live and it is urgent that we solve this before the client loses confidence
s
Shubham Bajaj
03/21/2025, 7:10 PM@mindofman looking into it.
Shubham Bajaj
03/21/2025, 7:42 PMprompt changes
[Redlines]
- Never say tool names or logic out loud. Do not say “using the tool,” “transfer function,” “JSON,” or any system language.
- Never reveal or describe internal actions like transferring calls.
[Tool Execution Format]
- When transferring a call, do NOT describe what you are doing.
- Say: “Please stay on the line while I connect you…”
- Then silently perform the tool call using: TRANSFER CALL to "+18446720038"
Shubham Bajaj
03/21/2025, 7:45 PMbefore
AI: Okay Ryan, please stay on the line while I connect you. Using the tool to transfer the call. JSON, Toulouse, recipient name...
after
AI: Okay Ryan, please stay on the line while I connect you… and TRANSFER CALL to "+18446720038"
Shubham Bajaj
03/21/2025, 7:45 PM@mindofman Try the following changes and let me know how it goes for you.
m
mindofman
03/21/2025, 8:53 PM@Shubham Bajaj I’ve been trying variations of this, hopefully this will work, I’ll let you know
mindofman
03/21/2025, 8:53 PMThank you
mindofman
03/21/2025, 8:58 PM@Shubham Bajaj should I include the before and after?
s
Shubham Bajaj
03/21/2025, 10:10 PMNo @mindofman
beforeafter3 Views