knowledge base with either pdf or simple text file...
# support
a
CAllID: 01f8d886-1d9f-4acc-8d83-53ab6c69755d Removed query_tool function and asted the same info info the prompt and it is working 100% of the time.
k
Looking into it
s
🔵 20:04:20:795 Conversation Buffer Appending Bot Message. Emitting "conversation-update"... { "role": "bot", "message": "Lil Ninjas is at 4 PM on Monday", "time": 1744315456045, "endTime": 1744315458285, "secondsFromStart": 77.26, "duration": 2240, "source": "" } https://cdn.discordapp.com/attachments/1359984939583410457/1359998148403007640/message.txt?ex=67f9847a&is=67f832fa&hm=fa8d79cd3826cc0994d4048fd22956cdc243d9fc76ee64cf7e2b6fbc6996d50e&
@alexrb1 you can see the request was sent to the KB.
could you share the following if the above is incorrect: - What response you expected to get - What response you actually got instead This would really help us figure out what went wrong!
a
Monday: 4:00 pm Tiny Tigers 4:45 pm Young Warriors 5:30 pm Lil’ Ninjas 6:15 pm Brown/Red Belts 7:00 pm Black Belts 7:45 pm Stick Sparr It was supposed to be 5:30 on Monday. Along me pusing it... it said.. "text": "Lil Ninjas is on Monday, Wednesday, and Friday at 4 PM.", however there are Lil` Ninjas classes every day. Once I removed the KB and added the same exact text withint he body of the prompt, I now get the right info everytime. I can do that, but was trying to use KB and maybe reduce the need to use a squad to keep the prompt and instructions clearer
More testing.. call_id: d26a94c9-c651-4450-aa09-458c8c097018.. said today's Wed April 10th... although this is in the system prompt. - Current date and time: {{"now" | date: "%b %d, %Y, %I:%M %p", "America/New_York"}} with gpt-4.5
call_id: ed648a7e-ee93-4651-8af8-208629ed4e5b same assistant... with goolgle 2.5.. said today's Monday April 10th....
this is pretty cool.. someone is debugging.... says transfering to query_tool and a print statement.. although the time is still off.. says tomorrow, which willbe Friday is Wed April 10th. call_bfHKqCvSjl49A18XAxdUoNLV
k
To help track down this issue, could you share one or two: - The call ID - When exactly this happened (the timestamp) - What response you expected to get - What response you actually got instead This would really help us figure out what went wrong!
Hey Alex, anything which starts with the call underscore followed by some ID. It's a tool call ID, not the call ID.
a
Hi @Shubham Bajaj . Here's a call id fromt his afternoon: 80af805d-dcae-4c33-839d-ab87fabb5533 at 3:22PM EDST. I asked what time the Black Belt class was today. It should know it is Friday 4/11 since I have the {{now}} in the prompt. See below. It said the calass was at 6pm. I told it no, and came back with 6:45. Here's the Times in the prompt.. this is actually all embeded into the prompt. Start of prompt > You are a friendly martial arts instructor helping existing students with class schedules and information. Below is the list of classes by day of week. Make sure to match the day of the week with the right schedule. > For reference, current date and time is {{"now" | date: "%b %d, %Y, %I:%M %p", "America/New_York"}} https://cdn.discordapp.com/attachments/1359984939583410457/1360375226487148544/image.png?ex=67fae3a8&is=67f99228&hm=3085e010564c3aa62ea4eaa4dd2115294237e3623a5f9626b851de4f0cfe059c& https://cdn.discordapp.com/attachments/1359984939583410457/1360375226696994846/image.png?ex=67fae3a8&is=67f99228&hm=99f7a721684264f03db356782b03e0272182ba25562b930fc48c450ee196eb16&
k
Hey Alex, you are only passing the current date and time, not the day. Your classes are cited by the day, not date and time. So, technically it's bound to fail. Pass the current day as well and then try again. It will work. In case it fails, then pass current day separately as a separate variable and use it smartly. It will work after two to three test calls for sure with iterative testing.
a
Thansk @Shubham Bajaj. Let me try it.. I would think that if it has date/time it will be able to figure out the rest. Will let you know.
@Shubham Bajaj , I've been doing a whole bunch of testing, chat, web call and phone call using the KB.. it either doesn't look up the answer or it uses the wrong tool and transfers to a land line. c3e5c90c-e415-48ff-8b5d-cdb2354f20ef e88b32c9-8972-43b7-bbd4-d6c51b9cb105 bea27b90-18e7-4bdd-b562-255c7b203d03 63998765-6f4c-4463-8d29-db98e376efd4 so i can't really test this now at all.
Okay.. this call 7b3a0031-b5a3-4647-8d88-88064fd6e297 used the KB and only provided the times for Tuesday and Thurday. I removed the KB reference in the prompt and the tool, embeded the schedule and this call provided all of the right answers d93dbb7d-07ec-4927-a5b6-7e9a3a02b6c3
k
Hey Alex, When you mention some information in the prompt, it will always work. But when it comes to the tools and KBE(especially using Query KB tool), you have to be more rigid and descriptive instead of those usually written prompts. In your case, previously there was no reference of the current day, that's why the assistant or the LLM never got to know which day is today and it couldn't refer to the right time. So I will still suggest you the same, but it's up to you to take the final call.
k
@alexrb1
a
@Shubham Bajaj @Kings_big💫 hey.. i did.. I added %A to get the day. I think its more than that. Even without %A, when the schedule is within the prompt it got it right. Then I added %A and still gets it wrong from the KB. In the example above, the classes are everyday. So say it missed Monday, and since it got Tue and Thu, it should have also gotten Wed and Friday. > For reference, current date and time is {{"now" | date: "%A, %b %d, %Y, %I:%M %p", "America/New_York"}}
I removed the schedule from the prompt and configured the assistant to use a file. It got it right. Same example as above. I then removed the file and changed the prompt to use the KB tool that has the same file configured and it also got it right this time. IDK if anything changed in the system, but this time looks good. I'll keep trying to see if any further issues arrise. Thanks much for the assistance. https://cdn.discordapp.com/attachments/1359984939583410457/1361331292339179620/image.png?ex=67fe5e10&is=67fd0c90&hm=69ee7ba4df8590daec2d96f349b90c788d7d275bea679cc98e4c3554d0e519f4& https://cdn.discordapp.com/attachments/1359984939583410457/1361331292607742053/image.png?ex=67fe5e10&is=67fd0c90&hm=afc5a4ae3614e99a688298dcc19629b76fd6cf9348a39161052e9b1f2353df10&
this is extremely inconsistant.. Got the first and 3rd one right, but tne 2nd and 4th didn't even attempt to use the KB (assuming per the missing promto and getting it wrong) https://cdn.discordapp.com/attachments/1359984939583410457/1361348021031538779/image.png?ex=67fe6da4&is=67fd1c24&hm=fda089a9747cb6cb079439ba23dbc56c4280c70c764ba472e690bb550e3e3fdc&
Prompt*** [Class Schedule] ALWAYS call the fma_sched tool to get the updated class schedule. It only calls the tool once and then makes up stuff...when it calls the tool, it gets it right. https://cdn.discordapp.com/attachments/1359984939583410457/1361453073792499832/image.png?ex=67fecf7b&is=67fd7dfb&hm=12ee79ae09c6f2b243e100de015ca736d9aa0efef26bf5d377435a5dfe2e9818&
Switched back to embeded schedule in the prompt and got 14/14 correct. File and KB are just not working - most often wrong than right.
k
Watch this video

â–¾

this should help.
a
Watched it and that's what got me to move from file to kb tool. I'm thinking of asking Jonah to try it again, with that same file and see if it works. what I haven't tried was to use a PDF instead of a text file, but if a simple file doesn't work, I wouldn't expect a pdf to be better
k
Hi, I was out of office for a few days and was unable to respond to your message earlier. I apologize for any inconvenience this may have caused. 
Hey Alex, let's do it over the call. I'll show you how to make use of it, and eventually, all of your doubts will be resolved.
a
Thank you very much for the offer. I was out too a few days last week. Want to do it over the office hour or a diff time? Please let me know what works best for you.
k
I have already sent you a DM, please check.
a
@Shubham Bajaj figures first time I try after the OH and it fails. Please see: d7adc4ee-f06d-4607-8c14-01626b990eeb
Missed Wed even when I point blank asked it... 33d22c87-aa9a-4368-8801-e7f49a0dbe19
k
Hey Alex, can you check your DM let's do it over the call.