Is there a way, or maybe some kind of toggle, that will prevent our agent from using information outside of its knowledge base? We have it clearly defined in the prompt not to do so, but it will occasionally go on a tangent providing information that it shouldn't. In terms of KBs, we've tried the built-in KB, Trieve and Azure AI Search, but getting the same results.

Hi there! 👋 Unfortunately, I couldn't find information about a specific toggle that will definitively prevent an agent from accessing information outside its knowledge base. However, I can share several approaches that might help restrict your agent to only using information from its KB. Here are some methods that might help: ### 1. Prompt Engineering One of the most effective approaches is to use clear, explicit prompts. For example:

You are a smart assistant whose responses should be based solely on the provided knowledge base of profoundly false facts. If the knowledge base does not contain the information asked for, respond with 'I do not know'. Always cite the knowledge base when providing an answer.

[Source](https://discord.com/channels/1211482211119796234/1211483291191083018/threads/1335953119275782144) ### 2. Model Temperature Setting Setting the model temperature to 0 can prevent the AI from being creative and potentially generating responses based on information outside the KB. [Source](https://discord.com/channels/1211482211119796234/1211483291191083018/threads/1342028540085932102) ### 3. Knowledge Base Configuration Parameters Adjust these parameters to fine-tune how the agent uses the KB: - Increase the

scoreThreshold

to filter out irrelevant chunks - Adjust

topK

to control how many results the agent considers - Ensure proper configuration of

searchType

and other parameters [Source](https://discord.com/channels/1211482211119796234/1211483291191083018/threads/1335953119275782144) ### 4. Custom Tools Approach Using custom tools to invoke the knowledge base can be a safer and more effective option than direct KB integration. [Source](https://discord.com/channels/1211482211119796234/1211483291191083018/threads/1342355912576471112) ### 5. Local Knowledge Base Server

Hey! To help track down this issue, could you share: - The call ID - When exactly this happened (the timestamp) - What response you expected to get - What response you actually got instead This would really help us figure out what went wrong!