2. KB Content, Prompt Consistency, and Chunking
Previously, we leveraged KB files to include prompts and instructions. This allowed us to extend our main prompt across multiple assistants easily—avoiding the need to copy and paste content for each instance. Our use cases include:
- A questionnaire assistant that collects customer data using a KB file for common and purpose-related questions.
We currently operate over 10 distinct questionnaire assistants, each tailored for specific use cases. Rather than maintaining separate KB files for each assistant, we rely on one comprehensive KB file that contains all potential questions. This file includes detailed instructions on how to select the appropriate subset of questions for each case, ensuring consistency and ease of management across our multiple assistants.
- An emergency procedures KB that should be appended to each assistant’s prompt.
- An appointment booking KB where the order of instructions is critical.
With the new Trieve approach using chunking for search, it appears that KBs are being optimized for Q&A rather than for consistently injecting instructions. With Trieve’s new chunking/search approach, is it still possible to use KB files to maintain consistent instructional content across multiple assistants? If so, could you suggest recommended chunk or KB settings for such scenarios?
We’re concerned about the rapid transition and the short notice (3 days) regarding these changes. Any clarification on how to best manage these KB files under the new system—and whether the old functionality might be available in any form—would be greatly appreciated.
PS: I checked the below articles:
https://docs.vapi.ai/customization/bring-your-own-vectors/trieve
https://docs.vapi.ai/knowledgebase
Thank you for your assistance and prompt response.
Best regards,
Ganna