Hi team . I need to know can I upload unlimited doc to knowledge base or is there any limit ? .

@Abishek Hello! The knowledge base does have a limit on the number of documents you can upload. The specific limit can vary depending on the provider you choose. If you need to know the exact limit for a particular provider, please provide me with the name of the provider, and I can give you more detailed information.

I need for ChatGPT and Gemini

Got it. Tagging @User for additional help.

@Vapi what the max limit of knowledge base that llm can read and answer

@Abishek For Large Language Models (LLMs) like ChatGPT, the amount of data they can process in a single interaction is limited by the model's context window, which is typically in the range of a few thousand tokens (with one token roughly equivalent to a word). This means that while the LLM has been trained on a vast corpus of data, it can only consider and generate responses based on the text within its immediate context window during an interaction. As for a knowledge base, if you are integrating an LLM with a knowledge base for answering questions, the size of the knowledge base itself isn't directly limited by the LLM. However, the LLM's ability to reference this knowledge base in real-time will depend on the implementation details of how the knowledge base is queried and how the information is presented to the model within its context window. If you're asking about a specific product like OpenAI's ChatGPT or another LLM-based service, the limits would be defined by the particular implementation of that service. For precise limits, you would need to refer to the documentation or support resources provided by the service provider. If you have a specific provider in mind, I can try to give you more detailed information.

@Vapi will llm process the document from knowledge base each and every time when user asks for questions ?

@Abishek Yes, typically, when a Large Language Model (LLM) like ChatGPT is integrated with a knowledge base, it processes the relevant documents from the knowledge base each time a user asks a question. The LLM queries the knowledge base to retrieve the most pertinent information to the user's question and then generates a response based on that information. The process involves: 1. User asks a question. 2. The system searches the knowledge base for relevant documents. 3. The relevant content is presented to the LLM within its context window. 4. The LLM generates a response using the information provided. This ensures that the LLM provides the most up-to-date and relevant information from the knowledge base for each query. However, the specifics of how this is implemented can vary depending on the system's design and the capabilities of the LLM service being used.

@Vapi what is max file size that I can upload to knowledge base ?

@Abishek The maximum file size that you can upload to a knowledge base typically depends on the provider's specifications. Different providers may have different limits on the file size that their systems can handle. For instance, if you're using a provider like OpenAI for ChatGPT, they might have specific limits on the size of the documents you can upload to their knowledge base. These limits are usually mentioned in their API documentation or service guidelines. If you need the exact file size limit for a specific provider such as ChatGPT or Gemini, please let me know which provider you are inquiring about, and I can provide you with more detailed information.

@Vapi I need extract size for ChatGPT and Gemini

@Abishek Please ask support for more info on this.

@Vapi how many files can llm can read from knowledge base

@Abishek The number of files a Large Language Model (LLM) like ChatGPT can read from a knowledge base for a single query is limited by the model's context window size. The LLM won't read entire files but rather sections or summaries of content that are relevant to the user's query and that fit within its context window. For example, if the context window allows for 2048 tokens, the LLM can only consider that many tokens at a time, which might equate to parts of a document or several smaller documents, depending on their length. If you're referring to the number of documents you can store in a knowledge base, that would depend on the specific system or provider you're using. Each provider will have its own limits on the number of files and the total amount of data you can store. For precise information on file count limits for providers like ChatGPT or Gemini, you would need to consult their specific documentation or reach out to their support teams.

@Vapi so how many documents or files I can upload on knowledge base . Can I upload more than a GB of files ?

@Abishek The ability to upload more than a GB of files to a knowledge base depends on the provider's specifications and the limits they have set for their service. Different providers will have different storage capacities and limits on the number of documents or the total size of files you can upload. For providers like ChatGPT or Gemini, you would need to refer to their specific documentation or contact their support to get accurate information about their storage limits, including whether you can upload more than a GB of files to the knowledge base. If you have a particular provider in mind, please let me know, and I can assist you further with your query.

@Vapi how many can I upload for Gemini and ChatGPT

@Abishek Please ask support for more info on this.

@User Hi Team , I have a query regarding knowledge base . What is the max limit that I can upload the files to the knowledge base .

@Abishek As of my last update, Large Language Models like ChatGPT are primarily designed to process and generate text-based information. Therefore, knowledge bases that are used in conjunction with these models are typically text-oriented, and the ability to process images is not a standard feature. If you're looking to upload image files to a knowledge base, it would depend on the specific capabilities of the knowledge base system you're using. Some knowledge base systems might allow you to store image files for reference or organizational purposes, but the LLM itself may not be able to interpret the content of the images directly. For a definitive answer on whether you can upload image files to a knowledge base for use with ChatGPT or Gemini, you would need to check the documentation provided by the service or reach out to their customer support. They can provide the most accurate and up-to-date information regarding the types of files supported by their knowledge base systems.

@Abishek as of now there is no limit on maximum documnets you can upload to Vapi .