HI Vapi, There is a persistent error AI Assistant...
# office-hours
h
HI Vapi, There is a persistent error AI Assistant is facing while using query tool to retrieve the data from knowledge base> When uploading a knowledge data file (~4 MB) into the knowledge base, the query tool consistently fails with a 400 Bad Request error when used by the ai assistant. The same issue occurs when splitting the file into smaller chunks. the error is
Copy code
[VertexAI.ClientError]: got status: 400 Bad Request. 
{"error":{"code":400,"message":"The input token count (1125861) exceeds the maximum number of tokens allowed (1048575).","status":"INVALID_ARGUMENT"}}
Additional Information: Tool may only support Gemini 2.0 Flash (token limit ≈ 1 million). The tool seems (a guess) to be internally chunking based on Gemini 2.5 Flash (higher token limit), causing overflow. Attempted switching to Gemini 1.5 Pro through tool settings, but upload fails as “model not authorised for use with Vertex AI”.
2 Views