Does vapi supports Web crawling
# support
s
we have our Webpage in that lots of data is present so we want to use that as a Knowledgebase and we tried manually crawling and uploading to your knowledgebase but results are not up to mark sometimes working sometime not any solution for it ?
j
It sounds like your crawler isn’t indexing your content consistently, which is why answers work sometimes and fail other times. With Vapi, this usually happens when pages are dynamic, chunking is poor, or embeddings aren’t optimized. You’ll get better results by using structured scraping, cleaner content, proper chunk sizing, and regular re-indexing. Adding metadata and testing retrieval with sample queries also helps improve accuracy. Is your website mostly static, dynamic, or behind login, and how often does it change? @Saurabh
c
Hi Saurabh, currently Vapi doesn't support web crawling.