Hmm interesting, the usecase is super complex, its basically for a shopify ecommerce site replacing a customer service representative role, so the agent needs to be able to grab info from the KB if asked, also complex integrations with Shopify to check orders info, customer info, payment etc, and there are so many complexities of this business and rules you must account for, despite that the prompt isn't very long. The KB consists of a 17 page pdf. I wonder if there is a way in the prompt to not have it fetch from the KB often, not sure it can be done. Also its 6 min long because I was trying to test many scenarios one after the other, didn't think this will shoot up the price, maybe its better to call it per scenario.