One of 2 things to take a look at: 1. Change the LLM. I find 4o cluster works really well. 4.1 tends to behave wonky (from personal experience) 2. Update your prompt to have the LLM better understand backend messages vs conversional messages