Investigating a crazy hallucination
# support
a
callId: e387be35-ce6d-4a30-bf05-eb00f3648223 See the log at this timestamp: 11:58:43:797 we see
Copy code
during business hours."},{"role":"assistant","content":"1 point hundred in n ear warm would specific and firm lesion"}
What caused the issue?
p
We looked at the call id and assistant settings, which appear to be normal. Are you able to reproduce this issue with your assistant?
a
no i just want to know how i make sure it doesnt happen again
i got another one where it just started sayiung break time for no reason.
p
After looking at the assistant configuration again, the prompt is incredibly long and because of this the model may struggle to maintain coherence across the entire context. Important instructions at the beginning might be "forgotten" by the time it reaches specific scenarios. There are a couple of things you can do here: Assistant prompt is massive (estimated to be 15,000 tokens worth) and your max token count is 250. Increasing the max token limit to at least 1200 tokens will be an improvement. Simplify the system prompt. You can use ChatGPT to reduce the word count and maintain the same identity and style guidelines. Referencing an external knowledge base will also help here for the detailed troubleshooting responses/behavior.