Assistant narrates hallucinated convo
# support
a
call id : 6ed0fa31-74ee-41bf-83a5-b7c55516778e
s
The assistant appears to hallucinate due to a limited token count and apparent text preprocessing. I attempted to create a custom solution for a company where latency was an issue, but the response quality was excellent.
a
Ah! let me up that limit and see what happens. Its been a dice roll so far but some have come out pretty good.
s
Sure and do let me know about your results.
d
I am having the same problem when the conversations are very long I guess the context can go over a certain amount and then after that starts hallucinating
that becomes an issue with me ... I am using a Tool which i use to invoce a RAG and when I get the RAG data after a while the assistant cant get any more info in and start hallucinating
is there a way to get a bigger context ?
I am at max count now "1000"
s
@Domenico Rutigliano create a new support ticket with call_id
d
ok