Hey all, a bit of VAPI Advice: Please enable Langfuse in your VAPI apps (https://langfuse.com/) you can do this free in your VAPI settings area. Its important to help track and eval your models 🙂

-- Langfuse maintainer here 👋 Thanks @AiTitus :) ! We are happy to answer any questions on the integration and how to get the most out of Langfuse to track and eval your VAPI agents 🙂 https://langfuse.com/support

maybe a quick intro post would help?

i love the langfuse tracing integration with vapi but I'm wondering how you guys are thinking about connecting prompts in langfuse to assistants in vapi? Langfuse shines whhen you can store your prompts there and iterate on them, but right now I don't see a way to connect vapi traces in langfuse with prompts in langfuse

you could use the API to get the specific prompt: https://api.reference.langfuse.com/#tag/prompts/GET/api/public/v2/prompts/{promptName} and then add it to your VAPI agent with a transient agent or dynamic variable

yeah that lets me manage prompts in langfuse and connect them to assistants, but then when the trace comes through it's not tagged as associated with the langfuse prompt, which is the end result I'm shooting for

Ahh yes good point @Shubham Bajaj is there a way we can add some sort of tracing data to lanfuse in vapi?

@Rafael Garcia can you create the feature request over here: https://roadmap.vapi.ai

Hi Jannik! I have multiple agents running on the same prompt with small variations. I have structured my prompt in a way that makes it easy to change "parameters" inside each prompt. The challenge is that the quantity of assistants is increasing and I find it more difficult to manage updating small changes to all prompts. I also create new assistants all the time and it's a slow process. I have saved this prompt in LangFuse which I currently only use for version control. What is a good method for managing my prompt across all assistants/agents programmatically where I can support variable changes for each assistant?