For example here a python snippet I used to simply pass the openAI response back to vapi which vapi isn't able to process using the custom-llm setting even though this test function works by accessing it directly: @app.post("/api/openai/chat/completions") async def custom_model_openai(request: Request): data = await request.json() print("Raw input received from VAPI:", data) # Use the messages from the VAPI request user_messages = data.get('messages', []) # Send request to OpenAI completion = client.chat.completions.create( model="gpt-3.5-turbo", messages=user_messages ) # Use the json() method to get the response data in JSON serializable format completion_data = completion.model_dump_json() # Log the response being sent back for debugging print("Sending OpenAI response back to VAPI:", completion_data) # Return the OpenAI response directly return JSONResponse(content=completion_data)

to test, create a script to call your openai competible endpoint with

stream=True

if that works, it'll work with VAPI

1. Consumers hate accents from other countries, immediately discredits them and puts up the consumers guard. 2. For current robo callers, you can not have a conversation with that robot and ask clarifying questions

Side note, VoiceAI isn’t at a place where it can replace human call centers and have the same effect. Soon yes, now no. For the next two years or so it’ll be a ramp up period as more companies take a risk on voiceAI, consumers will adapt behaviors, and in turn more companies will adopt voiceAI solutions, and in turn more consumers will adapt.

Plenty of companies are trying to become ai call centers and run into a scaling problem and then get destroyed by their burn rate because the scale of mass adoption you need to make real money is 95% impossible to reach yet. The only money in it right now is finding low risk calls to automate at scale for SMBs. Think about your value prop as how many hours you can save (not by replacing but by assisting) CSRs. 10 CSRs $15 an hour 8 hours a day is $1,200 / day. I’ve done research and interviews with CSRs & business owners and I can guarantee you 60% of what CSRs do is repetitive low risk work. If you can save someone $720 a day (60% reduction) in hours (not to mention the revenue generated from them now being free to do more high value, revenue generating tasks), what could you charge them a month?