Baseten Not working with Vapi Custom LLM
# support
s
Hi there I am trying baseten openai compatible api with Vapi and it not getting through. An error occurred in this call: pipeline-error-custom-llm-400-bad-request-validation-failed In logs:-
Copy code
Model request failed (attempt #1, reason: 400 "function-after[check_json_schema(), function-after[check_n(), function-after[disallow_beam_search(), DynamoTRTLLMChatCompletionRequest]]].metadata.numAssistantTurns (0): Input should be a valid string, function-after[check_json_schema(), function-after[check_n(), function-af...) (provider: custom-llm, model: meta-llama/Llama-4-Maverick-17B-128E-Instruct, region: unknown, credential: true)
v
Thank you for sharing the error details. The log indicates a schema validation issue:
metadata.numAssistantTurns (0): Input should be a valid string
. Could you please share the exact JSON payload you are sending from Vapi to the Baseten endpoint (with any sensitive info redacted)? This will help identify if any required fields are missing or incorrectly formatted. Source: - [Custom LLM Tool Calling Integration](https://docs.vapi.ai/customization/tool-calling-integration)
3 Views