<@865531204849500190> is Vapi planning to implemen...
# general-english
e
@Shubham Bajaj is Vapi planning to implement** Claude caching? ** Claude tokens are pretty expensive without them! One line after the System Prompt, and one line after each message, is all it takes: https://docs.anthropic.com/en/docs/build-with-claude/prompt-caching
Copy code
system=[
      {
        "type": "text",
        "text": "You are an AI assistant tasked with analyzing literary works. Your goal is to provide insightful commentary on themes, characters, and writing style.\n",

      },
      {
        "type": "text",
        "text": "<the entire contents of 'Pride and Prejudice'>",
        "cache_control": {"type": "ephemeral"}
      }
    ],
2 Views