@Phil Hignight
For OpenAI, when using models like GPT-3.5, there are limits on the context window which affects the amount of text that can be processed in a single request. The context window for GPT-3.5 is 4096 tokens, which includes the prompt, the completion, and any documents provided for context. There isn't a specific limit on the number of documents, but the total token count must stay within this limit.
As for Anthropic, they also offer large language models, and while they may have similar constraints regarding context size, the specifics can vary. It's important to check the documentation provided by Anthropic for the most accurate and up-to-date information on their limits.
If you need more detailed information or have specific requirements, I would recommend checking the official documentation or reaching out to the support teams of OpenAI and Anthropic.