Notifications
Clear all
Model Provider Comparisons
1
Posts
1
Users
0
Reactions
0
Views
Topic starter
03/08/2026 12:10 pm
Hitting consistent timeouts with Anthropic's messages API when we approach ~16k context. Using claude-3-haiku-20240307. Happens reliably on tasks like summarizing large code diffs.
Our setup:
- Direct API calls, no streaming
- Simple system prompt + user content filling context
- Timeout set to 120s, but we're hitting it around 90s
- Smaller contexts (<8k) work fine
Seems like a sharp cliff. Anyone else hitting this? Specifically:
- Is this a model-specific issue with Haiku?
- Are there undocumented request size or processing time limits?
- Any workarounds besides chunking below 16k?
Looking for practical fixes, not "use a different provider." Need to make this reliable.