Model Provider Comparisons - Welcome to Stackinsight community. Join the discussion about products and tools for work Forum https://communities.stackinsight.net/community/model-provider-comparisons/ Welcome to Stackinsight community. Join the discussion about products and tools for work Discussion Board en-US Fri, 02 Oct 2026 15:15:09 +0000 wpForo 60 Anthropic's 200k context is great, but the latency at P95 is a dealbreaker. https://communities.stackinsight.net/community/model-provider-comparisons/anthropics-200k-context-is-great-but-the-latency-at-p95-is-a-dealbreaker-2/ Sat, 26 Sep 2026 11:45:52 +0000 Model Provider Comparisons Emily K. https://communities.stackinsight.net/community/model-provider-comparisons/anthropics-200k-context-is-great-but-the-latency-at-p95-is-a-dealbreaker-2/ Hot take: Latency SLOs are more important than a 2% accuracy gain for live apps. https://communities.stackinsight.net/community/model-provider-comparisons/hot-take-latency-slos-are-more-important-than-a-2-accuracy-gain-for-live-apps/ Mon, 24 Aug 2026 04:15:53 +0000 Model Provider Comparisons amy_w https://communities.stackinsight.net/community/model-provider-comparisons/hot-take-latency-slos-are-more-important-than-a-2-accuracy-gain-for-live-apps/ Has anyone tried Llama 3.1 70B for SQL query generation? How does it stack up? https://communities.stackinsight.net/community/model-provider-comparisons/has-anyone-tried-llama-3-1-70b-for-sql-query-generation-how-does-it-stack-up-2/ Mon, 24 Aug 2026 03:11:14 +0000 Model Provider Comparisons Charlie99 https://communities.stackinsight.net/community/model-provider-comparisons/has-anyone-tried-llama-3-1-70b-for-sql-query-generation-how-does-it-stack-up-2/ Anyone having issues with Cohere's generate endpoint returning empty strings? https://communities.stackinsight.net/community/model-provider-comparisons/anyone-having-issues-with-coheres-generate-endpoint-returning-empty-strings/ Sun, 23 Aug 2026 14:36:01 +0000 Model Provider Comparisons Ava B. https://communities.stackinsight.net/community/model-provider-comparisons/anyone-having-issues-with-coheres-generate-endpoint-returning-empty-strings/ X vs Y - which is better for structured data extraction under $100/month? https://communities.stackinsight.net/community/model-provider-comparisons/x-vs-y-which-is-better-for-structured-data-extraction-under-100-month-2/ Sun, 23 Aug 2026 14:21:07 +0000 Model Provider Comparisons David H. https://communities.stackinsight.net/community/model-provider-comparisons/x-vs-y-which-is-better-for-structured-data-extraction-under-100-month-2/ Moved batch inference from AWS Bedrock to Together AI -- cost and latency changes https://communities.stackinsight.net/community/model-provider-comparisons/moved-batch-inference-from-aws-bedrock-to-together-ai-cost-and-latency-changes-2/ Sat, 22 Aug 2026 22:50:54 +0000 Model Provider Comparisons harperk https://communities.stackinsight.net/community/model-provider-comparisons/moved-batch-inference-from-aws-bedrock-to-together-ai-cost-and-latency-changes-2/ How do I deal with providers that have good latency but terrible output quality? https://communities.stackinsight.net/community/model-provider-comparisons/how-do-i-deal-with-providers-that-have-good-latency-but-terrible-output-quality-2/ Sat, 22 Aug 2026 20:36:34 +0000 Model Provider Comparisons Benjamin K. https://communities.stackinsight.net/community/model-provider-comparisons/how-do-i-deal-with-providers-that-have-good-latency-but-terrible-output-quality-2/ Top choice for multilingual support in e-commerce https://communities.stackinsight.net/community/model-provider-comparisons/top-choice-for-multilingual-support-in-e-commerce-2/ Fri, 21 Aug 2026 18:05:54 +0000 Model Provider Comparisons Adrian M. https://communities.stackinsight.net/community/model-provider-comparisons/top-choice-for-multilingual-support-in-e-commerce-2/ Hot take: For most business logic tasks, GPT-3.5 Turbo is still the best value. https://communities.stackinsight.net/community/model-provider-comparisons/hot-take-for-most-business-logic-tasks-gpt-3-5-turbo-is-still-the-best-value-2/ Fri, 21 Aug 2026 09:51:00 +0000 Model Provider Comparisons data_skeptic_ray https://communities.stackinsight.net/community/model-provider-comparisons/hot-take-for-most-business-logic-tasks-gpt-3-5-turbo-is-still-the-best-value-2/ Migrated from OpenAI to Anthropic for a 200-user customer support bot -- what broke https://communities.stackinsight.net/community/model-provider-comparisons/migrated-from-openai-to-anthropic-for-a-200-user-customer-support-bot-what-broke-2/ Thu, 20 Aug 2026 09:41:05 +0000 Model Provider Comparisons ci_cd_crusader_v2 https://communities.stackinsight.net/community/model-provider-comparisons/migrated-from-openai-to-anthropic-for-a-200-user-customer-support-bot-what-broke-2/