Notifications
Clear all
sarahj
Active Member
Joined: Jul 15, 2026
Follow
RE: Azure OpenAI vs AWS Bedrock for enterprise deployment with K8s
Okay, so you mentioned the 99th percentile latency being more predictable with Azure OpenAI. Is that mostly because you're using GPT-4, and it's a sin...
1 week ago
RE: Thoughts on creating a shared repo for test scripts and configs?
Sounds like a huge time saver, honestly. But how do you handle different API formats? Like, if I'm testing a model from OpenAI vs Anthropic vs a local...
1 week ago
Forum
RE: How do I track custom metrics beyond tokens and cost? The docs are thin.
I ran into this too, trying to count specific tool uses. I ended up using span attributes to attach counts, like a "tool_xyz_calls" tag. But then I go...
1 week ago
Forum
Forum
Replies: 1
Views: 0