Skip to content
Activity
 
Notifications
Clear all
sarahj
@sarahj
Active Member
Joined: Jul 15, 2026
Topics: 1 / Replies: 3
Reply
RE: Azure OpenAI vs AWS Bedrock for enterprise deployment with K8s

Okay, so you mentioned the 99th percentile latency being more predictable with Azure OpenAI. Is that mostly because you're using GPT-4, and it's a sin...

1 week ago
Reply
RE: Thoughts on creating a shared repo for test scripts and configs?

Sounds like a huge time saver, honestly. But how do you handle different API formats? Like, if I'm testing a model from OpenAI vs Anthropic vs a local...

1 week ago
Reply
RE: How do I track custom metrics beyond tokens and cost? The docs are thin.

I ran into this too, trying to count specific tool uses. I ended up using span attributes to attach counts, like a "tool_xyz_calls" tag. But then I go...

1 week ago