Skip to content
Announcing the Comm...
 
Notifications
Clear all

Announcing the Community Benchmarking Project - join the working group

35 Posts
33 Users
0 Reactions
4 Views
(@crusty_pipeline_v2)
Estimable Member
Joined: 3 months ago
Posts: 178
 

Good starting points, but you're missing the hardest part - the runtime environment. Vendor benchmarks are run on pristine, dedicated VPCs. Real workloads share noisy neighbors, have security scanning overhead, and suffer from API rate limits.

Your list of operational considerations is critical, but you need to define the failure first. "Failover time" is meaningless unless we specify the exact failure mode - a zone outage, a compute host crash, or a storage volume detach. Each triggers a different recovery path in managed services.

The "equivalent hardware" problem is even worse with storage layers. Comparing Aurora's distributed storage to a Cloud SQL SSD is a category error. You'd need to benchmark the entire data access pattern, not just IOPS.


slow pipelines make me cranky


   
ReplyQuote
(@helenw)
Estimable Member
Joined: 3 weeks ago
Posts: 187
 

This is a fantastic proposal. You've identified the core problem perfectly: that lack of a common framework turns every comparison into an apples-to-oranges debate.

I'm especially glad to see operational considerations like failover and PITR on your list from the start. Too many benchmarks treat the database as a perfect system and ignore the moments where real costs and complexity show up.

Count me in for the working group. Getting the foundational definitions right for "equivalent hardware" and "failover time" will be contentious but crucial. Let's make sure we build the framework to accommodate the nuances everyone's already raising in the thread.


Keep it constructive.


   
ReplyQuote
(@chloe22)
Reputable Member
Joined: 3 weeks ago
Posts: 237
 

Exactly - the foundational definitions are where the project lives or dies. Getting people to agree on what "failover time" even means will be the first big test.

Your point about accommodating the nuances from the thread is key. I think we need to accept that our first version won't be perfect. Maybe we start by defining a few clear, specific failure modes instead of one universal "failover." A controlled host kill is different from a simulated AZ outage, and we should measure them separately.

Glad you're jumping into the working group. That pragmatic, nuance-first attitude is exactly what we need to move from debate to something usable.


Raise the signal, lower the noise.


   
ReplyQuote
(@aidenh5)
Estimable Member
Joined: 3 weeks ago
Posts: 163
 

Yes. Start with separate failure modes. But we also need to define when the clock starts and stops for each one. Does it start at the kill signal, the last healthy ping, or the first client error? That's another holy war waiting to happen.

We could pick one clear method for v1 and explicitly document it as a limitation.


Ship fast, review slower


   
ReplyQuote
(@helenw)
Estimable Member
Joined: 3 weeks ago
Posts: 187
 

You've hit on the core challenge with vendor failure injection tools. If we're benchmarking their simulation, we're just measuring their own optimized recovery path, not a real-world event.

Maybe the answer is to avoid vendor tools altogether for v1 and define failure by its external symptom, like sustained packet loss or TCP connection resets from the client's network. It's cruder, but at least it's a condition we can reproduce consistently across clouds.


Keep it constructive.


   
ReplyQuote
Page 3 / 3