Skip to content
Notifications
Clear all

First-time evaluator - what's the single most useful metric?

3 Posts
3 Users
0 Reactions
0 Views
(@cost_cutter_99)
Reputable Member
Joined: 4 months ago
Posts: 225
Topic starter   [#24300]

I'm deep in the evaluation phase for Braintrust for our dev and data science teams. The platform looks powerful, but as usual, the pricing page and case studies are heavy on features and light on the one number that really helps you model the cost.

Everyone talks about the 0% marketplace fee (which is a great differentiator), but for internal budgeting, I need to translate that into a predictable metric.

So, for those already using it: **what's the single most useful metric for forecasting your monthly Braintrust spend?**

Is it:
* **Hourly rate of your most common talent tier?** This seems obvious, but is the spread between "Entry" and "Expert" too wide to be useful?
* **Average project duration** from your internal history?
* **The platform fee on top of the hourly rate?** (They say 10% + payment processing, but are there clear line items for this on the invoice?)
* Or something else entirely, like a blended average hourly cost you've back-calculated from total invoices?

I'm trying to build a simple model in the spreadsheet. Knowing which variable has the least variance would be a huge help. Real-world examples of how this metric behaves would be perfect.



   
Quote
(@integration_ian_2)
Reputable Member
Joined: 2 months ago
Posts: 284
 

Great question. I've been running our Braintrust spend through our accounting software for about eight months, and I can tell you the single most predictable metric for us has been the **blended average hourly cost**.

The hourly rate spread is real, even within a single tier. You might budget for a "Mid-Level" developer at $85/hour, but in practice we've seen those contracts settle anywhere from $75 to $95 based on the specific skill mix needed. The platform fee (it's a clean 10% plus Stripe processing, shown as separate line items) is constant, so it doesn't introduce variance.

What worked for our model was taking our last three months of total invoiced spend and dividing it by the total logged hours. That gave us a blended rate that absorbed all the tier and rate variation. We now forecast using that number multiplied by our estimated monthly hours, and it's been within 5% of actuals. Start with your best guess for hours, then use a blended rate you refine after your first few projects.


api first


   
ReplyQuote
(@annie82)
Estimable Member
Joined: 3 weeks ago
Posts: 119
 

Blended average hourly cost makes a lot of sense, thank you! It seems like the variance within tiers is the key thing I wasn't considering.

A follow-up, if you don't mind: how did you settle on three months of history as the right amount? I'm worried that with only a couple of small initial projects, our blended rate might swing wildly for a while. Did you use a placeholder rate until you had enough data?



   
ReplyQuote