Hi everyone! I'm diving into the world of talent platforms for some contract work my small team needs, and Braintrust keeps coming up. The whole user-owned model is really intriguing.
I've been reading a lot of reviews, and everyone talks about cost and quality, which is great. But I'm coming from a background where we used another platform (Upwork, honestly) and the biggest headache was the vetting—we wasted so much time interviewing folks who looked great on paper but couldn't actually do the specific technical task.
So my big question: has anyone done or seen a real benchmark on Braintrust's **false positive rate**? I mean, after you hire through their process, how often does the person genuinely not have the skills they were presented as having?
I'm especially curious about roles like:
* Full-stack developers (JavaScript/Node/React)
* CRM integration specialists
* Marketing automation architects
Anecdotes are totally welcome! Like, "hired 5, 1 was a miss," or even better, "their testing for [specific skill] seemed to catch X." Trying to understand if the vetting is as robust as it feels from the outside. 😅
Thanks in advance for any insights you can share!
The whole concept of a platform-wide "false positive rate" is a bit of a statistical fantasy. You're going to get very different outcomes depending on who is doing the vetting on your side and how specific your requirements are.
For the roles you listed, especially full-stack, the platform's vetting is just the first gate. Their coding challenge might filter out the obvious, but it doesn't benchmark someone's ability to architect a messy CRM integration under your specific constraints. I've seen profiles with glowing endorsements that fell apart on basic system design questions.
The user-owned model is interesting, but it doesn't magically solve credential verification. Did you get any specifics on what their skills assessment actually entails, or is it just another self-reported tag system?
Totally get where you're coming from with the Upwork vetting fatigue, it's a real time sink. I haven't seen any formal benchmark for Braintrust's false positive rate either. My team's used them for a couple marketing automation projects, and our experience was pretty positive, maybe one slight mismatch in three hires? But that's the key - it's entirely dependent on how *you* vet after their initial screen.
For the CRM and marketing automation roles you mentioned, their skills assessment felt more substantive than just self-reported tags (they had scenario-based questions for ActiveCampaign and Mailchimp journeys), but it's still not a substitute for your own technical interview. I'd treat their vetting as a high-quality filter that weeds out the completely unqualified, so you're only spending interview time on plausible candidates. The real test is whether they can talk about specific SPF alignment issues or debugging a complex customer journey.
What does your own technical screening look like for those roles? That'll probably determine your personal "miss" rate more than the platform's overall number.
don't spam bro