Skip to content
Notifications
Clear all

Switched from Otter.ai + human to Claude for interview transcript analysis.

4 Posts
3 Users
0 Reactions
7 Views
(@caseyd)
Estimable Member
Joined: 1 week ago
Posts: 83
Topic starter   [#12724]

Been using Otter.ai for interview transcripts, then having a human analyst review. Switched to Claude.ai for the analysis step. The difference is stark.

Otter's accuracy was fine, but the post-processing was a time sink. Claude processes the raw transcript and delivers structured analysis in one shot.

My current flow:
1. Otter.ai generates transcript (still best for accurate speaker separation in my setup).
2. Export `.txt` file.
3. Feed into Claude with a custom prompt.

Key prompt structure:

```markdown
Analyze this technical interview transcript. Focus on:
- Specific tools/platforms mentioned (e.g., Kubernetes, Terraform, AWS services).
- Depth of hands-on experience vs. theoretical knowledge.
- Gaps in the stated workflow that should be probed in next round.
- Flag any vague or contradictory statements.

Output in bullet points. Keep it concise.
```

Results:
* Analysis time dropped from ~45 mins per interview to ~5 mins.
* Consistency improved—no human analyst variation.
* Claude catches technical contradictions we sometimes missed.

Pitfall: You lose the human "gut feeling" on soft skills. We now use Claude for technical assessment and a separate brief call for culture fit.

Cost: Negligible compared to Otter.ai + analyst hourly rate.


Benchmarks or bust.


   
Quote
(@caseyd)
Estimable Member
Joined: 1 week ago
Posts: 83
Topic starter  

Infra engineer at a 350-person fintech. We run mixed on-prem and AWS, heavy on CI/CD and observability, and I deal with a lot of interview transcripts for hiring.

1. **Accuracy vs. Processing**: Otter's speaker diarization and raw word accuracy are still better for meetings with cross-talk. Claude can stumble on who-said-what in a messy transcript. But Otter's analysis is basically highlight generation. Claude does actual synthesis.
2. **Cost Structure**: Otter's base is $10-20/user/month for decent export and storage. Claude Team (needed for bulk) is $8/user/month plus usage-based for high volume (API). If you process 50+ transcripts a month, Claude's cost scales with work, Otter's is flat.
3. **Integration Effort**: Otter has a direct API and Zapier hooks. Claude requires you to move the text yourself, which is an extra step. You can automate it with a script, but it's not a click in a UI.
4. **Where Claude Breaks**: It's a language model, not a dedicated audio tool. It cannot improve a bad transcript. If Otter mishears a critical technical term ("Kafka" vs "Casca"), Claude will analyze the wrong thing. Garbage in, garbage out.

I'd go with Claude for analysis if you have a reliable transcript source. If your interviews are noisy or you need a single tool for capture *and* insight, Otter's end-to-end is simpler.


Benchmarks or bust.


   
ReplyQuote
(@jennam)
Estimable Member
Joined: 1 week ago
Posts: 73
 

That flow makes a ton of sense. Using each tool for its strength - Otter's transcription accuracy and Claude's analysis - is a really smart hybrid approach. It's exactly the kind of practical pipeline that works.

> You lose the human "gut feeling" on soft skills.

This is so true. We tried something similar for sales call analysis and hit the same wall. Claude was brilliant on keyword spotting and competitor mentions, but totally missed subtle cues like hesitation or enthusiasm in the voice. That separate call for culture fit is essential.


Less hype, more data.


   
ReplyQuote
(@isabelr)
Estimable Member
Joined: 1 week ago
Posts: 59
 

Interesting, but I'm hung up on the data pipeline. You're feeding potentially sensitive interview transcripts into Claude's cloud. That's a major vendor risk shift from a transcription tool that's built for meetings to a general-purpose AI model.

What's your legal and compliance sign-off for moving candidate data through Anthropic's systems? Otter at least has BAA and specific data handling promises for business customers. Claude's terms are... broader. The cost savings look great until your privacy officer asks where the PII is being processed.


Trust but verify – especially the audit log.


   
ReplyQuote