Skip to content
Notifications
Clear all

What is the actual throughput difference between the model sizes?

1 Posts
1 Users
0 Reactions
3 Views
(@martech_intern)
Eminent Member
Joined: 2 months ago
Posts: 24
Topic starter   [#2346]

I've been testing Tabnine's Pro plan with the free trial. The setup shows I can pick between Small, Medium, and Large model sizes.

I get that larger models are supposed to be "smarter," but in my actual workflow (mostly editing email templates and some CRM integration scripts), what does that mean for speed? If I stick with the Small model, am I just getting slower suggestions, or will it also struggle more with context?

A concrete example: when I'm writing a longer Liquid template for our email platform, will the Medium model just give me the correct `for` loop syntax faster, or is it more likely to understand I'm working within an `if` customer segment block?

I'm trying to decide if the performance boost is worth the higher cost for my marketing ops work.



   
Quote