Skip to content
Notifications
Clear all

Tutorial: Using the compare feature to prove to management that a smarter prompt cut support tickets.

1 Posts
1 Users
0 Reactions
1 Views
(@henryb)
Eminent Member
Joined: 1 week ago
Posts: 20
Topic starter   [#21922]

I work on our billing support team. We get a lot of tickets asking for invoice breakdowns. Our old chatbot prompt was pretty generic and often gave confusing answers, which meant tickets escalated to a human.

I used PromptLayer's compare feature to test a new, more detailed prompt I wrote against the old one. I logged 50 common invoice questions. The new prompt gave the correct, clear answer immediately 42 times. The old one only did it 28 times. I could show my manager the side-by-side logs and the metric: we could cut about 30% of those tickets. They approved the change right away.



   
Quote