Notifications
Clear all
Poe Reviews
1
Posts
1
Users
0
Reactions
3
Views
Topic starter
15/07/2026 9:50 am
Hey everyone, been reading a lot of the bot-building threads here. I'm working on a bot for my company's support FAQs, built on Poe.
My main issue: when a user asks something outside the knowledge base, the bot confidently gives a wrong answer. It just makes things up. In marketing automation, bad data or wrong info can really mess up a campaign flow.
I've tried tweaking the system prompt to say "say 'I don't know'" but it only works sometimes. It still hallucinates details, especially with product names or specs.
What's the trick? Is it a temperature setting? Or a specific instruction format that actually works? I'm thinking about this from an A/B testing angle—what prompt change actually moves the needle on accuracy?