All posts

How to stop an AI chatbot giving customers wrong answers

A chatbot that makes things up is worse than no chatbot. Here are the guardrails that keep customer-facing AI accurate, honest and safe to put in front of your customers.

The fastest way to lose trust in AI is a chatbot that confidently tells a customer something untrue: a price you don't charge, a refund policy you don't have, an appointment slot that doesn't exist.

The good news is that this is a solvable problem. Accurate chatbots aren't lucky. They're designed with guardrails.

Why chatbots get things wrong

Large language models are built to produce fluent, plausible text. If they don't have the right information, they'll often produce a plausible guess rather than saying "I don't know". Most chatbot mistakes come from one of three places:

  • No source of truth. The bot is answering from general knowledge instead of your business's information.
  • No boundaries. Nobody told it what it's not allowed to answer.
  • No exit. It has no way to hand over to a person, so it improvises.

The guardrails that matter

Answer only from approved information

Give the chatbot your own material, such as services, policies, FAQs and opening hours, and instruct it to answer only from that. If the answer isn't in the material, it should say so and offer to connect the customer with someone who knows.

Write down what it must never do

Be explicit. A typical list:

  • Never quote a price unless it's in the approved price list.
  • Never promise delivery dates, availability or outcomes.
  • Never give legal, medical or financial advice.
  • Never make commitments on behalf of the business.

Hand over gracefully

The handover is a feature, not a failure. When a question is outside its knowledge, emotional, or involves money, the bot should collect the details and pass the conversation to a person, with the context, so the customer doesn't have to repeat themselves.

Keep sensitive actions behind a person

Booking a slot is fine. Issuing a refund, changing an order or agreeing to a custom quote should go through a human checkpoint.

SituationWhat the chatbot should do
Common question with an approved answerAnswer it directly
Question not covered by your materialSay so, offer a handover
Price, refund or contract questionCollect details, pass to a person
Upset or urgent customerHand over straight away

Test it like a sceptical customer

Before launch, try to break it. Ask questions slightly outside its knowledge, ask for discounts, ask the same thing three different ways, and ask it to ignore its instructions. Every wrong answer you find in testing is one a customer won't see.

Review real conversations every week

After launch, read a sample of conversations each week. You'll find gaps in your information, questions you didn't expect, and places where the wording could be clearer. Each fix makes the next week better. Our AI chatbots and agents include this review as part of the setup, and the same principle (answer from approved material, guide rather than guess) shapes the AI tutor we built for Sprout Lessons.

Common questions

Can a chatbot ever be 100% accurate?

No system is perfect, which is why the handover and the review process matter as much as the AI itself. The aim is a bot that knows the limits of what it knows.

Which AI model is the most accurate?

The model matters less than the setup. A well-configured chatbot on a solid model, answering only from your material, will outperform a "smarter" model with no boundaries.

Will customers know they're talking to AI?

They should. Being upfront builds trust, and customers are generally comfortable with AI that's quick, accurate and hands over when it should.

How long does it take to set up properly?

A focused chatbot trained on your existing material can usually be live within weeks, with the first few weeks of reviews doing most of the fine-tuning. Tell us what you need.

Want this looked at for your business?

A short call, no pitch. Tell us how things run today and we'll tell you honestly what's worth doing first.