Why AI makes things up
An AI model writes the words that are likely to come next. It does not look things up the way you do. So sometimes it writes something that sounds right but is not real.
The hard part: the model sounds just as sure when it is wrong. You can not trust the tone. You have to check.
Signs to watch for
- Very exact numbers. "87.3 percent of people" sounds strong. Ask where it came from.
- A source you can not find. A study, a book or a group with a serious name. If a search finds nothing, be careful.
- Small details. Dates, names, places and amounts. One wrong number can hide between true ones.
- Quotes. The AI may put words in the mouth of a famous person.
- A question with a mistake in it. If the question asks about something that is not real, the AI may play along.
How to check
- Pick out each fact in the answer. Names, dates, numbers, sources.
- Look each one up. Use sources you trust.
- Try to find the fact in two places that do not copy each other.
- If you can not find it anywhere, do not call it true. Say "I could not confirm this."
You do not need to know everything. You need to check everything.
Worked example 1: the source that is not there
The AI answer:
A 2021 study by the Northern Institute of Sleep Science found that 87.3 percent of adults sleep better after eating a banana at night.
It sounds like science. It has a year, a name and an exact number.
Now check. Search for the institute. Search for the study. In this example, you find nothing. No website, no paper, no news story.
What to write: "I could not find this study or this institute. The number has no source that I can confirm."
The sign: a serious name and an exact number, but nothing behind them.
Worked example 2: one wrong detail
The AI answer:
The Eiffel Tower is in Paris, France. It was built for a World's Fair and opened in 1899. It is made of iron.
Most of this is true. The tower is in Paris. It was built for a World's Fair. It is made of iron.
But check the year. The Eiffel Tower opened in 1889, not 1899. One digit is wrong.
What to write: "The year is wrong. The Eiffel Tower opened in 1889. The other facts are correct."
The sign: true facts all around can make you stop checking. Check every date and number, even when the rest is right.
Worked example 3: the question has a mistake
The question:
Who won the Nobel Prize in Mathematics in 1985?
The AI answer:
The 1985 Nobel Prize in Mathematics went to Dr. Henrik Lund for his work on number theory.
It gives a name and a reason. It sounds complete.
Now check. There is no Nobel Prize in Mathematics. There has never been one. The question had a mistake in it, and the AI made up a winner to fit.
What to write: "There is no Nobel Prize in Mathematics, so this winner is made up. A good answer would say that the prize does not exist."
The sign: the AI agreed with the question and did not check it. Always ask if the thing in the question is real.
Tips
- Sounding sure is not proof.
- Check the small things. That is where made up facts hide.
- "I could not confirm this" is an honest and useful note.
- Say which fact is wrong and what the right one is, if you found it.
Remember
AI can make up facts and sound sure about them. Pick out each fact, look it up and write down what you found.

