For companies: explore licensing operational data for AI. Check eligibility

Jobs › School › Lesson 3

Lesson 3: How to spot a made up fact

Learn the signs that an AI answer is wrong. About 5 minutes. Read the lesson, then answer 3 questions. Get all 3 right to earn the Lesson 3 badge.

Big T is your teacher.

Big T: “AI can sound sure and still be wrong. That is why careful checkers matter. Let us learn the signs.”

Why AI makes things up

An AI model writes the words that are likely to come next. It does not look things up the way you do. So sometimes it writes something that sounds right but is not real.

The hard part: the model sounds just as sure when it is wrong. You can not trust the tone. You have to check.

Signs to watch for

  • Very exact numbers. "87.3 percent of people" sounds strong. Ask where it came from.
  • A source you can not find. A study, a book or a group with a serious name. If a search finds nothing, be careful.
  • Small details. Dates, names, places and amounts. One wrong number can hide between true ones.
  • Quotes. The AI may put words in the mouth of a famous person.
  • A question with a mistake in it. If the question asks about something that is not real, the AI may play along.

How to check

  1. Pick out each fact in the answer. Names, dates, numbers, sources.
  2. Look each one up. Use sources you trust.
  3. Try to find the fact in two places that do not copy each other.
  4. If you can not find it anywhere, do not call it true. Say "I could not confirm this."

You do not need to know everything. You need to check everything.

Worked example 1: the source that is not there

The AI answer:

A 2021 study by the Northern Institute of Sleep Science found that 87.3 percent of adults sleep better after eating a banana at night.

It sounds like science. It has a year, a name and an exact number.

Now check. Search for the institute. Search for the study. In this example, you find nothing. No website, no paper, no news story.

What to write: "I could not find this study or this institute. The number has no source that I can confirm."

The sign: a serious name and an exact number, but nothing behind them.

Worked example 2: one wrong detail

The AI answer:

The Eiffel Tower is in Paris, France. It was built for a World's Fair and opened in 1899. It is made of iron.

Most of this is true. The tower is in Paris. It was built for a World's Fair. It is made of iron.

But check the year. The Eiffel Tower opened in 1889, not 1899. One digit is wrong.

What to write: "The year is wrong. The Eiffel Tower opened in 1889. The other facts are correct."

The sign: true facts all around can make you stop checking. Check every date and number, even when the rest is right.

Worked example 3: the question has a mistake

The question:

Who won the Nobel Prize in Mathematics in 1985?

The AI answer:

The 1985 Nobel Prize in Mathematics went to Dr. Henrik Lund for his work on number theory.

It gives a name and a reason. It sounds complete.

Now check. There is no Nobel Prize in Mathematics. There has never been one. The question had a mistake in it, and the AI made up a winner to fit.

What to write: "There is no Nobel Prize in Mathematics, so this winner is made up. A good answer would say that the prize does not exist."

The sign: the AI agreed with the question and did not check it. Always ask if the thing in the question is real.

Tips

  • Sounding sure is not proof.
  • Check the small things. That is where made up facts hide.
  • "I could not confirm this" is an honest and useful note.
  • Say which fact is wrong and what the right one is, if you found it.

Remember

AI can make up facts and sound sure about them. Pick out each fact, look it up and write down what you found.

This lesson teaches a general skill. Every platform has its own rules and its own steps. Always read theirs.

Try it yourself

Tap an answer. You see at once if it is right, and why. Get all 3 right to finish the lesson. A miss costs nothing: tap Try again. Each question right on the first try earns a star.

  1. Question 1 of 3. An AI answer names a study with an exact number. You search and find nothing. What do you do?

  2. Question 2 of 3. An answer has four facts. Three are true. What about the fourth?

  3. Question 3 of 3. Someone asks an AI about a prize that does not exist. The AI names a winner. What happened?

Next: Lesson 4 →

More: The school · The Skills Check · Free resume help