AI/4 min exploration

The 99% accuracy trap

A good headline score can hide a very different story inside the alerts.

AIMAKE A PREDICTION

Among messages this AI filter flags as scams, what percentage really are scams?

In a made-up batch of 10,000 messages, 100 are scams. The filter catches 99% of those, and wrongly flags 1% of the 9,900 non-scam messages.

YOUR ESTIMATE
AMONG FLAGGED MESSAGES90%Actual scamsOrdinary messagesA flag is a prediction.
The ring shows your estimated share of correct flags. This is a hypothetical detector, not a measured AI product.
90%
No flags are genuineEvery flag is genuine

A rough guess is enough.

The bigger picture Synthetic AI model · reviewed 4 October 2026

What the numbers mean

Two piles of 99. Only one contains scams.

The filter correctly flags 99 scams and wrongly flags 99 ordinary messages. That makes 198 alerts, with scams accounting for half. Across the whole batch, 9,900 of its 10,000 decisions are correct: 99% accuracy.

Read the sources
01

Two percentages, two different questions

Accuracy asks how often the filter gets any decision right. Precision asks how many of its flags are genuine. Our filter correctly clears 9,801 ordinary messages and catches 99 scams. Those many correct clearances make overall accuracy high, even though half the flagged messages are false alarms. [1]

02

A small error rate can meet a very large group

Only one in 100 messages is a scam in this example. The remaining 99 in 100 create a much bigger pool for false alarms. Google's machine-learning guidance calls this a class imbalance. The starting mix matters: the same detection and false-alarm rates can produce different shares of genuine alerts in different batches. [2]

03

Look beyond one headline score

A useful evaluation separates caught scams, missed scams, false alarms and correctly cleared messages. It also checks whether the test batch resembles the messages the filter will actually see. Raising or lowering a filter's decision threshold can change these trade-offs. No single accuracy percentage describes all of them. [3]

Sources & method

How we worked it out.

Synthetic AI model · reviewed 4 October 2026

Sources checked

Synthetic example, not a measured AI product. True flags = 100 × 0.99 = 99. False flags = 9,900 × 0.01 = 99. Precision = 99 ÷ (99 + 99) = 50%. Accuracy = (99 + 9,801) ÷ 10,000 = 99%. Changing the scam share keeps the model's 99% catch rate and 1% false-alarm rate fixed.

  1. 01Google Machine Learning Crash CourseClassification: accuracy, recall, precision and related metrics (opens in a new tab)
  2. 02Google Machine Learning Crash CourseClass-imbalanced datasets: why the mix matters (opens in a new tab)
  3. 03Google Machine Learning Crash CourseClassification thresholds and the confusion matrix (opens in a new tab)