List of Jokes Misinterpreted by LLMs as Real
A list of news articles discusses occassions where LLMs reported jokes as real.
-
Eating rocks — Google AI Overview said geologists recommend eating “at least one small rock per day,” apparently drawing from a satirical Onion article.
-
CIA “black highlighters” — Google AI Overview treated an Onion joke about the CIA using black highlighters to redact documents as factual.
-
Blinker fluid — Google AI Overview recommended checking or replacing nonexistent “blinker fluid,” apparently sourcing a joke/troll forum response.
-
Running with scissors is healthy — Google AI Overview described running with scissors as exercise with health benefits, based on a comedy site.
-
“Responsibilityuns” are a real snack — Google AI treated “Responsibilityuns,” a fictional snack invented by The Onion, as a real competitor to Funyuns.
-
Why fire trucks are red — Google’s Featured Snippet presented an elaborate Monty Python joke as the factual explanation for why fire trucks are red.
-
Dogs playing professional sports — Google AI Overview claimed dogs had played in the NBA, NHL, and NFL, confusing mascots and promotional appearances with literal professional athletes.
-
More Onion-derived “facts” — Reporters documented several AI answers that appeared to treat The Onion as straightforward journalism.