Google AI Overviews Recommend Glue on Pizza and Eating Rocks (2024)

Incident Summary

In May 2024, shortly after Google rolled out its AI Overviews feature broadly across U.S. search results, the system produced a series of dangerously inaccurate recommendations that went viral on social media.^[1]

The most widely reported errors included advising users to add “about 1/8 cup of non-toxic glue to the sauce to give it more tackiness” when searching for why cheese slides off pizza, and suggesting users should “eat at least one small rock a day” for minerals. The glue recommendation was traced to an 11-year-old satirical Reddit post by a user named “fucksmith” in r/Pizza that had received only 8 upvotes. The rocks suggestion originated from The Onion, a satirical publication. Additional documented errors included suggesting bathing with a toaster and recommending running with scissors.^[2]

Google Head of Search Liz Reid published a blog post acknowledging “some odd, inaccurate or unhelpful AI Overviews certainly did show up” and announced over a dozen technical changes, including better detection of nonsensical queries, limiting inclusion of satire and humor content, and reducing use of user-generated forum content. Google subsequently reduced AI Overviews frequency from approximately 84% of queries to 11–15%.^[3]

Key Facts

• Feature: Google AI Overviews (AI-synthesized answers at the top of search results)
• Key errors: “Add glue to pizza sauce” (from an 11-year-old satirical Reddit post); “eat one small rock per day” (from The Onion)
• Additional errors: Bathing with a toaster, running with scissors, drinking urine for kidney stones
• Root cause: AI failed to distinguish satirical, humorous, or user-generated content from factual information
• Google response: Blog post by Head of Search Liz Reid; over a dozen technical changes; AI Overviews frequency reduced from ~84% to 11–15% of queries
• Context: Google had signed a $60 million licensing deal with Reddit in February 2024 to train AI on Reddit content

Threat Patterns Involved

Primary: Misinformation and Hallucinated Content — Google’s AI Overviews presented satirical and humorous user-generated content as factual health and safety advice in authoritative search result positions.

Secondary: Overreliance and Automation Bias — The deployment of AI-generated answers at the top of search results creates an implicit authority signal, and users may trust these answers without verifying them through the underlying sources.

Significance

1. Scale of exposure — Google Search processes billions of queries daily; AI Overviews appeared on up to 84% of queries before the rollback, meaning potentially dangerous misinformation was presented to an enormous audience in an authoritative position
2. Satirical content vulnerability — The incident demonstrated that current LLMs cannot reliably distinguish satirical from factual content, a fundamental limitation when generating authoritative answers from web sources
3. Training data quality — The glue recommendation’s origin in a low-engagement Reddit post highlights the risks of training AI on user-generated content without adequate quality filtering, particularly given Google’s $60 million Reddit licensing deal
4. Rapid corporate response — Google’s public acknowledgment and technical changes within days represent a notable corporate response, though the incident raised questions about pre-deployment testing adequacy for a feature affecting billions of users