Why AI Search Engines Cause More 404 Errors Than Google
AI search engines like ChatGPT are sending users to broken web pages (called 404 errors) much more often than Google. Recent research shows ChatGPT directs users to 404 pages about 7 times more than Google does. Across all AI tools tested, the rate of 404s is nearly 3 times higher than Google. This includes both links users click directly and links AI mentions as sources. This is a big problem for anyone who manages websites or cares about user experience.
AI vs Google: The 404 Discrepancy
A study by Ahrefs looked at 16 million URLs from popular AI assistants like ChatGPT, Perplexity, Gemini, and compared them to Google’s search results.
- For URLs that people click, ChatGPT has a 404 error rate of about 1.01%, while Google’s rate is only about 0.15%.
- When looking at all URLs AI assistants mention (not just clicks), ChatGPT’s 404 rate jumps to 2.38%.
- The average 404 rate across AI tools is about 0.86%, still much higher than Google’s 0.84% baseline.
Other AI tools also have broken link problems, but ChatGPT is the biggest offender. For example, Gemini and Perplexity have lower 404 rates but still higher than Google’s.
Why Do AI Tools Hallucinate Broken URLs?
There are two main reasons AI causes broken links:
- Outdated Information: The AI sometimes relies on old web data. Many pages it cites used to be live but got deleted or moved.
- Invented Links: Sometimes AI makes up links that sound real but don’t actually exist. For instance, it might suggest URLs like “/blog/internal-links/” or “/blog/newsletter/” that seem plausible but are fake.
Because AI generates answers quickly without checking if a link works in real-time, broken pages often get shown.
What This Means for Web Professionals
- Traffic disruption: AI-generated traffic hitting broken pages inflates analytics data and confuses website owners.
- Lost opportunities: Visitors from AI who land on 404 pages likely leave without exploring further.
- Fixing broken links becomes even more important as AI referrals grow. Websites should monitor AI-generated traffic and set up redirects for known broken URLs.
How to Protect Your Site from AI-Generated 404s
Here are some practical tips:
- Use analytics tools to spot traffic coming from AI assistants.
- Create smart custom 404 pages that help users navigate to other parts of your site, like search bars or sitemaps.
- Set up 301 redirects for known broken URLs that AI might hallucinate.
- Use structured data and keep your sitemap updated. This helps AI models find real, live pages instead of guessing.
- Regularly monitor your 404 error logs and fix or redirect them quickly.
Google’s developer guides recommend these steps as best practices.
The Bigger Picture: Link Rot & AI Disruption
Link rot is when old links on the internet break over time as pages are removed or changed—a problem websites have faced for a long time. AI-powered search makes this worse by creating new broken links when it hallucinates URLs. As AI content grows (74% of new pages already contain AI content), this broken link problem may spread wider.
Conclusion
AI search tools like ChatGPT send users to broken pages nearly three times more often than Google, causing trouble for both users and webmasters. While the overall traffic from AI assistants is still small, the problem could grow. The best defense is to monitor AI referrals carefully, maintain excellent 404 pages, and proactively set up redirects for broken links.
FAQ Section
Why do AI search engines lead to more 404s?
Because AI sometimes invents or uses outdated links without checking if they work.
How often does ChatGPT send users to broken links vs Google?
ChatGPT directs users to 404 pages about 7 times more often than Google in clicked links.
What’s the “404 rate” for citations vs clicked links?
For ChatGPT, 404s appear in 1.01% of clicked links and 2.38% of all cited URLs.
How can I reduce AI-generated 404 traffic?
Monitor AI referrals, create smart 404s, use redirects, and keep your sitemap and site updated for AI models.