Edition #3 – May 2026: AI Bot Insights

🚀 Edition #3 – May 2026: Content Bridge #AIBotInsights

The third issue of our monthly series is here, with fresh data on bot activity across publisher sites in DACH.

Here's what's in the May edition:

🔍 Which bot categories are most active
→ Search & Indexing (23.8%) leads, closely followed by AI Search & Answer Engines (21.1%) and Developer & Integration (18.7%). Around 31% of bot traffic is clearly AI-related.

🤖 Which AI bots drive the most traffic
→ Amazonbot, GPTBot and Claude-Bot make up the top three. Oai-searchbot, applebot and chatgpt-user are now also clearly visible in the top 10.

🌍 Where bot traffic originates
→ The US remains by far the leading source.

🚫 How many publishers actively block AI crawlers
→ 70% block CCBot, 68% GPTBot, and 66% ClaudeBot via robots.txt.

📄 New in this edition: robots.txt & llms.txt adoption
→ 95.9% of Germany's top 120 publishers maintain a robots.txt. 7.3% already have an llms.txt in place.

Bot traffic has long had a direct impact on reach, monetization, infrastructure costs, and content strategy — and is still often underestimated.

At Content Bridge, we're building the infrastructure between publishers and AI providers. Publishers can offload their bot management to our platform to gain valuable bot monitoring and protection. They can also prepare their sites for scalable content licensing.

Interested in a free trial or more bot insights? Please reach out to Nadeem Qureshi.

📊 More insights every month.

Here's the link to the report.