Bot protection, path by path

We just shipped a couple of new features on the platform. Together they close a gap most publishers know well. You can't protect what you can't see, and one policy for the whole domain was never going to fit a site where every section is a different kind of asset.

Path based analytics

Your traffic, broken down per URL path.

For every part of your site you get the request volume, the human versus bot split, how much is already blocked, and which categories or specific bots are behind it. Filter by bot type, by volume or by traffic, or search for one bot and see every path it touches. Export the data whenever you want it in your own reporting.

The Path Analytics feature tells you which page content is in high demand among bots. Maybe your archive is quietly pulling 40% bot traffic. Maybe your premium section is being crawled by bots you never heard of, while your homepage stays mostly human. Once you can see it per path, the decisions get obvious.

Path based rules

Set up paths and define blocking rules for each one. You decide what a rule targets:

• Bot name, like GPTBot or ClaudeBot
• Category, like AI Crawlers or Commercial Scrapers
• Bot type, stealth bots that hide their identity versus transparent ones that don't
• Country
• Any mix of those

Bot type is the one that matters most. A bot that identifies itself is easy to handle. The ones costing you traffic are the ones that spoof their user agent or hide behind residential proxies to look human. Because we sit in the request path at server, CDN, CMS plugin or log level, we catch the disguise, not just the name tag.

A quick example

News stays open for search crawlers, visibility still brings readers. Premium blocks AI related crawlers, since that content is the base of the subscription business. Archive blocks stealth traffic, that's usually where scraping at scale happens.

One site, multiple blocking strategies with full visibility, all based on real numbers instead of a hunch.

Try it

Path analytics and path rules are live in the platform now. Already on Content Bridge? Check your bot monitoring, then apply your protection. Not yet? Get in touch at content-bridge.eu.