What is GPTBot and should you let it crawl your site?
Every argument for and against, with a decision framework for ecommerce, media, and SaaS sites.
Coming soonThe first posts land shortly after launch. In the meantime, here is the schedule. Subscribe to the RSS feed to get each one on the day it ships.
I'm publishing one piece a week for twelve weeks after launch, starting with the tactical stuff every marketer asks about first.
Every argument for and against, with a decision framework for ecommerce, media, and SaaS sites.
Coming soonThree methods compared, plus the limits of each one and which to actually trust.
Coming soonWhy every standard analytics stack misses it and what the gap costs you in practice.
Coming soonA walk through the IAB/ABC Spiders and Bots List and what to use instead.
Coming soonWho they work for, what they index, how often they visit, and how to tell them apart.
Coming soonWhen to allow, when to rate-limit, when to block. Plus the SEO cost of each choice.
Coming soonPlugin, edge worker, and log-file. Which one fits your setup and which one to avoid.
Coming soonWhat Shopify exposes, what it hides, and how to get a real per-URL crawl picture without log access.
Coming soonEvery declared crawler, every vendor, with the reasoning for allow and disallow rules.
Coming soonA year of public Cloudflare numbers, re-cut by vertical and by crawler.
Coming soonCutting through the acronym soup. What changes, what stays, what is marketing noise.
Coming soonThe first original research piece from Botsanalyser. Median hit rates, spikes, and the bots that showed up without announcing themselves.
Coming soonReserve your spot. I email once at launch and send each post straight after it publishes.