Nati Elimelech's Blog

Here I write about what I've learned in 20+ years at scale: how to build TECH SEO and GEO systems that work on millions of pages, how to solve problems no one else has solved, and how to translate SEO into language that product and engineering teams understand.

3 articles

Googlebot IP Addresses: 1,800+ IPs Updated Daily (All 4 Crawler Types)

Every Googlebot IP address and CIDR range, pulled directly from Google's official JSON endpoints. Updated daily. Covers all 4 crawler types: Common Crawlers (Googlebot), Special Crawlers (AdsBot), User-Triggered Fetchers, and User-Triggered Agents (Google-Agent). Copy-paste ready for firewall rules.

08/11/25 · updated 15/03/26 · 7 min read

web-bot-auth: The Bot Authentication Protocol Explained

The definitive guide to web-bot-auth, the IETF protocol for cryptographic bot identity. How it works, who built it (Cloudflare + Google), who's using it (OpenAI, AWS WAF, Akamai), and what it means for your site.

23/03/26 · 12 min read

I tested if AI agents can read Lovable, Base44, Bolt, and v0 websites so you don't have to

I built the same page on Lovable, Base44, Bolt, and v0, then tested whether ChatGPT and Claude could retrieve it. All exposed the topic. Only some exposed enough HTML for reliable body retrieval.

18/03/26 · 11 min read