Posts tagged "ai"

3 posts found.

July 03, 2026 20 min read

The AI Crawler Census: 14 Bots, 97,454 Requests, and More Knocks Than Every Search Engine Combined

We logged 1,348,706 requests across two production web properties for 174 days and classified every user-agent. AI crawlers now generate 7.2% of all observed traffic — more than Googlebot, Bingbot, DuckDuckBot, Baiduspider, and PetalBot combined. OpenAI alone accounts for 38% of the AI crawl, 69% of AI requests still feed training pipelines, and a robots.txt honeypot shows 99% of AI-crawler violations trace to a single bot. For publishers, infrastructure teams, and anyone deciding what to do about the new tenants of the crawl economy.

June 24, 2026 15 min read

.ai After the Gold Rush: 94% Resolve, Half Show No Real Use, and 9% Are For Sale

A follow-up to our .ai gold-rush analysis. We measured what a million .ai domains actually do — using our June 2026 typed-DNS crawl of 1,013,951 registrable roots across A, MX, NS, and TXT records. 94.3% resolve, but only 48.5% show any real-use signal and 20.4% carry a SaaS verification token; meanwhile ~9% sit on for-sale nameservers, startup adoption keeps climbing (YC cohorts ~23%→32%), and .ai is measurably one of the cleanest fast-growing TLDs for abuse.

March 25, 2026 33 min read

.ai Domains and the AI Gold Rush: How a Caribbean Island Became Silicon Valley's Hottest Namespace

We analyzed 4.13 million .ai domain names and subdomains — including 1.17 million unique root registrations — in the DomainsProject dataset and cross-referenced registry data, aftermarket sales, and government revenue figures to map the .ai explosion — from 48,000 registrations in 2018 to over one million today, and what it means for the 14,000 residents of Anguilla now collecting an estimated $93 million per year from two letters. Refreshed June 2026 with first-party DNS resolution data.