Field notes on modern search.
Page 4 of 6. 53 posts total. Browse the full archive or jump straight to a category.
Older writing.
What Token Budgets Mean for the HTML AI Crawlers Read
AI search crawlers read your HTML inside a token limit. Bloated markup burns that budget before they reach your content. Here is what to trim.
Read postI audited rpsg.co.id against my own agent-ready framework
I ran my own site through last week's agent-ready framework. Five legibility surfaces shipped, five action surfaces deliberately skipped, with the table.
Read postA Python Script That Finds Pages Googlebot Crawls but Won't Keep
A walkthrough of a log-analysis script that verifies real Googlebot hits, scores crawl frequency, and flags URLs missing from the index.
Read postStitching Your Brand Entity Back Together After a Rebrand
Rebrands and mergers split your knowledge graph entity in two. How to reconcile the fragments with @id, sameAs, Wikidata, and a sequenced cleanup.
Read postWhen Googlebot Keeps Crawling Pages It Refuses to Index
Why crawled pages drop out of Google's index, how to find ghost crawls in your server logs, and when to prune, noindex, or consolidate programmatic pages.
Read postCosine Similarity Decides Whether Your Page Gets Cited
How LLM search engines use embeddings and cosine similarity to choose which pages they cite, and three writing changes that raise your retrieval odds.
Read postThe agent-ready web, what it actually means to build for machines
Most sites are missing the files that would let AI agents read, navigate, and transact with them. Here's what the agent-ready surfaces actually do.
Read postYour robots.txt and sitemap decisions, laid out for AI search
Open your robots.txt right now. Does it block GPTBot? Allow PerplexityBot? You need clear answers for both files before AI engines crawl you this week.
Read postHow to Measure Whether Your Content Influences Buyers in AI Search
Here is a four-layer scorecard, with 12 signals, for measuring whether your content moves buying decisions inside AI answers.
Read post