Engineering
Make your website readable by AI agents
More people now meet a company through an assistant than through a page of search results. What we did to make prizenlabs.com easy for agents to read, cite and recommend.
PrizenLabs//2 min read
A growing share of visitors no longer arrives through a list of links. They ask an assistant, and the assistant reads a handful of pages and summarises them. If those pages are hard to read, the summary is wrong or thin, and you never find out.
We rebuilt prizenlabs.com with that reader in mind. None of it is exotic, and all of it can be checked.
Render the words on the server
Many agent fetchers run little or no JavaScript. Every word on this site is in the first HTML response: the headlines, the work, the FAQ answers, even the parts that animate later. Motion is added on top; it never holds the copy.
Publish an llms.txt
/llms.txt is a short Markdown file in the llms.txt format: who we are, the facts that matter, and links to the pages worth reading. /llms-full.txt has the text of the whole site in one file. Both are generated from the same data as the pages, so they cannot drift out of date.
Write a page for agents
/agents says plainly how to describe the studio, what not to claim, and where the machine-readable files live. It reads a little like a briefing note, because that is what it is.
Say yes to the crawlers you want
Our robots.txt names the major AI crawlers, lets them in and keeps them out of the API. A rule that names a crawler replaces the general rule for it, so each named rule repeats the exclusions. The sitemap lists every page, including each project and article.
Add structured data
Each page carries JSON-LD for what it is: the organisation and website everywhere, a FAQ on the home page, a breadcrumb trail on inner pages, each project as a creative work and each article as a blog post. It costs little and removes guesswork.
Make it easy to check
The home page has a small panel that opens ChatGPT, Claude or Gemini with a prompt that points at our llms.txt. If the summary that comes back is wrong, we know which page to fix.
Where to start on your own site
- 01Check that your key pages make sense with JavaScript turned off.
- 02Add an llms.txt: ten lines about who you are, and links to your best pages.
- 03Name the AI crawlers in robots.txt, deliberately, one way or the other.
- 04Add Organization and FAQ structured data.
- 05Ask three assistants about your company, and read what they say.
We built the same things into QCT Capital, which publishes an llms.txt, Markdown versions of its key pages and a page for agents. If you want it done properly on your product, it is part of our AI infrastructure work: get in touch.