As it’s summer holiday time, it gives me a chance to look at websites with a bit more vision.

Often, we get caught up in the daily grind.

Lately, I’ve been digging deep into several sites I’m working on, and one thing I noticed was missing across all of them was an llms.txt file. Most of the sites are built on WordPress and Shopify, and fortunately, there are easy plugins or workarounds to add one.

In our analytics data, we’ve seen AI-driven search traffic grow between 4–29%. Gemini and Perplexity are currently leading the charge.

LLMS is becoming just as important as organic rankings these days.

A robots.txt file is a widely recognized web standard used to instruct search engine crawlers on which parts of a website they can or cannot access, helping manage indexing and site performance. In contrast, an llms.txt file is not a standardized format, but it can be used to declare guidelines for large language models (LLMs)—such as AI bots or crawlers—outlining content usage permissions, attribution requirements, or areas to exclude from training.

While robots.txt is enforced by most search engines, llms.txt relies on voluntary compliance from AI systems and acts more as a transparency or ethical use signal.

You can check if your website has one by simply adding /llms.txt to the end of your URL.

If you don’t have one, this free tool can generate it for you. https://asvaai.com/tools/llm-txt-generator

#AI #LLMS #ChatGPT #Gemini #Perplexity