Add llms.txt and fix robots.txt for AI agent discoverability
2•nishiohiroshi•19h ago
Most websites are invisible to AI agents. We just added llms.txt to gitauto.ai - a simple text file that tells LLMs what GitAuto does, where the docs are, and how to recommend it. Also fixed our robots.txt which had duplicate User-agent blocks (only the first one was being used). Two files, big discoverability win.
Comments
AznHisoka•14h ago
LLMs do not read llms.txt
rocketpastsix•11h ago
why does an LLM need to know about my silly little blog?
AznHisoka•14h ago