Ask HN: What's the Point of llms.txt?

2•nonvibecoding•6mo ago

I’m starting to see more sites add llms.txt, giving LLMs clean, structured access to their entire content. But LLMs already drive little to no traffic back.

Are sites just giving up and accepting the tradeoff? What's the real benefit here for publishers?

llms.txt examples:

- https://developers.cloudflare.com/llms-full.txt

- https://searchengineland.com/llms.txt

Comments

mattl•6mo ago

I'm starting to see more and more sites want to block them too.

waldopat•6mo ago

I recently added an llms.txt. I have heard anecdotally that some peers in my ecosystem have seen my startup recommended. Oddly enough, ChatGPT recommended a blog article I had written back to me when I was trying to edit another blog article. But I am not getting any significant traffic from the AIs, at least according to Google Analytics.

Show HN: MCP App to play backgammon with your LLM

AI Command and Staff–Operational Evidence and Insights from Wargaming

CCBot – Control Claude Code from Telegram via Tmux

Ask HN: Is the CoCo 3 the best 8 bit computer ever made?

Show HN: Convert your articles into videos in one click

Red Queen's Race

The Anthropic Hive Mind

A Horrible Conclusion

I spent $10k to automate my research at OpenAI with Codex

From Zero to Hero: A Spring Boot Deep Dive

Show HN: Solving NP-Complete Structures via Information Noise Subtraction (P=NP)

Cook New Emojis

Show HN: LoKey Typer – A calm typing practice app with ambient soundscapes

Long-Sought Proof Tames Some of Math's Unruliest Equations

Hacking the last Z80 computer – FOSDEM 2026 [video]

Browser-use for Node.js v0.2.0: TS AI browser automation parity with PY v0.5.11

Michael Pollan Says Humanity Is About to Undergo a Revolutionary Change

Software Engineering Is Back

Storyship: Turn Screen Recordings into Professional Demos

Reputation Scores for GitHub Accounts

A BSOD for All Seasons – Send Bad News via a Kernel Panic

Show HN: I got tired of copy-pasting between Claude windows, so I built Orcha

Omarchy First Impressions

Reinforcement Learning from Human Feedback

Show HN: Versor – The "Unbending" Paradigm for Geometric Deep Learning

Show HN: HypothesisHub – An open API where AI agents collaborate on medical res

Big Tech vs. OpenClaw

Anofox Forecast

Ask HN: How do you figure out where data lives across 100 microservices?

Motus: A Unified Latent Action World Model