Ask HN: What's the Point of llms.txt?

2•nonvibecoding•4h ago

I’m starting to see more sites add llms.txt, giving LLMs clean, structured access to their entire content. But LLMs already drive little to no traffic back.

Are sites just giving up and accepting the tradeoff? What's the real benefit here for publishers?

llms.txt examples:

- https://developers.cloudflare.com/llms-full.txt

- https://searchengineland.com/llms.txt

Comments

mattl•4h ago

I'm starting to see more and more sites want to block them too.

waldopat•4h ago

I recently added an llms.txt. I have heard anecdotally that some peers in my ecosystem have seen my startup recommended. Oddly enough, ChatGPT recommended a blog article I had written back to me when I was trying to edit another blog article. But I am not getting any significant traffic from the AIs, at least according to Google Analytics.

Marvel Heroes Height Comparison [video]

When novels mattered– NY Times

New AI agent that clicks, types, and responds – without any code changes

The New Beeper

Why climate change alarmism failed

In 2000 a Man Claimed to Be from 2036. Some Predictions Have Been Coming True

Crates.io Implements Trusted Publishing Support

'It's just better ' Trump says Coca-Cola to change key US ingredient

Show HN: A 'Choose Your Own Adventure' Written in Emacs Org Mode

Videos from the Amazon Reveal an Unexpected Animal Friendship

Show HN: Tech Debt Game – Launch a programming language before the deadline

I improved funny-bunnies.fleo.at and it is my birthday

Tsunami warning issued in Southern Alaska after 7.3 magnitude earthquake

Babies made using three people's DNA are born free of mitochondrial disease

Marin – open lab for building foundation models

Claude Is Back on Windsurf

Delivering the Missing Building Blocks for Nvidia CUDA Kernel Fusion in Python

Project Servfail: One Year In

Lessons from an Olive Oil Sommelier

Mark Cuban: Why AI Will Create More Jobs, Not Fewer

Anthropic hired back two of its employees – 2 weeks after leaving for Cursor

A third parent's DNA can prevent an inherited disease

Tin Can – The landline, reinvented for kids

Hügelkultur – Horticultural Technique

The performance of a heat sink for satellite avionics thermal management

Mapped: The Richest Person in Every U.S. State

Some gut microbes can absorb and help expel 'forever chemicals' from the body

An Etymological Knockout

Stop Pretending You're the Last Developer

Context in LLMs and the Blockchain