There's a whole spectrum of things they could do from most to least aligned with that as a principle.

For example, they could have a thumbs up/down

- just track the metadata of the conversation (e.g. model used, how far through its context it was, how old the session was) - track metadata of the user as a whole (how often they use Claude, how many other "active" conversations they have on the go, how much they've tested other models, if this is their first time using new tweaks to params etc) - have contextual feedback of the chat available for humans to review (alongside the comments you put in the feedback), but not explicitly train on it.

Whereas the option they've chosen is:

> If you explicitly report feedback or bugs to us (e.g. via our thumbs up/down feedback button), or otherwise choose to allow us to use your data, then we may use your chats and coding sessions to train our models.

So literally using your session as training input. They also could've allowed this to be an opt-in on bug reports.

https://privacy.claude.com/en/articles/10023580-is-my-data-u...

The link in the post is for the API and commercial offerings. With that said, as others have already pointed out, how else could they actually make use of the feedback without the data that the feedback was given on.

Use it for training/review (RLHF, whatever) and "we load the whole thread, not the specific response or surrounding few prompts, and store it for 5 years" seem completely different things. It's not obvious why being tech savvy would automatically make one aware that the 2nd version is happening.

And to be fair to them, my motivation to send quite a lot of personal data to an LLM is shockingly high.

I send medical data to openai while I never ever send any AI provider an Image of me or my wife despite me wanting to do Star Wars montages and Studio Ghibli avatars.

I disabled Gemini Activity history because they told me that they will let humans look over it, but I gave claude access to my laptop.

There is a reason why we have consumer protection. Life doesn't need to be hard by default :D

They will train on it, and now competitors or future competitors will know about your niche, the specific problems you face within it, and how to solve them without doing the work that you did to get there.