I fear it won't be possible to detect any potential "commercial interests" in the output, unless the LLM companies are required to disclose them.
If I ask an LLM to write some basic application for me and it uses Next.js with settings that only work with deployment to Vercel, another LLM can't determine if this is sponsored or if Next.js is just the most popular tool du jour, and Vercel is the most popular way Next.js apps are deployed. If another LLM determines this is sponsored and blocks it, I may reasonably be upset about this. I mean I would personally would want Vercel blocked (and would ask LLMs not to use Vercel or any of their products), but many other users don't have an opinion about Vercel yet, and blocking this if it's not due to sponsorship violates users' expectations regarding how LLMs work.
pcthrowaway•15m ago
If I ask an LLM to write some basic application for me and it uses Next.js with settings that only work with deployment to Vercel, another LLM can't determine if this is sponsored or if Next.js is just the most popular tool du jour, and Vercel is the most popular way Next.js apps are deployed. If another LLM determines this is sponsored and blocks it, I may reasonably be upset about this. I mean I would personally would want Vercel blocked (and would ask LLMs not to use Vercel or any of their products), but many other users don't have an opinion about Vercel yet, and blocking this if it's not due to sponsorship violates users' expectations regarding how LLMs work.