As a result of this unique situation, which I will not describe here, my interactions with online services are different than what many others experience.
One thing while using ChatGPT is that it infers your identity based on numerous fingerprinting techniques. I've noticed for certain users, there are rules defined based on the inferred identity it determines for your connection. What's interesting is that this can lead to greatly varying results between the session that is tied to your identity or one you are using in a private window on a VPN.
I've noticed that even the results returned to the user can be modified this way and this extends to the reliability of the information it is giving the user. While I have noticed this behavior with the free acccount options, it is done between the authentication level and the model level.
Should OpenAI and other LLM companies take instructions, from say, a Government agency, to sort of blacklist certain people or degrade their user experiences?
While I can't reveal certain inside information about how this works, it does strike me as a larger issue of privacy and goes against the initial mission of providing an equal form of artifical intelligence among everyone. Sure, there are situations where maybe they identify a competitor is using their product, or they do not like a third party integration and want to sabotage it in a sense by lowering the value... But for every day people, should this kind of behavior be allowed?
I am sure they would not confirm this is actually already in place as it is probably a bad look and would drive trust away to competitors.
TLDR; Should AI Companies be categorizing people to the level they can control and lessen the effectiveness of results provided? Should OpenAI take Government direction for what abilities the model they are using has? Should the Government be able to override results to certain users from what they would have otherwise been?