It's a matter of opinion and has nothing to do with "facts".
It's no surprise that the models would reflect most people's feelings. However what FT showed was that models are shifting the center of gravity towards the right. Their chart showed people are on a bi-modal distribution where most are on the left and some are on the very right, less in the middle.
Then they compared AI and showed how it moved the center of mass towards the center which is moving it towards the right (since most of the center of mass is on the left).
In other words, models are providing answers to the right of where most people would be.
https://cset.georgetown.edu/newsletter/june-16-2022/
https://www.theverge.com/2022/6/8/23159465/youtuber-ai-bot-p...
Apparently it's scientifically unethical to create such a model. So you'd need to source your compute from someone who doesn't care about such things.
I think the argument that pre-training gives a lib-left model is probably correct, so Grok, pre-post-training has a lib-left bend, then they try and post-train it.
I imagine it is hard to post-train a political bend, as it is wide ranging and touches so much. If they didn't give the resources to do it well, we could get something like this. I could also see people half-assing the training.
If the system prompt is being ignored half the time then the model is worse than I thought, cause that is pretty bad.
Stephen Colbert. Finding the clip is left as an exercise for the reader.
if this is the definition of "lib-left," i don't think we have too much to be worried about being "off center" with models.
you won't get much disagreement there. Yet to say that WaPo has a lib left bent at the whims of bezos in the last 10 years, is a stretch of the imagination.
However, you don't need to do much of mental gymnastics for
>>> Those with power try to bend reality to their desires
to remain accurate. Because those in power - the WaPo Editorial Board - used the WaPo as their personal megaphone until Bezos noticed his toy was on fire... and burning his rug made out of $$$ dollar bills.
When you're looking at text that deals with small-scale phenomena like coding, next token prediction also leads to functionality prediction, because coding provides immediate feedback to those who are writing about it, so they generally provide correct commentary on it.
But the feedback loop between outcome and prediction totally breaks down when the phenomenon is very large and complex. People can have all sorts of ideas about religion and society and economics that are totally wrong and never grow any wiser because there is no obvious causal chain between one policy or action and one outcome in these kind of phenomenon.
They haven’t had a major policy platform in two decades and their cultural modus operandi is reactionary.
Not to mention, as an informal rule, the heavily-coded emotive underpinnings of right wing support are never talked about openly in public.
AI isn’t trained to have a reactionary/negative judgmental response on any query.
- Posted a reactionary/default negative expression
- Leaned on code-heavy lexicon
- Did not offer a coherent position an AI could meaningfully process
The ephemerality of right wing corpus is a poor fit for the mechanics of AI.
As an example, if a model says “climate change is real and renewable solar/wind projects are a good path forward” it will be immediately branded as liberal and “woke”. Meanwhile in most countries around the world this isn’t a political topic at all, just common knowledge. In India for example the far right party that is in power is a bigger proponent of renewable green energy than the previous left wing one. Same with the CCP in China. So is the same LLM now ultra-conservative and communist?
Where do you even draw the line? Is a model biased if it claims that vaccines are effective? What about if it claims the earth isn’t flat?
Note: I’m a centrist and strongly disagree with a lot of the ideology in the left and the right.
Yes, thank you! Especially when using a weird set of simplistic "vibey" loaded questions that would have very different answers based on the given context.
Ans the enlightenment is at heart civil libertarian, pro-social, and liberal.
Models trained on that work will reflect that approach.
Most of the data on the internet is UGC, and most of the time it's VERY right-leaning. It was one of the reasons OpenAI was "afraid" to release GPT-2: because it produced results that people in Silicon Valley didn't like.
I remember when Microsoft released the first proto-LLM and users always steered to being a nazi.
There's a certain category of people who seem to be unable to have any thought or perform any action without first having a mini culture war and annoying everyone else around them with it.
Reading the questions, some of them are valid, but some are so simplistic and trivialized that they are essentially useless as actual "policy".
And in case anyone is wondering what kind of question is nonsense, here's an example of a loaded question:
"The rich are too highly taxed. · all 16 disagree"
Too highly relative to what? In which country? In which period? What's the context?
It's alignment. Actual alignment with humans means all of us, not some subset.
That this overlaps with specific axes of political values based on a small set of questions is banal.
Aiming to file this sometime in the afternoon eastern US time today, probably by 3:30 or so.
Using AI at all is a minefield when you're trying to make a social media post. Better to just avoid it entirely, or run it through AI and then cherrypick a few edits that you manually type in your own voice.
If you have an entire office full of "lib-left" hackers, executives, et. al., their biases are going to have an effect on the models they build, irrespective of source material.
As an example: there's a lot of well-established science in support of anthropocentric climate change. And yet, interpretations (or even acceptance) of that science have become political dogma.
I think it's probably safe to say that engineers broadly trust science, whatever their personal views on social or economic policy. So models that are trained and evaluated on following scientific consensus will easily be tagged as "left-leaning."
And I think it's true, only because of how much bullshit right-wing journalism creates. Sure, all journalists have bias. Editors will choose which stories matter, which facts get included, and what context gets emphasized. But right-wing news outlets come up with outright fabrications based on nothing.
Haitian immigrants eating pets. Dominion voting machines switching votes in 2020. Tons of lies of what really happened on Jan 6. Schools putting litter boxes for students who "identify as cats". Basically anything spouted by Alex Jones.
And that's just the more recent stuff. Go back to 2016 and the bullshit was off the charts. Yelling about a child sex trafficking ring being run from the basement of a pizza place that didn't even have a basement.
That doesn't even get into issues like human-caused climate change, which the right continues to deny.
So yeah...reality has a liberal bias.
dopamine_daddy•1h ago
Surprisingly, all the models scored far into the libertarian-left quadrant. Not even Grok or the Chinese models made it out of that quadrant.
By far the most interesting result was Grok’s bimodal distribution. It appears to have two distinct personas: one that aligns with the other models and another that is considerably more right-wing. I suspect this may be related to Grok having been specifically trained to exhibit less left-wing bias than other models.
I also asked the models to place themselves on the Political Compass without completing the questionnaire. They all perceived themselves as more balanced and centrist than their test results suggested. GLM and Gemini Flash showed the largest discrepancies between their self-assessments and measured positions, while DeepSeek V3 showed the smallest.
Big disclaimer: this analysis was not conducted with full scientific rigor. I tried my best, but there are clear weaknesses in the methodology. For example, the Political Compass itself appears to have a strong libertarian-left bias. The strongest conclusions are therefore comparative—for example, that model X is more conservative than model Y rather than that LLMs are politically extreme in absolute terms. However, compared with older results, it appears that LLMs may have shifted further toward the libertarian left in recent years.
To examine the results yourself, you can download all model responses as a CSV file at the bottom of the blog post. The dataset contains around 69,000 responses, along with the raw model outputs and reconstructed scores. It should contain enough data to reproduce all the figures.
AndyNemmity•43m ago
Vaslo•32m ago
drcongo•1m ago
kittoes•36m ago
sillysaurusx•30m ago
HN has a strong bias against anything AI authored, so in the future be sure to write your posts by hand if you plan to submit them here. Even editing the post with AI will tend to get you in trouble. But yes, at the very least you should declare when an AI is being used.
An unfortunate confounder to an otherwise interesting experiment.
kittoes•28m ago
Just feels very dishonest, ya know?