I worry deeply because Meta connects a vast amount of humanity. The damage they've done already is immense; the damage they could do to civilisation (democracy, our trajectory towards freedom and peace, the post-WW2 vision of the West) is even worse. I've read [0] Zuckerberg wants to think of himself like one of the early Caesars (thus explaining the haircut) with a focus on absolute domination; what would such a man with such a fixation be willing to do?
That ship sailed, reached it's destination, had a leisurely visit to the chandlery and is on the way back to do it again.
gdulli•1h ago
Maybe their goal is to be able to point to the untrustworthiness of the source material as cover when they're accused of hallucination.
rileymat2•58m ago
The thing that bothers me about this article is that there was no attempt to explain why Meta would want to train on this content.
avaer•51m ago
The reason should be obvious. Powerful people would complain about unfairness/bias otherwise.
eddythompson80•44m ago
surely it depends on how the data is labeled or classified. When a model is trained on fiction and medical journals, it doesn't assume that a healing potion is the right answer for a runny nose.
rileymat2•32m ago
Yes, I need to have a full picture from the article for this reason, to counter my initial baises.
konart•50m ago
I was under the impression that all of them try to train their models on all data they can possible ibtain.
I'd think what ever data this Newsmax has - it would be in all datasets by now or soon enough. Was I wrong?
cyanydeez•10m ago
that was the first stab at it; but it's pretty clear that you try to get good data, especially when you see how much the open source chinese models are doing with far less compute and parameter sizes. These are the open source datasets: https://huggingface.co/datasets/HuggingFaceFW/fineweb
I don't think they do that anymore, but at the beginning, yes, they threw all kind of bullshit in there to get a proper gradient.
TacticalCoder•23m ago
But when it's trained on far-left media outlets, where's the outrage?
vintagedave•1h ago
[0] https://romanempiretimes.com/is-mark-zuckerberg-just-a-roman...
noir_lord•1h ago
Not could, already have.
That ship sailed, reached it's destination, had a leisurely visit to the chandlery and is on the way back to do it again.