Executives working on AI at Microsoft and OpenAI admitted what its critics have been saying all along: Large language models are predatory pieces of technology that have been built on what a Microsoft executive called “an astonishing theft of unprecedented proportions,” and the “largest theft of labor in human history.” An internal Microsoft document said generative AI products have created a “doom loop” that is killing “the entire web.”
Those statements and a series of other mask-off moments feature heavily in an unredacted court filing that was unsealed Thursday in the behemoth New York Times vs OpenAI copyright lawsuit that has been winding its way through the court system for years. In a filing asking for summary judgment (basically, a filing with the court asking it to rule), lawyers for the New York Times laid out a series of admissions made by Microsoft and OpenAI executives in documents and depositions that until now had remained either sealed or redacted at the request of Microsoft and OpenAI.
It’s easy to see why the AI companies wanted to hide this from the public. The statements, taken together, are some of the most damning indictments of the ways LLMs were trained, how they worked, and the immediate threat they pose to human labor. It is a reminder that even as AI becomes more powerful and companies try to shift the narrative to the supposed existential risk of “superintelligent” AI, the tools they have already built were created by stealing from human creativity and labor and are by definition existential threats to the human labor market.
The best succinct description of llm that I’ve read was “plagiarism machine”, because that’s basically what they are: automated plagiarism. At best they create a collage of other works, at worst they copy one work verbatim, but they never create something original because they can’t.
Copying something is a lot easier and thus cheaper than creating an original work from scratch, so genuine creators cannot hope to compete on cost. Which leads to less people being able to afford to earn a living from creating works, which leads to less original works being created.
Short term that’s great for the neoliberal company executives: fire the expensive artists, create cheap slop with the plagiarism machine, and thus maximize profits now. That the plagiarism machine becomes stagnant because not enough new original works are being created is a future problem, by which time the current executives will have already jumped ship.
But while it’s great for the neoliberal business model, for the rest of society it will suck. So now that we have confirmation that the AI executives know how bad their products are, and that they were just publicly lying about it in the style of tobacco executives, will anything be done about this “astonishing theft of unprecedented proportions”? Personally I doubt it, there’s too much regulatory capture.
Hide it from the public? All you have to do is just think about it.
Internet search is terrible now. Every website I go to reads like it was generated by an LLM.
Because it was generated by a llm.
I did a search for the torque spec on a castle nut last week and the second result was for a nut (as in, food nuts that you eat) website and the llm had gone all in on nuts and added a page about castle nuts. It even generated an image of a castle for the top because… castle nut.
It proceeded to provide vague instructions and a torque recommendation of 2x the actual spec.
Then there was the other one about a small 4 stroke engine where it stated “other sites will say you don’t need to mix oil with gas but you absolutely must!” (You don’t and shouldn’t) … I wonder how many people have fucked up their shit by trusting llm garbage without knowing better.
Glad I spent my teens and 20s getting stoned and reading the shit out of wikipedia before this shit happened. Can’t trust anything written online now.
I once looked for a tutorial on a process in a Minecraft mod and there was a site that gave out incorrect information that was obviously written by an LLM.
Yeah I don’t even use ai so I can’t compare, but even paid search services are noticeably so much more frustrating.
Actually surprised how candid some of these statements are. Maybe points to more internal resistance than I would have assumed… like, they see the problem.
Their focus on threats to media companies is probably borne out of fear of litigation, so maybe they only pay a lil lip service to how they also hurt “content creators” (people).
Could also be that they know that when talking to the representatives of runaway financial automatons like multinational corporations, they have to appeal in terms the machine will understand.
One more generation of this shit, two at most, and tech will be working for the people again, unless we blow everything to smithereens before then.
you’re weirdly optimistic…
Whoopsies
LLMs are NOT destroying the planet. It’s the humans running the companies making LLMs.
Okay, the let’s destroy the humans running the companies making LLMs before they destroy us. Fetch the guillotines!
That’s what I’m sayin’!!!
guns dont kill people. people do.
technically, it’s the hardware that helps humans destroy the planet. and that hardware is astoundingly inefficient in what they’re trying to do with it. if you need to stack a literal data center with GPUs - maybe you need to develop some new tech.
But the LLM and the hardware is not making the decision and approving anything. It’s the humans.
humans destroy the planet with gear. that’s what i meant. and it’s the humans who think they can build superintelligent AI with tech and gear so woefully unfit for that it is not even funny.
We’re about to enter the age of A.I. inbreeding.
Can’t wait for Habsburg AI. I wonder what the AI equivalent to such genetic defects are.
As a programmer I can already give some hints. The code generated by current LLMs is really looking weird, Certainly nothing that humans would do…
They knew what they were doing every step of the way. They are criminals that need to be disarmed and locked away. And we need to create a new Internet from scratch somehow thanks to these donkeys.
If we make a new internet from scratch can we get rid of JavaScript too while we’re at it?
And make cookies illegal if not needed for transactions, functionality, or admin purposes?
a “doom loop” that is killing “the entire web.”
the corporate web maybe. how does it affect independent parts like the fediverse?
By bombarding it with bots like Reddit? Honestly, I can’t tell what is bot and not. Are you a bot? Am I a bit? Who knows?
Yeah once the mainstream is fully saturated they’ll turn their gaze to smaller, more “authentic” places. Imagine if they could have a boot infiltrate a tiny little private chat between a dozen people by building up the appearance of an organic presence on the fediverse / indie web.
Now advertisers (and potentially, malicious state actors) have a little spy and influencer in your group.
You gotta be blind. We’re all here reacting to ai slop articles, images and videos. It’s only getting more common.
Slop commenting. The litany of AI slop websites that have popped up, polluting search results. The absolute flood of AI slop pull requests being submitted to open source projects, to the point at which many open source maintainers are buckling under the weight of garbage being thrown their way. Bots everywhere. The list goes on and on and on.
The internet is already a dessicated husk of what it once was.
“Our AI content strategy has started a ‘doom loop’ that will hurt the performance of our models and the entire web at the same time: It is highly unusual that an end-product threatens the economic foundations of its essential suppliers, but that is the situation we have created for our LLM business with respect to its ‘content supply chain,’” the document said.
So basically the ouroboros
funny thing is that this ouroboros thing been known ever since LLM concept became a thing. that’s why it took forever to take off beyond r&d experiments. basically, the only remotely adequate way to apply LLM is what NotebookLM does - which literally parsing an uploaded document and reiterating it in some preset format. that’s literally it.
Nah, shitting where you eat.
Gonna get real weird soon when they run out of rich new training data and they begin to consume their own shit. When that happens their entire model will collapse and if the bubble hasn’t popped already that may be what causes it.
model collapse is the endgame. that’s the whole point of LLM.
What do you mean? Why would collapse be the endgame?
in a manner of speaking - you always end up there. not by design though. models operate via continuous refinement and you can only optimize a model so much until it is a mess and you need to figure out where to roll back. so you either get shit like semantic drift or variance decay and you can whack a mole it to an extent but then you hit the rlhf wall when the model starts gaming its reinforcement framework and the fat lady sings.
It’s either agi or model collapse. For every AI system actually. If you have a high enough adoption you start to muss original data so if your AI is not self sufficient in time it will collapse, because it will be trained on its own data, which just is an incentive loop
Pretty sure they mostly use the pre-AI internet (that they scraped and kept) and synthetic data currently. Probably trying (and failing so far or we’d have heard) to adapt to using video as training material at the moment, but developments there will likely apply to robotics at some point. Here’s hoping the current chuds have crashed and burned before then and that some sanity has taken over from unfettered capitalist oligarchs dreams of computer slavery.
Why don’t you thinj they have not adapted to video as training. Is that not what Flock does?
They’re already doing it. They call it distilling when they take it from another llm. Pretty sure most content was already stolen in the early days and they now rely on distillation and stealing new content.
So it’s like if everyone combined the backwash from their water bottles into a new drink…
Sounds super appealing!
Don’t get high off your own supply?
That’s my thought. So long as someone inputs anything new to the internet they will be able to scrape it and sell it as their product.
Why do you think there has been such an emphasis on hacking with LLMs lately (especially by OpenAI). They figured out all those vulnerability databases were an excellent source for training material. In the past they scraped those, but just for general language training. Now they’ve specifically trained the models on the information within. Some team figured out how to use that data to train a model and have testing scenarios automated so they could write a good reward function. It wasn’t that they figured out the models are good at hacking, they ran out of content and found a new source of good data.
With all the books they’ve been scanning I wonder if the next thing is going to be a writing assistant or editor or something like that. Even though writing good books is an art form and the actual writing down of the words is the easiest part (still not easy tho).
These companies are starving for content and they’ve not just poisoned buy absolutely destroyed the content well that is the internet. Given they were already hitting diminishing returns hard, it doesn’t matter too much to them probably. But more compute and storage has also been hitting diminishing returns hard and customers are complaining about the cost. So they are getting a bit desperate on how to improve these things at all.
“Our AI content strategy has started a ‘doom loop’ that will hurt the performance of our models and the entire web at the same time: It is highly unusual that an end-product threatens the economic foundations of its essential suppliers, but that is the situation we have created for our LLM business with respect to its ‘content supply chain,’” the document said.
Microsoft executives, including CEO Satya Nadella, testified under oath that after ripping content from the New York Times and other news sites, clicks to those news sites fully cratered, falling by more than 90 percent on Bing.
Documents obtained during the court proceedings found that OpenAI created “a hack to get around nytimes paywall,” to which OpenAI cofounder Greg Brockman said “ah, nice.” Microsoft executive Brent Hecht wrote that LLMs steal content “without ways of distributing economic value down the supply chain, [which] necessarily threatens the economic stability of those who create the content.”
Fuck these guys.
That’s kind of the funniest part in fact: these companies are destroying their own viable business segments. Bing was a huge growth driver for Microsoft. Less clicks is bad for them. They make more money on Bing ads than they do on LLMs. Same with Google.
Reddit is getting crushed atm after it sold access to its data to train models. Chat bots make visiting these websites pointless, without replacing that traffic with anything they can meaningfully monetize.
The more popular Gemini is, the less money Google will make. The market has already shown how much people are willing to pay for Ai subscriptions, and it isn’t all that much. None of these companies have found a way to make ads viable in LLMs either. They are beyond self sabotaging themselves at this point. It really is a doom loop.
That’s because, thus far, they get away with choosing not to distribute any of their trillions of dollars to the suppliers of the information they consume - money has only gone to the suppliers of hardware and power, and to influencing politicians and rewarding investors. That’s their choice, and they should not be allowed to continue to make that choice. Good luck to the NYT.
https://www.advocate.com/politics/national/new-york-times-transgender-controversy
https://www.npr.org/2023/02/15/1157181127/nyt-letter-trans
https://theintercept.com/2024/04/15/nyt-israel-gaza-genocide-palestine-coverage/
NYT is transphobic and pro-genocide. I hope they go bankrupt, and papers with fewer conservative biases survive. Unfortunately, the opposite will happen. Billionaire-backed news will run at a loss to manufacture propaganda, while independent journalism dies.
True enough. Maybe in an ideal world, they would both lose.
But would it be worth it if they had to pay the creative costs for it?
They are only worth it now cause it doesn’t include that AND it’s subsidized by investor money.
From an economic viewpoint AI companies are not worth is as it is now. OpenAI and Anthropic are hundreds of billions of dollars in debt and will never make a profit. Same goes for the AI subsidiaries of Microsoft, Meta, Google etc, except they are just leeching off of the mother companies and hiding their figures among their finances. Paying creators for their data would make very little difference in their overall finances.
But would it be worth it if they had to pay the creative costs for it?
no and they already admitted as much
I think the way they are operating now is commonly called predatory pricing.
I don’t know if there is a potential for a profitable business that covers all the costs. Possibly the direct costs, but I think not if they had to fairly compensate those who created the intellectual property they consumed to train their models, and much less likely if they had to pay the indirect costs. They might, some day, compensate creators a little, like Google shares a pittance of their ad revenue with some creators. But it is unlikely to be anything near a living wage.
AND it’s subsidised by too big a supply of compute power - Microsoft prints demand for Azure, by buying ownership stakes in openAI through the grant of Azure credits. There’s too much available compute.
At least they are going to pick one between copyright and using all the Web as accumulated material for their answering machine.
Copy right is ridiculous, ideas should be shared freely.
I’m glad ai is ruining the internet.
They all deserve nothing less for being brain dead capitalist drones. The primary concern with ai is it taking your useless crap without paying you?!
Your idea is worthless, but the big players ideas are hoarded and you are worried about your little shit drawings or crap stories being eaten by ai. Luddite donkeys.
Oh but at the same time we love piracy.
But they charge for their “services” and if it was ultimately a net positive I’d be rallying alongside you, but they just suck and have made everything else they touch also suck.
Everyone is insufferable in regards to ai.
It’s a fancy google search.
It’s like going from a manual car to an automatic car.
It’s still a car, it’s still a google search.
It’s worse than Google search was pre 2020 and has subsequently also made Google search itself the worst it’s ever been
Relax guys, the very stable high IQ president of the united states will protect you. No meed for guardrails or regulations.
God the guardrails things. These stupid companies are all hyping up “We need to slow down, we need guard rails!”
Ok.
No one is fucking stopping you. Just… Slow yourself down, guardrail yourself.
Oh wait, it’s just an excuse to create regulatory capture.
It’s the theftbot manufacturers trying to have excuses in the public perception for why all their claims about their product don’t ever happen.
“We had to slow down for safety. All those things we promised are coming, just one more round of funding bro.”
That clown is legalizing all kinds of white collar crime, already. This kind of shit is nothing to him.
