I’m not trying to say that LLMs are on the whole good for humanity. I agree with you that they’re not. And I’m not trying to argue that OpenAI never steals intellectual property. Clearly they do.
But these mathematical problems were solved by OpenAI’s models. That much is indisputable. There was nothing in the training data that could have given them the solutions.
If you feed them the approach the mathematicians were using, they for sure can solve it! It has never been published what source material their LLM was provided with. This is the equivalent of someone telling you a result, but never telling you how they got the information needed to achieve it in the first place.
There is value in this technology. But we should do out best to not conflate remixing shit with intelligence - these things are not the same at all. LLMs are more like the proverbial infinite room of monkeys with typewriters, with the very important restriction that these monkeys can never type something that resembles an original thought.
If you feed them the approach the mathematicians were using, they for sure can solve it!
The solutions published by openAI contain techniques that have been reviewed by the mathematical community and determined to be novel. Maybe someone had used the technique before, but then wouldn’t they have published their solution or spoken up about openAI stealing their preprint?
Yes, but only for one result out of 275-ish, and as far as I understand it, the AI proof contained a lot more than their existing research. Failing to credit past work is an issue, and could easily be argued as theft, but this isn’t good evidence that AI cannot generate proofs that contain more than just stolen material.
And is there any evidence that the required information for the other proofs wasn’t already available in the training data? As i said, these things remix stuff, they cannot come up with new stuff.
I’m not trying to say that LLMs are on the whole good for humanity. I agree with you that they’re not. And I’m not trying to argue that OpenAI never steals intellectual property. Clearly they do.
But these mathematical problems were solved by OpenAI’s models. That much is indisputable. There was nothing in the training data that could have given them the solutions.
If you feed them the approach the mathematicians were using, they for sure can solve it! It has never been published what source material their LLM was provided with. This is the equivalent of someone telling you a result, but never telling you how they got the information needed to achieve it in the first place.
There is value in this technology. But we should do out best to not conflate remixing shit with intelligence - these things are not the same at all. LLMs are more like the proverbial infinite room of monkeys with typewriters, with the very important restriction that these monkeys can never type something that resembles an original thought.
The solutions published by openAI contain techniques that have been reviewed by the mathematical community and determined to be novel. Maybe someone had used the technique before, but then wouldn’t they have published their solution or spoken up about openAI stealing their preprint?
They have spoken up! They accused OpenAI of accessing their chats: https://futurism.com/artificial-intelligence/drama-openai-supposed-mathematical-breakthrough.
Yes, but only for one result out of 275-ish, and as far as I understand it, the AI proof contained a lot more than their existing research. Failing to credit past work is an issue, and could easily be argued as theft, but this isn’t good evidence that AI cannot generate proofs that contain more than just stolen material.
And is there any evidence that the required information for the other proofs wasn’t already available in the training data? As i said, these things remix stuff, they cannot come up with new stuff.