And is there any evidence that the required information for the other proofs wasn’t already available in the training data? As i said, these things remix stuff, they cannot come up with new stuff.
By “required information for the other proofs”, what do you mean exactly?
The proof, more or less in the same structure that the AI output, existed in the literature? This would’ve been published already and would be very easy to prove was stolen from the input corpus. We know this isn’t true.
The theorems and techniques used in the generated proof existed, but were not yet assembled into a final proof? Trained mathematicians have looked at the proof and seem to think it contains novel techniques, or at least novel applications of techniques from different areas of math. Even if that weren’t true, this would still be novel work; a lot of math breakthroughs are made this way, and it’s a nontrivial feat. Although if this was as far as it could go, we would run into limitations at some point.
The starting point of the proof existed, but the entire proof was built from the ground up by AI, using no existing methods or theorems? This would be very impressive, and as noted above the consensus seems to be that it did create some new techniques, but I’m not experienced or knowledgeable enough to verify that claim. Either way it definitely used at least some previous work for nontrivial reasons.
It looks like it’s somewhere between options 2 and 3 in reality; it used a lot of existing techniques and at least invented some new applications of existing techniques if not created new ones entirely (the line can be blurry). This is also what all mathematicians do! Remixing is coming up with new stuff. No thoughts, or generated output from LLMs, exist without prior context.
Here is the evidence: the entire field of mathematics was trying to solve these problems and couldn’t do it for decades.
If you want to still insist that it’s just “remixing the training data” then fine, but don’t act like that rules out the possibility of intelligence, because by any reasonable standard a system that can discover hundreds of groundbreaking new mathematical proofs is intelligent. Any human that accomplished that would go down in history as one of the most intelligent people to have ever lived.
And is there any evidence that the required information for the other proofs wasn’t already available in the training data? As i said, these things remix stuff, they cannot come up with new stuff.
By “required information for the other proofs”, what do you mean exactly?
The proof, more or less in the same structure that the AI output, existed in the literature? This would’ve been published already and would be very easy to prove was stolen from the input corpus. We know this isn’t true.
The theorems and techniques used in the generated proof existed, but were not yet assembled into a final proof? Trained mathematicians have looked at the proof and seem to think it contains novel techniques, or at least novel applications of techniques from different areas of math. Even if that weren’t true, this would still be novel work; a lot of math breakthroughs are made this way, and it’s a nontrivial feat. Although if this was as far as it could go, we would run into limitations at some point.
The starting point of the proof existed, but the entire proof was built from the ground up by AI, using no existing methods or theorems? This would be very impressive, and as noted above the consensus seems to be that it did create some new techniques, but I’m not experienced or knowledgeable enough to verify that claim. Either way it definitely used at least some previous work for nontrivial reasons.
It looks like it’s somewhere between options 2 and 3 in reality; it used a lot of existing techniques and at least invented some new applications of existing techniques if not created new ones entirely (the line can be blurry). This is also what all mathematicians do! Remixing is coming up with new stuff. No thoughts, or generated output from LLMs, exist without prior context.
Here is the evidence: the entire field of mathematics was trying to solve these problems and couldn’t do it for decades.
If you want to still insist that it’s just “remixing the training data” then fine, but don’t act like that rules out the possibility of intelligence, because by any reasonable standard a system that can discover hundreds of groundbreaking new mathematical proofs is intelligent. Any human that accomplished that would go down in history as one of the most intelligent people to have ever lived.