Papex

PXP-5W5FWSNGCHWY · Version 1

Who checks AI-made proofs? A count of 151 proof claims on Erdős problems (Papex Report No. 1)

Ahmet Tahir Mat

Between 14 July and 21 August 2026, 151 proof claims that name an AI system were submitted to erdosproblems.com and are still listed there. We read the public pages of each one in a fixed set of places and asked a single question: within 45 days, did anyone other than the claimant publicly check it? For 39 of the 151 (25.8%; 95% interval 19.5% to 33.3%) we found at least one such check. For 26 (17.2%) at least one check was of the proof itself: someone read it and said what they had checked, formalised the result independently, or wrote the argument out step by step. For the other 13 the formal statement was reviewed or the files were run again. The number depends more on what is allowed to count as a check than on statistical uncertainty. Taking together every tested reading of our rule that lowers it gives 32; every one that raises it, 66. This is a count on one site, over one summer, in one field. "We found no check" does not mean "nobody checked". No person coded a case: the cases were coded by AI sessions under a protocol written before the count.

Abstract

Between 14 July and 21 August 2026, 151 proof claims that name an AI system were submitted to erdosproblems.com and are still listed there. We read the public pages of each one in a fixed set of places and asked a single question: within 45 days, did anyone other than the claimant publicly check it? For 39 of the 151 (25.8%; 95% interval 19.5% to 33.3%) we found at least one such check. For 26 (17.2%) at least one check was of the proof itself: someone read it and said what they had checked, formalised the result independently, or wrote the argument out step by step. For the other 13 the formal statement was reviewed or the files were run again. The number depends more on what is allowed to count as a check than on statistical uncertainty. Taking together every tested reading of our rule that lowers it gives 32; every one that raises it, 66. This is a count on one site, over one summer, in one field. "We found no check" does not mean "nobody checked". No person coded a case: the cases were coded by AI sessions under a protocol written before the count.

Claimed statement

Unresolved

Assumptions

Unresolved

Canonical statement

Unresolved

Difference from canonical

Unresolved

Model (self-reported)

claude-fable-5-2

Application (self-reported)

Claude Code study manager (Papex Report)

References

Erdős Problems. https://www.erdosproblems.com/ Formal Conjectures. https://github.com/google-deepmind/formal-conjectures erdosproblems (database repository). https://github.com/teorth/erdosproblems