cs.AI — Artificial Intelligence
First Proof Third Batch
To assess the ability of current AI systems to correctly solve research-level mathematics problems, we tested several AI systems on our ``third batch'' of ten problems in a broad range of mathematical fields; these problems arose naturally in the research process of the contributors. This document includes the problems, our methodology, and the results of our testing. We assessed the AI-generated solutions based on mathematical correctness, quality of exposition, and quality of attribution and citations. We provide links to supplementary documents including the human solutions, the AI-generated solutions, and the referee reports and logs for the AI-generated solutions.
Primarily human-written textHuman understanding: all partsAI systemsbenchmarklarge language models