GraphEval36K: Benchmarking Coding and Reasoning Capabilities of Large Language Models on Graph Datasets was published in Findings of NAACL 2025.

The work introduces a benchmark of 40 graph programming problems and 36,900 test cases for assessing the ability of language models to reason about graph structure and algorithms.

Read the paper