Skip to content

Commit

Permalink
Processed metadata corrections (closes #4572)
Browse files Browse the repository at this point in the history
  • Loading branch information
mjpost committed Feb 8, 2025
1 parent ae1ad30 commit d1dec22
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions data/xml/2024.findings.xml
Original file line number Diff line number Diff line change
Expand Up @@ -8908,9 +8908,9 @@
</paper>
<paper id="220">
<title>Functional Overlap Reranking for Neural Code Generation</title>
<author><first>Hung</first><last>To</last><affiliation>FPT Software AI Center</affiliation></author>
<author><first>Minh</first><last>Nguyen</last><affiliation>FPT Software AI Center</affiliation></author>
<author><first>Nghi</first><last>Bui</last></author>
<author><first>Hung Quoc</first><last>To</last></author>
<author><first>Minh</first><last>Huynh Nguyen</last></author>
<author><first>Nghi D. Q.</first><last>Bui</last></author>
<pages>3686-3704</pages>
<abstract>Code Large Language Models (CodeLLMs) have ushered in a new era in code generation advancements. However, selecting the best code solutions from all possible CodeLLM outputs remains a challenge. Previous methods often overlooked the intricate functional similarities and interactions between solution clusters. We introduce SRank, a novel reranking strategy for selecting the best solutions from code generation, focusing on modeling the relationships between clusters of solutions. By quantifying the functional overlap between solution clusters, our approach provides a better ranking strategy for code solutions. Empirical results show that our method achieves remarkable results on the pass@1 score. For instance, on the Human-Eval benchmark, we achieve 69.66% in pass@1 with Codex002, 75.31% with WizardCoder, 53.99% with StarCoder, and 60.55% with CodeGen, surpassing state-of-the-art code generation reranking methods such as CodeT and Coder-Reviewer on the same CodeLLM by a significant margin approx 6.1% improvement on average. Even in scenarios with a limited number of sampled solutions and test cases, our approach demonstrates robustness and superiority, marking a new benchmark in code generation reranking. Our implementation can be found at https://github.com/FSoft-AI4Code/SRank-CodeRanker.</abstract>
<url hash="c742830d">2024.findings-acl.220</url>
Expand Down

0 comments on commit d1dec22

Please sign in to comment.