33.9850° N, 118.4695° W THE OBSERVATORY
THE COALITION — A FUTURE FORGED IN UNITY. A TRUTH BEYOND VEIL.
INITIATION IS DISCERNMENT KNOWLEDGE IS SOVEREIGNTY △
Login Register
Research Wire arXiv medium Watch Signal Needs Review

Understanding the Rejection of Fixes Generated by Agentic Pull Requests -- Insights from the AIDev Dataset

AI coding agents are increasingly used to generate pull requests (PRs) that propose code fixes in software projects. From a first exploration of the AIDev dataset, we find that 46.41\% of the fixes proposed by the agents Copilot, Devin, Cursor, and Claude are rejected. This represents a significant amount of wasted resources that require human reviews, verifications, and running tests and validations for fixes that are merely discarded. Our goal in this paper is to understand the failure modes of AI-agents, an understanding that is crucial for better integrating AI-agents as efficient teammates. In this paper, we conduct a qualitative study on a representative sample of 306 non-merged pull requests created or co-authored by the agents mentioned earlier, followed by a quantitative analysis

Source: arXiv ↗

arXiv@arXiv Jun 11, 2026Published 15:19 UTCSignal Time 61Trust Score
arXiv arXiv arxiv.org

AI coding agents are increasingly used to generate pull requests (PRs) that propose code fixes in software projects. From a first exploration of the AIDev dataset, we find that 46.41\% of the fixes proposed by the agents Copilot, Devin, Cursor, and Claude are rejected. This represents a significant amount of wasted resources that require human reviews, verifications, and running tests and validations for fixes that are merely discarded. Our goal in this paper is to understand the failure modes of AI-agents, an understanding that is crucial for better integrating AI-agents as efficient teammates. In this paper, we conduct a qualitative study on a representative sample of 306 non-merged pull requests created or co-authored by the agents mentioned earlier, followed by a quantitative analysis

This Coalition transmission preserves metadata, trust context, and source routing for a Research Wire item from arXiv. The complete article remains with the original publisher.

Content handling is marked as Metadata Only. Use the source article link for the full report, updates, corrections, and publisher-controlled context.

Key Points

  • Published by arXiv.
  • Categorized as Research Wire.
  • Source handling: Needs Review.
  • Rights posture: Metadata Only.
  • Follow the source article for the complete original report.
Source Article Understanding the Rejection of Fixes Generated by Agentic Pull Requests -- Insights from the AIDev Dataset arxiv.org ↗