Skip to content

Fix SWE-Milestone paper listing (was incorrectly titled EvoClaw) - #58

Merged
autogame-17 merged 1 commit into
mainfrom
fix/swe-milestone-paper-listing
Sep 5, 2026
Merged

autogame-17 merged 1 commit into
mainfrom
fix/swe-milestone-paper-listing

Conversation

@autogame-17

Copy link
Copy Markdown
Member

What does this PR do?

Correct the arXiv 2603.13428 listing. The live paper title is SWE-Milestone: Evaluating AI Agents on Continuous Software Evolution, not EvoClaw. The previous GitHub URL FSoft-AI4Code/EvoClaw is a confirmed 404; this PR replaces it with the official benchmark repo published in the paper HTML.

Papers live in README (not data/projects.json). Only these two rows changed.

Before

  • Papers: [EvoClaw: Evaluating AI Agents on Continuous Software Evolution](https://arxiv.org/abs/2603.13428) (arXiv'26) - Benchmark revealing performance drops from >80% to at most 38% in continuous evolution settings.
  • Benchmarks: [EvoClaw](https://github.com/FSoft-AI4Code/EvoClaw) (arXiv'26) - Evaluating agents on continuous software evolution.

After

  • Papers: [SWE-Milestone: Evaluating AI Agents on Continuous Software Evolution](https://arxiv.org/abs/2603.13428) (ICML'26) - Benchmark revealing performance drops from >80% on isolated tasks to 38.03% in continuous evolution settings.
  • Benchmarks: [SWE-Milestone](https://github.com/DeepCommit-ai/SWE-Milestone) (ICML'26) - Evaluating agents on continuous software evolution.

Evidence (checked live, not inferred)

  • arXiv abs title: SWE-Milestone. Comments: ICML 2026. Abstract: scores drop from >80% on isolated tasks to 38.03% in continuous settings. No EvoClaw name and no code URL on the abs page.
  • Paper HTML (v4) publishes official links: Benchmark github.com/DeepCommit-ai/SWE-Milestone, pipeline github.com/DeepCommit-ai/DeepCommit.
  • gh api repos/FSoft-AI4Code/EvoClaw → HTTP 404. gh api repos/DeepCommit-ai/SWE-Milestone → public MIT repo, description [ICML 2026] Evaluating AI Agents on Continuous Software Evolution, homepage https://swe-milestone.com. EvoClaw-Bench/EvoClaw 301-redirects to that same repo (rename), and was not substituted as the listed URL.
  • Unrelated GitHub hits (slhleosun/EvoClaw, clawinfra/evoclaw, etc.) were not used.

Checklist

  • Project added to data/projects.json with correct schema — N/A: paper/benchmark rows are hand-maintained in README
  • node scripts/generate-readme.js was run and README.md is up to date (idempotent; AUTOGEN sections unchanged)
  • node scripts/validate.js passes (Validated 119 projects across 10 categories / Validation passed.)
  • Project meets inclusion criteria (open source, active, documented, 50+ stars or a documented novelty exception) — N/A for paper-row correction; official code repo is public MIT
  • Category and cross-list scope are correct; any duplicate listing is justified
  • Description is concise, objective, starts with a capital letter, and ends with punctuation
  • Links, paper, license, and factual claims were checked against primary sources
  • No duplicate entries
  • git diff --check is clean
  • node scripts/check-links.js not applicable (script only checks data/projects.json, which this PR does not change)

Category

  • Research Paper

🤖 Generated with Claude Code

arXiv 2603.13428 is SWE-Milestone, not EvoClaw. Replace the 404
FSoft-AI4Code/EvoClaw code link with the official benchmark repo
published in the paper.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@autogame-17
autogame-17 merged commit 338098d into main Sep 5, 2026
2 checks passed
@autogame-17
autogame-17 deleted the fix/swe-milestone-paper-listing branch September 5, 2026 02:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant