Skip to content
devhub.
ExploreCompareSaved
Sign in
DevHubBuilt for curious developers. Data from GitHub.
Back to repositories
Public repository / cvphelps

swebench-experiments

Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.

View on GitHub
0Stars
0Forks
0Open issues
0Subscribers

Language distribution

Share of source bytes reported by GitHub

Shell93%
Python7%

Recent activity

Latest commits on the default branch

Update metadata, resultsjohn-b-yang · Jan 19, 2025Remove trajs, logs (uploaded to swe-bench/experiments bucket)john-b-yang · Jan 19, 2025W&B Programmer o1 crosscheck5shawnlewis · Jan 18, 2025Add Blackbox ai agent swe-bench Verified submission (#153)blackboxai-team · Jan 13, 2025Resubmit Ugaiforge swe-bench verified results (#156)JOJO201 · Jan 13, 2025add learn-by-interact (#154)hongjin-su · Jan 12, 2025Moatless Tools + Deepseek V3 (#155)Albert Örwall · Jan 12, 2025Next leaderboard updatejohn-b-yang · Jan 8, 2025Add missing `site`john-b-yang · Jan 8, 2025add Gru Agent (20241208_gru) submission for SWE-bench-Lite (#140)Hui-Hwoo · Jan 8, 2025

Project details

Created Mar 2025 Updated Mar 2025

Contributors

8
john-b-yang's avatarjohn-b-yang37 commitsbrutalsavage's avatarbrutalsavage4 commitsepam-ai-run's avatarepam-ai-run3 commitscrhf's avatarcrhf3 commitsnurdabolatov's avatarnurdabolatov3 commitsxingyaoww's avatarxingyaoww3 commitsyawar59's avataryawar593 commitsshreysingla11's avatarshreysingla113 commits