[2506.20640] CoMind: Towards Community-Driven Agents for Machine Learning Engineering

Computer Science > Artificial Intelligence arXiv:2506.20640 (cs) [Submitted on 25 Jun 2025 (v1), last revised 27 Feb 2026 (this version, v3)] Title:CoMind: Towards Community-Driven Agents for Machine Learning Engineering Authors:Sijie Li, Weiwei Sun, Shanda Li, Ameet Talwalkar, Yiming Yang View a PDF of the paper titled CoMind: Towards Community-Driven Agents for Machine Learning Engineering, by Sijie Li and 4 other authors View PDF Abstract:Large language model (LLM) agents show promise in automating machine learning (ML) engineering. However, existing agents typically operate in isolation on a given research problem, without engaging with the broader research community, where human researchers often gain insights and contribute by sharing knowledge. To bridge this gap, we introduce MLE-Live, a live evaluation framework designed to assess an agent's ability to communicate with and leverage collective knowledge from a simulated Kaggle research community. Building on this framework, we propose CoMind, a multi-agent system designed to systematically leverage external knowledge. CoMind employs an iterative parallel exploration mechanism, developing multiple solutions simultaneously to balance exploratory breadth with implementation depth. On 75 past Kaggle competitions within our MLE-Live framework, CoMind achieves a 36% medal rate, establishing a new state of the art. Critically, when deployed in eight live, ongoing competitions, CoMind outperforms 92.6% of human competitors...