[2603.28361] Deep Research of Deep Research: From Transformer to Agent, From AI to AI for Science

Computer Science > Artificial Intelligence arXiv:2603.28361 (cs) [Submitted on 30 Mar 2026] Title:Deep Research of Deep Research: From Transformer to Agent, From AI to AI for Science Authors:Yipeng Yu View a PDF of the paper titled Deep Research of Deep Research: From Transformer to Agent, From AI to AI for Science, by Yipeng Yu View PDF HTML (experimental) Abstract:With the advancement of large language models (LLMs) in their knowledge base and reasoning capabilities, their interactive modalities have evolved from pure text to multimodality and further to agentic tool use. Consequently, their applications have broadened from question answering to AI assistants and now to general-purpose agents. Deep research (DR) represents a prototypical vertical application for general-purpose agents, which represents an ideal approach for intelligent information processing and assisting humans in discovering and solving problems, with the goal of reaching or even surpassing the level of top human scientists. This paper provides a deep research of deep research. We articulate a clear and precise definition of deep research and unify perspectives from industry's deep research and academia's AI for Science (AI4S) within a developmental framework. We position LLMs and Stable Diffusion as the twin pillars of generative AI, and lay out a roadmap evolving from the Transformer to agents. We examine the progress of AI4S across various disciplines. We identify the predominant paradigms of human-...