[2603.29199] AEC-Bench: A Multimodal Benchmark for Agentic Systems in Architecture, Engineering, and Construction

[2603.29199] AEC-Bench: A Multimodal Benchmark for Agentic Systems in Architecture, Engineering, and Construction

arXiv - AI 3 min read

About this article

Abstract page for arXiv paper 2603.29199: AEC-Bench: A Multimodal Benchmark for Agentic Systems in Architecture, Engineering, and Construction

Computer Science > Artificial Intelligence arXiv:2603.29199 (cs) [Submitted on 31 Mar 2026] Title:AEC-Bench: A Multimodal Benchmark for Agentic Systems in Architecture, Engineering, and Construction Authors:Harsh Mankodiya, Chase Gallik, Theodoros Galanos, Andriy Mulyar View a PDF of the paper titled AEC-Bench: A Multimodal Benchmark for Agentic Systems in Architecture, Engineering, and Construction, by Harsh Mankodiya and 3 other authors View PDF HTML (experimental) Abstract:The AEC-Bench is a multimodal benchmark for evaluating agentic systems on real-world tasks in the Architecture, Engineering, and Construction (AEC) domain. The benchmark covers tasks requiring drawing understanding, cross-sheet reasoning, and construction project-level coordination. This report describes the benchmark motivation, dataset taxonomy, evaluation protocol, and baseline results across several domain-specific foundation model harnesses. We use AEC-Bench to identify consistent tools and harness design techniques that uniformly improve performance across foundation models in their own base harnesses, such as Claude Code and Codex. We openly release our benchmark dataset, agent harness, and evaluation code for full replicability at this https URL under an Apache 2 license. Subjects: Artificial Intelligence (cs.AI) Cite as: arXiv:2603.29199 [cs.AI]   (or arXiv:2603.29199v1 [cs.AI] for this version)   https://doi.org/10.48550/arXiv.2603.29199 Focus to learn more arXiv-issued DOI via DataCite (pen...

Originally published on April 01, 2026. Curated by AI News.

Related Articles

Llms

Gemini caught a $280M crypto exploit before it hit the news, then retracted it as a hallucination because I couldn't verify it - because the news hadn't dropped yet

So this happened mere hours ago and I feel like I genuinely stumbled onto something worth documenting for people interested in AI behavio...

Reddit - Artificial Intelligence · 1 min ·
Llms

GPT-4 vs Claude vs Gemini for coding — honest breakdown after 3 months of daily use

I am a solo developer who has been using all three seriously. Here is what I actually think: GPT-4o — Strengths: Large context window, st...

Reddit - Artificial Intelligence · 1 min ·
Llms

You're giving feedback on a new version of ChatGPT

So I will be paying attention to these system messages more now- the last time I got one of these not so long back the 'tone' changed to ...

Reddit - Artificial Intelligence · 1 min ·
Llms

Gemma 4 actually running usable on an Android phone (not llama.cpp)

I wanted a real local assistant on my phone, not a demo. First tried the usual llama.cpp in Termux — Gemma 4 was 2–3 tok/s and the phone ...

Reddit - Artificial Intelligence · 1 min ·
More in Llms: This Week Guide Trending

No comments

No comments yet. Be the first to comment!

Stay updated with AI News

Get the latest news, tools, and insights delivered to your inbox.

Daily or weekly digest • Unsubscribe anytime