[2603.24595] Model2Kernel: Model-Aware Symbolic Execution For Safe CUDA Kernels

Computer Science > Programming Languages arXiv:2603.24595 (cs) [Submitted on 6 Mar 2026] Title:Model2Kernel: Model-Aware Symbolic Execution For Safe CUDA Kernels Authors:Mengting He, Shihao Xia, Haomin Jia, Wenfei Wu, Linhai Song View a PDF of the paper titled Model2Kernel: Model-Aware Symbolic Execution For Safe CUDA Kernels, by Mengting He and 4 other authors View PDF Abstract:The widespread adoption of large language models (LLMs) has made GPU-accelerated inference a critical part of modern computing infrastructure. Production inference systems rely on CUDA kernels to implement core transformer operations, yet these kernels are highly susceptible to memory-safety bugs due to model-dependent tensor layouts, intricate memory indexing, and massive thread-level parallelism. Such bugs can corrupt model weights, crash inference services, or even enable adversarial attacks. Existing techniques either depend on unavailable hardware, incur high overhead, or fail to handle kernel inputs with variable lengths, and none can effectively detect CUDA memory bugs in LLM inference systems. This paper presents Model2Kernel, the first practical system for automatically verifying the memory safety of CUDA kernels used in LLM inference. Model2Kernel performs model-aware dynamic analysis to determine how each model invokes kernels and to classify kernel arguments as either fixed by the model architecture or controlled by model users. Using this information, Model2Kernel then applies CUDA-spe...