[2604.03291] RAGnaroX: A Secure, Local-Hosted ChatOps Assistant Using Small Language Models

Computer Science > Hardware Architecture arXiv:2604.03291 (cs) [Submitted on 27 Mar 2026] Title:RAGnaroX: A Secure, Local-Hosted ChatOps Assistant Using Small Language Models Authors:Benedikt Dornauer, Mircea-Cristian Racasan View a PDF of the paper titled RAGnaroX: A Secure, Local-Hosted ChatOps Assistant Using Small Language Models, by Benedikt Dornauer and 1 other authors View PDF HTML (experimental) Abstract:This paper introduces RAGnaroX, a resource-efficient ChatOps assistant that operates entirely on commodity hardware. Unlike existing solutions that often rely on external providers such as Azure or OpenAI, RAGnaroX offers a fully auditable, on-premise stack implemented in Rust. Its architecture integrates modular data ingestion, hybrid retrieval, and function calling, enabling flexible yet secure deployment. Our evaluation focuses on the RAG pipeline, with benchmarks conducted on the SQuAD (single-hop QA), MultiHopRAG (multi-hop QA), and MLQA (cross-lingual QA) datasets. Results show that RAGnaroX achieves competitive accuracy while maintaining strong resource efficiency, for example, reaching 0.90 context precision on single-hop questions with an average response time of 2.5 seconds per request. A replication package containing the tool, the demonstration video (this https URL v=cDxfuEbcoM4), and all supporting materials are available at this https URL. Subjects: Hardware Architecture (cs.AR); Artificial Intelligence (cs.AI) Cite as: arXiv:2604.03291 [cs.AR]   (or...