ANALYSIS OF METHODS FOR DESIGNING THE ARCHITECTURE OF A SECURE MULTI-AGENT SYSTEM FOR AUTONOMOUS PENETRATION TESTING BASED ON LARGE LANGUAGE MODELS
DOI:
https://doi.org/10.28925/2663-4023.2026.35.1431Keywords:
penetration testing; multi-agent system; large language models; information security; state graphs; isolated environment; Model Context Protocol; cryptographic protectionAbstract
The article provides a comprehensive analysis of methods and approaches for designing the architecture of a secure multi-agent system for autonomous penetration testing based on large language models. The relevance of the study is driven by the need to bridge the gap between resource-intensive, slow manual information security audits and the dangerous full automation of classic scanners, the uncontrolled use of which in production environments poses critical risks of Denial of Service (DoS) or exceeding the authorized scope. An analysis of recent publications revealed that existing AI-based solutions (e.g., PentAGI or Penligent) suffer from specific threats such as cascading failures, identity spoofing, and group hallucinations of language models. The theoretical foundation of the work is the concept concept of integrating a neural network approach and cryptographic protection of operations, according to which large language models exclusively perform the functions of semantic context management, strategic planning, and task routing. The direct execution of commands and the generation of evidence are delegated to real specialized tools, eliminating the risk of artificial artifact fabrication. The research methodology involves designing the backend infrastructure as a modular monolith using TypeScript and the Nest.js framework based on CQRS and Saga architectural patterns. To manage the attack deployment process, the LangGraph framework is utilized, formalizing the audit as state graphs with a clear distribution of tasks (reconnaissance, vulnerability search, verification) among independent agents. The main result of the research is the developed mechanism for strict tool isolation: all destructive utilities, including Metasploit, nmap, and OWASP ZAP, are launched in disposable Kali Linux-based Docker containers. Communication between the orchestrator and the isolated environment occurs solely through standard input/output streams according to the Model Context Protocol (MCP) specification, without exposing external network ports. To ensure control over the process, a dynamic interruption system (Approval Gating) has been implemented, supporting three levels of autonomy (Manual, Semi-auto, Full-auto) and allowing the specialist to approve high-risk actions. To guarantee the immutability of the evidence base, cryptographic signing of the obtained artifacts using the Ed25519 algorithm is implemented. The conclusions prove that the proposed architecture eliminates the problem of excessive artificial intelligence agency, creating a reliable intermediary layer between the target system and the expert. Future research will focus on scaling the infrastructure to enable parallel testing of a significant number of hosts.
Downloads
References
Cankurt, S. (2026, 9 квітня). AI pentesting agents 2026: The rise of 39+ tools tested. AppSec Santa. https://appsecsanta.com/research/ai-pentesting-agents-2026
Veeam Software. (2026, 24 лютого). Veeam introduces agent commander to confront agentic AI risk at enterprise scale. https://www.veeam.com/company/press-release/veeam-introduces-agent-commander-to-confront-agentic-ai-risk-at-enterprise-scale.html
GitHub - vxcontrol/pentagi: Fully autonomous AI Agents system capable of performing complex penetration testing tasks. GitHub. https://github.com/vxcontrol/pentagi
Feedback from internal security team assessment — Is this a fair evaluation of pentagi's current capabilities vxcontrol/pentagi Discussion #217. GitHub. https://github.com/vxcontrol/pentagi/discussions/217
Penligent AI pentesting tool | agentic penetration testing for security teams. Penligent. https://www.penligent.ai/
Shannon AI pentesting tool vs penligent, what security engineers should actually compare in 2026. Penligent Security Blog – AI-Driven Hacking Tutorials, Exploit PoCs & Cybersecurity Research. https://www.penligent.ai/hackinglabs/shannon-ai-pentesting-tool-vs-penligent-what-security-engineers-should-actually-compare-in-2026/
Hammar, K. (2026). Multiagent LLM systems for security operations. IEEE Security & Privacy, 2–10. https://doi.org/10.1109/msec.2026.3713252
TrinityGuard: A unified framework for safeguarding multi-agent systems. arXiv.org e-Print archive. https://arxiv.org/html/2603.15408v1
Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., Lin, Y., Zhao, W. X., Wei, Z., & Wen, J. (2024). A survey on large language model based autonomous agents. Frontiers of Computer Science, 18(6). https://doi.org/10.1007/s11704-024-40231-1
Wang, X., Bai, H., Huang, S., Wu, G., Yang, D., Wang, S., Liao, J., Zhang, Y., Liu, M., & Liu, L. (2026). A survey on synergizing large language models and knowledge graphs for reasoning. Engineering Applications of Artificial Intelligence, 182, 116132. https://doi.org/10.1016/j.engappai.2026.116-132
Besta, M., Blach, N., Kubicek, A., Gerstenberger, R., Podstawski, M., Gianinazzi, L., Gajda, J., Lehmann, T., Niewiadomski, H., Nyczyk, P., & Hoefler, T. (2024). Graph of thoughts: Solving elaborate problems with large language models. Proceedings of the AAAI Conference on Artificial Intelligence, 38(16), 17682–17690. https://doi.org/10.1609/aaai.v38i16.29720
Negnevitsky, M. (2025). The rise of autonomous AI agents: Automating complex tasks. International Journal of Artificial Intelligence for Science (IJAI4S), 1(2). https://doi.org/10.63619/ijai4s.v1i2.007
Jo, Y., Choi, O., You, J., Cha, Y., & Lee, D. H. (2022). Cyberattack models for ship equipment based on the MITRE att&ck framework. Sensors, 22(5), 1860. https://doi.org/10.3390/s22051860
LLM06:2025 excessive agency. OWASP Gen AI Security Project. https://genai.owasp.org/llmrisk/llm062025-excessive-agency/
LangChain overview - Docs by LangChain. Docs by LangChain. https://docs.langchain.com/oss/python/langchain/overview
Kali linux | penetration testing and ethical hacking linux distribution. Kali Linux. https://www.kali.org/
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Вадим Бойко, Олена Шаповалова, Наталя Долгова

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.