ANALYSIS OF METHODS FOR DESIGNING THE ARCHITECTURE OF A SECURE MULTI-AGENT SYSTEM FOR AUTONOMOUS PENETRATION TESTING BASED ON LARGE LANGUAGE MODELS

Authors

DOI:

https://doi.org/10.28925/2663-4023.2026.35.1431

Keywords:

penetration testing; multi-agent system; large language models; information security; state graphs; isolated environment; Model Context Protocol; cryptographic protection

Abstract

The article provides a comprehensive analysis of methods and approaches for designing the architecture of a secure multi-agent system for autonomous penetration testing based on large language models. The relevance of the study is driven by the need to bridge the gap between resource-intensive, slow manual information security audits and the dangerous full automation of classic scanners, the uncontrolled use of which in production environments poses critical risks of Denial of Service (DoS) or exceeding the authorized scope. An analysis of recent publications revealed that existing AI-based solutions (e.g., PentAGI or Penligent) suffer from specific threats such as cascading failures, identity spoofing, and group hallucinations of language models. The theoretical foundation of the work is the concept concept of integrating a neural network approach and cryptographic protection of operations, according to which large language models exclusively perform the functions of semantic context management, strategic planning, and task routing. The direct execution of commands and the generation of evidence are delegated to real specialized tools, eliminating the risk of artificial artifact fabrication. The research methodology involves designing the backend infrastructure as a modular monolith using TypeScript and the Nest.js framework based on CQRS and Saga architectural patterns. To manage the attack deployment process, the LangGraph framework is utilized, formalizing the audit as state graphs with a clear distribution of tasks (reconnaissance, vulnerability search, verification) among independent agents. The main result of the research is the developed mechanism for strict tool isolation: all destructive utilities, including Metasploit, nmap, and OWASP ZAP, are launched in disposable Kali Linux-based Docker containers. Communication between the orchestrator and the isolated environment occurs solely through standard input/output streams according to the Model Context Protocol (MCP) specification, without exposing external network ports. To ensure control over the process, a dynamic interruption system (Approval Gating) has been implemented, supporting three levels of autonomy (Manual, Semi-auto, Full-auto) and allowing the specialist to approve high-risk actions. To guarantee the immutability of the evidence base, cryptographic signing of the obtained artifacts using the Ed25519 algorithm is implemented. The conclusions prove that the proposed architecture eliminates the problem of excessive artificial intelligence agency, creating a reliable intermediary layer between the target system and the expert. Future research will focus on scaling the infrastructure to enable parallel testing of a significant number of hosts.

Downloads

Download data is not yet available.

References

Cankurt, S. (2026, 9 квітня). AI pentesting agents 2026: The rise of 39+ tools tested. AppSec Santa. https://appsecsanta.com/research/ai-pentesting-agents-2026

Veeam Software. (2026, 24 лютого). Veeam introduces agent commander to confront agentic AI risk at enterprise scale. https://www.veeam.com/company/press-release/veeam-introduces-agent-commander-to-confront-agentic-ai-risk-at-enterprise-scale.html

GitHub - vxcontrol/pentagi: Fully autonomous AI Agents system capable of performing complex penetration testing tasks. GitHub. https://github.com/vxcontrol/pentagi

Feedback from internal security team assessment — Is this a fair evaluation of pentagi's current capabilities vxcontrol/pentagi Discussion #217. GitHub. https://github.com/vxcontrol/pentagi/discussions/217

Penligent AI pentesting tool | agentic penetration testing for security teams. Penligent. https://www.penligent.ai/

Shannon AI pentesting tool vs penligent, what security engineers should actually compare in 2026. Penligent Security Blog – AI-Driven Hacking Tutorials, Exploit PoCs & Cybersecurity Research. https://www.penligent.ai/hackinglabs/shannon-ai-pentesting-tool-vs-penligent-what-security-engineers-should-actually-compare-in-2026/

Hammar, K. (2026). Multiagent LLM systems for security operations. IEEE Security & Privacy, 2–10. https://doi.org/10.1109/msec.2026.3713252

TrinityGuard: A unified framework for safeguarding multi-agent systems. arXiv.org e-Print archive. https://arxiv.org/html/2603.15408v1

Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., Lin, Y., Zhao, W. X., Wei, Z., & Wen, J. (2024). A survey on large language model based autonomous agents. Frontiers of Computer Science, 18(6). https://doi.org/10.1007/s11704-024-40231-1

Wang, X., Bai, H., Huang, S., Wu, G., Yang, D., Wang, S., Liao, J., Zhang, Y., Liu, M., & Liu, L. (2026). A survey on synergizing large language models and knowledge graphs for reasoning. Engineering Applications of Artificial Intelligence, 182, 116132. https://doi.org/10.1016/j.engappai.2026.116-132

Besta, M., Blach, N., Kubicek, A., Gerstenberger, R., Podstawski, M., Gianinazzi, L., Gajda, J., Lehmann, T., Niewiadomski, H., Nyczyk, P., & Hoefler, T. (2024). Graph of thoughts: Solving elaborate problems with large language models. Proceedings of the AAAI Conference on Artificial Intelligence, 38(16), 17682–17690. https://doi.org/10.1609/aaai.v38i16.29720

Negnevitsky, M. (2025). The rise of autonomous AI agents: Automating complex tasks. International Journal of Artificial Intelligence for Science (IJAI4S), 1(2). https://doi.org/10.63619/ijai4s.v1i2.007

Jo, Y., Choi, O., You, J., Cha, Y., & Lee, D. H. (2022). Cyberattack models for ship equipment based on the MITRE att&ck framework. Sensors, 22(5), 1860. https://doi.org/10.3390/s22051860

LLM06:2025 excessive agency. OWASP Gen AI Security Project. https://genai.owasp.org/llmrisk/llm062025-excessive-agency/

LangChain overview - Docs by LangChain. Docs by LangChain. https://docs.langchain.com/oss/python/langchain/overview

Kali linux | penetration testing and ethical hacking linux distribution. Kali Linux. https://www.kali.org/

Downloads


Abstract views: 1

Published

2026-10-26

How to Cite

Boyko , V., Shapovalova, O., & Dolgova, N. (2026). ANALYSIS OF METHODS FOR DESIGNING THE ARCHITECTURE OF A SECURE MULTI-AGENT SYSTEM FOR AUTONOMOUS PENETRATION TESTING BASED ON LARGE LANGUAGE MODELS. Electronic Professional Scientific Journal «Cybersecurity: Education, Science, Technique», 3(35), 900–909. https://doi.org/10.28925/2663-4023.2026.35.1431