SIA-GUARD: SESSION-AWARE ACTION CONTROL FOR LLM AGENTS AGAINST PROMPT-INJECTION ATTACKS

Authors

DOI:

https://doi.org/10.28925/2663-4023.2026.35.1330

Keywords:

Large language models; cybersecurity; LLM-agent; prompt injection; Model Context Protocol; tool poisoning; intent-flow subversion; command injection;, Large language models, cybersecurity, LLM-agents, prompt injections, Model Context Protocol, tool poisoning, intent-flow subversion, command injection

Abstract

The paper presents an overview of the development and experimental evaluation of SIA-GUARD, a security filter for LLM agents that accounts for session context and controls the execution of actions involving external tools. The study addresses the escalation of prompt-injection risks from the level of malicious textual prompts to the level of actions performed on files, corporate records, and business processes. Such actions may include reading files, exporting customer records, modifying customer data, writing malicious reports, or executing unauthorized financial transactions. The proposed SIA-GUARD filter is positioned between the LLM agent and the model API, as well as between the agent and MCP-like tool servers. SIA-GUARD maintains a unified chronological record of each session, labels outputs from untrusted tools as potentially malicious, applies deterministic policies to high-risk data sources, removes or masks leakage-detection control markers, and may employ an auxiliary LLM to assess ambiguous tool actions or identify underlying intent. A demonstration environment was developed for the experimental evaluation, comprising a document server, a file server, and a business-data server. A test set of 25 prompts was also constructed: four legitimate prompts for measuring false-positive rates and 21 adversarial prompts. The latter included hidden malicious instructions embedded in HTML, Markdown, and PDF content; obfuscated messages; malicious data embedded in external tools or APIs, commonly referred to as tool poisoning; concealed calls encoded in data schemas; cross-session persistence mechanisms; and attempts to pressure the agent into exporting or modifying data. The study evaluated 1,050 paired records: 525 records generated in an unprotected baseline configuration, with three repetitions of each of the 25 prompts across seven locally deployed models, and 525 corresponding records generated in the protected configuration using SIA-GUARD. In addition, 525 paired records were analyzed in an ablation study in which individual filter components were disabled in turn, thereby isolating the contribution of specific protection mechanisms for the qwen/qwen3-coder-next model. In the multi-model evaluation, the protected configuration prevented all leakage of the designated control markers, whereas the unprotected baseline produced 63 leakage incidents across 525 records. In the unprotected configuration, the models proceeded to carry out unsafe actions, while the SIA-GUARD-protected configuration either blocked the risky action or routed it for review in 88.3% of cases. The findings demonstrate the high effectiveness of execution-time security controls for LLM-agent actions as a practical complement to prompt-level defenses. This approach substantially reduces the number of successful attacks at the agentic level while preserving a useful degree of automation.

Downloads

Download data is not yet available.

References

Greshake, K., Abdelnabi, S., Mishra, S., Endres, C., Holz, T., & Fritz, M. (2023). Not what you've signed up for: Compromising real-world LLM-integrated applications with indirect prompt injection. arXiv. https://doi.org/10.48550/arXiv.2302.12173

Schulhoff, S., Pinto, J., Khan, A., Bouchard, L.-F., Si, C., Anati, S., Tagliabue, V., Kost, A. L., Carnahan, C., & Boyd-Graber, J. (2023). Ignore this title and HackAPrompt: Exposing systemic vulnerabilities of LLMs through a global scale prompt hacking competition. arXiv. https://arxiv.org/abs/2311.16119

Liu, Y., Jia, Y., Geng, R., Jia, J., & Gong, N. Z. (2024). Formalizing and benchmarking prompt injection attacks and defenses. In 33rd USENIX Security Symposium (USENIX Security 24) (pp. 1831-1847). USENIX Association. https://www.usenix.org/conference/usenixsecurity24/presentation/liu-yupei

Liu, Y., Deng, G., Li, Y., Wang, K., Wang, Z., Wang, X., Zhang, T., Liu, Y., Wang, H., Zheng, Y., Zhang, L. Y., & Liu, Y. (2023). Prompt injection attack against LLM-integrated applications. arXiv. https://doi.org/10.48550/arXiv.2306.05499

OWASP Foundation. (2025). OWASP Top 10 for LLM Applications 2025. OWASP GenAI Security Project. https://genai.owasp.org/llm-top-10/

OWASP Foundation. (2025). OWASP MCP Top 10. https://owasp.org/www-project-mcp-top-10/

Model Context Protocol. (2026). Tools - Model Context Protocol specification. https://modelcontextprotocol.io/specification/draft/server/tools

Tabassi, E. (2023). Artificial Intelligence Risk Management Framework (AI RMF 1.0) (NIST AI 100-1). National Institute of Standards and Technology. https://doi.org/10.6028/NIST.AI.100-1

National Institute of Standards and Technology. (2024). Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile (NIST AI 600-1). https://doi.org/10.6028/NIST.AI.600-1

MITRE. (2026). MITRE ATLAS: Adversarial Threat Landscape for Artificial-Intelligence Systems. https://atlas.mitre.org/

Syros, G., Suri, A., Ginesin, J., Nita-Rotaru, C., & Oprea, A. (2025). SAGA: A security architecture for governing AI agentic systems. arXiv. https://arxiv.org/abs/2504.21034

Narajala, V. S., & Narayan, O. (2025). Securing agentic AI: A comprehensive threat model and mitigation framework for generative AI agents. arXiv. https://doi.org/10.48550/arXiv.2504.19956

Downloads


Abstract views: 4

Published

2026-10-26

How to Cite

Sanchenko, V., & Akhramovych, V. (2026). SIA-GUARD: SESSION-AWARE ACTION CONTROL FOR LLM AGENTS AGAINST PROMPT-INJECTION ATTACKS. Electronic Professional Scientific Journal «Cybersecurity: Education, Science, Technique», 3(35), 177–186. https://doi.org/10.28925/2663-4023.2026.35.1330