DEVELOPMENT OF AN AI-ASSISTANT MODULE BASED ON QLoRA FINE-TUNING OF A LARGE LANGUAGE MODEL FOR AUTOMATED CYBERSECURITY INCIDENT ANALYSIS
DOI:
https://doi.org/10.28925/2663-4023.2026.34.1269Keywords:
artificial intelligence, LLM, fine-tuning, QLoRA, cybersecurity, incident analysis, MITRE ATT&CK, SOC, FastAPI, Llama 3.2Abstract
The article addresses the development and integration of an artificial-intelligence module for automated cybersecurity incident analysis within the decentralised Cybersecurity Dataspace (CSDS) platform for sharing cyber-incident data between organisations. The relevance of the study stems from systemic problems of modern security operations centres (SOCs): the excessive volume of security events, the global shortage of qualified specialists, the effect of alert fatigue, and the growing complexity of multi-stage attacks. The aim of the work is to build a specialised large language model (LLM) capable of classifying threats, assessing their severity, and providing structured response recommendations in line with the MITRE ATT&CK and NIST SP 800-61 methodologies. The paper provides a comparative analysis of four approaches to building AI assistants (zero-shot prompting, RAG, full fine-tuning, and parameter-efficient fine-tuning) and substantiates the choice of QLoRA as optimal for local deployment given confidentiality requirements and limited computational resources. A training dataset of 1,875 examples was assembled from five open sources (MITRE ATT&CK, NVD CVE, synthetic incident logs, open cybersecurity Q&A datasets, and Sigma/Elastic detection rules); it underwent deduplication, quality filtering, and verification of MITRE techniques. Two independent rounds of QLoRA fine-tuning of the Llama 3.2 3B Instruct base model were carried out with identical hyperparameters, and their results were described in terms of loss and token-level accuracy. A FastAPI microservice with REST endpoints for incident analysis, dialogue, batch processing, and monitoring was developed and integrated into the platform’s Next.js front end. Functional testing on three representative attack classes (SQL injection, ransomware, and brute force) and a comparative evaluation of answer quality using a keyword-overlap metric demonstrated a substantial quality improvement after fine-tuning compared with the base model. The proposed approach is reproducible on consumer-grade GPU hardware and can be scaled for industrial use. The article presents the problem statement, an analysis of current industrial and academic solutions, the theoretical basis of the method, the dataset-construction and fine-tuning methodology, the obtained results, and directions for further research.
Downloads
References
Hu, E. J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., & Chen, W. (2021). LoRA: Low-rank adaptation of large language models (arXiv:2106.09685). arXiv. https://arxiv.org/abs/2106.09685
Dettmers, T., Pagnoni, A., Holtzman, A., & Zettlemoyer, L. (2023). QLoRA: Efficient finetuning of quantized LLMs. Advances in Neural Information Processing Systems, 36.
Freitas, S., Callahan, A., Bhatt, A., & Bono, J. (2024). AI-driven guided response for security operation centers with Microsoft Copilot for Security (arXiv:2407.09017). arXiv. https://arxiv.org/abs/2407.09017
Bono, J., & Xu, A. (2024). Randomized controlled trials for Security Copilot for IT administrators (arXiv:2411.01067). arXiv. https://arxiv.org/abs/2411.01067
MITRE Corporation. (2025). ATT&CK Enterprise Matrix. https://attack.mitre.org/matrices/enterprise
National Institute of Standards and Technology. (2025). National Vulnerability Database (NVD): CVE API 2.0. https://nvd.nist.gov/developers/vulnerabilities
Meta AI. (2024). Llama 3.2: Multilingual large language models. Hugging Face. https://huggingface.co/meta-llama/Llama-3.2-3B-Instruct
Touvron, H., Martin, L., Stone, K., Albert, P., Almahairi, A., Babaei, Y., Bashlykov, N., et al. (2023). Llama 2: Open foundation and fine-tuned chat models (arXiv:2307.09288). arXiv. https://arxiv.org/abs/2307.09288
Sophos. (2024). LLM benchmarks for cybersecurity: Evaluation of incident investigation, summarisation and severity evaluation [Technical report].
Microsoft. (2024). Generative AI and security operations center productivity: Evidence from live operations [Microsoft Research report].
IBM Security, & Ponemon Institute. (2024). Cost of a data breach report 2024.
ISC2. (2024). Cybersecurity workforce study 2024.
National Institute of Standards and Technology. (2023). Artificial intelligence risk management framework (AI RMF 1.0) (NIST AI 100-1). https://doi.org/10.6028/NIST.AI.100-1
Perez, F., & Ribeiro, I. (2022). Ignore previous prompt: Attack techniques for language models (arXiv:2211.09527). arXiv. https://arxiv.org/abs/2211.09527
Wei, J., Bosma, M., Zhao, V., Guu, K., Yu, A. W., Lester, B., Du, N., Dai, A. M., & Le, Q. V. (2022). Finetuned language models are zero-shot learners. In International Conference on Learning Representations (ICLR).
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., & Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, 30.
SigmaHQ. (2025). Sigma detection rules repository. GitHub. https://github.com/SigmaHQ/sigma
Elastic. (2025). Detection rules repository. GitHub. https://github.com/elastic/detection-rules
Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., et al. (2020). HuggingFace's Transformers: State-of-the-art natural language processing. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations (pp. 38-45). Association for Computational Linguistics. https://doi.org/10.18653/v1/2020.emnlp-demos.6
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., et al. (2022). Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems, 35.
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Даниїл Куцюк, Кирило Гороховський

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.