DEVELOPMENT OF AN AI-ASSISTANT MODULE BASED ON QLoRA FINE-TUNING OF A LARGE LANGUAGE MODEL FOR AUTOMATED CYBERSECURITY INCIDENT ANALYSIS

Authors

DOI:

https://doi.org/10.28925/2663-4023.2026.34.1269

Keywords:

artificial intelligence, LLM, fine-tuning, QLoRA, cybersecurity, incident analysis, MITRE ATT&CK, SOC, FastAPI, Llama 3.2

Abstract

The article addresses the development and integration of an artificial-intelligence module for automated cybersecurity incident analysis within the decentralised Cybersecurity Dataspace (CSDS) platform for sharing cyber-incident data between organisations. The relevance of the study stems from systemic problems of modern security operations centres (SOCs): the excessive volume of security events, the global shortage of qualified specialists, the effect of alert fatigue, and the growing complexity of multi-stage attacks. The aim of the work is to build a specialised large language model (LLM) capable of classifying threats, assessing their severity, and providing structured response recommendations in line with the MITRE ATT&CK and NIST SP 800-61 methodologies. The paper provides a comparative analysis of four approaches to building AI assistants (zero-shot prompting, RAG, full fine-tuning, and parameter-efficient fine-tuning) and substantiates the choice of QLoRA as optimal for local deployment given confidentiality requirements and limited computational resources. A training dataset of 1,875 examples was assembled from five open sources (MITRE ATT&CK, NVD CVE, synthetic incident logs, open cybersecurity Q&A datasets, and Sigma/Elastic detection rules); it underwent deduplication, quality filtering, and verification of MITRE techniques. Two independent rounds of QLoRA fine-tuning of the Llama 3.2 3B Instruct base model were carried out with identical hyperparameters, and their results were described in terms of loss and token-level accuracy. A FastAPI microservice with REST endpoints for incident analysis, dialogue, batch processing, and monitoring was developed and integrated into the platform’s Next.js front end. Functional testing on three representative attack classes (SQL injection, ransomware, and brute force) and a comparative evaluation of answer quality using a keyword-overlap metric demonstrated a substantial quality improvement after fine-tuning compared with the base model. The proposed approach is reproducible on consumer-grade GPU hardware and can be scaled for industrial use. The article presents the problem statement, an analysis of current industrial and academic solutions, the theoretical basis of the method, the dataset-construction and fine-tuning methodology, the obtained results, and directions for further research.

Downloads

Download data is not yet available.

References

Hu, E. J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., & Chen, W. (2021). LoRA: Low-rank adaptation of large language models (arXiv:2106.09685). arXiv. https://arxiv.org/abs/2106.09685

Dettmers, T., Pagnoni, A., Holtzman, A., & Zettlemoyer, L. (2023). QLoRA: Efficient finetuning of quantized LLMs. Advances in Neural Information Processing Systems, 36.

Freitas, S., Callahan, A., Bhatt, A., & Bono, J. (2024). AI-driven guided response for security operation centers with Microsoft Copilot for Security (arXiv:2407.09017). arXiv. https://arxiv.org/abs/2407.09017

Bono, J., & Xu, A. (2024). Randomized controlled trials for Security Copilot for IT administrators (arXiv:2411.01067). arXiv. https://arxiv.org/abs/2411.01067

MITRE Corporation. (2025). ATT&CK Enterprise Matrix. https://attack.mitre.org/matrices/enterprise

National Institute of Standards and Technology. (2025). National Vulnerability Database (NVD): CVE API 2.0. https://nvd.nist.gov/developers/vulnerabilities

Meta AI. (2024). Llama 3.2: Multilingual large language models. Hugging Face. https://huggingface.co/meta-llama/Llama-3.2-3B-Instruct

Touvron, H., Martin, L., Stone, K., Albert, P., Almahairi, A., Babaei, Y., Bashlykov, N., et al. (2023). Llama 2: Open foundation and fine-tuned chat models (arXiv:2307.09288). arXiv. https://arxiv.org/abs/2307.09288

Sophos. (2024). LLM benchmarks for cybersecurity: Evaluation of incident investigation, summarisation and severity evaluation [Technical report].

Microsoft. (2024). Generative AI and security operations center productivity: Evidence from live operations [Microsoft Research report].

IBM Security, & Ponemon Institute. (2024). Cost of a data breach report 2024.

ISC2. (2024). Cybersecurity workforce study 2024.

National Institute of Standards and Technology. (2023). Artificial intelligence risk management framework (AI RMF 1.0) (NIST AI 100-1). https://doi.org/10.6028/NIST.AI.100-1

Perez, F., & Ribeiro, I. (2022). Ignore previous prompt: Attack techniques for language models (arXiv:2211.09527). arXiv. https://arxiv.org/abs/2211.09527

Wei, J., Bosma, M., Zhao, V., Guu, K., Yu, A. W., Lester, B., Du, N., Dai, A. M., & Le, Q. V. (2022). Finetuned language models are zero-shot learners. In International Conference on Learning Representations (ICLR).

Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., & Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, 30.

SigmaHQ. (2025). Sigma detection rules repository. GitHub. https://github.com/SigmaHQ/sigma

Elastic. (2025). Detection rules repository. GitHub. https://github.com/elastic/detection-rules

Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., et al. (2020). HuggingFace's Transformers: State-of-the-art natural language processing. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations (pp. 38-45). Association for Computational Linguistics. https://doi.org/10.18653/v1/2020.emnlp-demos.6

Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., et al. (2022). Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems, 35.

Downloads


Abstract views: 3

Published

2026-09-24

How to Cite

Kutsiuk, D., & Gorokhovskyi, K. (2026). DEVELOPMENT OF AN AI-ASSISTANT MODULE BASED ON QLoRA FINE-TUNING OF A LARGE LANGUAGE MODEL FOR AUTOMATED CYBERSECURITY INCIDENT ANALYSIS. Electronic Professional Scientific Journal «Cybersecurity: Education, Science, Technique», 2(34), 241–248. https://doi.org/10.28925/2663-4023.2026.34.1269