Raqamli Transformatsiya va Sun’iy Intellekt
ADVERSARIAL ANALYSIS OF AUTONOMOUS MULTI-AGENT NETWORK DEFENCE
1 TUIT named after Muhammad al-Khwarizmi
Zenodo DOI: 10.5281/zenodo.22930219
Keywords
Abstract
Research on the security of machine-learning network defense treats the detector as the object under attack. A system that also acts - installing enforcement rules, resetting sessions, quarantining endpoints and revising its own policy from observed outcomes - acquires an attack surface of its own, and that surface is neither enumerated nor measured across most of the literature. This paper analyses an eight-agent detect-and-respond architecture with evidence-theoretic fusion and a reinforcement-learned response policy as a target rather than a defense. Ten threats are enumerated across four surfaces - the evidence path, the coordination bus, the learning path and the enforcement plane - each mapped to an architectural control and to a stated residual risk. Three findings follow: under constrained protocol-valid perturbation the dominant failure mode is displaced rather than removed, reliability discounting bounds agent compromise only asymptotically, and finally, the conflict gate introduces a failure mode of its own: Each control bounds its threat; none eliminates one, and one creates a new one.
References
- H. Benaddi, K. Ibrahimi, A. Benslimane, M. Jouhari, and J. Qadir, “Robust enhancement of intrusion detection systems using deep reinforcement learning and stochastic game,” IEEE Trans. Vehicular Technology, vol. 71, no. 10, pp. 11089–11102, 2022.
- J. Schulman, F. Wolski, P. Dhariwal, A. Radford, and O. Klimov, “Proximal policy optimization algorithms,” arXiv:1707.06347, 2017, doi: 10.48550/arXiv.1707.06347.
- S. Jacobs, R. Beltiukov, W. Willinger, R. A. Ferreira, A. Gupta, and L. Z. Granville, “AI/ML for network security: The emperor has no clothes,” in Proc. 2022 ACM SIGSAC Conf. Computer and Communications Security (CCS), 2022, pp. 1537–1551.
- A. Servin and D. Kudenko, “Multi-agent reinforcement learning for intrusion detection,” in Adaptive Agents and Multi-Agent Systems III, Berlin, Germany: Springer, 2008, pp. 211–223.
- K. Sethi, Y. V. Madhav, R. Kumar, and P. Bera, “Attention based multi-agent intrusion detection systems using reinforcement learning,” Journal of Information Security and Applications, vol. 61, art. 102923, 2021.
- M. Tellache, A. Mokhtari, A. Amara Korba, and Y. Ghamri-Doudane, “Multi-agent reinforcement learning-based network intrusion detection system,” in Proc. NOMS 2024 IEEE Network Operations and Management Symp., 2024, pp. 1–9.
- K. Sethi, E. Sai Rupesh, R. Kumar, P. Bera, and Y. Venu Madhav, “A context-aware robust intrusion detection system: A reinforcement learning-based approach,” International Journal of Information Security, vol. 19, pp. 657–678, 2020.
- F. Louati, F. Barika Ktata, and I. Amous, “BiG-IDS: A decentralized multi-agent reinforcement learning approach for distributed intrusion detection in big data networks,” Cluster Computing, 2024.
- . Axelsson, “The base-rate fallacy and its implications for the difficulty of intrusion detection,” in Proc. 6th ACM Conf. Computer and Communications Security (CCS), Singapore, 1999, pp. 1–7, doi: 10.1145/319709.319710.
- R. Flood, G. Engelen, D. Aspinall, and L. Desmet, “Bad design smells in benchmark NIDS datasets,” in Proc. 2024 IEEE 9th European Symp. Security and Privacy (EuroS&P), 2024, pp. 658–675.
- T. T. Nguyen and V. J. Reddi, “Deep reinforcement learning for cyber security,” IEEE Trans. Neural Networks and Learning Systems, vol. 34, no. 8, pp. 3779–3795, Aug. 2023, doi: 10.1109/TNNLS.2021.3121870.
- M. K. Adawadkar and N. Kulkarni, “Cyber-security and reinforcement learning - A brief survey,” Engineering Applications of Artificial Intelligence, vol. 114, art. 105116, 2022, doi: 10.1016/j.engappai.2022.105116.
- G. Folino and P. Sabatino, “Ensemble based collaborative and distributed intrusion detection systems: A survey,” Journal of Network and Computer Applications, vol. 66, pp. 1–16, 2016, doi: 10.1016/j.jnca.2016.03.011.
- M. Foley, C. Hicks, K. Highnam, and V. Mavroudis, “Autonomous network defence using reinforcement learning,” in Proc. 2022 ACM Asia Conf. Computer and Communications Security (ASIA CCS), 2022, pp. 1252–1254, doi: 10.1145/3488932.3527286.
- G. Apruzzese, P. Laskov, E. Montes de Oca, W. Mallouli, L. Búrdalo Rapa, A. V. Grammatopoulos, and F. Di Franco, “The role of machine learning in cybersecurity,” Digital Threats: Research and Practice, vol. 4, no. 1, art. 8, Mar. 2023, doi: 10.1145/3545574.
- G. Shi and G. He, “Collaborative multi-agent reinforcement learning for intrusion detection,” in Proc. 2021 7th IEEE Int. Conf. Network Intelligence and Digital Content (IC-NIDC), 2021, pp. 245–249.
- S. Bozorov, N. Nasrullayev, F. Xoliyorov, and T. Buriboyev, “Cooperative multi-agent intrusion detection and mitigation: Heterogeneous AI detectors with evidence-theoretic fusion and risk-aware reinforcement-learned response,” submitted for publication, 2026.
- I. Sharafaldin, A. H. Lashkari, S. Hakak, and A. A. Ghorbani, “Developing realistic distributed denial of service (DDoS) attack dataset and taxonomy,” in Proc. 2019 Int. Carnahan Conf. Security Technology (ICCST), Chennai, India, 2019, pp. 1–8, doi: 10.1109/CCST.2019.8888419.
- I. Sharafaldin, A. H. Lashkari, and A. A. Ghorbani, “Toward generating a new intrusion detection dataset and intrusion traffic characterization,” in Proc. 4th Int. Conf. Information Systems Security and Privacy (ICISSP), Funchal, Portugal, 2018, pp. 108–116, doi: 10.5220/0006639801080116.
- K. He, D. D. Kim, and M. R. Asghar, “Adversarial machine learning for network intrusion detection systems: A comprehensive survey,” IEEE Communications Surveys & Tutorials, vol. 25, no. 1, pp. 538–566, 2023, doi: 10.1109/COMST.2022.3233793.
- G. Engelen, V. Rimmer, and W. Joosen, “Troubleshooting an intrusion detection dataset: The CICIDS2017 case study,” in Proc. 2021 IEEE Security and Privacy Workshops (SPW), 2021, pp. 7–12, doi: 10.1109/SPW53761.2021.00009.
- D. Jin, S. Chen, H. He, X. Jiang, S. Cheng, and J. Yang, “Federated incremental learning based evolvable intrusion detection system for zero-day attacks,” IEEE Network, vol. 37, no. 1, pp. 125–132, 2023.
- N. Moustafa and J. Slay, “UNSW-NB15: A comprehensive data set for network intrusion detection systems,” in Proc. 2015 Military Communications and Information Systems Conf. (MilCIS), Canberra, Australia, 2015, pp. 1–6, doi: 10.1109/MilCIS.2015.7348942.
- D. Arp, E. Quiring, F. Pendlebury, A. Warnecke, F. Pierazzi, C. Wressnegger, L. Cavallaro, and K. Rieck, “Dos and don’ts of machine learning in computer security,” in Proc. 31st USENIX Security Symp., Boston, MA, USA, 2022, pp. 3971–3988.
- H. Kheddar, D. W. Dawoud, A. I. Awad, et al., “Reinforcement-learning-based intrusion detection in communication networks: A review,” IEEE Communications Surveys & Tutorials, 2024.
- Z. Long and W. Jinsong, “A hybrid method of entropy and SSAE-SVM based DDoS detection and mitigation mechanism in SDN,” Computers & Security, vol. 115, art. 102604, 2022, doi: 10.1016/j.cose.2022.102604.
- L. Liu, G. Engelen, T. Lynar, D. Essam, and W. Joosen, “Error prevalence in NIDS datasets: A case study on CIC-IDS-2017 and CSE-CIC-IDS-2018,” in Proc. 2022 IEEE Conf. Communications and Network Security (CNS), 2022, pp. 254–262, doi: 10.1109/CNS56114.2022.9947235.
- M. Standen, M. Lucas, D. Bowman, T. J. Richer, J. Kim, and D. Marriott, “CybORG: A gym for the development of autonomous cyber agents,” in IJCAI-21 1st Int. Workshop on Cyber Defense, 2021, arXiv:2108.09118.