JBT Journal
Advanced

Raqamli Transformatsiya va Sun’iy Intellekt

ADVERSARIAL ANALYSIS OF AUTONOMOUS MULTI-AGENT NETWORK DEFENCE

Suhrobjon Bozorov1

1 TUIT named after Muhammad al-Khwarizmi

Zenodo DOI: 10.5281/zenodo.22930219

Keywords

autonomous network defense threat modelling escalation saturation adversarial evasion attack surface Dempster–Shafer conflict reliability discounting multi-agent intrusion detection

Abstract

Research on the security of machine-learning network defense treats the detector as the object under attack. A system that also acts - installing enforcement rules, resetting sessions, quarantining endpoints and revising its own policy from observed outcomes - acquires an attack surface of its own, and that surface is neither enumerated nor measured across most of the literature. This paper analyses an eight-agent detect-and-respond architecture with evidence-theoretic fusion and a reinforcement-learned response policy as a target rather than a defense. Ten threats are enumerated across four surfaces - the evidence path, the coordination bus, the learning path and the enforcement plane - each mapped to an architectural control and to a stated residual risk. Three findings follow: under constrained protocol-valid perturbation the dominant failure mode is displaced rather than removed, reliability discounting bounds agent compromise only asymptotically, and finally, the conflict gate introduces a failure mode of its own: Each control bounds its threat; none eliminates one, and one creates a new one.

Views: 109 Published: 2026-08-28 Pages: 265-272 Volume: 4 Issue: 4

References

  1. H. Benaddi, K. Ibrahimi, A. Benslimane, M. Jouhari, and J. Qadir, “Robust enhancement of intrusion detection systems using deep reinforcement learning and stochastic game,” IEEE Trans. Vehicular Technology, vol. 71, no. 10, pp. 11089–11102, 2022.
  2. J. Schulman, F. Wolski, P. Dhariwal, A. Radford, and O. Klimov, “Proximal policy optimization algorithms,” arXiv:1707.06347, 2017, doi: 10.48550/arXiv.1707.06347.
  3. S. Jacobs, R. Beltiukov, W. Willinger, R. A. Ferreira, A. Gupta, and L. Z. Granville, “AI/ML for network security: The emperor has no clothes,” in Proc. 2022 ACM SIGSAC Conf. Computer and Communications Security (CCS), 2022, pp. 1537–1551.
  4. A. Servin and D. Kudenko, “Multi-agent reinforcement learning for intrusion detection,” in Adaptive Agents and Multi-Agent Systems III, Berlin, Germany: Springer, 2008, pp. 211–223.
  5. K. Sethi, Y. V. Madhav, R. Kumar, and P. Bera, “Attention based multi-agent intrusion detection systems using reinforcement learning,” Journal of Information Security and Applications, vol. 61, art. 102923, 2021.
  6. M. Tellache, A. Mokhtari, A. Amara Korba, and Y. Ghamri-Doudane, “Multi-agent reinforcement learning-based network intrusion detection system,” in Proc. NOMS 2024 IEEE Network Operations and Management Symp., 2024, pp. 1–9.
  7. K. Sethi, E. Sai Rupesh, R. Kumar, P. Bera, and Y. Venu Madhav, “A context-aware robust intrusion detection system: A reinforcement learning-based approach,” International Journal of Information Security, vol. 19, pp. 657–678, 2020.
  8. F. Louati, F. Barika Ktata, and I. Amous, “BiG-IDS: A decentralized multi-agent reinforcement learning approach for distributed intrusion detection in big data networks,” Cluster Computing, 2024.
  9. . Axelsson, “The base-rate fallacy and its implications for the difficulty of intrusion detection,” in Proc. 6th ACM Conf. Computer and Communications Security (CCS), Singapore, 1999, pp. 1–7, doi: 10.1145/319709.319710.
  10. R. Flood, G. Engelen, D. Aspinall, and L. Desmet, “Bad design smells in benchmark NIDS datasets,” in Proc. 2024 IEEE 9th European Symp. Security and Privacy (EuroS&P), 2024, pp. 658–675.
  11. T. T. Nguyen and V. J. Reddi, “Deep reinforcement learning for cyber security,” IEEE Trans. Neural Networks and Learning Systems, vol. 34, no. 8, pp. 3779–3795, Aug. 2023, doi: 10.1109/TNNLS.2021.3121870.
  12. M. K. Adawadkar and N. Kulkarni, “Cyber-security and reinforcement learning - A brief survey,” Engineering Applications of Artificial Intelligence, vol. 114, art. 105116, 2022, doi: 10.1016/j.engappai.2022.105116.
  13. G. Folino and P. Sabatino, “Ensemble based collaborative and distributed intrusion detection systems: A survey,” Journal of Network and Computer Applications, vol. 66, pp. 1–16, 2016, doi: 10.1016/j.jnca.2016.03.011.
  14. M. Foley, C. Hicks, K. Highnam, and V. Mavroudis, “Autonomous network defence using reinforcement learning,” in Proc. 2022 ACM Asia Conf. Computer and Communications Security (ASIA CCS), 2022, pp. 1252–1254, doi: 10.1145/3488932.3527286.
  15. G. Apruzzese, P. Laskov, E. Montes de Oca, W. Mallouli, L. Búrdalo Rapa, A. V. Grammatopoulos, and F. Di Franco, “The role of machine learning in cybersecurity,” Digital Threats: Research and Practice, vol. 4, no. 1, art. 8, Mar. 2023, doi: 10.1145/3545574.
  16. G. Shi and G. He, “Collaborative multi-agent reinforcement learning for intrusion detection,” in Proc. 2021 7th IEEE Int. Conf. Network Intelligence and Digital Content (IC-NIDC), 2021, pp. 245–249.
  17. S. Bozorov, N. Nasrullayev, F. Xoliyorov, and T. Buriboyev, “Cooperative multi-agent intrusion detection and mitigation: Heterogeneous AI detectors with evidence-theoretic fusion and risk-aware reinforcement-learned response,” submitted for publication, 2026.
  18. I. Sharafaldin, A. H. Lashkari, S. Hakak, and A. A. Ghorbani, “Developing realistic distributed denial of service (DDoS) attack dataset and taxonomy,” in Proc. 2019 Int. Carnahan Conf. Security Technology (ICCST), Chennai, India, 2019, pp. 1–8, doi: 10.1109/CCST.2019.8888419.
  19. I. Sharafaldin, A. H. Lashkari, and A. A. Ghorbani, “Toward generating a new intrusion detection dataset and intrusion traffic characterization,” in Proc. 4th Int. Conf. Information Systems Security and Privacy (ICISSP), Funchal, Portugal, 2018, pp. 108–116, doi: 10.5220/0006639801080116.
  20. K. He, D. D. Kim, and M. R. Asghar, “Adversarial machine learning for network intrusion detection systems: A comprehensive survey,” IEEE Communications Surveys & Tutorials, vol. 25, no. 1, pp. 538–566, 2023, doi: 10.1109/COMST.2022.3233793.
  21. G. Engelen, V. Rimmer, and W. Joosen, “Troubleshooting an intrusion detection dataset: The CICIDS2017 case study,” in Proc. 2021 IEEE Security and Privacy Workshops (SPW), 2021, pp. 7–12, doi: 10.1109/SPW53761.2021.00009.
  22. D. Jin, S. Chen, H. He, X. Jiang, S. Cheng, and J. Yang, “Federated incremental learning based evolvable intrusion detection system for zero-day attacks,” IEEE Network, vol. 37, no. 1, pp. 125–132, 2023.
  23. N. Moustafa and J. Slay, “UNSW-NB15: A comprehensive data set for network intrusion detection systems,” in Proc. 2015 Military Communications and Information Systems Conf. (MilCIS), Canberra, Australia, 2015, pp. 1–6, doi: 10.1109/MilCIS.2015.7348942.
  24. D. Arp, E. Quiring, F. Pendlebury, A. Warnecke, F. Pierazzi, C. Wressnegger, L. Cavallaro, and K. Rieck, “Dos and don’ts of machine learning in computer security,” in Proc. 31st USENIX Security Symp., Boston, MA, USA, 2022, pp. 3971–3988.
  25. H. Kheddar, D. W. Dawoud, A. I. Awad, et al., “Reinforcement-learning-based intrusion detection in communication networks: A review,” IEEE Communications Surveys & Tutorials, 2024.
  26. Z. Long and W. Jinsong, “A hybrid method of entropy and SSAE-SVM based DDoS detection and mitigation mechanism in SDN,” Computers & Security, vol. 115, art. 102604, 2022, doi: 10.1016/j.cose.2022.102604.
  27. L. Liu, G. Engelen, T. Lynar, D. Essam, and W. Joosen, “Error prevalence in NIDS datasets: A case study on CIC-IDS-2017 and CSE-CIC-IDS-2018,” in Proc. 2022 IEEE Conf. Communications and Network Security (CNS), 2022, pp. 254–262, doi: 10.1109/CNS56114.2022.9947235.
  28. M. Standen, M. Lucas, D. Bowman, T. J. Richer, J. Kim, and D. Marriott, “CybORG: A gym for the development of autonomous cyber agents,” in IJCAI-21 1st Int. Workshop on Cyber Defense, 2021, arXiv:2108.09118.