Research on Simulation and Path Optimization of University Emergency Evacuation Based on Multi-Agent Reinforcement Learning

Linna Yang*
School of Economics and Management, Lanzhou Institute of Technology, Lanzhou, Gansu, China
* Corresponding author: Linna Yang. Email: yangln@lzit.edu.cn
Journal of Digital Frontier 2026, Vol. 1, No. 2, pp. 124-152
DOI: 10.67541/jdf2612
Received: 27 August 2026; Revised: 19 September 2026; Accepted: 24 October 2026; Published: 30 October 2026
Abstract

To address the spatial misalignment between local observations and global bottleneck consequences in university emergency evacuation, as well as the difficulty of sparse team rewards in guiding diversion behaviors, the Topological Awareness Hierarchical State Encoder (TAHSE) and Bottleneck Sensitive Reward Decomposition Mechanism (BSRD) are proposed. These two mechanisms are coupled into a unified architecture within a centralized training-decentralized execution framework. TAHSE aggregates the features of the local neighborhood graph using attention and uses learnable bottleneck tokens as the keys and values for the second layer's cross-domain attention, enabling agents to obtain the compressed prior of the global bottleneck solely based on their own observations and pre-stored bottleneck graphs, reducing the computational complexity from the square level of the full graph attention to the linear level. BSRD decomposes a single negative time team reward into three components: progress, bottleneck pressure, and coordination completion. It triggers pressure penalties with a warning threshold lower than the safety upper limit and uses an adaptive coefficient to weigh the safety constraints as the difficulty of the scenario increases. Twenty seed repetition experiments were conducted in three-tier campus scenarios (500/1500/3000 agents) and structured perturbation protocols: The gap ratio of the proposed method relative to the upper bound reference in the three scenarios was controlled within 15%, while the MAPPO baseline increased from 18.4% to 31.5% as the scale expanded; the peak density effect under topological perturbation reached 1.42 (p<0.001), and the triggering threshold for diversion shifted systematically towards the bottleneck nodes with reduced capacity. The results show that embedding the bottleneck as a portable prior in the decentralized strategy and guiding diversion with reward signals ahead of the safety upper limit can achieve joint improvement in efficiency and safety at a controllable computational cost and is more reliable under structural variation conditions.

Keywords
Multi-agent reinforcement learning Emergency evacuation Bottleneck perception State encoding Reward decomposition
Funding

This research was supported by the Youth Science and Technology Innovation Project of Lanzhou Institute of Technology (No. 2024KJ-32).

References
  1. Zhang, M., Li, Z., Si, H., Cheng, L., Zhou, X., & Wang, B. (2023). Urban travel time and residential location choice: The impacts of traffic congestion. Sustainable Cities and Society, 99, 104975. DOI: 10.1016/j.scs.2023.104975
  2. Fan, M., Hedayati Marzbali, M., Abdullah, A., & Maghsoodi Tilaki, M. J. (2024). Using a space syntax approach to enhance pedestrians' accessibility and safety in the historic city of George Town, Penang. Urban Science, 8(1), 6. DOI: 10.3390/urbansci8010006
  3. Chen, L., Deng, P., Li, L., & Hu, X. (2025). Mixed motivation driven social multi-agent reinforcement learning for autonomous driving. IEEE/CAA Journal of Automatica Sinica, 12(6), 1272-1282. DOI: 10.1109/jas.2025.125201
  4. Lokam, A., & Dasari, K. (2026). A QMIX-driven routing protocol for dynamic Underwater Acoustic Sensor Networks. Scientific Reports. DOI: 10.1038/s41598-026-74771-2
  5. Guan, Y., Ren, Y., Sun, Q., Li, S. E., Ma, H., Duan, J., ... & Cheng, B. (2022). Integrated decision and control: Toward interpretable and computationally efficient driving intelligence. IEEE Transactions on Cybernetics, 53(2), 859-873. DOI: 10.1109/tcyb.2022.3163816
  6. Malathi, V., Sreedharan, P., PR, R., Anil Kumar, V., Sadasivan, A. L., Udupa, G., ... & Troppina, A. (2025). Decision-making for path planning of mobile robots under uncertainty: A review of belief-space planning simplifications. Robotics, 14(9), 127. DOI: 10.3390/robotics14090127
  7. Guo, Y., Mao, Z., Chen, X., Fan, X., Han, Y., Su, X., ... & Tian, H. (2026). Floor field cellular automata model of pedestrian crush and stampede behavior based on crowding force transmission mechanism. Physics Letters A, 131951. DOI: 10.1016/j.physleta.2026.131951
  8. Zambare, P., & Liu, Y. (2025). Modeling and simulation of pedestrian behavior in traffic environment: A systematic review of approaches and software. IEEE Access. DOI: 10.1109/access.2025.3602471
  9. Silva, E. C., Damazo, G. S., & Martins, L. G. (2025). Cellular Automata Applied to the Simulation of Pedestrian Evacuation with Surmountable Obstacles and Route Alternation Through an Impatience Mechanism. In International Conference on Agents and Artificial Intelligence (pp. 562-582). Cham: Springer Nature Switzerland. DOI: 10.1007/978-3-032-25032-2_27
  10. Imtiaz, T., Chai, L., Heal, K., Luo, X., Park, J., Dy, J., & Flynn, J. (2025). LVT: Large-Scale Scene Reconstruction via Local View Transformers. In Proceedings of the SIGGRAPH Asia 2025 Conference Papers (pp. 1-12). DOI: 10.1145/3757377.3763838
  11. Sun, T., Ji, J., Li, J., & Xv, Z. (2026). SpectVit: Spectral-spatial gating for efficient vision transformers. Pattern Recognition, 114749. DOI: 10.1016/j.patcog.2026.114749
  12. Ge, L., Wang, S., & Wang, G. (2024). Rapid vehicle trajectory prediction based on multi-attention mechanism for fusing multimodal information. Electronics, 13(23), 4806. DOI: 10.3390/electronics13234806
  13. Han, D., Ye, T., Han, Y., Xia, Z., Pan, S., Wan, P., ... & Huang, G. (2024). Agent attention: On the integration of softmax and linear attention. In European Conference on Computer Vision (pp. 124-140). Cham: Springer Nature Switzerland. DOI: 10.1007/978-3-031-72973-7_8
  14. Ye, K., Wu, Z., Wu, Y., Qian, H., Woo, S., Srigrarom, S., & Khoo, B. C. (2026). Topology-Safe Air-to-Air Interception via "Go"-Inspired Metrics and Multi-Agent Reinforcement Learning. Aerospace, 13(8), 680. DOI: 10.3390/aerospace13080680
  15. Terry, J. K., Black, B., Grammel, N., Jayakumar, M., Hari, A., Sullivan, R., ... & Ravi, P. (2021). Pettingzoo: Gym for multi-agent reinforcement learning. Advances in Neural Information Processing Systems, 34, 15032-15043. DOI: 10.48550/arXiv.2009.14471
  16. Metelo, F., Soares, C., Racković, S., & Costa, P. Á. (2024). Peersimgym: An environment for solving the task offloading problem with reinforcement learning. In Joint European Conference on Machine Learning and Knowledge Discovery in Databases (pp. 38-54). Cham: Springer Nature Switzerland. DOI: 10.1007/978-3-031-70378-2_3
  17. Yang, H., Shi, J., Jiang, N., Yu, H., & Yang, L. (2026). Congestion-Mitigating Evacuation Path Planning in Subway Stations via Graph-Theoretic Deep Reinforcement Learning. Simulation Modelling Practice and Theory, 103315. DOI: 10.1016/j.simpat.2026.103315
  18. Moreno, J. V., Gonçalves, A. B., & Falcão, A. P. (2026). Bridging BIM and Path-Finding Algorithms: A Systematic Review and Analysis of Escape Route Generation. Sustainability, 18(20), 10490. DOI: 10.3390/su182010490
  19. Zhong, Z., & Ren, Z. (2026). Multi-agent Reinforcement Learning Optimization for Urban Earthquake Emergency Evacuation with GIS-based Real-time Decision Support. Journal of Earthquake and Tsunami, 2540002. DOI: 10.1142/s1793431125400020
  20. Low, D., & Zhou, Y. (2025). Cooperative multi-agent reinforcement learning for robotic systems: A review. Multiagent and Grid Systems, 21(2), 96-123. DOI: 10.1177/15741702251370050
  21. Zhang, J., & Wu, S. (2026). Master-Refined MAPPO for Long-Term Joint Resource Scheduling in NOMA-MEC Systems. Symmetry, 18(7), 1243. DOI: 10.3390/sym18071243
  22. Torres Rodríguez, I. J., Marsà Fargas, J., Candelo Zuluaga, C., Pérez Díaz, C. A., Martin Hernández, L. D., Sanz Merodio, D., ... & López Estévez, M. (2026). Toward Reproducible Actuator Characterization: A Comprehensive Framework for Robotics Applications. In Actuators (Vol. 15, No. 6, p. 301). MDPI. DOI: 10.3390/act15060301
  23. Kalkanlı, D., Kundak, S., Atun, F., & Van Westen, C. J. (2026). Human-Centric Digital Twins for Spatial Sustainability: A Procedural VR Framework for Calibrating Agent-Based Evacuation Models in Diverse Urban Morphologies. Sustainability, 18(3), 1482. DOI: 10.3390/su18031482