Research on Simulation and Path Optimization of University Emergency Evacuation Based on Multi-Agent Reinforcement Learning
School of Economics and Management, Lanzhou Institute of Technology, Lanzhou, Gansu, China
* Corresponding author: Linna Yang. Email: yangln@lzit.edu.cn
Abstract
To address the spatial misalignment between local observations and global bottleneck consequences in university emergency evacuation, as well as the difficulty of sparse team rewards in guiding diversion behaviors, the Topological Awareness Hierarchical State Encoder (TAHSE) and Bottleneck Sensitive Reward Decomposition Mechanism (BSRD) are proposed. These two mechanisms are coupled into a unified architecture within a centralized training-decentralized execution framework. TAHSE aggregates the features of the local neighborhood graph using attention and uses learnable bottleneck tokens as the keys and values for the second layer's cross-domain attention, enabling agents to obtain the compressed prior of the global bottleneck solely based on their own observations and pre-stored bottleneck graphs, reducing the computational complexity from the square level of the full graph attention to the linear level. BSRD decomposes a single negative time team reward into three components: progress, bottleneck pressure, and coordination completion. It triggers pressure penalties with a warning threshold lower than the safety upper limit and uses an adaptive coefficient to weigh the safety constraints as the difficulty of the scenario increases. Twenty seed repetition experiments were conducted in three-tier campus scenarios (500/1500/3000 agents) and structured perturbation protocols: The gap ratio of the proposed method relative to the upper bound reference in the three scenarios was controlled within 15%, while the MAPPO baseline increased from 18.4% to 31.5% as the scale expanded; the peak density effect under topological perturbation reached 1.42 (p<0.001), and the triggering threshold for diversion shifted systematically towards the bottleneck nodes with reduced capacity. The results show that embedding the bottleneck as a portable prior in the decentralized strategy and guiding diversion with reward signals ahead of the safety upper limit can achieve joint improvement in efficiency and safety at a controllable computational cost and is more reliable under structural variation conditions.
Keywords
Multi-agent reinforcement learning
Emergency evacuation
Bottleneck perception
State encoding
Reward decomposition
Funding
This research was supported by the Youth Science and Technology Innovation Project of Lanzhou Institute of Technology (No. 2024KJ-32).
References
- Zhang, M., Li, Z., Si, H., Cheng, L., Zhou, X., & Wang, B. (2023). Urban travel time and residential location choice: The impacts of traffic congestion. Sustainable Cities and Society, 99, 104975. DOI: 10.1016/j.scs.2023.104975
- Fan, M., Hedayati Marzbali, M., Abdullah, A., & Maghsoodi Tilaki, M. J. (2024). Using a space syntax approach to enhance pedestrians' accessibility and safety in the historic city of George Town, Penang. Urban Science, 8(1), 6. DOI: 10.3390/urbansci8010006
- Chen, L., Deng, P., Li, L., & Hu, X. (2025). Mixed motivation driven social multi-agent reinforcement learning for autonomous driving. IEEE/CAA Journal of Automatica Sinica, 12(6), 1272-1282. DOI: 10.1109/jas.2025.125201
- Lokam, A., & Dasari, K. (2026). A QMIX-driven routing protocol for dynamic Underwater Acoustic Sensor Networks. Scientific Reports. DOI: 10.1038/s41598-026-74771-2
- Guan, Y., Ren, Y., Sun, Q., Li, S. E., Ma, H., Duan, J., ... & Cheng, B. (2022). Integrated decision and control: Toward interpretable and computationally efficient driving intelligence. IEEE Transactions on Cybernetics, 53(2), 859-873. DOI: 10.1109/tcyb.2022.3163816
- Malathi, V., Sreedharan, P., PR, R., Anil Kumar, V., Sadasivan, A. L., Udupa, G., ... & Troppina, A. (2025). Decision-making for path planning of mobile robots under uncertainty: A review of belief-space planning simplifications. Robotics, 14(9), 127. DOI: 10.3390/robotics14090127
- Guo, Y., Mao, Z., Chen, X., Fan, X., Han, Y., Su, X., ... & Tian, H. (2026). Floor field cellular automata model of pedestrian crush and stampede behavior based on crowding force transmission mechanism. Physics Letters A, 131951. DOI: 10.1016/j.physleta.2026.131951
- Zambare, P., & Liu, Y. (2025). Modeling and simulation of pedestrian behavior in traffic environment: A systematic review of approaches and software. IEEE Access. DOI: 10.1109/access.2025.3602471
- Silva, E. C., Damazo, G. S., & Martins, L. G. (2025). Cellular Automata Applied to the Simulation of Pedestrian Evacuation with Surmountable Obstacles and Route Alternation Through an Impatience Mechanism. In International Conference on Agents and Artificial Intelligence (pp. 562-582). Cham: Springer Nature Switzerland. DOI: 10.1007/978-3-032-25032-2_27
- Imtiaz, T., Chai, L., Heal, K., Luo, X., Park, J., Dy, J., & Flynn, J. (2025). LVT: Large-Scale Scene Reconstruction via Local View Transformers. In Proceedings of the SIGGRAPH Asia 2025 Conference Papers (pp. 1-12). DOI: 10.1145/3757377.3763838
- Sun, T., Ji, J., Li, J., & Xv, Z. (2026). SpectVit: Spectral-spatial gating for efficient vision transformers. Pattern Recognition, 114749. DOI: 10.1016/j.patcog.2026.114749
- Ge, L., Wang, S., & Wang, G. (2024). Rapid vehicle trajectory prediction based on multi-attention mechanism for fusing multimodal information. Electronics, 13(23), 4806. DOI: 10.3390/electronics13234806
- Han, D., Ye, T., Han, Y., Xia, Z., Pan, S., Wan, P., ... & Huang, G. (2024). Agent attention: On the integration of softmax and linear attention. In European Conference on Computer Vision (pp. 124-140). Cham: Springer Nature Switzerland. DOI: 10.1007/978-3-031-72973-7_8
- Ye, K., Wu, Z., Wu, Y., Qian, H., Woo, S., Srigrarom, S., & Khoo, B. C. (2026). Topology-Safe Air-to-Air Interception via "Go"-Inspired Metrics and Multi-Agent Reinforcement Learning. Aerospace, 13(8), 680. DOI: 10.3390/aerospace13080680
- Terry, J. K., Black, B., Grammel, N., Jayakumar, M., Hari, A., Sullivan, R., ... & Ravi, P. (2021). Pettingzoo: Gym for multi-agent reinforcement learning. Advances in Neural Information Processing Systems, 34, 15032-15043. DOI: 10.48550/arXiv.2009.14471
- Metelo, F., Soares, C., Racković, S., & Costa, P. Á. (2024). Peersimgym: An environment for solving the task offloading problem with reinforcement learning. In Joint European Conference on Machine Learning and Knowledge Discovery in Databases (pp. 38-54). Cham: Springer Nature Switzerland. DOI: 10.1007/978-3-031-70378-2_3
- Yang, H., Shi, J., Jiang, N., Yu, H., & Yang, L. (2026). Congestion-Mitigating Evacuation Path Planning in Subway Stations via Graph-Theoretic Deep Reinforcement Learning. Simulation Modelling Practice and Theory, 103315. DOI: 10.1016/j.simpat.2026.103315
- Moreno, J. V., Gonçalves, A. B., & Falcão, A. P. (2026). Bridging BIM and Path-Finding Algorithms: A Systematic Review and Analysis of Escape Route Generation. Sustainability, 18(20), 10490. DOI: 10.3390/su182010490
- Zhong, Z., & Ren, Z. (2026). Multi-agent Reinforcement Learning Optimization for Urban Earthquake Emergency Evacuation with GIS-based Real-time Decision Support. Journal of Earthquake and Tsunami, 2540002. DOI: 10.1142/s1793431125400020
- Low, D., & Zhou, Y. (2025). Cooperative multi-agent reinforcement learning for robotic systems: A review. Multiagent and Grid Systems, 21(2), 96-123. DOI: 10.1177/15741702251370050
- Zhang, J., & Wu, S. (2026). Master-Refined MAPPO for Long-Term Joint Resource Scheduling in NOMA-MEC Systems. Symmetry, 18(7), 1243. DOI: 10.3390/sym18071243
- Torres Rodríguez, I. J., Marsà Fargas, J., Candelo Zuluaga, C., Pérez Díaz, C. A., Martin Hernández, L. D., Sanz Merodio, D., ... & López Estévez, M. (2026). Toward Reproducible Actuator Characterization: A Comprehensive Framework for Robotics Applications. In Actuators (Vol. 15, No. 6, p. 301). MDPI. DOI: 10.3390/act15060301
- Kalkanlı, D., Kundak, S., Atun, F., & Van Westen, C. J. (2026). Human-Centric Digital Twins for Spatial Sustainability: A Procedural VR Framework for Calibrating Agent-Based Evacuation Models in Diverse Urban Morphologies. Sustainability, 18(3), 1482. DOI: 10.3390/su18031482