Construction and Real Time Status Monitoring of a Changxin Palace Lantern Digital Twin Based on Multi Mode Sensing Data Fusion

Xinzi Ma1 , Huixia Wu1*
1 Faculty of Art and Design, Beijing City University, Beijing, China
* Corresponding author: Huixia Wu. Email: art1993@163.com
Journal of Digital Frontier 2026, Vol. 1, No. 1, pp. 185-218
DOI: 10.67541/jdf2607
Received: 6 June 2026; Revised: 17 July 2026; Accepted: 29 July 2026; Published: 24 August 2026
Abstract

Aiming at the problems of environmental disturbance, hidden structural response, and difficult collaborative fusion of multi source monitoring information in the long-term preservation process of mobile cultural relics, this paper proposes a digital twin construction and real time status monitoring method for the Changxin Palace Lantern based on multi-mode perception data fusion. This paper constructs a multi-source sensing system integrating 3D structured light, spectral imaging, FBG strain sensing and MEMS vibration monitoring, and realizes the unified representation of geometric state, material characteristics and dynamic response of cultural relics through asynchronous spatio temporal registration and a physical constraint driven spatio temporal fusion network (ATS FusionNet). On this basis, the residual driven state deviation index (RSDI) is established to realize the location of abnormal areas and the identification of degradation risks. The experiment is carried out based on the joint verification platform of Changxin Palace Lantern. The results show that the mean absolute errors of temperature prediction, strain prediction, and vibration amplitude prediction in the multi-mode state field reconstruction is 0.31 ℃, 2.7με and 0.012g, respectively. The end-to-end response delay of the system is 43.6ms on average, meeting the requirements of real-time monitoring. The research shows that the proposed method can effectively break through the limitations of insufficient single-mode perception and lack of physical correlation in the traditional cultural relic monitoring and provide a high-precision and real-time digital twin technology path for the intelligent protection and preventive maintenance of complex mobile cultural relics.

Keywords
Digital twin Multi-mode perception fusion Protection of cultural heritage Condition monitoring Detection of anomalies
References
  1. Zhang, J., Lu, R., Xu, C., & Luo, J. (2026). Exploratory research on smart collection storage based on digital twin: A case study of China grand canal museum. Journal of Cultural Heritage, 80, 253-262. DOI: 10.1016/j.culher.2026.05.018
  2. Cao, J., Qu, J., Yang, C., Zhang, R., Du, D., Mai, B., & Zhang, Z. (2026). Research on the Construction of a Monitoring System for Immovable Cultural Heritage Resources Based on a Resilient Organizational Logic: A Case Study of the Hanguang Gate Site in Xi'an. Preprints. DOI: 10.20944/preprints202603.2012.v1
  3. Zhao, T., Chen, G., Suraphee, S., Phoophiwfa, T., & Busababodhin, P. (2025). A hybrid TCN-XGBoost model for agricultural product market price forecasting. PLoS One, 20(5), e0322496. DOI: 10.1371/journal.pone.0322496
  4. Ali, A. H., & Thakkar, R. (2023). Climate changes through data science: understanding and mitigating environmental crisis. Mesopotamian Journal of Big Data, 2023, 125-137. DOI: 10.58496/MJBD/2023/017
  5. Zhao, T., Chen, G., Pang, C., & Busababodhin, P. (2025). Application and performance optimization of SLHS-TCN-XGBoost model in power demand forecasting. Computer Modeling in Engineering & Sciences, 143(3), 2883-2917. DOI: 10.32604/cmes.2025.066442
  6. Crisan, A., Pepe, M., Costantino, D., & Herban, S. (2024). From 3D point cloud to an intelligent model set for cultural heritage conservation. Heritage, 7(3), 1419-1437. DOI: 10.3390/heritage7030068
  7. Zhao, T., Chen, G., Pang, C., Seenoi, P., Papukdee, N., & Busababodhin, P. (2025). Time-lapse earthquake difference prediction based on physics-informed long short-term memory coupled with interpretability boosting. Journal of Seismic Exploration, 34(3), 25. DOI: 10.36922/JSE025310049
  8. Wu, H., Ji, P., Ma, H., & Xing, L. (2023). A comprehensive review of digital twin from the perspective of total process: Data, models, networks and applications. Sensors, 23(19), 8306. DOI: 10.3390/s23198306
  9. Segovia, M., & Garcia-Alfaro, J. (2022). Design, modeling and implementation of digital twins. Sensors, 22(14), 5396. DOI: 10.3390/s22145396
  10. Wang, Z., Zhang, Z., Su, T., Ding, Z., & Zhao, T. (2024). Research on supply chain network optimisation based on the CNNs-BiLSTM model. In 2024 International Conference on Information Technology, Comunication Ecosystem and Management (ITCEM) (pp. 197-202). IEEE. DOI: 10.1109/ITCEM65710.2024.00044
  11. Zhao, T., Chen, G., Pang, C., Seenoi, P., Papukdee, N., Busababodhin, P., & Du, Y. (2025). Hybrid convolutional neural network-graph attention network-gradient boosting decision tree model for seismic impedance inversion prediction. Journal of Seismic Exploration, 34(5), 81-98. DOI: 10.36922/JSE025310051
  12. Saeed, A., A. Khan, M., Akram, U., J. Obidallah, W., Jawed, S., & Ahmad, A. (2025). Deep learning based approaches for intelligent industrial machinery health management and fault diagnosis in resource-constrained environments. Scientific Reports, 15(1), 1114. DOI: 10.1038/s41598-024-79151-2
  13. Zhao, T., Chen, G., Pang, C., Li, L., & Busababodhin, P. (2026). Forecasting global agricultural trade imbalances using a hybrid deep learning and gradient boosting framework. Discover Computing, 29(1), 443. DOI: 10.1007/s10791-026-10367-8
  14. Zhong, D., Xia, Z., Zhu, Y., & Duan, J. (2023). Overview of predictive maintenance based on digital twin technology. Heliyon, 9(4). DOI: 10.1016/j.heliyon.2023.e14534
  15. Liu, Y., Gong, M., Chen, G., & Zhao, T. (2025). CNN-LSTM-based spatio-temporal prediction model for photovoltaic power generation. In Proceedings of the 2025 2nd International Conference on Big Data and Digital Management (pp. 570-575). DOI: 10.1145/3768801.3768892
  16. Kushwaha, D., Kumar, A., & Harsha, S. P. (2025). Advancements and applications of digital twin in the railway industry: a literature review. International Journal of Rail Transportation, 13(5), 865-890. DOI: 10.1080/23248378.2024.2434834
  17. Xu, Y., Huang, W., Xiao, J., Shan, J., Liu, M., Guo, W., ... & Yan, Y. (2026). A WebGIS-based digital twin platform for intelligent operation and maintenance of rail transit infrastructure. Expert Systems with Applications, 296, 129180. DOI: 10.1016/j.eswa.2025.129180
  18. Zhao, T., Chen, G., & Busababodhin, P. (2026). An intelligent expert system for logistics disruption prediction and mitigation in global supply chains: Integrating graph-based risk inference with ensemble forecasting. Scientific Reports. DOI: 10.1038/s41598-026-61617-0
  19. Pietroni, E., & Ferdani, D. (2021). Virtual restoration and virtual reconstruction in cultural heritage: Terminology, methodologies, visual representation techniques and cognitive models. Information, 12(4), 167. DOI: 10.3390/info12040167
  20. Peng, M., Hu, J., & Zhao, T. (2026). Hybrid ARIMA-LSTM model for international trade logistics demand forecasting. In IET Conference Proceedings CP982 (Vol. 2026, No. 9, pp. 243-247). Stevenage, UK: The Institution of Engineering and Technology. DOI: 10.1049/icp.2026.2978
  21. Du, Y., Chen, G., Pang, C., & Zhao, T. (2025). Prediction of fracture and vug parameters in carbonate reservoirs using a combined T-GNO-PINN approach. Journal of Seismic Exploration, 35(1), 46. DOI: 10.36922/JSE025330057
  22. Li, Q., Zhang, F., Jia, W., & Guo, Y. (2025). Study on the Surface Coating Techniques of Furniture in the Long'en Hall of Qing Changling Mausoleum. Coatings, 15(6), 712. DOI: 10.3390/coatings15060712
  23. Zhang, Z., Jia, Z., Wei, J., Xiao, Y., Zhang, R., & Zhao, T. (2025). Combining 5G Communication Technology with XGboost Model for Global Gas Trade Flow Prediction. In International Conference on Artificial Intelligence and Communication Technology (pp. 53-64). Cham: Springer Nature Switzerland. DOI: 10.1007/978-3-032-06376-2_5
  24. Dölker, E. M., Gröllich, D., Schmauder, M., & Haueisen, J. (2025). Vibration, temperature, and humidity influence the perception of electrocutaneous stimulation for occupational warning. Scientific Reports, 15(1), 38471. DOI: 10.1038/s41598-025-25166-2
  25. Zhang, Z., Qiu, T., Liao, Z., Liu, H., Wei, C., & Zhao, T. (2025). Research on global power equipment trade prediction and logistics optimization based on 5G and edge computing. In International Conference on Optoelectronics and Information Technology (ICOIT 2025) (Vol. 13665, pp. 302-310). SPIE. DOI: 10.1117/12.3071144
  26. Wang, A., Chen, G., Pang, C., & Zhao, T. (2025). Research on the prediction of telecommunication fraud using BKA-CNN-LSTM model from the perspective of big data. In Proceedings of the 2025 2nd International Conference on Big Data and Digital Management (pp. 576-582). DOI: 10.1145/3768801.3768893
  27. Yingxi, B., & Huaping, S. (2026). A Chinese Paradigm for Wartime Cultural Heritage Protection: The Case of the Palace Museum's Cultural Relics Evacuation. The Historic Environment: Policy & Practice, 17(1), 6-24. DOI: 10.1080/17567505.2026.2620982
  28. Gerstenblith, P. (2022). Protecting cultural heritage: The ties between people and places. Cultural Heritage and Mass Atrocities. Getty Publications, Los Angeles, 363-380. DOI: 10.2307/j.ctv2k88r7p.18
  29. Tian, R., Zhang, J., Zhang, S., Wang, L., Yang, H., Chen, Y., ... & Zhang, L. (2020). A high-precision energy-efficient GPS time-sync method for high-density seismic surveys. Applied Sciences, 10(11), 3768. DOI: 10.3390/app10113768
  30. Li, H., Wen, S., Li, S., Cao, X., Geng, X., Wu, S., ... & Liu, S. (2025). Multimodal image fusion to enhance 3D reconstruction based on IKKD-tree registration and CSTDFusion. Infrared Physics & Technology, 106255. DOI: 10.1016/j.infrared.2025.106255
  31. Lu, P., Liu, Q., & Guo, J. (2015). Camera calibration implementation based on Zhang Zhengyou plane method. In Proceedings of the 2015 Chinese Intelligent Systems Conference: Volume 1 (pp. 29-40). Berlin, Heidelberg: Springer Berlin Heidelberg. DOI: 10.1007/978-3-662-48386-2_4
  32. Tian, X., Shen, C., Ma, D., Huang, C., Liu, Y., Liang, L., & Wang, Y. (2023). Temperature-compensated fiber Bragg grating strain sensor based on a two-tap microwave photonic filter. Journal of Lightwave Technology, 42(7), 2532-2537. DOI: 10.1109/JLT.2023.3339508
  33. Zhou, R., Yu, J., Dai, Y., Tang, J., Yang, M., & Mumtaz, F. (2026). Multi-Parameter Optimization and Adaptive Temperature Compensation for FBG Strain Sensors in Wide-Temperature-Range Aerospace Applications. IEEE Sensors Journal. DOI: 10.1109/JSEN.2026.3657893
  34. Zheng, Q., Wang, H., Zhao, X., Wang, X., Li, M., & Chen, C. (2026). Hybrid deep learning-based automatic identification, localization and quantitative evaluation of internal defects in welds. Journal of Nondestructive Evaluation, 45(2), 73. DOI: 10.1007/s10921-026-01368-0
  35. Lin, L., Wu, J., Fu, S., Zhang, S., Tong, C., & Zu, L. (2024). Channel attention & temporal attention based temporal convolutional network: A dual attention framework for remaining useful life prediction of the aircraft engines. Advanced Engineering Informatics, 60, 102372. DOI: 10.1016/j.aei.2024.102372
  36. Xing, Y., & Yin, Y. (2026). Incipient Fault Diagnosis in Power Cables Based on WOA-CEEMDAN and a TCN-BiLSTM Network with Multi-Head Attention. Applied Sciences, 16(8), 3908. DOI: 10.3390/app16083908

© 2026 The Author(s). Published by Digital Intelligence Press Limited. This is an open access article under the CC BY 4.0 license.

How to cite: Ma, X., & Wu, H. (2026). Construction and Real Time Status Monitoring of a Changxin Palace Lantern Digital Twin Based on Multi Mode Sensing Data Fusion. Journal of Digital Frontier, 1(1), 185-218. https://doi.org/10.67541/jdf2607