Construction and Real‑Time Status Monitoring of a Changxin Palace Lantern Digital Twin Based on Multi‑Mode Sensing Data Fusion
DOI:
https://doi.org/10.67541/jdf2607Keywords:
Digital twin; Multi-mode perception fusion; Protection of cultural heritage; Condition monitoring; Detection of anomaliesAbstract
Aiming at the problems of environmental disturbance, hidden structural response, and difficult collaborative fusion of multi‑source monitoring information in the long-term preservation process of mobile cultural relics, this paper proposes a digital twin construction and real‑time status monitoring method for the Changxin Palace Lantern based on multi-mode perception data fusion. This paper constructs a multi-source sensing system integrating 3D structured light, spectral imaging, FBG strain sensing and MEMS vibration monitoring, and realizes the unified representation of geometric state, material characteristics and dynamic response of cultural relics through asynchronous spatio‑temporal registration and a physical‑constraint‑driven spatio‑temporal fusion network (ATS‑FusionNet). On this basis, the residual‑driven state deviation index (RSDI) is established to realize the location of abnormal areas and the identification of degradation risks. The experiment is carried out based on the joint verification platform of Changxin Palace Lantern. The results show that the mean absolute errors of temperature prediction, strain prediction, and vibration amplitude prediction in the multi-mode state field reconstruction is 0.31 ℃, 2.7με and 0.012g, respectively. The end-to-end response delay of the system is 43.6ms on average, meeting the requirements of real-time monitoring. The research shows that the proposed method can effectively break through the limitations of insufficient single-mode perception and lack of physical correlation in the traditional cultural relic monitoring and provide a high-precision and real-time digital twin technology path for the intelligent protection and preventive maintenance of complex mobile cultural relics.
References
[1] Zhang, J., Lu, R., Xu, C., & Luo, J. (2026). Exploratory research on smart collection storage based on digital twin: A case study of China grand canal museum. Journal of Cultural Heritage, 80, 253-262. https://doi.org/10.1016/j.culher.2026.05.018
[2] Cao, J., Qu, J., Yang, C., Zhang, R., Du, D., Mai, B., & Zhang, Z. (2026). Research on the Construction of a Monitoring System for Immovable Cultural Heritage Resources Based on a Resilient Organizational Logic: A Case Study of the Hanguang Gate Site in Xi'an. https://www.preprints.org/manuscript/202603.2012
[3] Zhao, T., Chen, G., Suraphee, S., Phoophiwfa, T., & Busababodhin, P. (2025). A hybrid TCN-XGBoost model for agricultural product market price forecasting. PLoS One, 20(5), e0322496. https://doi.org/10.1371/journal.pone.0322496
[4] Ali, A. H., & Thakkar, R. (2023). Climate changes through data science: understanding and mitigating environmental crisis. Mesopotamian Journal of Big Data, 2023, 125-137. https://doi.org/10.58496/MJBD/2023/017
[5] Zhao, T., Chen, G., Pang, C., & Busababodhin, P. (2025). Application and performance optimization of SLHS-TCN-XGBoost model in power demand forecasting. Comput. Model. Eng. Sci, 143(3), 2883-2917. http://dx.doi.org/10.32604/cmes.2025.066442
[6] Crisan, A., Pepe, M., Costantino, D., & Herban, S. (2024). From 3D point cloud to an intelligent model set for cultural heritage conservation. Heritage, 7(3), 1419-1437. https://doi.org/10.3390/heritage7030068
[7] Zhao, T., Chen, G., Pang, C., Seenoi, P., Papukdee, N., & Busababodhin, P. (2025). Time-lapse earthquake difference prediction based on physics-informed long short-term memory coupled with interpretability boosting. Journal of Seismic Exploration, 34(3), 25. https://doi.org/10.36922/JSE025310049
[8] Wu, H., Ji, P., Ma, H., & Xing, L. (2023). A comprehensive review of digital twin from the perspective of total process: Data, models, networks and applications. Sensors, 23(19), 8306. https://doi.org/10.3390/s23198306
[9] Segovia, M., & Garcia-Alfaro, J. (2022). Design, modeling and implementation of digital twins. Sensors, 22(14), 5396. https://doi.org/10.3390/s22145396
[10] Wang, Z., Zhang, Z., Su, T., Ding, Z., & Zhao, T. (2024, December). Research on supply chain network optimisation based on the CNNs-BiLSTM model. In 2024 International Conference on Information Technology, Comunication Ecosystem and Management (ITCEM) (pp. 197-202). IEEE. https://doi.org/10.1109/ITCEM65710.2024.00044
[11] Zhao, T., Chen, G., Pang, C., Seenoi, P., Papukdee, N., Busababodhin, P., & Du, Y. (2025). Hybrid convolutional neural network-graph attention network-gradient boosting decision tree model for seismic impedance inversion prediction. J Seismic Explor, 34(5), 81-98. https://doi.org/10.36922/JSE025310051
[12] Saeed, A., A. Khan, M., Akram, U., J. Obidallah, W., Jawed, S., & Ahmad, A. (2025). Deep learning based approaches for intelligent industrial machinery health management and fault diagnosis in resource-constrained environments. Scientific Reports, 15(1), 1114. https://doi.org/10.1038/s41598-024-79151-2
[13] Zhao, T., Chen, G., Pang, C., Li, L., & Busababodhin, P. (2026). Forecasting global agricultural trade imbalances using a hybrid deep learning and gradient boosting framework. Discover Computing, 29(1), 443. https://doi.org/10.1007/s10791-026-10367-8
[14] Zhong, D., Xia, Z., Zhu, Y., & Duan, J. (2023). Overview of predictive maintenance based on digital twin technology. Heliyon, 9(4). https://doi.org/10.1016/j.heliyon.2023.e14534
[15] Liu, Y., Gong, M., Chen, G., & Zhao, T. (2025, July). CNN-LSTM-based spatio-temporal prediction model for photovoltaic power generation. In Proceedings of the 2025 2nd International Conference on Big Data and Digital Management (pp. 570-575). https://doi.org/10.1145/3768801.3768892
[16] Kushwaha, D., Kumar, A., & Harsha, S. P. (2025). Advancements and applications of digital twin in the railway industry: a literature review. International Journal of Rail Transportation, 13(5), 865-890. https://doi.org/10.1080/23248378.2024.2434834
[17] Xu, Y., Huang, W., Xiao, J., Shan, J., Liu, M., Guo, W., ... & Yan, Y. (2026). A WebGIS-based digital twin platform for intelligent operation and maintenance of rail transit infrastructure. Expert Systems With Applications, 296, 129180. https://doi.org/10.1016/j.eswa.2025.129180
[18] Zhao, T., Chen, G., & Busababodhin, P. (2026). An intelligent expert system for logistics disruption prediction and mitigation in global supply chains: Integrating graph-based risk inference with ensemble forecasting. Scientific Reports. https://doi.org/10.1038/s41598-026-61617-0
[19] Pietroni, E., & Ferdani, D. (2021). Virtual restoration and virtual reconstruction in cultural heritage: Terminology, methodologies, visual representation techniques and cognitive models. Information, 12(4), 167. https://doi.org/10.3390/info12040167
[20] Peng, M., Hu, J., & Zhao, T. (2026, March). Hybrid ARIMA-LSTM model for international trade logistics demand forecasting. In IET Conference Proceedings CP982 (Vol. 2026, No. 9, pp. 243-247). Stevenage, UK: The Institution of Engineering and Technology. https://doi.org/10.1049/icp.2026.2978
[21] Du, Y., Chen, G., Pang, C., & Zhao, T. (2025). Prediction of fracture and vug parameters in carbonate reservoirs using a combined T-GNO-PINN approach. Journal of Seismic Exploration, 35(1), 46. https://doi.org/10.36922/JSE025330057
[22] Li, Q., Zhang, F., Jia, W., & Guo, Y. (2025). Study on the Surface Coating Techniques of Furniture in the Long’en Hall of Qing Changling Mausoleum. Coatings, 15(6), 712. https://doi.org/10.3390/coatings15060712
[23] Zhang, Z., Jia, Z., Wei, J., Xiao, Y., Zhang, R., & Zhao, T. (2025, June). Combining 5G Communication Technology with XGboost Model for Global Gas Trade Flow Prediction. In International Conference on Artificial Intelligence and Communication Technology (pp. 53-64). Cham: Springer Nature Switzerland. https://doi.org/10.1007/978-3-032-06376-2_5
[24] Dölker, E. M., Gröllich, D., Schmauder, M., & Haueisen, J. (2025). Vibration, temperature, and humidity influence the perception of electrocutaneous stimulation for occupational warning. Scientific reports, 15(1), 38471. https://doi.org/10.1038/s41598-025-25166-2
[25] Zhang, Z., Qiu, T., Liao, Z., Liu, H., Wei, C., & Zhao, T. (2025, July). Research on global power equipment trade prediction and logistics optimization based on 5G and edge computing. In International Conference on Optoelectronics and Information Technology (ICOIT 2025) (Vol. 13665, pp. 302-310). SPIE. https://doi.org/10.1117/12.3071144
[26] Wang, A., Chen, G., Pang, C., & Zhao, T. (2025, July). Research on the prediction of telecommunication fraud using BKA-CNN-LSTM model from the perspective of big data. In Proceedings of the 2025 2nd International Conference on Big Data and Digital Management (pp. 576-582). https://doi.org/10.1145/3768801.3768893
[27] Yingxi, B., & Huaping, S. (2026). A Chinese Paradigm for Wartime Cultural Heritage Protection: The Case of the Palace Museum’s Cultural Relics Evacuation. The Historic Environment: Policy & Practice, 17(1), 6-24. https://doi.org/10.1080/17567505.2026.2620982
[28] Gerstenblith, P. (2022). Protecting cultural heritage: The ties between people and places. Cultural heritage and mass atrocities. Getty Publications, Los Angeles, 363-380. https://www.getty.edu/publications/cultural-heritage-mass-atrocities/part-4/
[29] Tian, R., Zhang, J., Zhang, S., Wang, L., Yang, H., Chen, Y., ... & Zhang, L. (2020). A high-precision energy-efficient GPS time-sync method for high-density seismic surveys. Applied Sciences, 10(11), 3768. https://doi.org/10.3390/app10113768
[30] Li, H., Wen, S., Li, S., Cao, X., Geng, X., Wu, S., ... & Liu, S. (2025). Multimodal image fusion to enhance 3D reconstruction based on IKKD-tree registration and CSTDFusion. Infrared Physics & Technology, 106255. https://doi.org/10.1016/j.infrared.2025.106255
[31] Lu, P., Liu, Q., & Guo, J. (2015, November). Camera calibration implementation based on Zhang Zhengyou plane method. In Proceedings of the 2015 Chinese Intelligent Systems Conference: Volume 1 (pp. 29-40). Berlin, Heidelberg: Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-662-48386-2_4
[32] Tian, X., Shen, C., Ma, D., Huang, C., Liu, Y., Liang, L., & Wang, Y. (2023). Temperature-compensated fiber Bragg grating strain sensor based on a two-tap microwave photonic filter. Journal of Lightwave Technology, 42(7), 2532-2537. https://doi.org/10.1109/JLT.2023.3339508
[33] Zhou, R., Yu, J., Dai, Y., Tang, J., Yang, M., & Mumtaz, F. (2026). Multi-Parameter Optimization and Adaptive Temperature Compensation for FBG Strain Sensors in Wide-Temperature-Range Aerospace Applications. IEEE Sensors Journal. https://doi.org/10.1109/JSEN.2026.3657893
[34] Zheng, Q., Wang, H., Zhao, X., Wang, X., Li, M., & Chen, C. (2026). Hybrid deep learning-based automatic identification, localization and quantitative evaluation of internal defects in welds. Journal of Nondestructive Evaluation, 45(2), 73. https://doi.org/10.1007/s10921-026-01368-0
[35] Lin, L., Wu, J., Fu, S., Zhang, S., Tong, C., & Zu, L. (2024). Channel attention & temporal attention based temporal convolutional network: A dual attention framework for remaining useful life prediction of the aircraft engines. Advanced Engineering Informatics, 60, 102372. https://doi.org/10.1016/j.aei.2024.102372
[36] Xing, Y., & Yin, Y. (2026). Incipient Fault Diagnosis in Power Cables Based on WOA-CEEMDAN and a TCN-BiLSTM Network with Multi-Head Attention. Applied Sciences, 16(8), 3908. https://doi.org/10.3390/app16083908
Published
Data Availability Statement
The data that support the findings of this study are available upon request from the corresponding authors, H.W.
Issue
Section
License
Copyright (c) 2026 Xinzi Ma, Huixia Wu (Author)
This work is licensed under a Creative Commons Attribution 4.0 International License.
