Citation: | YANG Na, WANG Shuo, WANG De-jia. DEFORMATION MONITORING DURING THE GROWTH OF CRACKS IN MURAL WALLS WITH STONE MASONRY MATERIAL OF TIBETAN ANCIENT BUILDINGS BASED ON COMPUTER VISION[J]. Engineering Mechanics, 2025, 42(1): 129-142. DOI: 10.6052/j.issn.1000-4750.2022.10.0898 |
Numerous achievements have been made in the research of conventional fracture detection under a single background, but the study on preventive deformation monitoring of cracks under complex backgrounds in long-term conditions is still at its early stages. Considering that the mural walls of ancient buildings have the characteristics of micro-deformation and non-interference, a non-contact and preventive deformation monitoring system has been established. This system is based on computer vision technology, including traditional image segmentation processing technology, as well as a neural network model for semantic segmentation of crack images. In order to reduce the interference of color-painted murals, environmental lighting, and noise that are unique to cracks in mural walls and effectively separate the cracks from the complex background, traditional threshold segmentation algorithm systems and intelligent semantic segmentation systems are studied. The former system utilizes feature matching of scale-invariant feature transform and the solution of homography matrix to solve the problem of image perspective differences. Meanwhile, by comparing different filtering algorithms, a monitoring algorithm is selected, which combines bilateral filtering and threshold segmentation that is more suitable for mural crack segmentation. The latter system uses multi-layer convolution, sampling and splicing operations to remove redundant features, reconstruct the high-level semantic feature map of cracks, and select multi-step optimization strategy to improve the original U-Net model network architecture, which improves the average accuracy of model to 0.9899. The crack of typical mural walls with stone masonry material of Tibetan ancient buildings has been monitored for 12 days, and relevant characteristic parameters such as crack contours and crack skeleton lines are extracted as key indicators to quantitatively describe the changing information during the crack growth process. The results show that the coefficient of variation (COV) of the two-dimensional feature indicators (such as crack area, density, and width) obtained by the traditional threshold segmentation algorithm system ranges from 4.50% to 6.52%. However, the improved U-Net model reduces the COV of the crack area feature parameter, which has the largest data fluctuation in the traditional threshold segmentation system, from 6.52% to 3.53%, and thus improves the monitoring system's robustness to mural color, lighting, and shadow interference. Both algorithms process 12 images of the same crack image from different perspectives, and the output data is uniformly consistent, with a COV not exceeding 7%. These results demonstrate the technical feasibility of the monitoring system for real-time, non-destructive monitoring of long-term deformation of mural wall cracks.
[1] |
赵林毅. 布达拉宫壁画的保护修复[D]. 兰州: 兰州大学, 2007.
ZHAO Linyi. The conservation and restoration campaign to mural paintings of Potala Palace [D]. Lanzhou: Lanzhou University, 2007. (in Chinese)
|
[2] |
赵林毅, 汪万福, 马赞峰, 等. 西藏罗布林卡壁画病害成因及其防治对策[J]. 中国藏学, 2009(3): 54 − 60.
ZHAO Linyi, WANG Wanfu, MA Zanfeng, et al. The cause of diseases of the murals in Norbulingka and the prevention and cure of them [J]. China Tibetology, 2009(3): 54 − 60. (in Chinese)
|
[3] |
樊再轩, 李最雄, 王旭东, 等. 西藏拉萨布达拉宫空鼓壁画现场灌浆加固试验[J]. 敦煌研究, 2005(4): 35 − 39.
FAN Zaixuan, LI Zuixiong, WANG Xudong, et al. On site grouting test to enforcement of detachment of wall-painting of Potala palace of Tibetan [J]. Dunhuang Research, 2005(4): 35 − 39. (in Chinese)
|
[4] |
李倩. 奉国寺元代壁画裂隙病害成因分析[D]. 西安: 西北大学, 2019.
LI Qian. Analysis on the causes of cracks disease on mural paintings of Yuan Dynasty in Fengguo Temple [D]. Xi’an: Northwest University, 2019. (in Chinese)
|
[5] |
杨娜, 滕东宇. 藏式石砌体在剪-压复合作用下抗剪性能研究[J]. 工程力学, 2020, 37(2): 221 − 229. doi: 10.6052/j.issn.1000-4750.2019.04.0158
YANG Na, TENG Dongyu. Shear performance of Tibetan stone masonry under shear-compression loading [J]. Engineering Mechanics, 2020, 37(2): 221 − 229. (in Chinese) doi: 10.6052/j.issn.1000-4750.2019.04.0158
|
[6] |
TALAB A M A, HUANG Z C, XI F, et al. Detection crack in image using Otsu method and multiple filtering in image processing techniques [J]. Optik, 2016, 127(3): 1030 − 1033. doi: 10.1016/j.ijleo.2015.09.147
|
[7] |
DORAFSHAN S, THOMAS R J, MAGUIRE M. Benchmarking image processing algorithms for unmanned aerial system-assisted crack detection in concrete structures [J]. Infrastructures, 2019, 4(2): 19. doi: 10.3390/infrastructures4020019
|
[8] |
ZHANG C B, CHANG C C, JAMSHIDI M. Concrete bridge surface damage detection using a single‐stage detector [J]. Computer‐Aided Civil and Infrastructure Engineering, 2020, 35(4): 389 − 409. doi: 10.1111/mice.12500
|
[9] |
MIAO Z H, JI X D, OKAZAKI T, et al. Pixel‐level multicategory detection of visible seismic damage of reinforced concrete components [J]. Computer‐Aided Civil and Infrastructure Engineering, 2021, 36(5): 620 − 637. doi: 10.1111/mice.12667
|
[10] |
PAN G, ZHENG Y X, GUO S, et al. Automatic sewer pipe defect semantic segmentation based on improved U-Net [J]. Automation in Construction, 2020, 119: 103383. doi: 10.1016/j.autcon.2020.103383
|
[11] |
单宝华, 申宇. 立体视觉方法在混凝土表面裂缝检测中的应用[J]. 工程力学, 2013, 30(9): 125 − 131. doi: 10.6052/j.issn.1000-4750.2012.05.0331
SHAN Baohua, SHEN Yu. Application of stereovision method to detect concrete surface crack [J]. Engineering Mechanics, 2013, 30(9): 125 − 131. (in Chinese) doi: 10.6052/j.issn.1000-4750.2012.05.0331
|
[12] |
杨娜, 张翀, 李天昊. 基于无人机与计算机视觉的中国古建筑木结构裂缝监测系统设计[J]. 工程力学, 2021, 38(3): 27 − 39. doi: 10.6052/j.issn.1000-4750.2020.04.0263
YANG Na, ZHANG Chong, LI Tianhao. Design of crack monitoring system for Chinese ancient wooden buildings based on UAV and CV [J]. Engineering Mechanics, 2021, 38(3): 27 − 39. (in Chinese) doi: 10.6052/j.issn.1000-4750.2020.04.0263
|
[13] |
张良, 王高峰, 杨锋平, 等. 基于数字图像的裂纹测量系统在X80管线钢全尺寸弯曲试验中的验证[J]. 工程力学, 2022, 39(11): 157 − 165. doi: 10.6052/j.issn.1000-4750.2021.06.0464
ZHANG Liang, WANG Gaofeng, YANG Fengping, et al. Verification of a crack measurement system based on digital images in full-scale bending test of X80 pipeline steel [J]. Engineering Mechanics, 2022, 39(11): 157 − 165. (in Chinese) doi: 10.6052/j.issn.1000-4750.2021.06.0464
|
[14] |
KONG S Y, FAN J S, LIU Y F, et al. Automated crack assessment and quantitative growth monitoring [J]. Computer‐Aided Civil and Infrastructure Engineering, 2021, 36(5): 656 − 674. doi: 10.1111/mice.12626
|
[15] |
YANG K, DING Y L, SUN P, et al. Computer vision-based crack width identification using F-CNN model and pixel nonlinear calibration [J]. Structure and Infrastructure Engineering, 2023, 19(7): 978 − 989. doi: 10.1080/15732479.2021.1994617
|
[16] |
曾庆响, 韩大建. 预应力混凝土箱梁桥的裂缝防治研究现状[J]. 工程力学, 2010, 27(增刊 1): 184 − 188.
ZENG Qingxiang, HAN Dajian. A review of crack prevention in prestressed concrete box girder bridges [J]. Engineering Mechanics, 2010, 27(Suppl 1): 184 − 188. (in Chinese)
|
[17] |
陈斌, 邵旭东, 曹君辉. 正交异性钢桥面疲劳开裂研究[J]. 工程力学, 2012, 29(12): 170 − 174. doi: 10.6052/j.issn.1000-4750.2011.04.0251
CHEN Bin, SHAO Xudong, CAO Junhui. Study of fatigue cracking for orthotropic steel bridge deck [J]. Engineering Mechanics, 2012, 29(12): 170 − 174. (in Chinese) doi: 10.6052/j.issn.1000-4750.2011.04.0251
|
[18] |
刘宇飞, 樊健生, 孔思宇, 等. 多视角几何三维重建法识别工程结构缺损与变形[J]. 工程力学, 2020, 37(9): 103 − 111. doi: 10.6052/j.issn.1000-4750.2019.10.0598
LIU Yufei, FAN Jiansheng, KONG Siyu, et al. Detection of structural defect and deformation based on multi-view geometric three-dimensional reconstruction method [J]. Engineering Mechanics, 2020, 37(9): 103 − 111. (in Chinese) doi: 10.6052/j.issn.1000-4750.2019.10.0598
|
[19] |
杨娜, 汪德佳, 李天昊, 等. 基于计算机视觉方法的古建筑变形监测[J]. 建筑结构学报, 2023, 44(1): 192 − 202. doi: 10.14006/j.jzjgxb.2021.0499
YANG Na, WANG Dejia, LI Tianhao, et al. Deformation monitoring of ancient buildings based on computer vision method [J]. Journal of Building Structures, 2023, 44(1): 192 − 202. (in Chinese) doi: 10.14006/j.jzjgxb.2021.0499
|
[20] |
谢文高, 张怡孝, 刘爱荣, 等. 基于水下机器人与数字图像技术的混凝土结构表面裂缝检测方法[J]. 工程力学, 2022, 39(增刊 1): 64 − 70. doi: 10.6052/j.issn.1000-4750.2021.05.S010
XIE Wengao, ZHANG Yixiao, LIU Airong, et al. Method for concrete surface cracking detection based on ROV and digital image technology [J]. Engineering Mechanics, 2022, 39(Suppl 1): 64 − 70. (in Chinese) doi: 10.6052/j.issn.1000-4750.2021.05.S010
|
[21] |
EBNER M. A parallel algorithm for color constancy [J]. Journal of Parallel and Distributed Computing, 2004, 64(1): 79 − 88. doi: 10.1016/j.jpdc.2003.06.004
|
[22] |
王平让, 黄宏伟, 薛亚东. 隧道衬砌裂缝机器视觉检测系统研制与应用[J]. 公路, 2022, 67(10): 439 − 446.
WANG Pingrang, HUANG Hongwei, XUE Yadong. Research and application of the detection system for tunnel lining crack based on machine vision [J]. Highway, 2022, 67(10): 439 − 446. (in Chinese)
|
[23] |
SUZUKI S, BE K. Topological structural analysis of digitized binary images by border following [J]. Computer Vision, Graphics, and Image Processing, 1985, 30(1): 32 − 46. doi: 10.1016/0734-189X(85)90016-7
|
[24] |
ZHANG T Y, SUEN C Y. A fast parallel algorithm for thinning digital patterns [J]. Communications of the ACM, 1984, 27(3): 236 − 239. doi: 10.1145/357994.358023
|
[25] |
滕东宇. 藏式石砌体静力性能研究[D]. 北京: 北京交通大学, 2019.
TENG Dongyu. Study on static performance of Tibetan-style stone masonry [D]. Beijing: Beijing Jiaotong University, 2019. (in Chinese)
|
[26] |
刘少华, 任宜春, 郑智雄, 等. 基于航拍图像与改进U-Net的建筑外墙裂缝检测方法[J]. 土木与环境工程学报(中英文), 2024, 46(1): 223 − 231. doi: 10.11835/j.issn.2096-6717.2022.145
LIU Shaohua, REN Yichun, ZHENG Zhixiong, et al. Building exterior wall crack detection based on aerial images and improved U-Net [J]. Journal of Civil and Environmental Engineering, 2024, 46(1): 223 − 231. (in Chinese) doi: 10.11835/j.issn.2096-6717.2022.145
|
1. |
杨娜,王烁,迪力达尔·迪力夏提. 古建筑砌体结构裂缝损伤监测和数据挖掘. 工程力学. 2025(03): 18-31 .
![]() |