Quantitative identification of surface defects in wood paneling based on improved YOLOv5

Jia Haonan; Xu Huadong; Wang Lihai; Zhang Jinsheng; Chu Xiaohui; Tang Xu

doi:10.12171/j.1000-1522.20220419

Journal of Beijing Forestry University > 2023 > 45(4): 147-155. > DOI: 10.12171/j.1000-1522.20220419

Jia Haonan, Xu Huadong, Wang Lihai, Zhang Jinsheng, Chu Xiaohui, Tang Xu. Quantitative identification of surface defects in wood paneling based on improved YOLOv5[J]. Journal of Beijing Forestry University, 2023, 45(4): 147-155. DOI: 10.12171/j.1000-1522.20220419

Citation:

PDF (3507 KB)

Quantitative identification of surface defects in wood paneling based on improved YOLOv5

College of Mechanical and Electrical Engineering, Northeast Forestry University, Harbin 150040, Heilongjiang, China

More Information

Received Date: October 19, 2022
Revised Date: March 15, 2023
Accepted Date: March 18, 2023
Available Online: March 20, 2023
Published Date: April 24, 2023

Graphical Abstract

Abstract

Abstract

Objective This paper aims to solve the problems of poor recognition and low efficiency of surface defects of wood panel lumber by manual and traditional digital image processing methods, and to improve the utilization rate of wood. Based on the deep learning model, we constructed a wood panel surface defect detection system, aiming to expand the application of deep learning model in the field of wood panel defect detection.
Method Based on 839 wood panel defect images in the public dataset “Wood Defect Database”, the dataset was expanded using Imgaug data enhancement library; by introducing SE attention mechanism in the backbone feature network part, the YOLOv5 wood panel surface defect target detection framework was constructed using focus, FPN + PAN structure, and then the transfer learning idea to improve the training method and divide the training process into two phases (freezing phase and unfreezing phase). Then the constructed model was compared with the current mainstream deep learning target detection models, and finally the model was evaluated using confusion matrix, loss value change curve, model size, detection time, and mean average accuracy.
Result A detection method based on YOLOv5 model for live knots, dead knots, cracks and holes in wood panel surface defects was proposed. The mean average accuracy of the model for dead knots, live knots, cracks, and hole identification results were about 98.66%, 99.06%, 98.10% and 96.53, respectively, and compared with the current mainstream detection models, the improved model had better accuracy, recall, and mean average accuracy of 97.48%, 96.53% and 98.22%, respectively. The average detection time of the model for a single image was 10.3 ms, and the maximum detection time was 20.5 ms. The detection effect and generalization characteristics were good, and the model only occupied 13.7 MB of memory, making it easy to transplant.
Conclusion The experiments indicate that the improved YOLOv5 model can be used to detect the main defects on the surface of wood paneling. The model is better than the other five mainstream inspection models in identifying surface defects. On the basis of maintaining the original detection accuracy, it improves the recognition of small target defects, reduces the situation of missing wood panel defects, and realizes fast detection in complex scenes.
- wood plate,
- surface defect,
- YOLOv5,
- real-time detection,
- deep learning,
- quantitative identification

FullText(HTML)

References (22)

References

[1]	谢永华. 数字图像处理技术在木材表面缺陷检测中的应用研究[D]. 哈尔滨: 东北林业大学, 2013. Xie Y H. The application and research of digital image processing on wood surface texture inspection[D]. Harbin: Northeast Forestry University, 2013.
[2]	Akhyar F, Novamizanti L, Putra T, et al. Lightning YOLOv4 for a surface defect detection system for sawn lumber[C]//Jay K C C, Klara N, Yong R, et al. IEEE 5th International Conference on Multimedia Information Processing and Retrieval (MIPR). New York: IEEE, 2022: 184−189.
[3]	肖雨晴, 杨慧敏, 王柯欣, 等. 卷积神经网络在木材缺陷检测应用中的研究进展[J]. 木材科学与技术, 2021, 35(3): 12−18. doi: 10.12326/j.2096-9694.2020088 Xiao Y Q, Yang H M, Wang K X, et al. Research progress of convolutional neural network in wood defect detection[J]. Wood Science and Technology, 2021, 35(3): 12−18. doi: 10.12326/j.2096-9694.2020088
[4]	Xia B, Luo H, Shi S. Improved faster R-CNN based surface defect detection algorithm for plates[J]. Computational Intelligence and Neuroscience, 2022, 2022: 11−22.
[5]	Mu H, Zhang M, Qi D, et al. Wood defects recognition based on fuzzy bp neural network[J]. International Journal of Smart Home, 2015, 9: 143−152.
[6]	Yang Y, Zhou X, Liu Y, et al. Wood defect detection based on depth extreme learning machine[J]. Applied Sciences, 2020, 10(21): 7488. doi: 10.3390/app10217488
[7]	Mu H, Zhang M, Qi D, et al. The application of RBF neural network in the wood defect detection[J]. International Journal of Hybrid Information Technology, 2015, 8(2): 41−50. doi: 10.14257/ijhit.2015.8.2.04
[8]	李超, 刘思佳, 曹军, 等. 基于PSO优选特征的实木板材缺陷的压缩感知分选方法[J]. 北京林业大学学报, 2015, 37(7): 117−122. Li C, Liu S J, Cao J, et al. The method of wood defectrecognition based on PSO feature selection and compressed sensing[J]. Journal of Beijing Forestry University, 2015, 37(7): 117−122.
[9]	Chen L C, Pardeshi M S, Lo W T, et al. Edge-glued wooden panel defect detection using deep learning[J]. Wood Science and Technology, 2022, 56(2): 477−507. doi: 10.1007/s00226-021-01316-3
[10]	缪伟志, 陆兆纳, 王俊龙, 等. 基于视觉的火灾检测研究[J]. 森林工程, 2022, 38(1): 86−92. doi: 10.3969/j.issn.1006-8023.2022.01.011 Miao W Z, Lu Z N, Wang J L, et al. Fire detection research based on vision[J]. Forest Engineering, 2022, 38(1): 86−92. doi: 10.3969/j.issn.1006-8023.2022.01.011
[11]	高明宇, 倪海明, 张博洋, 等. 一种基于GoogLeNet卷积神经网络的木节缺陷识别方法[J]. 森林工程, 2021, 37(4): 66−70. doi: 10.3969/j.issn.1006-8023.2021.04.009 Gao M Y, Ni H M, Zhang B Y, et al. A method for recognizing wood knots defects based on GoogLeNet convolutional neural network[J]. Forest Engineering, 2021, 37(4): 66−70. doi: 10.3969/j.issn.1006-8023.2021.04.009
[12]	He T, Liu Y, Yu Y, et al. Application of deep convolutional neural network on feature extraction and detection of wood defects[J]. Measurement, 2020, 152: 107357. doi: 10.1016/j.measurement.2019.107357
[13]	Urbonas A, Raudonis V, Maskeliūnas R, et al. Automated identification of wood veneer surface defects using faster region-based convolutional neural network with data augmentation and transfer learning[J]. Applied Sciences, 2019, 9(22): 4898. doi: 10.3390/app9224898
[14]	Shi J, Li Z, Zhu T, et al. Defect detection of industry wood veneer based on NAS and multi-channel mask R-CNN[J]. Sensors, 2020, 20(16): 4398. doi: 10.3390/s20164398
[15]	Sun P A. Wood quality defect detection based on deep learning and multicriteria framework[J]. Mathematical Problems in Engineering, 2022, 2022: 9−16.
[16]	Wang L, Yan W Q. Tree leaves detection based on deep learning[C]//Minh N, Wei Q Y, Harvey H. International Symposium on Geometry and Vision. Auckland: Auckland University of Technology (AUT), 2021: 26−38.
[17]	赵睿, 刘辉, 刘沛霖, 等. 基于改进YOLOv5s的安全帽检测算法[J/OL]. 北京航空航天大学学报, 2023[2023−01−12]. https://doi.org/10.13700/j.bh.1001-5965.2021.0595. Zhao R, Liu H, Liu P L, et al. Research on safety helmet detection algorithm based on improved YOLOv5s[J/OL]. Journal of Beijing University of Aeronautics and Astronautics, 2023[2023−01−12]. https://doi.org/10.13700/j.bh.1001-5965.2021.0595.
[18]	李彦甫, 范习健, 杨绪兵, 等. 基于自注意力卷积网络的遥感图像分类[J]. 北京林业大学学报, 2021, 43(10): 81−88. doi: 10.12171/j.1000-1522.20210196 Li Y F, Fan X J, Yang X B, et al. Remote sensing image classification framework based on self-attention convolutional neural network[J]. Journal of Beijing Forestry University, 2021, 43(10): 81−88. doi: 10.12171/j.1000-1522.20210196
[19]	邹梓吟, 盖绍彦, 达飞鹏, 等. 基于注意力机制的遮挡行人检测算法[J]. 光学学报, 2021, 41(15): 157−165. Zou Z Y, Gai S Y, Da F P, et al. Occluded pedestrian detection algorithm basedon attention mechanism[J]. Acta Optica Sinica, 2021, 41(15): 157−165.
[20]	Gao M, Wang F, Liu J, et al. Estimation of the convolutional neural network with attention mechanism and transfer learning on wood knot defect classification[J]. Journal of Applied Physics, 2022, 131(23): 233101. doi: 10.1063/5.0087060
[21]	Du J. Understanding of object detection based on CNN family and YOLO[J] . Journal of Physics Conference, 2018, 1004: 012029.
[22]	Gao M, Song P, Wang F, et al. A novel deep convolutional neural network based on ResNet-18 and transfer learning for detection of wood knot defects[J]. Journal of Sensors, 2021, 2021: 16−27.

[1]	Zhang Minghui, Yin Yunzhou, Wang Ke, Wang Shuli. Effects of spatial structure characteristics of Fraxinus mandshurica plantation on soil nutrient content[J]. Journal of Beijing Forestry University, 2023, 45(9): 73-82. DOI: 10.12171/j.1000-1522.20220476
[2]	Hui Gangying, Zhao Zhonghua, Hu Yanbo, Zhang Ganggang, Zhang Gongqiao, Cheng Shiping, Lu Yanlei. Research on the measurement method of forest spatial structure diversity based on 4 neighborhood tree relationship[J]. Journal of Beijing Forestry University, 2023, 45(7): 18-26. DOI: 10.12171/j.1000-1522.20220282
[3]	Wang Lina, Wu Junwen, Dong Qiong, Shi Zhuogong, Hu Haocheng, Wu Danzi, Li Luping. Effects of tending and thinning on non-structural carbon and stoichiometric characteristics of Pinus yunnanensis[J]. Journal of Beijing Forestry University, 2021, 43(8): 70-82. DOI: 10.12171/j.1000-1522.20210115
[4]	Hu Xuefan, Zhang Huiru, Zhou Chaofan, Zhang Xiaohong. Effects of different thinning patterns on the spatial structure of Quercus mongolica secondary forests[J]. Journal of Beijing Forestry University, 2019, 41(5): 137-147. DOI: 10.13332/j.1000-1522.20190037
[5]	LI Jian, PENG Peng, HE Huai-jiang, TAN Ling-zhao, ZHANG Xin-na, WU Xiang-ju, LIU Zhao-gang. Effects of thinning intensity on spatial structure of multi-species temperate forest at Jiaohe in Jilin Province, northeastern China[J]. Journal of Beijing Forestry University, 2017, 39(9): 48-57. DOI: 10.13332/j.1000-1522.20170220
[6]	LI Ji-ping, FENG Yao, ZHAO Chun-yan, ZHANG Cai-cai. Quantitative analysis of stand spatial structure of Cunninghamia lanceolata non-commercial forest based on Voronoi diagram.[J]. Journal of Beijing Forestry University, 2014, 36(4): 1-7. DOI: 10.13332/j.cnki.jbfu.2014.04.005
[7]	WANG Ping, JIA Li-ming, WEI Song-po, WANG Qi-feng. Analysis of stand spatial structure of Platycladus orientalis recreational forest based on Voronoi diagram method[J]. Journal of Beijing Forestry University, 2013, 35(2): 39-44.
[8]	DONG Ling-bo, LIU Zhao-gang, MA Yan, NI Bao-long, LI Yuan. A new composite index of stand spatial structure for natural forest.[J]. Journal of Beijing Forestry University, 2013, 35(1): 16-22.
[9]	DUAN Chang-sheng, WANG Jun-hui, MA Jian-wei, YUAN Shi-yun, DU Yan-chang. Evaluation of Quercus aliena var. acuteserrata forest at the western segment of Qinling Mountain，northwestern China[J]. Journal of Beijing Forestry University, 2009, 31(5): 61-66.
[10]	LIU Yan, YU Xin-xiao, YUE Yong-jie, GAN Jing, WANG Xiao-ping, LI Jin-hai. Spatial structure of Robinia pseudoacacia plantation in Miyun Reservoir Watershed of Beijing.[J]. Journal of Beijing Forestry University, 2009, 31(5): 25-28.

Cited By

Cited by

Periodical cited type(8)

1.	张慧，燕怡帆，朱雅，陈玉婷，王菁华，崔志鹏，杨迪，任学敏. 林分密度对伏牛山南麓山茱萸人工林林下草本植物多样性和土壤性质的影响. 西南林业大学学报(自然科学). 2025(01): 96-105 .
2.	赵金同，马俊. 刺槐扦插育苗技术与精细抚育要点. 现代园艺. 2024(08): 49-51 .
3.	何欢，康必均，尹婧，李菲，彭栋，李桂静，查同刚. 不同营林措施对川东华蓥山杉木林土壤团聚体稳定性及细根分布的影响. 土壤通报. 2024(02): 351-359 .
4.	史小鹏，苟贺然，何淑勤，刘柏廷，冉兰芳，杨琪琳，扎西拉姆，陈雨馨，骆紫藤. 成都市温江区两种绿地土壤抗蚀抗冲性及其影响因素. 水土保持通报. 2024(04): 117-125 .
5.	刘忆南，申振宏，都都，张知然，林勇明. 蒋家沟泥石流堆积扇不同植被类型区土壤抗蚀性评价. 应用与环境生物学报. 2024(05): 886-893 .
6.	王依瑞，王彦辉，段文标，李平平，于澎涛，甄理，李志鑫，尚会军. 黄土高原刺槐人工林郁闭度对林下植物多样性特征的影响. 应用生态学报. 2023(02): 305-314 .
7.	赵云鹤，钟鹏，高晗，付玉. 土地利用类型对典型黑土团聚体稳定性和抗蚀性的影响. 东北林业大学学报. 2023(09): 112-119 .
8.	胡亚伟，施政乐，刘畅，徐勤涛，张建军. 晋西黄土区刺槐林密度对林下植物多样性及土壤理化性质的影响. 生态学杂志. 2023(09): 2072-2080 .

Other cited types(9)

Get Citation

PDF

XML

Article views (1309) PDF downloads (175) Cited by(17)

Turn off MathJax

Article Contents

Abstract

References

Quantitative identification of surface defects in wood paneling based on improved YOLOv5