Height extraction method of multiple standing trees based on monocular vision of smart phones

Chen Xiangwu; Xu Aijun

doi:10.12171/j.1000-1522.20190345

Journal of Beijing Forestry University > 2020 > 42(8): 43-52. > DOI: 10.12171/j.1000-1522.20190345

Chen Xiangwu, Xu Aijun. Height extraction method of multiple standing trees based on monocular vision of smart phones[J]. Journal of Beijing Forestry University, 2020, 42(8): 43-52. DOI: 10.12171/j.1000-1522.20190345

Citation:

PDF (1100 KB)

Height extraction method of multiple standing trees based on monocular vision of smart phones

Chen Xiangwu^{1, 2, 3,},
Xu Aijun^{1, 2, 3, ,}

1.
School of Information Engineering, Zhejiang A&F University, Hangzhou 311300, Zhejiang, China
2.
Zhejiang Provincial Key Laboratory of Forestry Intelligent Monitoring and Information Technology,Zhejiang A&F University, Hangzhou 311300, Zhejiang, China
3.
Key Laboratory of State Forestry and Grassland Administration on Forestry Sensing Technologyand Intelligent Equipment, Hangzhou 311300, Zhejiang, China

More Information

Received Date: August 29, 2019
Revised Date: December 02, 2019
Available Online: July 20, 2020
Published Date: September 06, 2020

Graphical Abstract

Abstract

Abstract

Objective This paper aims to propose a method for extracting height of multiple standing trees based on monocular vision of smart phones.
Method First of all, with smart phone as the acquisition device, this method segmented and located the input images of standing trees by Graph Cut algorithm, so as to realize the automatic outline acquisition of multiple standing trees in a single image. Then, the camera was calibrated by the camera of smart phones to acquire the depth of camera image of smart phones based on the geometry analogue method. Next, targets were taken from different angles to optimize the accuracy of depth extraction model and further determine the optimal orientation of information extraction. Meanwhile, combined with high-precision gyroscope, the depression angle of camera can be acquired, and the height measurement of multiple standing trees under non-contact condition can be realized according to the extracted depth information and depression angle of camera.
Result In this method, the height measurement model of standing trees had good stability with smart phone MI 2S as the experimental equipment. Moreover, the maximum relative error was 2.45% and the accuracy of tree height measurement can reach 97.55%.
Conclusion The height extraction method of multiple standing trees based on monocular vision of smart phones has the characteristics of high accuracy and easy operation, which can effectively meet the accuracy requirements of tree height measurement in national forest resource survey II.
- monocular vision,
- multiple standing tree,
- depth extraction,
- height measurement

FullText(HTML)

References (32)

References

[1]	罗朝沁, 林辉, 孙华, 等. 基于MODIS影像大尺度森林资源信息提取方法研究[J]. 中南林业科技大学学报, 2015, 35(11):21−26, 42. Luo C Q, Lin H, Sun H, et al. Based on MODIS image large-scale forest resources information extraction method[J]. Journal of Central South University of Forestry & Technology, 2015, 35(11): 21−26, 42.
[2]	He J S. Carbon cycling of Chinese forests: from carbon storage, dynamics to models[J]. Science China Life Sciences, 2012, 55(2): 188−190. doi: 10.1007/s11427-012-4285-z
[3]	Sellers P J, Mintz Y, Sud Y C, et al. A simple biosphere model (SIB) for use within general-circulation models[J]. Journal of the Atmospheric Sciences, 1986, 43(6): 505−531. doi: 10.1175/1520-0469(1986)043<0505:ASBMFU>2.0.CO;2
[4]	Hauglin M, Hansen E H, Næsset E, et al. Accurate single-tree positions from a harvester: a test of two global satellite-based positioning systems[J]. Scandinavian Journal of Forest Research, 2017, 32(8): 774−781. doi: 10.1080/02827581.2017.1296967
[5]	Olivier M D, Robert S, Fournier R A. A method to quantify canopy changes using multi-temporal terrestrial lidar data: tree response to surrounding gaps[J]. Agricultural and Forest Meteorology, 2017, 237−238: 184−195. doi: 10.1016/j.agrformet.2017.02.016
[6]	Ahmed O S, Shemrock A, Chabot D, et al. Hierarchical land cover and vegetation classification using multispectral data acquired from an unmanned aerial vehicle[J]. International Journal of Remote Sensing, 2017, 38(8/10): 2037−2052.
[7]	王佳, 张隆裕, 吕春东, 等. 基于地面激光雷达点云数据的树种识别方法[J]. 农业机械学报, 2018, 49(11):180−188. doi: 10.6041/j.issn.1000-1298.2018.11.021 Wang J, Zhang L Y, Lü C D, et al. Tree species identification methods based on point cloud data using ground-based LiDAR[J]. Transactions of the Chinese Society for Agricultural Machinery, 2018, 49(11): 180−188. doi: 10.6041/j.issn.1000-1298.2018.11.021
[8]	张雄清, 张建国, 段爱国. 基于贝叶斯法估计杉木人工林树高生长模型[J]. 林业科学, 2014, 50(3):69−75. Zhang X Q, Zhang J G, Duan A G. Tree-height growth model for Chinese fir plantation based on bayesian method[J]. Scientia Silvae Sinicae, 2014, 50(3): 69−75.
[9]	刘鲁霞, 庞勇, 李增元. 基于地基激光雷达的亚热带森林单木胸径与树高提取[J]. 林业科学, 2016, 52(2):26−37. Liu L X, Pang Y, Li Z Y. Individual tree DBH and height estimation using terrestrial laser scanning (TLS) in a subtropical forest[J]. Scientia Silvae Sinica, 2016, 52(2): 26−37.
[10]	Persson H J, Fransson J E S. Comparison between TanDEM-X- and ALS-based estimation of aboveground biomass and tree height in boreal forests[J]. Scandinavian Journal of Forest Research, 2017, 32(4): 306−319. doi: 10.1080/02827581.2016.1220618
[11]	沈鹏, 汪长城, 朱建军, 等. 融合升降轨的极化干涉SAR三层模型植被高度反演方法[J]. 测绘学报, 2017, 46(11):1868−1879. doi: 10.11947/j.AGCS.2017.20170122 Shen P, Wang C C, Zhu J J, et al. Vegetation height inversion method with three-layer model by fusing the ascending and descending PolInSAR data[J]. Acta Geochimica Sinica, 2017, 46(11): 1868−1879. doi: 10.11947/j.AGCS.2017.20170122
[12]	冯仲科, 黄晓东, 刘芳. 森林调查装备与信息化技术发展分析[J]. 农业机械学报, 2015, 46(9):257−265. doi: 10.6041/j.issn.1000-1298.2015.09.038 Feng Z K, Huang X D, Liu F. Forest survey equipment and development of information technology[J]. Transactions of the Chinese Society for Agricultural Machinery, 2015, 46(9): 257−265. doi: 10.6041/j.issn.1000-1298.2015.09.038
[13]	Thamrin N M, Arshad N H M, Adnan R, et al. Enhanced technique for cylindrical object diameter measurement via low-cost and innovated rotational non-intrusive sensor[C]// IEEE 10th International Colloquium on Signal Processing and its Applications (CSPA). Kuala Lumpur: IEEE, 2014.
[14]	瞿帅, 张晓丽, 朱程浩, 等. 机载激光雷达森林资源调查系统的设计与试验[J]. 西北林学院学报, 2018, 33(4):175−182. doi: 10.3969/j.issn.1001-7461.2018.04.29 Qu S, Zhang X L, Zhu C H, et al. Design and test of airborne LiDAR system for forest resources survey[J]. Journal of Northwest Forestry University, 2018, 33(4): 175−182. doi: 10.3969/j.issn.1001-7461.2018.04.29
[15]	Corona P, Fattorini L, Franceschi S, et al. Estimation of standing wood volume in forest compartments by exploiting airborne laser scanning information: model-based, design-based, and hybrid perspectives[J]. Canadian Journal of Forest Research, 2014, 44(11): 1303−1311. doi: 10.1139/cjfr-2014-0203
[16]	Tomppo E, Kuusinen N, Mäkisara K, et al. Effects of field plot configurations on the uncertainties of ALS-assisted forest resource estimates[J]. Scandinavian Journal of Forest Research, 2016, 32(6): 488−500.
[17]	王宁宁, 尹文广, 黄秦军, 等. 三维扫描技术在获取杨树树冠结构特征参数上的应用[J]. 林业科学, 2015, 51(5):108−116. Wang N N, Yin W G, Huang Q J, et al. Application of 3D scanner technology to analysis the crown architecture parameters of poplar plantations[J]. Scientia Silvae Sinicae, 2015, 51(5): 108−116.
[18]	Díaz-Varela R A, De La Rosa R, León L, et al. High-resolution airborne UAV imagery to assess olive tree crown parameters using 3D photo reconstruction: application in breeding trials[J]. Remote Sensing, 2015, 7(4): 4213−4232. doi: 10.3390/rs70404213
[19]	邓向瑞, 冯仲科, 马钦彦, 等. 三维激光扫描系统在立木材积测定中的应用[J]. 北京林业大学学报, 2007(增刊2): 74−77. Deng X R, Feng Z K, Ma Q Y, et al. Application of 3D laser scanning system in mensurating standing volume[J]. Journal of Beijing Forestry University, 2007(Suppl.2): 74−77.
[20]	郭彩玲, 宗泽, 张雪, 等. 基于三维点云数据的苹果树冠层几何参数获取[J]. 农业工程学报, 2017, 33(3):175−181. doi: 10.11975/j.issn.1002-6819.2017.03.024 Guo C L, Zong Z, Zhang X, et al. Apple tree canopy geometric parameters acquirement based on 3D point clouds[J]. Transactions of the Chinese Society of Agricultural Engineering, 2017, 33(3): 175−181. doi: 10.11975/j.issn.1002-6819.2017.03.024
[21]	Zarco-Tejada P J, Diaz-Varela R, Angileri V, et al. Tree height quantification using very high resolution imagery acquired from an unmanned aerial vehicle (UAV) and automatic 3D photo-reconstruction methods[J]. European Journal of Agronomy, 2014, 55: 89−99. doi: 10.1016/j.eja.2014.01.004
[22]	张晓莉, 赵鹏祥, 高凌寒, 等. 基于ArboLiDAR的林分自动分割研究与应用[J]. 中南林业科技大学学报, 2017, 37(11):76−83. Zhang X L, Zhao P X, Gao L H, et al. Research and application of stand automatic segmentation based on ArboLiDAR[J]. Journal of Central South University of Forestry & Technology, 2017, 37(11): 76−83.
[23]	Panagiotidis D, Abdollahnejad A, Surový P, et al. Determining tree height and crown diameter from high-resolution UAV imagery[J]. International Journal of Remote Sensing, 2017, 38(8/10): 2392−2410.
[24]	Holzmann C, Hochgatterer M. Measuring distance with mobile phones using single-camera stereo vision[C]// 32nd International Conference on Distributed Computing Systems Workshops. Macau: IEEE, 2012: 88−93.
[25]	Chen S W, Fang X Y, Shen J B, et al. Single-image distance measurement by a smart mobile device[J]. IEEE Transactions on Cybernetics, 2016, 47(12): 4451−4462.
[26]	周克瑜, 汪云珍, 李记, 等. 基于Android平台的测树系统研究与实现[J]. 南京林业大学学报(自然科学版), 2016, 40(4):95−100. Zhou K Y, Wang Y Z, Li J, et al. A study of tree measurement systems based on Android platform[J]. Journal of Nanjing Forestry University (National Sciences Edition), 2016, 40(4): 95−100.
[27]	Han D Y, Wang C D. Tree height measurement based on image processing embedded in smart mobile phone[C]// International Conference on Multimedia Technology. Hangzhou: IEEE, 2011.
[28]	邱梓轩, 冯仲科, 蒋君志伟, 等. 森林智能测绘记算器设计与试验[J]. 农业机械学报, 2017, 48(5):179−187. doi: 10.6041/j.issn.1000-1298.2017.05.022 Qiu Z X, Feng Z K, Jiang J Z W, et al. Design and experiment of forest intelligent surveying and mapping instrument[J]. Transactions of the Chinese Society for Agricultural Machinery, 2017, 48(5): 179−187. doi: 10.6041/j.issn.1000-1298.2017.05.022
[29]	徐伟恒, 冯仲科, 苏志芳, 等. 手持式数字化多功能电子测树枪的研制与试验[J]. 农业工程学报, 2013, 29(3):90−99. Xu W H, Feng Z K, Su Z F, et al. Development and experiment of handheld digitalized and multi-functional forest measurement gun[J]. Transactions of the Chinese Society for Agricultural Engineering, 2013, 29(3): 90−99.
[30]	王佳, 杨慧乔, 冯仲科, 等. 利用轻小型飞机遥感数据建立人工林特征参数模型[J]. 农业工程学报, 2013, 29(8):164−170. Wang J, Yang H Q, Feng Z K, et al. Model of characteristic parameter for forest plantation with data obtained by light small aerial remote sensing system[J]. Transactions of the Chinese Society of Agricultural Engineering, 2013, 29(8): 164−170.
[31]	管昉立, 徐爱俊. 基于智能手机与机器视觉技术的立木胸径测量方法[J]. 浙江农林大学学报, 2018, 35(5):892−899. doi: 10.11833/j.issn.2095-0756.2018.05.014 Guan F L, Xu A J. Tree DBH measurement method based on smartphone and machine vision technology[J]. Journal of Zhejiang A&F University, 2018, 35(5): 892−899. doi: 10.11833/j.issn.2095-0756.2018.05.014
[32]	杨婷婷, 管昉立, 徐爱俊. 基于Graph Cut算法的多株立木轮廓提取方法[J]. 南京林业大学学报(自然科学版), 2018, 42(6):91−98. Yang T T, Guan F L, Xu A J. Multiple trees contour extraction method based on Graph Cut algorithm[J]. Journal of Nanjing Forestry University (Natural Science Edition), 2018, 42(6): 91−98.

[1]	Wu Zihan, Ji Jiachen, Zhang Fan. Optimization and attribution analysis of annual runoff simulation models in the upper reaches of the Heihe River, northwestern China[J]. Journal of Beijing Forestry University, 2024, 46(3): 80-90. DOI: 10.12171/j.1000-1522.20230212
[2]	Fan Lin, Wei Tianxing, Zhang Xiaoming, Miao Jindian, Li Yiran. Spatiotemporal variation of land use in counties of the upper reaches of the Beiluo River and its impact on runoff and sediment[J]. Journal of Beijing Forestry University, 2024, 46(2): 95-104. DOI: 10.12171/j.1000-1522.20230121
[3]	Gao Mengyao, Li Chi. Law and mechanism of spatio-temporal evolution of urban greenspace in the lower reaches of the Yellow River[J]. Journal of Beijing Forestry University, 2023, 45(3): 113-126. DOI: 10.12171/j.1000-1522.20220129
[4]	Bi Zaoying, Li Yanzhong, Lin Yixue, Bu Tianhui, Huang Rong. Quantitative assessment on the effects of vegetation changes on runoff based on Budyko theory in the Kuyehe River Basin of northern China[J]. Journal of Beijing Forestry University, 2020, 42(8): 61-71. DOI: 10.12171/j.1000-1522.20190330
[5]	ZHANG Shou-hong, LIU Su-xia, MO Xing-guo, SHU Chang, ZHENG Chao-lei, HOU Bo. Impacts of precipitation variation and soil and water conservation measures on runoff and sediment yield in the Wuding River Basin，middle reaches of the Yellow River.[J]. Journal of Beijing Forestry University, 2010, 32(4): 161-168.
[6]	XIN Zhong-bao, YU Xin-xiao, GAN Jing, WANG Xiao-ping, LI Jin-hai. Vegetation restoration and its effects on runoff and sediment yield in Hekouzhen Longmen Section of the middle reaches of Yellow River[J]. Journal of Beijing Forestry University, 2009, 31(5): 1-8.
[7]	LI Zi-jun, LI Xiu-bin. Trend and causation analysis of runoff variation in the upper reach of Chaobaihe River Basin in northern China during 1961--2005[J]. Journal of Beijing Forestry University, 2008, 30(supp.2): 82-87.
[8]	SUN Ning, LI Xiu-bin, LI Zi-jun, YU Xin-xiao. Simulation of impacts of changes in land use and cover on annual streamflow in the upper reach of Chaohe River Basin.[J]. Journal of Beijing Forestry University, 2008, 30(supp.2): 22-30.
[9]	LI Zi-jun, LI Xiu-bin, YU Xin-xiao. Impacts of soil and water conservation measures on annual runoff in the upper Chaohe River Basin in northern China based on hydrological analysis method[J]. Journal of Beijing Forestry University, 2008, 30(supp.2): 6-11.
[10]	HU Jian-zhong. Carbon storage of artificial forests in rehabilitated lands in the upper reaches of the Yellow River[J]. Journal of Beijing Forestry University, 2005, 27(6): 1-8.

Cited By

Cited by

Periodical cited type(3)

1.	郭英男，刘月扬，马静雨，张敬，马鑫彤，张馨月，刘建雨，姚娜，刘秀明，李海燕. 红花PAL家族全基因组分析及其在悬浮细胞中的表达. 中草药. 2021(11): 3362-3372 .
2.	王万奇，齐婉竹，赵秋爽，曾栋，刘轶，付鹏跃，曲冠证，赵曦阳. 白桦BpJMJ18基因启动子克隆及表达分析. 植物研究. 2020(05): 751-759 .
3.	张勇，胡晓晴，李豆，刘雪梅. 白桦BpSPL8启动子的克隆及异源过表达BpSPL8对拟南芥耐旱性的影响. 北京林业大学学报. 2019(08): 67-75 . 本站查看

Other cited types(5)

Get Citation

PDF

XML

Article views (2783) PDF downloads (74) Cited by(8)

Turn off MathJax

Article Contents

Abstract

References

Height extraction method of multiple standing trees based on monocular vision of smart phones