AUTHOR=Li Yunlong , Yang Baohua , Zhou Shuaijun , Cui Qiang 

TITLE=Identification lodging degree of wheat using point cloud data and convolutional neural network

JOURNAL=Frontiers in Plant Science

VOLUME=Volume 13 - 2022

YEAR=2022

URL=https://www.frontiersin.org/journals/plant-science/articles/10.3389/fpls.2022.968479

DOI=10.3389/fpls.2022.968479

ISSN=1664-462X

ABSTRACT=Lodging is one of the destructive disasters during the growing period of wheat, which not only affects the quality of wheat grains, but also causes severe yield reduction. Assessing the degree of wheat lodging is of great significance for yield estimation, wheat harvesting and agricultural insurance claims. In particular, point cloud data extracted from unmanned aerial vehicle (UAV) images have provided technical support for accurately assessing the degree of wheat lodging. However, it is difficult to process point cloud data due to the cluttered distribution, which limits the wide application of point cloud data. Therefore, a classification method of wheat lodging degree based on point cloud data dimensionality reduction image was proposed. Firstly, 2D images were obtained from the 3D point cloud data obtained from the UAV images of wheat field, which were generated by dimensionality reduction based on Hotelling transform and point cloud interpolation method. Then three convolutional neural network models were used to realize the classification of different lodging degrees of wheat, including AlexNet, VGG16, and MobileNetV2. Finally, the self-built wheat lodging dataset was used to evaluate the classification model, aiming to improve the universality and scalability of the lodging discrimination method. The results showed that based on MobileNetV2, the point cloud dimensionality reduction image obtained by the method proposed in this paper has achieved good results in identifying the lodging degree of wheat. The F1-Score of the classification model was 96.7% for filling, and 94.6% for maturity. In conclusion, the point cloud dimensionality reduction method proposed in this study could meet the accurate identification of wheat lodging degree at the field scale.