AUTHOR=Qiu Xinrui , Xia Juan , Zeng Ye , Huang Guangwen , Xin Bolai , Jiang Runpeng , Wu Kaixuan , Ma Zhe , Li Jun 

TITLE=Research on the multitarget 3D trajectory tracking method of Thalassodes immissaria in the thermal infrared region based on YOLOX-GMM and SORT-Pest

JOURNAL=Frontiers in Plant Science

VOLUME=Volume 15 - 2024

YEAR=2024

URL=https://www.frontiersin.org/journals/plant-science/articles/10.3389/fpls.2024.1403421

DOI=10.3389/fpls.2024.1403421

ISSN=1664-462X

ABSTRACT=Studying the behavioral responses and movement trajectories of insects under different stimuli is crucial for developing more effective biological control measures. Therefore, accurately obtaining the movement trajectories and behavioral parameters of insects in three-dimensional space is essential.. In this paper, the litchi pest Thalassodes immissaria was used as the research object. A special binocular vision observation system was designed for nighttime movement. A thermal infrared camera was used for video recording of T. immissaria in a lightless environment. Moreover, a multiobject tracking method for T. immissaria based on the YOLOX-GMM and SORT-Pest algorithms was proposed for tracking T. immissaria in thermal infrared images. By obtaining the central coordinates of the two T. immissaria in the video, the target matching and 3D trajectory reconstruction of the T. immissaria in the parallel binocular system were achieved. Through error analysis of the T. immissaria detection and tracking model and 3D reconstruction model, the experimental results showed that the average accuracy of T. immissaria detection reached 89.6%, the tracking accuracy reached 96.9%, and the average error of the reconstructed 3D spatial coordinates was 15 mm. This indicates that the method can accurately obtain the 3D trajectory and motion parameters of T. immissaria. And such data can greatly contribute to researchers' comprehensive understanding of insect behavioral patterns and habits, providing important support for more targeted control strategies.