Continuity-Aware Latent Interframe Information Mining for Reliable UAV Tracking

Abstract

Object tracking is crucial for the autonomous navigation of unmanned aerial vehicles (UAVs) and has broad application in robotic automation fields. However, reliable aerial tracking remains a challenging task due to various difficulties like frequent occlusion and aspect ratio change. Additionally, most of the existing work mainly focus on explicit information to improve tracking performance, ignoring potential connections between frames. To solve the above issues, this work proposes a novel framework with continuityaware latent interframe information mining for reliable UAV tracking, i.e., ClimRT. Specifically, a new efficient continuityaware latent interframe information mining network (ClimNet) is proposed for UAV tracking, which can generate highlyeffective latent frames between two adjacent frames. Besides, a novel location-continuity Transformer (LCT) is designed to fully explore continuity-aware spatial-temporal information, thereby markedly enhancing UAV tracking. Extensive qualitative and quantitative experiments on three authoritative aerial benchmarks have strongly validated the robustness and reliability of ClimRT in UAV Tracking. Furthermore, real-world tests on the typical aerial platform have proven its practicability and effectiveness. The code and demo materials are released at https://github.com/vision4robotics/ClimRT.

Publication
In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), ExCeL London, pp.1327-1333, 2023.

MKCT_workflow Overview of the ClimRT tracker.

Avatar
Changhong Fu
Associate Professor