Design and implementation of unmanned aerial vehicle localization
and light tracking system

doi:10.19682/j.cnki.1005-8885.2023.2017

中国邮电高校学报(英文) ›› 2023, Vol. 30 ›› Issue (4): 67-74.doi: 10.19682/j.cnki.1005-8885.2023.2017

Design and implementation of unmanned aerial vehicle localization and light tracking system

Xu Ming, Dong Chen, Li Hanlu, Luo Qiming, Wang Lizi, Zhang Wanru, Liu Huixin

1. School of Digital Media and Design Arts, Beijing University of Posts and Telecommunications, Beijing 100876, China 2. School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China 3. State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing 100876, China 4. School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing 100876, China

收稿日期:2023-02-17 修回日期:2023-06-23 接受日期:2023-08-31 出版日期:2023-08-31 发布日期:2023-08-31
通讯作者: Dong Chen, E-mail: dongchen@bupt.edu.cn E-mail:dongchen@bupt.edu.cn

Design and implementation of unmanned aerial vehicle localization and light tracking system

Xu Ming, Dong Chen, Li Hanlu, Luo Qiming, Wang Lizi, Zhang Wanru, Liu Huixin

1. School of Digital Media and Design Arts, Beijing University of Posts and Telecommunications, Beijing 100876, China 2. School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China 3. State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing 100876, China 4. School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing 100876, China

Received:2023-02-17 Revised:2023-06-23 Accepted:2023-08-31 Online:2023-08-31 Published:2023-08-31
Contact: Dong Chen, E-mail: dongchen@bupt.edu.cn E-mail:dongchen@bupt.edu.cn

摘要/Abstract

摘要： Unmanned aerial vehicles (UAV) are applied widely and profoundly in various fields. Moreover, high-precision positioning and tracking in multiple scenarios are the core requirements for UAV usage. To ensure stable communication of UAVs in denial environments with substantial electromagnetic interference, a systematic solution is proposed based on a deep learning algorithm for target detection and visible light for UAV tracking. Considering the cost and computational power limitations on the hardware, the you only look once (YOLO) v4-Tiny model is used for static target detection of the UAV model. For UAV tracking, and a light tracker that can adjust the angle of emitted light and focus it on the target is used for dynamic tracking processing. Thus, achieving the primary conditions of UAV optical communication with good secrecy is also suitable for dynamic situations. The UAV tracker positions the UAV model by returning the coordinates and calculating the time delay, and then controls the spotlight to target the UAV. In order to facilitate the deployment of deep learning models on hardware devices, the lighter and more efficient model is selected after comparison. The trained model can achieve 99.25% accuracy on the test set. The dynamic target detection can reach 20 frames per second (FPS) on a computer with an MX520 graphics processing unit (GPU) and 6 GB of random access memory (RAM). Dynamic target detection on a Jetson Nano can reach 5.4 FPS.

关键词: unmanned aerial vehicles, deep learning, light tracking, target detection, unmanned aerial vehicles location, unmanned aerial vehicles tracking

Abstract: Unmanned aerial vehicles (UAV) are applied widely and profoundly in various fields. Moreover, high-precision positioning and tracking in multiple scenarios are the core requirements for UAV usage. To ensure stable communication of UAVs in denial environments with substantial electromagnetic interference, a systematic solution is proposed based on a deep learning algorithm for target detection and visible light for UAV tracking. Considering the cost and computational power limitations on the hardware, the you only look once (YOLO) v4-Tiny model is used for static target detection of the UAV model. For UAV tracking, and a light tracker that can adjust the angle of emitted light and focus it on the target is used for dynamic tracking processing. Thus, achieving the primary conditions of UAV optical communication with good secrecy is also suitable for dynamic situations. The UAV tracker positions the UAV model by returning the coordinates and calculating the time delay, and then controls the spotlight to target the UAV. In order to facilitate the deployment of deep learning models on hardware devices, the lighter and more efficient model is selected after comparison. The trained model can achieve 99.25% accuracy on the test set. The dynamic target detection can reach 20 frames per second (FPS) on a computer with an MX520 graphics processing unit (GPU) and 6 GB of random access memory (RAM). Dynamic target detection on a Jetson Nano can reach 5.4 FPS.

Key words: unmanned aerial vehicles, deep learning, light tracking, target detection, unmanned aerial vehicles location, unmanned aerial vehicles tracking

Xu Ming, Dong Chen, Li Hanlu, Luo Qiming, Wang Lizi, Zhang Wanru, Liu Huixin. Design and implementation of unmanned aerial vehicle localization and light tracking system[J]. The Journal of China Universities of Posts and Telecommunications, 2023, 30(4): 67-74.

参考文献

References

[1] KRISHNAN N, MANAV T P, GEETHANJALI A N, et al. Design and development of drone. Proceedings of the 2022 IEEE Bombay Section Signature Conference ( IBSSC'22 ), 2022, Dec 8 - 10, Mumbai, India. Piscataway, NJ, USA: IEEE, 2022: 1 - 6.

[2] AL SAADI I, TARHUNI N, MESBAH M. Ground level mobile signal prediction using higher altitude UAV measurements and ANN. Proceedings of the 32nd IEEE FRUCT Conference of Open Innovations Association ( FRUCT'22 ), 2022, Nov 9 - 11, Tampere, Finland. Piscataway, NJ, USA: IEEE, 2022: 15 - 21.

[3] MA Y H, SHIEH T H, HUNG L C, et al. Research on the new drones design to improve transportation of supplies and medical care for remote mountain area in Taiwan. Proceedings of the 9th International Conference on Orange Technology ( ICOT'21 ), 2021, Dec 16 - 17, Tainan, China. Piscataway, NJ, USA: IEEE, 2021: 1 - 5.

[4] GANESH S, GOPALASAMY V, SHIBU N B S. Architecture for drone assisted emergency ad-hoc network for disaster rescue operations. Proceedings of the 2021 International Conference on Communication Systems and Networks ( COMSNETS'21 ), 2021, Jan 5 - 9, Bangalore, India. Piscataway, NJ, USA: IEEE, 2021: 44 - 49.

[5] NUWANTHA M B, JAYALATH C N, RATHNAYAKA M P, et al. A drone-based approach for deforestation monitoring. Proceedings of the 13th International Conference on Computing Communication and Networking Technologies ( ICCCNT'22 ), 2022, Oct 3 - 5, Kharagpur, India. Piscataway, NJ, USA: IEEE, 2022: 1 - 6.

[6] GAO H B, LU C, ZHANG T, et al. A structure constraint matrix factorization framework for human behavior segmentation. IEEE Transactions on Cybernetics, 2022, 52(12): 12978 - 12988.

[7] GAO H B, KAN Z, LI K Q. Robust lateral trajectory following control of unmanned vehicle based on model predictive control. IEEE/ASME Transactions on Mechatronics, 2022, 27(3): 1278 - 1287.

[8] YANG Y H, KHALIFE J, MORALES J J, et al. UAV waypoint opportunistic navigation in GNSS-denied environments. IEEE Transactions on Aerospace and Electronic Systems, 2022, 58(1): 663 - 678.

[9] KAUSHAL H, JAIN V K, KAR S. Free space optical communication. Berlin, Germany: Springer, 2017.

[10] GAO H B, QIN Y C, HU C, et al. An interacting multiple model for trajectory prediction of intelligent vehicles in typical road traffic scenario. IEEE Transactions on Neural Networks and Learning Systems, 2021, Early Access Article, DOI: 10.1109/TNNLS.2021.3136866.

[11] BUDIHARTO W, GUNAWAN A A S, SUROSO J S, et al. Fast object detection for quadcopter drone using deep learning. Proceedings of the 3rd International Conference on Computer and Communication Systems ( ICCCS'18 ), 2018, Apr 27 - 30, Nagoya, Japan. Piscataway, NJ, USA: IEEE, 2018: 192 - 195.

[12] GAO H, ZHU J P, ZHANG T, et al. Situational assessment for intelligent vehicles based on stochastic model and Gaussian distributions in typical traffic scenarios. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2022, 52(3): 1426 - 1436.

[13] REDMON J, FARHADI A. YOLO9000: Better, faster, stronger. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR'17), 2017, Jul 21 - 26, Honolulu, HI, USA. Piscataway, NJ, USA: IEEE, 2017: 7263 - 7271.

[14] REDMON J, FARHADI A. YOLOv3: An incremental improvement. ArXiv preprint, arXiv: 1804. 02767, 2018.

[15] BOCHKOVSKIY A, WANG C Y, LIAO H Y M. YOLOv4: Optimal speed and accuracy of object detection. ArXiv preprint, arXiv: 2004. 10934, 2020.

[16] HU J, SHEN L, SUN G. Squeeze-and-excitation networks. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR'18), 2018, Jun 18 - 23, Salt Lake City, UT, USA. Piscataway, NJ, USA: IEEE, 2018: 7132 - 7141.

[17] GAO H B, SU H, CAI Y F, et al. Trajectory prediction of cyclist based on dynamic Bayesian network and long short-term memory model at unsignalized intersections. Science China: Information Sciences, 2021, 64(7): Article 172207.

[18] Suzen A A, DUMAN B, SEN B. Benchmark analysis of Jetson TX2, Jetson Nano and Raspberry PI using deep-CNN. Proceedings of the 2020 International Congress on Human-Computer Interaction, Optimization and Robotic Applications (HORA'20), 2020, Jun 26 - 28. Ankara, Turkey. Piscataway, NJ, USA: IEEE, 2020: 1 - 5.

[19] RAIF M, EL OUAFIQ M, EL RHARRAS A, et al. Metamorphic testing for edge real-time face recognition and intrusion detection solution. Proceedings of the IEEE 96th Vehicular Technology Conference (VTC'22-Fall), 2022, Sept 26 - 29, London, UK. Piscataway, NJ, USA: IEEE, 2022: 1 - 5.

[20] KARAKED P, SAENGPHET W, TANTRAIRATN S. Multi-sensor fusion with extended Kalman filter for indoor localization system of multirotor UAV. Proceedings of the 19th International Joint Conference on Computer Science and Software Engineering ( JCSSE'22 ), 2022, Jun 22 - 25, Bangkok, Thailand. Piscataway, NJ, USA: IEEE, 2022: 1 - 5.

Design and implementation of unmanned aerial vehicle localization and light tracking system

Design and implementation of unmanned aerial vehicle localization and light tracking system

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 0

编辑推荐

Metrics

本文评价