GNN-based temporal knowledge reasoning for UAV mission planning systems

doi:10.19682/j.cnki.1005-8885.2024.2002

中国邮电高校学报(英文) ›› 2024, Vol. 31 ›› Issue (1): 12-25.doi: 10.19682/j.cnki.1005-8885.2024.2002

GNN-based temporal knowledge reasoning for UAV mission planning systems

Chai Rong, Duan Xiaofang, Wang Lixuan

School of Communications and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing 400065, China

收稿日期:2023-11-15 修回日期:2024-01-12 接受日期:2024-02-22 出版日期:2024-02-29 发布日期:2024-02-29
通讯作者: Corresponding author: Duan Xiaofang, E-mail: s220132035@stu.cqupt.edu.cn E-mail:s220132035@stu.cqupt.edu.cn
基金资助:
This work was supported in part by the National Natural Science Foundation of China (62271097, U23A20279).

GNN-based temporal knowledge reasoning for UAV mission planning systems

Chai Rong, Duan Xiaofang, Wang Lixuan

School of Communications and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing 400065, China

Received:2023-11-15 Revised:2024-01-12 Accepted:2024-02-22 Online:2024-02-29 Published:2024-02-29
Contact: Corresponding author: Duan Xiaofang, E-mail: s220132035@stu.cqupt.edu.cn E-mail:s220132035@stu.cqupt.edu.cn
Supported by:
This work was supported in part by the National Natural Science Foundation of China (62271097, U23A20279).

摘要/Abstract

摘要： Unmanned aerial vehicles (UAVs) are increasingly applied in various mission scenarios for their versatility, scalability and cost-effectiveness. In UAV mission planning systems (UMPSs), an efficient mission planning strategy is essential to meet the requirements of UAV missions. However, rapidly changing environments and unforeseen threats pose challenges to UMPSs, making efficient mission planning difficult. To address these challenges, knowledge graph technology can be utilized to manage the complex relations and constraints among UAVs, missions, and environments. This paper investigates knowledge graph application in UMPSs, exploring its modeling, representation, and storage concepts and methodologies. Subsequently, the construction of a specialized knowledge graph for UMPS is detailed. Furthermore, the paper delves into knowledge reasoning within UMPSs, emphasizing its significance in timely updates in the dynamic environment. A graph neural network (GNN)-based approach is proposed for knowledge reasoning, leveraging GNNs to capture structural information and accurately predict missing entities or relations in the knowledge graph. For relation reasoning, path information is also incorporated to improve the accuracy of inference. To account for the temporal dynamics of the environment in UMPS, the influence of timestamps is captured through the attention mechanism. The effectiveness and applicability of the proposed knowledge reasoning method are verified via simulations.

关键词: unmanned aerial vehicle, mission planning, knowledge graph, knowledge reasoning, graph neural network

Abstract: Unmanned aerial vehicles (UAVs) are increasingly applied in various mission scenarios for their versatility, scalability and cost-effectiveness. In UAV mission planning systems (UMPSs), an efficient mission planning strategy is essential to meet the requirements of UAV missions. However, rapidly changing environments and unforeseen threats pose challenges to UMPSs, making efficient mission planning difficult. To address these challenges, knowledge graph technology can be utilized to manage the complex relations and constraints among UAVs, missions, and environments. This paper investigates knowledge graph application in UMPSs, exploring its modeling, representation, and storage concepts and methodologies. Subsequently, the construction of a specialized knowledge graph for UMPS is detailed. Furthermore, the paper delves into knowledge reasoning within UMPSs, emphasizing its significance in timely updates in the dynamic environment. A graph neural network (GNN)-based approach is proposed for knowledge reasoning, leveraging GNNs to capture structural information and accurately predict missing entities or relations in the knowledge graph. For relation reasoning, path information is also incorporated to improve the accuracy of inference. To account for the temporal dynamics of the environment in UMPS, the influence of timestamps is captured through the attention mechanism. The effectiveness and applicability of the proposed knowledge reasoning method are verified via simulations.

Key words: unmanned aerial vehicle, mission planning, knowledge graph, knowledge reasoning, graph neural network

Chai Rong, Duan Xiaofang, Wang Lixuan. GNN-based temporal knowledge reasoning for UAV mission planning systems[J]. The Journal of China Universities of Posts and Telecommunications, 2024, 31(1): 12-25.

参考文献

References

[1] HASSIJA V, CHAMOLA A, AGRAWAL A, et al. Fast, reliable, and secure drone communication: A comprehensive survey. IEEE Communications Surveys & Tutorials, 2021, 23(4): 2802 - 2832.

[2] SHAKHATREH H, SAWALMEH A H, AL-FUQAHA A, et al. Unmanned aerial vehicles (UAVs): A survey on civil applications and key research challenges. IEEE Access, 2019, 7: 48572 - 48634.

[3] WANG B Y, LI R P, ZHU J H, et al. Knowledge enhanced semantic communication receiver. IEEE Communications Letters, 2023, 27(7): 1794 - 1798.

[4] HU L S, LI Y H, ZHANG H, et al. Robust semantic communication driven by knowledge graph. Proceedings of the 9th International Conference on Internet of Things: Systems,Management and Security (IOTSMS'22), 2022, Nov 29 - Dec 1, Milan, Italy. Piscataway, NJ, USA: IEEE, 2022: 1 - 5.

[5] LIU C H, GUO C L, WANG S Y, et al. Task-oriented semantic communication based on semantic triplets. Proceedings of the 2023 IEEE Wireless Communications and Networking Conference (WCNC'23), 2023, Mar 26 - 29, Glasgow, UK. Piscataway, NJ, USA: IEEE, 2023: 1 - 6.

[6] HU X, LIU J. Ontology construction and evaluation of UAV FCMS software requirement elicitation considering geographic environment factors. IEEE Access, 2020, 8: 106165 - 106182.

[7] CAVALIERE D, SENATORE S, LOIA V. Proactive UAVs for cognitive contextual awareness. IEEE Systems Journal, 2019, 13(3): 3568 - 3579.

[8] AL RAHHAL M M, BAZI Y, AL-HWITI H, et al. Adversarial learning for knowledge adaptation from multiple remote sensing sources. IEEE Geoscience and Remote Sensing Letters, 2021, 18(8): 1451 - 1455.

[9] CAVALIERE D, LOIA V, SAGGESE A, et al. Semantically enhanced UAVs to increase the aerial scene understanding. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2019, 49(3): 555 - 567.

[10] WU Y K, ZHU Y P, LI J C, et al. Unmanned aerial vehicle knowledge graph construction with SpERT. Evaluation Track: Proceedings of the 6th China Conference on Knowledge Graph and Semantic Computing (CCKS'21), 2021, Dec 25 - 26, Guangzhou, China. CCIS 1553. Berlin, Germany: Springer, 2022: 151 - 159.

[11] BORDES A, USUNIER N, GARCIA-DURAN A, et al. Translating embeddings for modeling multi-relational data. Advances in Neural Information Processing Systems: Proceedings of the 26th International Conference on Neural Information Processing Systems: Vol 2, 2013, Dec 5 - 10, Lake Tahoe, NV, USA. Red Hook, NY, USA: Curran Associates Inc, 2013: 2787 - 2795.

[12] LIN Y K, LIU Z Y, SUN M S, et al. Learning entity and relation embeddings for knowledge graph completion. Proceedings of the 29th AAAI Conference on Artificial Intelligence (AAAI'15), 2015, Jan 25 - 30, Austin, TX, USA. Palo Alto, CA, USA: Association for the Advancement of Artificial Intelligence (AAAI), 2015: 2181 - 2187.

[13] DETTMERS T, MINERVINI P, STENETORP P, et al. Convolutional 2D knowledge graph embeddings. Proceedings of the 32nd AAAI Conference on Artificial Intelligence and 31th Innovative Applications of Artificial Intelligence Conference and 8th AAAI Symposium on Educational Advances in Artificial Intelligence (AAAI'18/IAAI'18/EAAI'18), 2018, Feb 2 - 7, New Orleans, LA, USA. Palo Alto, CA, USA: Association for the Advancement of Artificial Intelligence (AAAI), 2018: 1811 - 1818.

[14] ZHU Q N, ZHOU X F, TAN J L, et al. Knowledge base reasoning with convolutional-based recurrent neural networks. IEEE Transactions on Knowledge and Data Engineering, 2021, 33(5): 2015 - 2028.

[15] SCHLICHTKRULL M, KIPF T N, BLOEM P, et al. Modeling relational data with graph convolutional networks. The Semantic Web: Proceedings of the 18th European Semantic Web Conference (ESWC'18), 2018, Jun 3 - 7, Crete, Greece. LNISA 10843. Berlin, Germany: Springer, 2018: 593 - 607.

[16] VELICKOVIC P, CUCURULL G, CASANOVA A, et al. Graph attention networks. Proceedings of the 6th International Conference on Learning Representations (ICLR'18), 2018, Apr 30 - May 3, Vancouver, Canada, 2018.

[17] VASHISHTH S, SANYAL S, NITIN V, et al. Composition-based multi-relational graph convolutional networks. Proceedings of the 8th International Conference on Learning Representations (ICLR'20), 2020, Apr 26 - 30, Addis Ababa, Ethiopia, 2020.

[18] YE R, LI X, FANG Y J, et al. A vectorized relational graph convolutional network for multi-relational network alignment. Proceedings of the 28th International Joint Conference on Artificial Intelligence (IJCAI'19), 2019, Aug 10 - 16, Macao China. Palo Alto, CA, USA: Association for the Advancement of Artificial Intelligence (AAAI), 2019: 4135 - 4141.

[19] JIANG T S, LIU T Y, GE T, et al. Towards time-aware knowledge graph completion. Proceedings of the 26th International Conference on Computational Linguistics: Technical Papers (COLING'16), 2016, Dec 11 - 16, Osaka, Japan. Osaka, Japan: The COLING 2016 Organizing Committee, 2016: 1715 - 1724.

[20] GARCIA-DURAN A, DUMANCIC S, NIEPERT M. Learning sequence encoders for temporal knowledge graph completion. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP'18), 2018, Oct 31 - Nov 4, Brussels, Belgium. Stroudsburg, PA, USA: Association for Computational Linguistics, 2018: 4816 - 4821.

[21] DASGUPTA S S, RAY S N, TALUKDAR P. Hyte: Hyperplane-based temporally aware knowledge graph embedding. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP'18), 2018, Oct 31 - Nov 4, Brussels, Belgium. Stroudsburg, PA, USA: Association for Computational Linguistics, 2018: 2001 - 2011.

[22] JIN W J, QU M, JIN X, et al. Recurrent event network: Autoregressive structure inference over temporal knowledge graphs. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP'20), 2020, Nov 16 - 20, Online. Stroudsburg, PA, USA: Association for Computational Linguistics, 2020: 6669 - 6683.

[23] ZHU C C, CHEN M H, FAN C J, et al. Learning from history: Modeling temporal knowledge graphs with sequential copy-generation networks. Proceedings of the 35th AAAI Conference on Artificial Intelligence (AAAI'21), 2021, Feb 2 - 9, Vancouver, Canada. Palo Alto, CA, USA: Association for the Advancement of Artificial Intelligence (AAAI), 2021: 4732 - 4740.

[24] XU Y, OU J J, XU H, et al. Temporal knowledge graph reasoning with historical contrastive learning. Proceedings of the 37th AAAI Conference on Artificial Intelligence (AAAI'23), 2023, Feb 7 - 14, Washington, DC, USA. Palo Alto, CA, USA: Association for the Advancement of Artificial Intelligence (AAAI), 2023: 4765 - 4773.

GNN-based temporal knowledge reasoning for UAV mission planning systems

GNN-based temporal knowledge reasoning for UAV mission planning systems

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 0

编辑推荐

Metrics

本文评价