Surveys on the application of neural networks to event extraction

doi:10.19682/j.cnki.1005-8885.2023.2015

中国邮电高校学报(英文) ›› 2023, Vol. 30 ›› Issue (4): 43-54.doi: 10.19682/j.cnki.1005-8885.2023.2015

• Artificial Intelligence • 上一篇下一篇

Surveys on the application of neural networks to event extraction

Duan Li, Chen Lin, Luo Bing

School of Electronic Engineering, Naval University of Engineering, Wuhan 430033, China

收稿日期:2022-02-26 修回日期:2022-11-08 接受日期:2023-08-31 出版日期:2023-08-31 发布日期:2023-08-31
通讯作者: Chen Lin, E-mail: forever_chenlin@126.com E-mail:forever_chenlin@126.com
基金资助:
This work was supported by the National Natural Science Foundation of China (U21A20488).

Surveys on the application of neural networks to event extraction

Duan Li, Chen Lin, Luo Bing

School of Electronic Engineering, Naval University of Engineering, Wuhan 430033, China

Received:2022-02-26 Revised:2022-11-08 Accepted:2023-08-31 Online:2023-08-31 Published:2023-08-31
Contact: Chen Lin, E-mail: forever_chenlin@126.com E-mail:forever_chenlin@126.com
Supported by:
This work was supported by the National Natural Science Foundation of China (U21A20488).

摘要/Abstract

摘要： Event extraction (EE) is a significant part of natural language information extraction, and it is widely adopted in other natural language processing (NLP) tasks such as question answering and machine reading comprehension. With the development of the NLP field, numerous datasets and approaches for EE are promoted, raising the need for a comprehensive review. In this paper, the resources for EE are reviewed, and then the numerous neural network models currently employed in EE tasks are classified into three types: Word sequence-based methods, graph-based neural network methods, and external knowledge-based approaches. And then the methods are compared and contrasted in detail, and their flaws and difficulties are analyzed with existing research in this survey. Finally, the future research tendency is discussed for EE.

关键词: event extraction, natural language processing, event extraction methods, neural networks

Abstract: Event extraction (EE) is a significant part of natural language information extraction, and it is widely adopted in other natural language processing (NLP) tasks such as question answering and machine reading comprehension. With the development of the NLP field, numerous datasets and approaches for EE are promoted, raising the need for a comprehensive review. In this paper, the resources for EE are reviewed, and then the numerous neural network models currently employed in EE tasks are classified into three types: Word sequence-based methods, graph-based neural network methods, and external knowledge-based approaches. And then the methods are compared and contrasted in detail, and their flaws and difficulties are analyzed with existing research in this survey. Finally, the future research tendency is discussed for EE.

Key words: event extraction, natural language processing, event extraction methods, neural networks

Duan Li, Chen Lin, Luo Bing. Surveys on the application of neural networks to event extraction[J]. The Journal of China Universities of Posts and Telecommunications, 2023, 30(4): 43-54.

参考文献

References

[1] ZHAN L Y, JIANG X P. Survey on event extraction technology in information extraction research area. Proceedings of the IEEE 3rd Information Technology Networking Electronic and Automation Control Conference (ITNEC'19), 2019, Mar 15 - 17, Chengdu, China. Piscataway, NJ, USA: IEEE, 2019: 2121 - 2126.

[2] LI Q, LI J X, SHENG J W, et al. A compact survey on event extraction: Approaches and applications. arXiv preprint, arXiv: 2107. 02126, 2021.

[3] CHEN Y B, XU L H, LIU K, et al. Event extraction via dynamic multi-pooling convolutional neural networks. Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing: Vol 1, 2015, Jul 26 - 31, Beijing, China. Stroudsburg, PA, USA: Association for Computational Linguistics, 2015: 167 - 176.

[4] YANG B S, MITCHELL T M. Joint extraction of events and entities within a document context. Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2016, Jun 12 - 17, San Diego, CA, USA. Stroudsburg, PA, USA: Association for Computational Linguistics, 2016: 289 - 299.

[5] NGUYEN T H, CHO K, GRISHMAN R. Joint event extraction via recurrent neural networks. Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2016, Jun 12 - 17, San Diego, CA, USA. Stroudsburg, PA, USA: Association for Computational Linguistics, 2016: 300 - 309.

[6] SHA L, QIAN F, CHANG B B, et al. Jointly extracting event triggers and arguments by dependency-bridge RNN and tensor-based argument interaction. Proceedings of the 32nd AAAI Conference on Artificial Intelligence and 30th Innovative Applications of Artificial Intelligence Conference and 8th AAAI Symposium on Educational Advances in Artificial Intelligence (AAAI'18/IAAI'18/EAAI'18), 2018, Feb 2 - 7, New Orleans, LA, USA. Palo Alto, CA, USA: Association for the Advancement of Artificial Intelligence (AAAI), 2018: 5916 - 5923.

[7] ZHENG S, CAO W, XU W, et al. Doc2EDAG: An end-to-end document-level framework for Chinese financial event extraction. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP'19), 2019, Nov 3 - 7, Hong Kong, China. Stroudsburg, PA, USA: Association for Computational Linguistics, 2019: 337 - 346.

[8] YANG H, SUI D B, CHEN Y B, et al. Document-level event extraction via parallel prediction networks. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing: Vol 1, 2021, Aug 1 - 6, Online. Stroudsburg, PA, USA: Association for Computational Linguistics, 2021: 6298 - 6308.

[9] REZA G, FERN X L, HUANG L, et al. Event nugget detection with forward-backward recurrent neural networks. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics: Vol 2, 2016, Aug 7 - 12, Berlin, Germany. Stroudsburg, PA, USA: Association for Computational Linguistics, 2016: 369 - 373.

[10] FENG X C, HUANG L F, TANG D Y, et al. A language independent neural network for event detections. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics: Vol 2, 2016, Aug 7 - 12, Berlin, Germany. Stroudsburg, PA, USA: Association for Computational Linguistics, 2016: 66 - 71.

[11] NGUYEN T H, GRISHMAN R. Graph convolutional networks with argument-aware pooling for event detection. Proceedings of the 32nd AAAI Conference on Artificial Intelligence and 30th Innovative Applications of Artificial Intelligence Conference and 8th AAAI Symposium on Educational Advances in Artificial Intelligence ( AAAI'18/IAAI'18/EAAI'18 ), 2018, Feb 2 - 7, New Orleans, LA, USA. Palo Alto, CA, USA: Association for the Advancement of Artificial Intelligence (AAAI), 2018: 5900 - 5907.

[12] LIU X, LUO Z C, HUANG H Y. Jointly multiple events extraction via attention based graph information aggregation. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, 2018, Oct 31 - Nov 4, Brussels, Belgium. Stroudsburg, PA, USA: Association for Computational Linguistics, 2018: 1247 - 1256.

[13] VEYSEH A, NGUYEN T N, NGUYEN T H. Graph transformer networks with syntactic and semantic structures for event argument extraction. Findings of the Association for Computational Linguistics: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing ( EMNLP'20 ), 2020, Nov 16 - 20, Online. Stroudsburg, PA, USA: Association for Computational Linguistics, 2020: 3651 - 3661.

[14] AHMAD W U, PENG N Y, CHANG K W. GATE: Graph attention transformer encoder for cross-lingual relation and event extraction. Proceedings of the 35th AAAI Conference on Artificial Intelligence (AAAI'21), 2021, Feb 2 - 9, Online. Palo Alto, CA, USA: Association for the Advancement of Artificial Intelligence (AAAI), 2021: 12462 - 12470.

[15] XU R X, LIU T Y, LI L, et al. Document-level event extraction via heterogeneous graph-based interaction model with a tracker. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing: Vol 1, 2021, Aug 1 - 6, Online. Stroudsburg, PA, USA: Association for Computational Linguistics, 2021: 3533 - 3546.

[16] HUANG Y S, JIA W J. Exploring sentence community for document-level event extraction. Findings of the Association for Computational Linguistics: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP'21), 2021, Nov 7 - 11, Online. Stroudsburg, PA, USA: Association for Computational Linguistics, 2021: 340 - 351.

[17] YAN H R, JIN X L, MENG X B, et al. Event detection with multi-order graph convolution and aggregated attention. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP'19), 2019, Nov 3 - 7, Hong Kong, China. Stroudsburg, PA, USA: Association for Computational Linguistics, 2019: 5766 - 5770.

[18] HAN R J, ZHOU Y C, PENG N Y. Domain knowledge empowered structured neural net for end-to-end event temporal relation extraction. Findings of the Association for Computational Linguistics: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing ( EMNLP'20 ), 2020, Nov 16 - 20, Online. Stroudsburg, PA, USA: Association for Computational Linguistics, 2020: 5717 - 5729.

[19] WEI K W, SUN X, ZHANG Z Q, et al. Trigger is not sufficient: Exploiting frame-aware knowledge for implicit event argument extraction. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing ( ACL-IJCNLP'21 ): Vol 1, 2021, Aug 1 - 6, Online. Stroudsburg, PA, USA: Association for Computational Linguistics, 2021: 4672 - 4682.

[20] LIN J J, JIAN J, CHEN Q. Eliciting knowledge from language models for event extraction. arXiv preprint, arXiv. 2109. 05190, 2002.

[21] GUO K H, JIANG T P, ZHANG H P. Knowledge graph enhanced event extraction in financial documents. Proceedings of the 2020 IEEE International Conference on Big Data (Big Data'20), 2020, Dec 10 - 13, Atlanta, GA, USA. Piscataway, NJ, USA: IEEE, 2020: 1322 - 1329.

[22] LU Y J, LIN H Y, HAN X P, et al. Distilling discrimination and generalization knowledge for event detection via delta-representation learning. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 2019, Jul 28 - Aug 2, Florence, Italy. Stroudsburg, PA, USA: Association for Computational Linguistics, 2019: 4366 - 4376.

[23] LIU J, CHEN Y B, LIU K. Exploiting the ground-truth: An adversarial imitation based knowledge distillation approach for event detection. Proceedings of the 33rd AAAI Conference on Artificial Intelligence and 31st Innovative Applications of Artificial Intelligence Conference and 9th AAAI Symposium on Educational Advances in Artificial Intelligence (AAAI'19/IAAI'19/EAAI'19), 2019, Jan 27 - Feb 1, Honolulu, HI, USA. Palo Alto, CA, USA: Association for the Advancement of Artificial Intelligence (AAAI), 2019: 6754 - 6761.

[24] TONG M H, XU B, WANG S, et al. Improving event detection via open-domain trigger knowledge. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020, Jul 5 - 10, Online. Stroudsburg, PA, USA: Association for Computational Linguistics, 2020: 5887 - 5897.

[25] CHEN Y B, LIU S L, ZHANG X, et al. Automatically labeled data generation for large scale event extraction. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics: Vol 1, 2017, Jul 30 - Aug 4, Vancouver, Canada. Stroudsburg, PA, USA: Association for Computational Linguistics, 2017: 409 - 419.

[26] HE H F, SUN X. A unified model for cross-domain and semi-supervised named entity recognition in Chinese social media. Proceedings of the 31st AAAI Conference on Artificial Intelligence (AAAI'17), 2017, Feb 4 - 9, San Francisco, CA, USA. Palo Alto, CA, USA: Association for the Advancement of Artificial Intelligence (AAAI), 2017: 3216 - 3222.

[27] XIE J Y, SUN H T, ZHOU J S, et al. Event detection as graph parsing. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing ( ACL-IJCNLP'21 ): Vol 1, 2021, Aug 1 - 6, Online. Stroudsburg, PA, USA: Association for Computational Linguistics, 2021: 1630 - 1640.

[28] LI F Y, PENG W H, CHEN Y G, et al. Event extraction as multi-turn question answering. Findings of the Association for Computational Linguistics: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP'20), 2020, Nov 16 - 20, Online. Stroudsburg, PA, USA: Association for Computational Linguistics, 2020: 829 - 838.

[29] LIU J, CHEN Y B, LIU K, et al. Event extraction as machine reading comprehension. Findings of the Association for Computational Linguistics: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP'20), 2020, Nov 16 - 20, Online. Stroudsburg, PA, USA: Association for Computational Linguistics, 2020: 1641 - 1651.

[30] DEVLIN J, CHANG M W, LEE K, et al. BERT: Pre-training of deep bidirectional transformers for language understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies ( NAACL-HLT'19 ): Vol 1, 2019, Jun 2 - 7, Minneapolis, MN, USA. Stroudsburg, PA, USA: Association for Computational Linguistics, 2019: 4171 - 4186.

[31] YANG S, FENG D W, QIAO L B, et al. Exploring pre-trained language models for event extraction and generation. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 2019, Jul 28 - Aug 2, Florence, Italy. Stroudsburg, PA, USA: Association for Computational Linguistics, 2019: 5284 - 5294.

[32] BENGIO Y, LOURADOUR J, COLLOBERT R, et al. Curriculum learning. Proceedings of the 26th Annual International Conference on Machine Learning (ICML'09), 2009, Jun 14 - 18, Montreal, Canada. New York, NY, USA: ACM, 2009: 41 - 48.

[33] HUANG Y Y, DU J H. Self-attention enhanced CNNs and collaborative curriculum learning for distantly supervised relation extraction. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP'19), 2019, Nov 3 - 7, Hong Kong, China. Stroudsburg, PA, USA: Association for Computational Linguistics, 2019: 389 - 398.

Surveys on the application of neural networks to event extraction

Surveys on the application of neural networks to event extraction

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 0

编辑推荐

Metrics

本文评价