Deep knowledge tracking algorithm based on forgetting law

doi:10.19682/j.cnki.1005-8885.2023.2002

The Journal of China Universities of Posts and Telecommunications ›› 2023, Vol. 30 ›› Issue (1): 17-27.doi: 10.19682/j.cnki.1005-8885.2023.2002

• Artificial intelligence • Previous Articles Next Articles

Deep knowledge tracking algorithm based on forgetting law

Guo Xiangbo, Wang Jian, Huang Mengjie, Wang Minghui, Yang Jian, Yu Yongtao

1. School of Computer and Artificial Intelligence, Zhengzhou University, Zhengzhou 450001, China
2. Yunnan Key Laboratory of Smart City in Cyberspace Security, Yuxi Normal University, Yuxi 653100, China

Received:2021-07-26 Revised:2022-04-01 Accepted:2023-02-13 Online:2023-02-28 Published:2023-02-28
Contact: Wang Jian, E-mail: iejwang@zzu.edu.cn E-mail:iejwang@zzu.edu.cn
Supported by:
This work was supported by the National Natural Science Foundation of China (61972133); Plan for “1125" Innovation Leading Talent of Zhengzhou City ( 2019 ); the Opening Foundation of Yunnan Key Laboratory of Smart City in Cyberspace Security ( 202105AG070010 ); Zhengzhou University Professors' Assisting Enterprises' Innovation-Driven Development Project (32213409).

Abstract

Abstract: Knowledge tracking (KT) algorithm, which can model the cognitive level of learners, is a fundamental artificial intelligence approach to solve the personalized learning problem in the field of education. The recently presented separated self-attentive neural knowledge tracing (SAINT) algorithm has got a great improvement on predictingthe accuracy of students' answers in comparison with the present other methods. However there is still potential to enhance its performance for it fails to effectively utilize temporal features. In this paper, an optimization algorithm for SAINT based on Ebbinghaus' law of forgetting was proposed which took temporal features into account. The proposed algorithm used forgetting law-based data binning to discretize the time information sequences, so as to obtain the temporal featuresin accordance with people's forgetting pattern. Then the temporal features were used as input in the decoder of SAINT model to improve its accuracy. Ablation experiments and comparison experiments were performed on the EdNet dataset in order to verify the effectiveness of the proposed model. Seen in the experimental results,it achieved higher area under curve (AUC) values than the other present representative knowledge tracing algorithms. It demonstrates that temporal featuresare necessary for KT algorithms if it can be properly dealt with.

Key words: knowledge tracking, neural network, attention mechanism, personalized learning, Ebbinghaus' law of forgetting

CLC Number:

TP391

Guo Xiangbo, Wang Jian, Huang Mengjie, Wang Minghui, Yang Jian, Yu Yongtao. Deep knowledge tracking algorithm based on forgetting law[J]. The Journal of China Universities of Posts and Telecommunications, 2023, 30(1): 17-27.

References

References
[1] LU H Y, ZHOU L J, ZHANG J. Application of educational data mining on analysis of students' online learning behavior under the
large data background. Computing Technology and Automation, 2017, 36(1): 136 -140 (in Chinese).
[2] LIU T Y, CHEN W, CHENG L, et al. Research advances in the knowledge tracing based on deep learning. Journal of Computer
Research and Development, 2022, 59 ( 1 ): 81 - 104 ( in Chinese).
[3] HA H, HWANG U, HONG Y, et al. Deep trustworthy knowledge tracing. arXiv Preprint, arXiv: 1805. 10768, 2018.
[4] PARDOS Z A, BERGNER Y, SEATON D T, et al. Adapting Bayesian knowledge tracing to a massive open online course in
edX. Proceedings of the 6th International Conference on Educational Data Mining (EDM'13), 2013, Jul 6 -9, Memphis, TN, USA. Worcester, MA, USA: International Educational Data Mining Society, 2013: 8p
[5] WANG Z, ZHU J L, LI X, et al. Structured knowledge tracing models for student assessment on Coursera. Proceedings of the 3rd ACM Conference on Learning @ Scale (L@S'16), 2016, Apr 25 -26, Edinburgh, UK. New York, NY, USA: ACM, 2016: 209 -212.
[6] TONG H S, ZHOU Y, WANG Z. Exercise hierarchical feature enhanced knowledge tracing. Artificial Intelligence in Education:
Proceedings of the 21st International Conference on Artificial Intelligence in Education (AIED'20): Part II, 2020, Jul 6 -10, Ifrane, Morocco. LNCS 12164. Berlin, Germany: Springer, 2020: 324 -328.
[7] CORBETT A T, ANDERSON J R. Knowledge tracing: Modeling the acquisition of procedural knowledge. User Modeling and User-Adapted Interaction, 1995, 4(4): 253 -278.
[8] EDDY S R. Hidden Markov models. Current Opinion in Structural Biology, 1996, 6(3): 361 -365.
[9] ZHANG N, JIANG B. Review progress of learner knowledge tracing. Computer Science, 2021, 48 ( 4 ): 213 - 222 ( in Chinese).
[10] ZHANG K, YAO Y Y. A three learning states Bayesian knowledge tracing model. Knowledge-Based Systems, 2018, 148: 189 -201.
[11] WANG Y T, HEFFERNAN N T, BECK J E. Representing student performance with partial credit. Proceedings of the 3rd
International Conference on Educational Data Mining (EDM'10), 2010, Jun 11 - 13, Pittsburgh, PA, USA. Worcester, MA, USA: International Educational Data Mining Society, 2010: 335 -336.
[12] PARDOS Z A, HEFFERNAN N T, RUIZ C, et al. Effective skill assessment using expectation maximization in a multi network
temporal Bayesian network. Proceedings of the Young Researchers Track at the 9th International Conference on Intelligent Tutoring Systems ( ITS'08), 2008, Jun 23 - 27, Montreal, Canada. Berlin, Germany: Springer, 2008: 1 -10.
[13] QIU Y M, QI Y M, LU H Y, et al. Does time matter? Modeling the effect of time with Bayesian knowledge tracing. Proceedings of the 4th International Conference on Educational Data Mining ( EDM'11 ), 2011, Jul 6 - 8, Eindhoven, Netherlands. Worcester, MA, USA: International Educational Data Mining Society, 2011: 139 -148.
[14] PIECH C, BASSEN J, HUANG J, et al. Deep knowledge tracing. Advances in Neural Information Processing Systems 28:
Proceedings of the 29th Annual Conference on Neural Information Processing Systems ( NIPS'15 ): Vol 1, 2015, Dec7 - 12,
Montreal, Canada. Cambridge, MA, USA: MIT Press, 2015: 505 -513.
[15] ZHANG J N, SHI X J, KING I, et al. Dynamic key-value memory networks for knowledge tracing. Proceedings of the 26th
International World Wide Web Conference (WWW'17), 2017 Apr 3 -7, Perth, Australia. Geneva, Switzerland: International
World Wide Web Conferences Steering Committee, 2017: 765 -774.

[16] LI X G, WEI S Q, ZHANG X, et al. LFKT: Deep knowledge tracing model with learning and forgetting behavior merging.
Journal of Software, 2021, 32(3): 818 -830 (in Chinese).
[17] NAGATANI K, ZHANG Q, SATO M, et al. Augmenting knowledge tracing by considering forgetting behavior. Proceedings
of the World Wide Web Conference ( WWW'19 ), 2019, May 13 -17, San Francisco, CA, USA. New York, NY, USA: ACM, 2019: 3101 -3107.
[18] PANDEY S, KARYPIS G. A self-attentive model for knowledge tracing. Proceedings of the 12th International Conference on
Educational Data Mining ( EDM'19 ), 2019, Jul 2 - 5, Montreal, Canada. Worcester, MA, USA: International Educational Data Mining Society, 2019: 384 -389.
[19] CHOI Y, LEE Y, CHO J, et al. Towards an appropriate query, key, and value computation for knowledge tracing. Proceedings of the 7th ACM Conference on Learning @ Scale ( L@S'20 ), 2020, Aug 12 -14, Virtual Event USA. New York, NY, USA: ACM, 2020: 341 -344.
[20] EBBINGHAUS H. Memory: A contribution to experimental psychology. Annals of Neurosciences, 2013, 20(4): 155 -156.
[21] SCHUSTER M, PALIWAL K K. Bidirectional recurrent neural networks. IEEE Transactions on Signal Processing, 1997, 45(11): 2673 -2681.
[22] VASWANI A, SHAZEER N, PARMAR N, et al. Attention is all you need. Advances in Neural Information Processing Systems
30: Proceedings of the 31st Annual Conference on Neural Information Processing Systems (NIPS'17): Vol 2, 2017, Dec 4 -9, Long Beach, CA, USA. Red Hook, NY, USA: Curran Associates Inc, 2017: 6000 -6010.
[23] BA J L, KIROS J R, HINTON G E. Layer normalization. arXiv Preprint, arXiv: 160706450, 2016.
[24] HE K M, ZHANG X Y, REN S Q, et al. Deep residual learning for image recognition. Proceedings of the 2016 IEEE Conference
on Computer Vision and Pattern Recognition (CVPR'16), 2016, Jun 27 - 30, Las Vegas, NV, USA. Piscataway, NJ, USA: IEEE, 2016: 770 -778.
[25] KANG W C, MCAULEY J. Self-attentive sequential recommendation. Proceedings of the 2018 IEEE International Conference on Data Mining (ICDM'18), 2018, Nov 17 - 20, Singapore. Piscataway, NJ, USA: IEEE, 2018: 197 -206.
[26] DUVENAUD D, MACLAURIN D, AGUILERA-IPARRAGUIRRE J, et al. Convolutional networks on graphs for learning molecular fingerprints. Advances in Neural Information Processing Systems 28:, Proceedings of the 29th Annual Conference on Neural Information Processing Systems (NIPS'15): Vol 2, 2015, Dec 7 - 12, Montreal, Canada. Cambridge, MA, USA: MIT Press, 2015: 2224 -2232.

Metrics

Comments

Copyright © 2020 The Journal of China Universities of Posts and Telecommunications
　 Adress: P.O. Box 231,Beijing University of Posts and Telecommunications,10 Xi Tucheng Road,Beijing 100876,P.R.China　Post Code: 100081
Tel：86-010-62282493　Fax： 86-010-62283461　E-mail: jchupt@bupt.edu.cn
Support by: Beijing Magtech Co.Ltd

Deep knowledge tracking algorithm based on forgetting law

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

Comments

[1]	Wang Xianlun, Wang Guangyu, Cui Yuxia. Facial expression recognition based on improved ResNet [J]. The Journal of China Universities of Posts and Telecommunications, 2023, 30(1): 28-38.
[2]	Wu Hongxin, Lin Zhijian, Chen Pingping, Chen Feng. Joint partial computation offloading and resource allocation in MEC-enable networks [J]. The Journal of China Universities of Posts and Telecommunications, 2023, 30(1): 80-86.
[3]	Kong Chao, Ou Weihua, Gong Xiaofeng, Li Weian, Han Jie, Yao Yi, Xiong Jiahao. Face anti-spoofing based on multi-modal and multi-scale features fusion [J]. The Journal of China Universities of Posts and Telecommunications, 2022, 29(6): 73-82.
[4]	Zhang Han Jing Yinji Zhao Yongli. FS-LSTM: sales forecasting in e-commerce on feature selection [J]. The Journal of China Universities of Posts and Telecommunications, 2022, 29(5): 92-98.
[5]	Shi Jinjing, Wang Wenxuan, Xiao Zimeng, Mu Shuai, Li Qin. Quantum classifier with parameterized quantum circuit based on the isolated quantum system [J]. The Journal of China Universities of Posts and Telecommunications, 2022, 29(4): 21-31.
[6]	Liu Hailing, Zhang Jie, Qin Sujuan, Gao Fei. Quantum algorithm for soft margin support vector machine with hinge loss function [J]. The Journal of China Universities of Posts and Telecommunications, 2022, 29(4): 32-41.
[7]	Wang Jian, Qiao Kuoyuan, Yuan Yanlei, Liu Xiaole, Yang Jian. Adaptive learning path recommendation model for examination-oriented education [J]. The Journal of China Universities of Posts and Telecommunications, 2022, 29(4): 77-88.
[8]	Meng Wei, Wang Liting, Lu Meng. Summary of research on recommendation system based on serendipity [J]. The Journal of China Universities of Posts and Telecommunications, 2022, 29(4): 89-105.
[9]	Jia Wei, Gong Chao. Precise and efficient Chinese license plate recognition in the real monitoring scene of intelligent transportation system [J]. The Journal of China Universities of Posts and Telecommunications, 2022, 29(3): 1-14.
[10]	Song Yue, Wu Chengmao, Tian Xiaoping, Song Qiuyu. Enhanced kernel-based fuzzy local information clustering integrating neighborhood membership [J]. The Journal of China Universities of Posts and Telecommunications, 2021, 28(6): 65-81.
[11]	Xue Chenzi, Wei Yifei, Zhang Yong. Performance optimization for smart grid blockchain integrated with fog computing using DDQN [J]. The Journal of China Universities of Posts and Telecommunications, 2021, 28(2): 68-78.
[12]	Guo Hairu, Meng Xueyao, Liu Yongli, Liu Shen. Improved HHO algorithm based on good point set and nonlinear convergence formula [J]. The Journal of China Universities of Posts and Telecommunications, 2021, 28(2): 48-67.
[13]	Wu Chengmao, Cao Zhuo. Entropy-like distance driven fuzzy clustering with local information constraints for image segmentation [J]. The Journal of China Universities of Posts and Telecommunications, 2021, 28(1): 24-40.
[14]	Shan Rui, Jiang Lin, Deng Junyong, Cui Pengfei, Zhang Yuting, Wu Haoyue, Xie Xiaoyan. Parallel design of convolutional neural networks for remote sensing images object recognition based on data-driven array processor [J]. The Journal of China Universities of Posts and Telecommunications, 2020, 27(6): 87-100.
[15]	Wang Zhaoying, Zhou Junhua, Liao Zhonghua, Zhai Xiang, Zhang Lianping. Semantic segmentation of track image based on deep neural network [J]. The Journal of China Universities of Posts and Telecommunications, 2020, 27(5): 23-33.