中国邮电高校学报(英文)

中国邮电高校学报(英文) ›› 2021, Vol. 28 ›› Issue (4): 13-28.doi: 10.19682/j.cnki.1005-8885.2021.2002

• Artificial Intelligence • 上一篇    下一篇

Resource allocation and hybrid prediction scheme for low-latency visual feedbacks to support tactile Internet multimodal perceptions

Kang Mancong, Li Xi, Ji Hong, Zhang Heli   

  1. School of Telecommunication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China
  • 收稿日期:2020-08-25 修回日期:2021-06-07 接受日期:2021-07-29 出版日期:2021-08-31 发布日期:2021-10-11
  • 通讯作者: Corresponding author: Li Xi, E-mail: lixi@bupt.edu.cn E-mail:lixi@bupt.edu.cn
  • 基金资助:
    This work was supported by the National Natural Science Foundation of China (61771070).

Resource allocation and hybrid prediction scheme for low-latency visual feedbacks to support tactile Internet multimodal perceptions

Kang Mancong, Li Xi, Ji Hong, Zhang Heli   

  1. School of Telecommunication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China
  • Received:2020-08-25 Revised:2021-06-07 Accepted:2021-07-29 Online:2021-08-31 Published:2021-10-11
  • Contact: Corresponding author: Li Xi, E-mail: lixi@bupt.edu.cn E-mail:lixi@bupt.edu.cn
  • Supported by:
    This work was supported by the National Natural Science Foundation of China (61771070).

PDF

184

摘要： Predicting user states in future and rendering visual feedbacks accordingly can effectively reduce the visual experienced delay in the tactile Internet (TI). However, most works omit the fact that different parts in an image may have distinct prediction requirements, based on which different prediction models can be used in the predicting process, and then it can further improve predicting quality especially under resources-limited environment. In this paper, a hybrid prediction scheme is proposed for the visual feedbacks in a typical TI scenario with mixed visuo-haptic interactions, in which haptic traffic needs sufficient wireless resources to meet its stringent communication requirement, leaving less radio resources for the visual feedback. First, the minimum required number of radio resources for haptic traffic is derived based on the haptic communication requirements, and wireless resources are allocated to the haptic and visual traffics afterwards. Then, a grouping strategy is designed based on the deep neural network (DNN) to allocate different parts from an image feedback into two groups to use different prediction models, which jointly considers the prediction deviation thresholds, latency and reliability requirements, and the bit sizes of different image parts. Simulations show that, the hybrid prediction scheme can further reduce the visual experienced delay under haptic traffic requirements compared with existing strategies.

关键词: tactile Internet, ultra-reliable and low-latency communications, enhanced mobile broadband, visuo-haptic feedbacks, layered rendering

Abstract: Predicting user states in future and rendering visual feedbacks accordingly can effectively reduce the visual experienced delay in the tactile Internet (TI). However, most works omit the fact that different parts in an image may have distinct prediction requirements, based on which different prediction models can be used in the predicting process, and then it can further improve predicting quality especially under resources-limited environment. In this paper, a hybrid prediction scheme is proposed for the visual feedbacks in a typical TI scenario with mixed visuo-haptic interactions, in which haptic traffic needs sufficient wireless resources to meet its stringent communication requirement, leaving less radio resources for the visual feedback. First, the minimum required number of radio resources for haptic traffic is derived based on the haptic communication requirements, and wireless resources are allocated to the haptic and visual traffics afterwards. Then, a grouping strategy is designed based on the deep neural network (DNN) to allocate different parts from an image feedback into two groups to use different prediction models, which jointly considers the prediction deviation thresholds, latency and reliability requirements, and the bit sizes of different image parts. Simulations show that, the hybrid prediction scheme can further reduce the visual experienced delay under haptic traffic requirements compared with existing strategies.

Key words: tactile Internet, ultra-reliable and low-latency communications, enhanced mobile broadband, visuo-haptic feedbacks, layered rendering

中图分类号: 

版权所有 © 2020 中国邮电高校学报(英文)编辑部　
　 地址：北京邮电大学图书馆1层119 室　邮政编码：100081
Tel：86-010-62282493　Fax： 86-010-62283461　E-mail: jchupt@bupt.edu.cn
本系统由北京玛格泰克科技发展有限公司设计开发 技术支持：support@magtech.com.cn