面向多点交互的多模态振动反馈触觉再现系统
作者:
作者单位:

(1. 南京航空航天大学 自动化学院, 江苏 南京 211106;2. 南京信息工程大学 自动化学院, 江苏 南京 210044)

作者简介:

陆熊(1980—),男,江苏如皋人,副教授,博士,硕士生导师,E-mail:luxiong@nuaa.edu.cn

通讯作者:

中图分类号:

TP242.6

基金项目:

国家自然科学基金面上基金资助项目(61773205,61773219);南京航空航天大学基本科研业务费专项资助项目(NS2019018);南京航空航天大学研究生创新基地(实验室)开放基金资助项目(kfjj20190307)


Vibration feedback based multi-modal haptic rendering system for multi-contact interaction
Author:
Affiliation:

(1. College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China;2. School of Automation, Nanjing University of Information Science & Technology, Nanjing 210044, China)

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    近年来,多点交互和多模态融合的力触觉再现系统由于能够进一步提高人机交互的真实感,已经成为该领域的研究热点。基于Leap Motion的多手指位置检测模块、振动触觉再现模块、NRF51822蓝牙通信模块、视觉再现模块和CHAI3D构建的虚拟环境等,设计实现了多点自然交互的、触觉和视觉相融合多模态触觉再现系统。为了验证系统的可行性和有效性,开展了虚拟物体轮廓感知实验和立方体放置任务实验。实验结果表明:虚拟物体轮廓感知实验平均识别率为87.9%;相比单一视觉再现模式,视觉和触觉再现融合模式完成相同任务的时间能节省47.7%。所设计的多点交互触觉再现系统,具有成本低、体积小和控制方法简单等优点,为促进多模态人机交互技术的发展和广泛应用奠定了重要基础。

    Abstract:

    In recent years, multi-modal haptic rendering featured with multi-contact interaction has become a research focus in the human-computer interaction due to its ability to further enhancing the sense of reality. A multi-modal haptic rendering system for multi-contact interaction was presented, which is composed of Leap Motion sensor based multi-finger position detection module, vibration-based tactile rendering module, NRF51822 blue-tooth communication module, visual rendering module, and CHAI3D based virtual environment. To verify the efficacy and effectiveness of the proposed system, the virtual object contour recognition experiments and object pick-and-place experiments were carried out. Experiment results show that the average success rate for distinguishing geometric virtual objects is 87.9%, and the pick-and-place experiment with combined haptic rendering and visual rendering can lead to an average time saving of 47.7%, compared with that of single visual rendering condition. The proposed multi-contact haptic system features the virtues of low cost, small size, and simple control strategy, which lays out a profound foundation for the further development and application of multi-modal human-computer interaction.

    参考文献
    相似文献
    引证文献
引用本文

陆熊,林闽旭,高永强,等.面向多点交互的多模态振动反馈触觉再现系统[J].国防科技大学学报,2021,43(3):52-57.
LU Xiong, LIN Minxu, GAO Yongqiang, et al. Vibration feedback based multi-modal haptic rendering system for multi-contact interaction[J]. Journal of National University of Defense Technology,2021,43(3):52-57.

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2019-10-28
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2021-06-02
  • 出版日期: 2021-06-28
文章二维码