Featured publication

Comparing Visual and Haptic Feedback Methods

VR-based human-robot teleoperation using multimodal visual and haptic feedback

Project overview

Hong Li, Jialin Chen, Praminda Caleb-Solly · ICSR + AI 2024 / Springer LNAI 15561

This student project investigated visual and haptic feedback modalities for a virtual reality based robot teleoperation system. The work focused on improving teleoperation by optimising controller movement, trialling a new data transmission format, and exploring sensory feedback through both visual and haptic modalities.

The system used a VR interface for robotic teleoperation, with enhanced feedback designed to help an operator perceive the robot’s working status in real time. The study compared visual feedback, haptic feedback, and combined visual+haptic feedback for task performance and user experience.

Key achievements

  • Developed an improved VR-based teleoperation system with reduced latency and more responsive robot control.
  • Added a controller clutch mechanism to better align the user’s control space with the robot workspace.
  • Integrated visual distance feedback and vibrotactile feedback using a wearable haptic vest.
  • Evaluated visual, haptic and combined feedback modes through user experiments.
  • Showed that the improved system reduced task completion time, controller movement and perceived workload.

Technologies and methods

Virtual Reality Robot Teleoperation Human-Robot Interaction Haptic Feedback Visual Feedback Sensory Augmentation bHaptics TactSuit X40 JAKA Minicobo Quest 2

Project video

Project poster

This poster summarises the system architecture, research aims, user trials, experimental setup, results and conclusions.

Poster for Comparing Visual and Haptic Feedback Methods for VR-Based Human-Robot Teleoperation

Citation

@inproceedings{li2025visualhapticteleoperation,
  title     = {Comparing Visual and Haptic Feedback Methods for VR-Based Human-Robot Teleoperation},
  author    = {Li, Hong and Chen, Jialin and Caleb-Solly, Praminda},
  booktitle = {Social Robotics and Artificial Intelligence},
  series    = {Lecture Notes in Artificial Intelligence},
  volume    = {15561},
  pages     = {178--191},
  publisher = {Springer Nature Singapore},
  year      = {2025},
  doi       = {10.1007/978-981-96-3522-1_17}
}