Download PDFOpen PDF in browser

Gesture Controlled Mouse Using Python

EasyChair Preprint 12652

4 pagesDate: March 21, 2024

Abstract

The technique of establishinga process of interaction between human and conmputer is evolving since the invention of In terms of HCI (Human-Computer Interaetion) technology, the mouse is a fantastic invention. Even while Bluetooth and wireless mouse technology is still in its infancy, it is not entirely device independent. A Bluetooth mouse needs a connected dongle and batteries to function. When a mouse has additional devices, it becomes harder to use The proposcd mouse system is beyond this limitation This project proposes a gesture-controlled mouse using Python, where the user can control the movement of the cursor on the comnuter sereen with hand gestures. The system uses a webcam to capture real-time video input and OpenCV, a computer vision library in Python, to detect and recognize hand gestures. The hand gestures are mapped to the movemnent of the cursor on the screen using PyAutoGUI, a Python library that allows for programmatically controling themouse and keyhoard. The proposcd system aims to interaction, especially for users with physical disabilities or for those who prefer a more natural way of controlling their computer. The system willI be implemented and tested on a Windows platform using Python 3.x, OpenCV 4.x, and PyAutoGUI. The performance and usability of the system will be evaluated through a user study, where participants will be askod to perfornm various tasks using the gesturc-controllcd mouse and provide feedback on their experience. Overall, this pruject aims to demonstrate the potential of using hand gestures as an alternative input method for controlling a computer mouse and tu provide a useful tool for people who have difficulty using traditional input devices

Keyphrases: Mediapipe: For hand tracking and pose estimation., OpenCV: For computer vision tasks such as hand detection and tracking., PyAutoGUI: For controlling the mouse cursor and simulating mouse clicks.

BibTeX entry
BibTeX does not have the right entry for preprints. This is a hack for producing the correct reference:
@booklet{EasyChair:12652,
  author    = {Bhavika Darji and Akula Mahesh and Akula Tharun and Akula Harsha and Alladi Bharadwaj},
  title     = {Gesture Controlled Mouse Using Python},
  howpublished = {EasyChair Preprint 12652},
  year      = {EasyChair, 2024}}
Download PDFOpen PDF in browser