We designed and implemented finger tracking based on a virtual mouse application using a regular webcam. Furthermore, we integrated a speech-to-text converter. While touchscreen technology is popular in mobile devices, it is costly for desktop systems. Therefore, we explored computer vision techniques as an alternative method to create a virtual human-computer interaction device, such as a mouse using a webcam and voice commands using a mic.
1. IDLE:- Python version 3.8 and above.
2. OS:- Windows 8 and above.
3. RAM:- 4GB and above.
4. WEBCAM:- An Webcam is necessary for input.
{ If webcam not available then you can use third party application like DroidCam or any other that can help you to use your mobile cam. But this DroidCam application should be installed in both android and pc devices for usage. }
5. MICROPHONE
For better Working Create an Virtual Environment.
-
Navigate to Your Project Directory:
cd path/to/your/project -
Create a Virtual Environment:
You can use the venv module that comes with Python:
python -m venv venv
-
Activate the Virtual Environment:
.\venv\Scripts\activate
-
Install Requirements:
pip install -r requirements.txt
-
Run the main.py file:
python main.py
-
Right Click
-
Multiple Selection
-
Brightness Control
-
Double Click
For Demo Video Click Here
Additionally, we have developed a feature to control the mouse using a mobile device's screen. When the user selects "Mobile Controller," a QR code is displayed on the screen. Scanning this code directs the user to a browser page where they can control the mouse by dragging their finger on the page. However, for this to work, both the PC and the mobile device must be on the same network. This only has feature of left click and cursor movement.
 QR Code to Scan |
|
 Mobile Browser Page |
Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.
| Name | Git ID | |
|---|---|---|
| Vivek Kalwar | vivekkalwar95@gmail.com | Viivveekk |
| Prabel Pandey | prabel397@gmail.com | HiPrabel |
| Nadeem Khan | kk0078841@gmail.com | Luciferkhan007 |
MIT Licensed
