Objectives

• The goal of this project is try to develop a computer vision based software for controlling keyboard or mouse events like mouse clicks, cursor motion or keystrokes by using hand gestures.
• Try to develop a computer vision based keyboard.
• Try to develop a computer vision based mouse.

Requirements

• Download Python
• For Opencv type pip install opencv-python in command prompt
• For Numpy type pip install numpy in command prompt
• For PyAutoGUI type pip install pyautogui in command prompt
• For TensorFlow type pip install tensorflow or pip install --upgrade tensorflow in command prompt
• For Python Imaging Library (PIL) type pip install Pillow in command prompt

How to Test Drive ?

First Download the code from Github and then

• For Alphabets Keys run alphabets_keys_test_drive.py file
• For Numeric Keys run numeric_keys_test_drive.py file
• For Mouse run mouse_test_drive.py file

Datasets

You can download datasets for your own model training from the following link.

• Sign Language for Alphabets
• Sign Language for Numbers

Screenshots