You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Computer Vision Project – Sign language interpreter
INTRODUCTION
Not everyone understands sign language,this project aims to solve this by removing the need of having a person who understands sign language interpret every single sign.
The project employs the follwing key areas:
Computer vision.
Deep learning. [TensorFlow library]
The project will be implemented in 3 phases:
Recognize simple hand poses by tracing the hand’s joints.
Implement TensorFlow object detection.
Implement Deep learning & train model.
Phase 1: Implement hand pose detection
Recognize the flow of movement of both hands finding key areas on a hand. Key-points correspond to the joints.
Dependencies & Tools used
** MediaPipe - Media Pipe is an open source library that enables object tracking by offering customizable M.L solutions for live and streaming media.
** OpenCV Python bindings - OpenCV is an open source framework used for Image and video manipulations i.e Computer vision.
Phase 2: Implementing TensorFlow object detection
Dependencies - Pre-trained models(cause i am on a laptop)
-- Labelling images for Object Detection - using Label Image package to label images for object detection.[LabelImg]
-- Training Tensorflow for Sign Language.
-- Detecting Sign language inreal Time.
Prepare image labels using labelling & draw boxes over multiple sing language collected with my webcam.