IC4Windows–Hand Gesture for Controlling MS Windows

IC4Windows (Intelligent Companion for Windows) provides a natural Human computer interaction through hand gesture to avoid direct contact with computer device. The hand gestures trigger a windows command that usually used by a user when they use MS windows system. Some gesture has a different purpose depending on the application being operated by the user. The proposed system using external depth camera to capture the frame as an input. The depth data is used to remove unnecessary inputs such as background, face, etc., so that our input is more specific to help get a high accuracy. The gestures are consists of two type, first is static gesture and second is dynamic gestures. These two types of gestures have a different characteristic, the static gestures use each single frame as an input while the dynamic gestures require a sequence of frame as an input. We use a different method to handle each type of gestures, CNN is used for static gestures and 3DCNN is used for dynamic gestures. The proposed method provides a recognition rate of up to 92% and average speed is up to 30 FPS.